Senior Databricks Architect

New
United StatesContractSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
10+ years of overall experience in data engineering or related fields
Required Skills
AWSPythonETLGCPAzureSparkCI/CDDevOpsScalaDatabricksPySpark

Requirements

  • 10+ years of overall experience in data engineering
  • 4+ years of hands-on experience with Databricks and Apache Spark
  • Strong proficiency in PySpark SQL
  • Expertise in Delta Lake data modeling
  • Experience with cloud platforms (Azure, AWS, or GCP)
  • Familiarity with Python or Scala
  • Experience with CI/CD and DevOps
  • Strong analytical and problem-solving skills

Responsibilities

  • Architect data platforms using Databricks
  • Develop and maintain ETL/ELT pipelines
  • Implement Delta Lake data modeling and optimization
  • Perform performance tuning on PySpark SQL
  • Manage data extraction processes
  • Implement Unity Catalog features
  • Manage CI/CD pipelines and DevOps practices
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now