Databricks SME
New
United StatesContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years
- Required Skills
- PythonSQLCloud ComputingData engineeringSparkScalaDatabricksPySpark
Requirements
- 8+ years of experience in Data Engineering and Big Data technologies.
- Strong hands-on expertise in Databricks and Apache Spark.
- Experience with Python, PySpark, SQL, and Scala.
- Expertise in Delta Lake, Unity Catalog, and Databricks Workflows.
- Strong understanding of data warehousing and modern lakehouse architecture.
- Experience with cloud platforms such as Microsoft Azure, Amazon AWS, or Google GCP.
- Experience integrating Databricks with BI and reporting tools.
- Knowledge of CI/CD pipelines and DevOps practices.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management abilities.
Responsibilities
- Lead the design, development, and optimization of Databricks-based data platforms and pipelines.
- Provide technical expertise on Databricks architecture, performance tuning, and best practices.
- Build scalable ETL/ELT workflows using Apache Spark and Databricks.
- Collaborate with business stakeholders, architects, and engineering teams to gather requirements and deliver solutions.
- Implement Delta Lake, data governance, and data quality frameworks.
- Support migration of legacy data platforms to Databricks.
- Optimize data processing workflows for performance and cost efficiency.
- Mentor development teams on Databricks, Spark, and cloud-native solutions.
- Troubleshoot production issues and provide timely resolutions.
- Ensure adherence to security, compliance, and coding standards.
View Full Description & ApplyYou'll be redirected to the employer's site
