Resident Solution Architect (Databricks)
New
C
CleraData Engineering
Open to candidates based anywhere in North AmericaFull-TimeSenior
SalaryUp to $80/hr on W2.
Apply NowOpens the employer's application page
Job Details
- Experience
- 10+ years of consulting experience, with at least 7 years focused on Data Engineering, Data Platforms, and Analytics.
- Required Skills
- AWSGCPAzureData engineeringSparkCI/CDDatabricksMLOps
Requirements
- 10+ years of consulting experience, with at least 7 years focused on Data Engineering, Data Platforms, and Analytics.
- Hands-on delivery of 6–8+ Databricks implementation projects at enterprise scale.
- Strong expertise in Apache Spark and distributed computing, including Spark runtime internals.
- Deep understanding of the Databricks Lakehouse Platform.
- Databricks Data Engineering Professional Certification (strongly preferred).
- Proven experience with performance tuning, optimization, and scalability of large-scale data platforms.
- Hands-on experience with at least one major cloud platform: AWS, Azure, or GCP.
- Solid understanding of CI/CD pipelines for production data deployments.
- Working knowledge of MLOps concepts and practices.
Responsibilities
- Lead end-to-end Databricks implementation projects, from architecture design through production deployment.
- Advise enterprise clients on Lakehouse platform best practices, capabilities, and roadmap decisions.
- Tune and optimize large-scale distributed data systems for performance and scalability.
- Design and support CI/CD pipelines for data platform production deployments.
- Apply MLOps patterns to bridge data engineering and machine learning workflows.
- Serve as a hands-on technical lead, working directly in cloud environments (AWS, Azure, and/or GCP).
View Full Description & ApplyYou'll be redirected to the employer's site