Resident Solution Architect (Databricks)
New
C
CleraData Consulting
Fully remote (North America).Full-TimeSenior
SalaryUp to $80/hr on W2
Apply NowOpens the employer's application page
Job Details
- Experience
- 10+ years of consulting experience, with at least 7 years focused on Data Engineering, Data Platforms, and Analytics.
- Required Skills
- AWSGCPAzureData engineeringSparkCI/CDDatabricksMLOps
Requirements
- 10+ years of consulting experience, with at least 7 years focused on Data Engineering, Data Platforms, and Analytics.
- Proven hands-on delivery of 6–8+ Databricks implementation projects.
- Strong understanding of the Databricks Lakehouse Platform, including current capabilities and best practices.
- Deep expertise in Apache Spark and distributed computing, including Spark runtime internals.
- Databricks Data Engineering Professional Certification (strongly preferred).
- Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP); multi-cloud experience is a plus.
- Experience with performance tuning, optimization, and scalability of large-scale data platforms.
- Solid understanding of CI/CD pipelines for production deployments.
- Working knowledge of MLOps.
Responsibilities
- Lead and deliver end-to-end Databricks implementation projects at enterprise scale.
- Design and architect Lakehouse Platform solutions aligned with client business needs and best practices.
- Apply deep Apache Spark expertise to optimize distributed workloads, including Spark runtime tuning and scalability improvements.
- Advise on cloud platform architecture across AWS, Azure, and/or GCP environments.
- Establish and support CI/CD pipelines for reliable, repeatable production deployments.
- Incorporate MLOps practices into platform design and delivery.
- Provide technical consulting and advisory support throughout the engagement lifecycle.
View Full Description & ApplyYou'll be redirected to the employer's site
