Databricks Resident Solution Architect
New
J
JobgetherCloud Data Platforms
United StatesFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 10+ years of overall experience in data engineering, data architecture, analytics engineering, or closely related disciplines.
- Required Skills
- PythonSQLAzureSparkCI/CDTerraformDatabricksPySpark
Requirements
- 10+ years of overall experience in data engineering, data architecture, analytics engineering, or closely related disciplines.
- 5+ years of hands-on experience with Databricks, including Delta Lake, Unity Catalog, Workflows/Jobs, and Lakehouse architecture.
- Mandatory Databricks Professional Certification.
- Strong expertise in Apache Spark, preferably PySpark, along with advanced Python and SQL capabilities.
- Proven experience designing and implementing production-grade, large-scale data pipelines and enterprise data platforms.
- Hands-on experience with at least one major cloud platform (Azure preferred; AWS or GCP also acceptable).
- Strong knowledge of data modeling, Medallion architecture, governance, and enterprise data platform design.
- Familiarity with CI/CD pipelines, infrastructure automation technologies such as Terraform, and Agile delivery practices.
- Excellent communication and stakeholder-management skills.
- Strong architectural judgment, problem-solving capabilities, and mentoring skills.
Responsibilities
- Architect and guide the implementation of modern Databricks data platforms using Lakehouse and Medallion architecture principles.
- Provide hands-on technical leadership across data engineering, analytics, and AI-enabled use cases within the Databricks ecosystem.
- Establish and enforce enterprise data governance, security, access controls, and data management standards using Databricks Unity Catalog.
- Enable AI and machine learning workloads, including ML pipelines and model lifecycle integration across the platform.
- Optimize platform performance, scalability, reliability, and cost efficiency using a FinOps-oriented approach.
- Collaborate with business leaders, architects, engineers, and other stakeholders to align platform capabilities with enterprise data and analytics objectives.
- Act as a resident technical authority, providing architectural guidance, mentoring engineering teams, and ensuring solution quality and consistency.
View Full Description & ApplyYou'll be redirected to the employer's site
