Senior Databricks Architect
New
Q
QodeFinancial Services
United StatesFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 12+ years of experience in Data Engineering / Data Architecture
- Required Skills
- AWSSQLETLGCPAzureSparkData modelingDatabricksPySpark
Requirements
- 12+ years of experience in Data Engineering / Data Architecture
- Strong expertise in Databricks, PySpark, and Spark ecosystem
- Hands-on experience with cloud platforms (Azure, AWS, or GCP)
- Experience with data orchestration tools (Airflow, ADF, etc.)
- Solid understanding of data modeling, ETL/ELT, and distributed systems
- Strong knowledge of Financial Services domain (Banking, Insurance, Capital Markets)
- Excellent problem-solving and stakeholder management skills
- Experience with Delta Lake and Unity Catalog (plus)
- Databricks certifications (plus)
- Experience with real-time data processing (Kafka, streaming) (plus)
- Exposure to AI/ML pipelines and MLOps (plus)
- Knowledge of regulatory and compliance frameworks in Financial Services (plus)
Responsibilities
- Architect and implement end-to-end data solutions using Databricks Lakehouse Platform
- Design and develop scalable data pipelines using PySpark, Spark, and SQL
- Lead cloud data platform implementations on AWS/Azure/GCP
- Drive modernization of legacy data systems to cloud-native architectures
- Implement Medallion Architecture (Bronze, Silver, Gold layers)
- Ensure data governance, security, and compliance (especially for Financial Services)
- Collaborate with business stakeholders, data scientists, and engineering teams
- Optimize performance, cost, and reliability of data pipelines
- Mentor and guide data engineering teams and provide architectural leadership
View Full Description & ApplyYou'll be redirected to the employer's site
