Sr. Data Architect (Databricks)

View full description

Requirements:

• Bachelors or Masters degree in computer science.
• 8+ years of industry experience in Data Engineering.
• 2+ years of experience at the principal/data architect level leading data modeling.
• 5+ years of experience in SQL, Spark, and/or other programming languages.
• 2+ years of experience with the Databricks environment.
• Familiarity with real-time ML systems within Databricks is a plus.

Responsibilities:

• Collaborate closely with product managers and engineers to understand business needs and architect data solutions.
• Model enterprise business lines with comprehensive documentation including gold tables and pipeline flow.
• Evaluate and recommend appropriate tools and methodologies for data modeling.
• Develop and manage scalable data pipelines on Databricks, ensuring integration with Databricks Feature Store.
• Implement real-time data processing and streaming capabilities using Databricks.
• Contribute to the maintenance of a high-quality code base and best practices.
• Partner with data science teams to translate data requirements into models.
• Mentor junior data engineers and share knowledge through presentations and discussions.