Senior Data & AI Engineer
New
East Coast/MidwestFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Cloud ComputingData engineeringSparkDatabricksLLM
Requirements
- Deep expertise in Databricks: Delta Lake, Unity Catalog, DLT, Databricks SQL, and Spark.
- Experience in end-to-end data engineering and production-grade Lakehouse architectures.
- Hands-on AI integration experience: LLMs, RAG pipelines, and model deployment.
- Professional services or consulting experience including scoping and stakeholder communication.
- Cloud platform familiarity (Azure, AWS, or GCP).
- Familiarity with Snowflake, Salesforce Data Cloud, or dbt is a plus.
- Databricks professional certifications are strongly preferred.
- Ability to collaborate with data science experts on model development.
Responsibilities
- Design and implement medallion architecture using Delta Lake as the foundational layer.
- Build and optimize scalable data pipelines using Apache Spark and Lakeflow.
- Architect and implement Unity Catalog for data lineage and security governance.
- Implement and optimize Databricks SQL for enterprise analytics and BI tool integration.
- Build production AI solutions using RAG pipelines, Mosaic AI Agent Framework, and external model APIs.
- Shape standards, methodologies, and delivery frameworks for the Databricks practice.
- Act as a hands-on practitioner and advisor for client engagements.
- Support pre-sales, scoping, and proposal contributions.
- Lead code reviews and conduct knowledge transfer sessions for the technical team.
View Full Description & ApplyYou'll be redirected to the employer's site
