Lead Data Engineer
New
Remote in the USFull-TimeLead
Salary188,251 - 230,084 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- Seven (7) or more years of data engineering experience
- Required Skills
- PythonSQLApache AirflowApache KafkaSparkDatabricksMLOps
Requirements
- Bachelor's degree or higher in computer science.
- Seven or more years of data engineering experience, including leading technical initiatives.
- Strong expertise in Python and SQL.
- Experience with distributed data systems (e.g., Spark, Databricks, Synapse).
- Experience building AI/ML ready data pipelines, including feature stores and model training data flows.
- Hands on experience with cloud platforms (Azure preferred).
- Strong understanding of ML concepts, lifecycle, and MLOps practices.
- Proven experience with workflow orchestration (e.g., Airflow, Data Factory).
- Experience with streaming platforms (e.g., Kafka, Event Hub).
- Familiarity with vector databases, embeddings, or LLM oriented data pipelines.
Responsibilities
- Lead the architecture and development of scalable, secure data pipelines supporting AI/ML workloads.
- Own end to end data engineering processes: ingestion, transformation, storage, quality, and monitoring.
- Collaborate with data scientists and ML engineers on model features, training pipelines, and deployment.
- Drive best practices in data modeling, orchestration, versioning, and performance optimization.
- Mentor and guide junior engineers; contribute to technical roadmaps and solution patterns.
- Ensure data governance, lineage, and compliance standards are met across platforms.
- Support real time and batch processing frameworks in production environments.
View Full Description & ApplyYou'll be redirected to the employer's site
