Senior Data Engineer (Remote, USA)

View full description

Requirements:

• Software development skills in Python, Java, Scala, or Go.
• High proficiency in SQL.
• Experience with workflow orchestration systems like Prefect, Dagster, or Airflow.
• Knowledge of MLOps best practices.
• Familiarity with dbt or similar data transformation tools.
• Excellent communication skills for technical topics.

Responsibilities:

• Build and maintain production quality data pipelines between operational systems and BigQuery.
• Implement data quality and freshness checks to ensure data accuracy and consistency.
• Build and maintain machine learning pipelines for automated model validation and deployment.
• Create and maintain documentation for data engineering processes and workflows.
• Maintain observability and monitoring of internal data pipelines.
• Troubleshoot data pipeline issues to ensure data availability.
• Contribute to dbt systems ensuring efficiency and availability.