Apply

Senior Data Engineer (MLOps)

Posted 6 days agoViewed

View full description

💎 Seniority level: Senior, 5+ years

📍 Location: U.S., U.K., European Union

🔍 Industry: Martech

🗣️ Languages: English

⏳ Experience: 5+ years

🪄 Skills: DockerPythonSQLApache AirflowKubernetesMicrosoft AzureData engineeringSparkTerraform

Requirements:
  • 5+ years of experience in data engineering or a related field.
  • Strong expertise in data pipeline orchestration tools such as Apache Airflow.
  • Proven track record of designing and implementing data lakes and warehouses, preferably with Azure.
  • Solid understanding of MLOps practices.
  • Proficiency in programming languages such as Python and SQL.
  • Experience with distributed computing frameworks like Spark.
  • Familiarity with version control systems like Git and CI/CD pipelines.
  • Effective communication skills and ability to collaborate with cross-functional teams.
Responsibilities:
  • Design and implement scalable, secure data lake and warehouse solutions.
  • Develop, monitor, and optimize ETL/ELT workflows using Apache Airflow.
  • Develop scalable web scraping solutions and process unstructured data.
  • Design cloud-native data solutions with Microsoft Azure.
  • Use Terraform for infrastructure automation.
  • Collaborate with data scientists on MLOps and implement CI/CD pipelines.
  • Utilize Kubernetes and Docker for deploying data processing systems.
  • Collaborate with stakeholders to provide solutions and maintain documentation.
Apply