Senior Data Engineer
New
D
DistroKidMusic distribution
Remote - European Union; Remote - Latin America & the Caribbean EASTERN TIME; Remote - United Kingdom; Remote - USA EASTERN time zone, EASTERN TIMEFull-TimeSenior
Salary70,000 - 140,000 EUR per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of experience in data engineering or a related role
- Required Skills
- PythonSQLApache AirflowCloud ComputingSparkData modelingdbt
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience.
- At least 5 years of experience in data engineering or a related role.
- Fluency in Python.
- Strong knowledge of SQL databases.
- Experience with distributed processing frameworks such as Glue/Spark.
- Knowledge of performance tuning and optimization techniques.
- Understanding of data warehousing, data modeling, schema design, and dimensional modeling.
- Experience with cloud-based data storage and computing platforms such as AWS, Azure, or Google Cloud Platform; AWS is preferred.
- Familiarity with dbt and Dagster, Airflow, or similar analytical pipeline orchestration tools.
- Familiarity with AI-enabled engineering workflows, such as agentic workflow and AI harnessing, is desirable.
- A master's degree is preferred.
Responsibilities
- Design, develop, and maintain scalable, reliable data pipelines and ETL processes.
- Partner with data engineers, analysts, data scientists, and cross-functional teams to support data infrastructure.
- Assist data science and backend services teams with robust data pipelines.
- Design, deploy, and maintain machine learning and AI infrastructure.
- Implement data validation, transformation, and cleaning processes to ensure data quality and consistency.
- Develop and maintain data warehousing solutions for storing, retrieving, and analyzing large datasets.
- Monitor and improve database systems and pipeline performance, availability, and responsiveness.
- Use agentic tooling and modern LLM software to produce code and architecture, with monitoring and oversight.
View Full Description & ApplyYou'll be redirected to the employer's site