Data Engineer
New
S
SportyGaming
EMEA, Core working hours are 10am-3pm in your local time zoneFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 3+ years
- Required Skills
- AWSPythonSQLApache AirflowETLNosqlSparkData modeling
Requirements
- Bachelor’s degree or equivalent experience in a technical field.
- 3+ years of experience in data engineering, data platforms, or BI.
- Experience implementing data-centric applications like data warehouses and integration projects.
- Experience with large-scale production relational and NoSQL databases.
- Experience with data modelling.
- Proficiency in SQL.
- Familiarity with Python.
- Experience with Apache Airflow and Apache Spark.
- Understanding of AWS services (S3, Athena, EC2, RedShift, EMR, EKS, RDS, Lambda).
- Understanding of event-driven architectures.
Responsibilities
- Design, develop and maintain scalable batch ETL and near-real-time data pipelines and architectures.
- Ensure all data provided is of the highest quality, accuracy, and consistency.
- Identify, design, and implement internal process improvements for optimising data delivery.
- Re-design infrastructure for greater scalability.
- Builds out new API integrations to support increasing data volume and complexity.
- Collaborate with data scientists, MLOps engineers, product owners, and BI analysts.
View Full Description & ApplyYou'll be redirected to the employer's site
