Senior Data Engineer
New
A
ArtefactData Engineering
Free Office (work from home or anywhere you want!)Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Fluent English
- Required Skills
- DockerPythonApache AirflowGCPData engineeringSpark
Requirements
- Degree in Computer Science, Statistics, Engineering, Economics, or a related field.
- Strong hands-on experience with Apache Airflow.
- Proficiency in Python.
- Experience navigating *nix systems using CLI.
- Familiarity with cloud technologies such as GCP (Google Cloud Platform).
- Experience with big data technologies like Beam (Dataflow), Spark (Dataproc), or Flink.
- Experience with Docker.
- Strong communication and interpersonal skills.
- Demonstrated ability to balance hands-on technical delivery with mentoring.
- Fluent English proficiency.
Responsibilities
- Develop, schedule, and monitor data pipelines using Apache Airflow.
- Collaborate with data analysts, scientists, and engineering teams to ensure reliable data delivery.
- Optimize ETL processes for performance, reliability, and scalability.
- Maintain and improve data architecture, ensuring data integrity and security.
- Troubleshoot and resolve pipeline failures and performance bottlenecks.
- Provide technical leadership and guidance in the implementation of technical solutions.
- Document architectural decisions, strategies, and implementation guidelines.
- Lead by example, promoting engineering excellence and a culture of continuous improvement.
- Coach and upskill team members by providing technical guidance, pair programming, design reviews, and knowledge sharing.
View Full Description & ApplyYou'll be redirected to the employer's site
