Lead Apache Airflow Engineer
New
E
EPAMData Engineering
Opportunity to work remotely within PolandFull-TimeLead
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- En B2
- Experience
- 7+ years
- Required Skills
- DockerPythonApache AirflowGCPKubernetesRESTful APIsLinux
Requirements
- 7+ years of experience with strong Python programming skills
- Experience with Cloud APIs (REST/RPC)
- Knowledge of DevOps/SysAdmin practices, Linux, and Kubernetes, including building container images
- Understanding of Cloud platforms, especially Google Cloud Platform
- Expertise in Airflow or similar experience in building workflows based on Luigi, Oozie, Argo, Azkaban, or Apache NiFi
- Experience working with open-source communities
- Proficiency in English communication, both spoken and written
Responsibilities
- Develop new and maintain existing Airflow Operators, Hooks and Sensors
- Integrate new Airflow versions with Cloud Composer
- Fix bugs in Airflow and implement improvements
- Implement tests for Airflow, including Unit Testing and Solution Testing
- Create internal documentation for the work artifacts
- Coordinate development activities within the team and support delivery planning
- Collaborate with cross-functional and distributed teams to support delivery and resolve technical issues
- Support junior team members through knowledge sharing, technical guidance, and code review activities
- Participate in technical discussions with client, prioritization, and coordination of development activities
View Full Description & ApplyYou'll be redirected to the employer's site