Lead Apache Airflow Engineer

New
E
EPAMData Engineering
Opportunity to work remotely within PolandFull-TimeLead
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Languages
En B2
Experience
7+ years
Required Skills
DockerPythonApache AirflowGCPKubernetesRESTful APIsLinux

Requirements

  • 7+ years of experience with strong Python programming skills
  • Experience with Cloud APIs (REST/RPC)
  • Knowledge of DevOps/SysAdmin practices, Linux, and Kubernetes, including building container images
  • Understanding of Cloud platforms, especially Google Cloud Platform
  • Expertise in Airflow or similar experience in building workflows based on Luigi, Oozie, Argo, Azkaban, or Apache NiFi
  • Experience working with open-source communities
  • Proficiency in English communication, both spoken and written

Responsibilities

  • Develop new and maintain existing Airflow Operators, Hooks and Sensors
  • Integrate new Airflow versions with Cloud Composer
  • Fix bugs in Airflow and implement improvements
  • Implement tests for Airflow, including Unit Testing and Solution Testing
  • Create internal documentation for the work artifacts
  • Coordinate development activities within the team and support delivery planning
  • Collaborate with cross-functional and distributed teams to support delivery and resolve technical issues
  • Support junior team members through knowledge sharing, technical guidance, and code review activities
  • Participate in technical discussions with client, prioritization, and coordination of development activities
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now