Data Engineer / Apache Airflow Specialist
New
I
InteticsSoftware Development
UkraineFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Advanced English
- Experience
- 3-5 years
- Required Skills
- PostgreSQLPythonApache AirflowElasticSearchETLFlaskOracleCI/CDGitLab
Requirements
- 3+ years of Apache Airflow DAG orchestration experience.
- 5+ years of Python experience with an ETL focus.
- 3+ years of Elasticsearch data indexing and optimization experience.
- 3+ years of Unix/Linux scripting and operations experience.
- 3+ years of experience with Oracle or PostgreSQL.
- 3+ years of experience with GitLab CI/CD pipelines.
- Advanced English proficiency.
- Technical degree.
- Flask API experience (plus).
- Experience with Great Expectations or similar data-quality tools (plus).
- Experience with Airflow on Kubernetes (plus).
- Proven performance tuning experience (plus).
Responsibilities
- Develop, orchestrate, and maintain complex Apache Airflow DAGs for ETL and data-processing pipelines.
- Build and optimize Python-based ETL scripts, integrating with Flask APIs when needed.
- Design and manage Elasticsearch indexing and performance tuning workflows.
- Handle Unix/Linux scripting and operations for automation and monitoring.
- Work with Oracle and PostgreSQL databases for large-scale data processing.
- Implement and maintain GitLab CI/CD pipelines for build, test, and deploy stages.
- Collaborate with the project team to ensure scalability, reliability, and quality of data solutions.
View Full Description & ApplyYou'll be redirected to the employer's site
