Senior ETL Testing / Data Engineer
New
J
JobgetherData Engineering
IndiaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5–10 years
- Required Skills
- PythonSQLApache AirflowETLGCPJavaSnowflakeData engineeringCI/CDBigQuery
Requirements
- 5–10 years of professional experience in data engineering, ETL testing, or data quality.
- Hands-on experience with Google Cloud Platform (GCP), including BigQuery, Cloud Storage, and Cloud Composer.
- Experience with relational and NoSQL databases like PostgreSQL, MySQL, Cloud SQL, Cloud Spanner, Oracle, and Snowflake.
- Advanced programming skills in Java, including JDBC and Apache Beam SDK.
- Strong Python expertise, including libraries such as Pandas and PyTest.
- Expert-level SQL skills including window functions, CTEs, and PL/SQL.
- Experience with testing frameworks such as TestNG, JUnit, and BDD Cucumber.
- Understanding of data-driven testing, schema validation, and reconciliation.
- Familiarity with CI/CD pipelines, Git, GitHub, Maven, and Jira.
- Experience with Informatica PowerCenter or Talend is advantageous.
Responsibilities
- Design, develop, and optimize scalable Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes using GCP services.
- Manage and orchestrate data workflows using Cloud Composer and Apache Airflow.
- Design and maintain data warehousing solutions across platforms including Snowflake, Oracle, and Teradata.
- Develop efficient, maintainable code using Java and Python for complex data transformations.
- Create advanced SQL queries using complex joins, CTEs, and window functions.
- Establish and execute comprehensive data testing strategies, including source-to-target reconciliation and regression testing.
- Integrate data pipelines and automated testing into CI/CD workflows using Jenkins, Git, and GCP Cloud Build.
View Full Description & ApplyYou'll be redirected to the employer's site
