Software Development Senior Specialist
New
N
NTT DATAData engineering
IndiaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonApache Airflowdbt
Requirements
- Work with Informatica workflows, including sessions, mappings, and parameterizations.
- Develop Python EL pipelines for high-volume data.
- Use SQLAlchemy, cx_Oracle, and pyodbc.
- Work with Oracle Data Pump and SQL Server BCP for bulk exports.
- Develop dbt transformation models using model layering, macros, incremental strategies, and snapshot patterns.
- Create dbt-native tests and Python unit tests.
- Develop Airflow DAGs for workflow orchestration.
- Contribute to GitLab CI/CD pipelines, automated testing, and deployment.
- Troubleshoot Oracle and SQL Server data discrepancies and reconcile row counts.
Responsibilities
- Assess Informatica workflows, including sessions, mappings, and parameterizations, and translate them into Python EL scripts and dbt transformation models.
- Develop and maintain Python EL pipelines for landing high-volume data in the target warehouse.
- Design dbt models from Informatica mapping logic using model layering, macros, incremental strategies, and snapshot patterns.
- Develop dbt-native tests and custom Python unit tests to validate transformation correctness and data quality.
- Build Airflow DAGs to orchestrate Python EL and dbt scripts end to end.
- Contribute to GitLab CI/CD pipelines for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.
- Review peer code and provide technical feedback to fellow engineers.
- Troubleshoot performance issues and data discrepancies during SIT and UAT, including row-count reconciliation between source systems and the target warehouse.
- Contribute to technical documentation, runbooks, and handover materials.
View Full Description & ApplyYou'll be redirected to the employer's site
