- Design, develop, and maintain scalable data pipelines using Microsoft Azure Fabric, Databricks, and Azure data services.
- Build and optimize robust ETL/ELT processes for structured, semi-structured, and unstructured data across enterprise environments.
- Collaborate with business stakeholders to understand data requirements and translate them into scalable technical solutions.
- Develop and maintain reliable data integration workflows that ensure data accuracy, consistency, and availability.
- Optimize data processing pipelines for performance, scalability, cost efficiency, and operational reliability.
- Leverage AI-assisted development tools and modern engineering practices to accelerate solution delivery and improve code quality.
- Monitor, troubleshoot, and resolve production data pipeline issues while proactively identifying opportunities for automation and optimization.
- Work closely with architects, analysts, developers, and cross-functional teams throughout the project lifecycle to deliver high-quality data solutions.
- Implement best practices for data engineering, governance, documentation, testing, and operational support.
- Take ownership of project deliverables by ensuring quality, meeting timelines, communicating risks proactively, and continuously improving engineering processes.
PythonSQLETL+4 more