Senior Azure Data Engineer

View full description

Requirements:

• Bachelor’s degree in Computer Science, Engineering, or related field.
• Minimum of 5+ years experience in data engineering roles with a focus on building and maintaining data pipelines.
• Strong proficiency in Azure Synapse Analytics and Azure DevOps.
• Expertise in Apache Spark pools.
• Proficient in Python scripting and programming languages such as SQL and Java.
• Senior level knowledge of data modeling and data warehousing concepts.
• Strong communication skills to convey technical concepts to non-technical stakeholders.
• Experience with data modeling, warehousing, and building ETL pipelines.
• Familiarity with Azure Data Factory and Azure Data Lake Storage.

Responsibilities:

• Design, develop, and maintain robust data pipelines and infrastructure to support data integration, processing, and storage.
• Collaborate with analysts and stakeholders to understand data requirements and translate them into technical solutions.
• Implement best practices for data governance, security, and quality assurance.
• Explore and evaluate new technologies and tools to enhance data infrastructure.
• Design and implement data models on Azure Synapse Analytics.
• Utilize Azure DevOps for CI/CD and agile project management.
• Manage and optimize Apache Spark pools for high-performance processing.
• Develop and maintain ETL processes using Python.
• Ensure data quality and integrity across platforms.
• Collaborate with cross-functional teams.
• Stay current with industry trends in Azure data services.