Sr. Data Engineer - Azure (Remote)

View full description

Requirements:

• 5+ years of professional experience in data engineering or a similar role.
• Bachelor’s or master’s degree in computer science, mathematics, statistics, data science, engineering, or a related field.
• Proficiency in designing and managing Azure SQL Server databases.
• Strong understanding of data warehouse design and optimization for query efficiency.
• Extensive experience in building data pipelines and ETL processes using modern tools and frameworks.
• Advanced Python programming skills, particularly in data processing libraries (e.g., pandas, NumPy).
• Familiarity with Microsoft Azure platforms and services.
• Strong problem-solving skills and the ability to work independently or collaboratively.
• Excellent communication skills with technical and non-technical audiences.

Responsibilities:

• Design, develop, and optimize scalable data pipelines and ETL processes for ingesting, transforming, and storing large datasets.
• Manage and optimize databases on Azure SQL Server, ensuring high performance and availability.
• Collaborate with cross-functional teams to understand data needs and deliver effective solutions.
• Develop and maintain robust Python scripts to support data transformation and processing.
• Create interactive data visualizations using Plotly for business intelligence.
• Monitor and troubleshoot data pipeline issues to maintain data quality and system reliability.
• Identify performance improvements in ETL processes.
• Enhance performance of data and queries for interactive analysis.
• Ensure compliance with data governance, security, and privacy policies.
• Stay updated with industry trends and contribute to strategies for project leadership.