Data Engineer (Integration Specialist)

View full description

Requirements:

• 5+ Years of experience using cloud (AWS, GCP, Azure) for Data integration or data engineering purposes.
• 2+ Years must be with Azure cloud.
• 5+ Years of experience using a OOP language such as C/C++, C# or Java to build and maintain RESTful API's.
• 2+ Years must be with C#.
• 5+ Years of building data pipelines using Databricks, Snowflake, Azure Synapse, Spark, Airflow.
• 2+ years must be in one of the following: Databricks, Snowflake, Azure Synapse.

Responsibilities:

• Design and implement data integration strategies.
• Perform data mapping, transformation, and data cleansing activities.
• Collaborate with data architects and other stakeholders to ensure integration solutions meet business requirements.
• Identify and resolve data integration issues, such as inconsistencies or discrepancies.
• Develop and maintain documentation related to data integration processes, including data source definitions, data flow diagrams, and system interactions.
• Participate in design reviews and provide input on data integration plans.
• Ensure adherence to data security and privacy regulations.
• Maintain knowledge of latest data integration tools and technologies and recommend upgrades when necessary.
• Perform regular audits to ensure the integrity and quality of integrated data.