AWS / Azure Cloud Data Engineer (3931)

View full description

Requirements:

• Two + years of experience in relevant fields.
• Expertise in complex SQL.
• Knowledge of AWS technologies.
• Solid understanding of RDBMS concepts, including Postgres, RedShift, and SQL Server.
• Experience with logical data modeling and database/query optimization.
• Familiarity with AWS data migration tools (DMS).
• Scripting knowledge, especially in Python and Lambda.
• Experience with version control and CI/CD tools such as Git, TFS, and Azure DevOps.
• Awareness of network authentication and authorization protocols (Kerberos, SAML/OAUTH).
• Some knowledge of networks.
• Ability to obtain and maintain a Public Trust clearance; US Citizenship is required.
• Strong collaboration and communication skills.

Responsibilities:

• Assist Data Architect and customer in collecting requirements and documenting tasks for the data loading platform, focusing on performance and data quality.
• Implement data loading and quality control activities based on project requirements and customer tickets.
• Create CI/CD pipelines for infrastructure and data loading related to data warehouse maintenance.
• Code and implement unique data migration requirements using AWS technologies like DMS and Lambda/Python.
• Resolve identity and access management issues for various data sets in Postgres, Redshift, and SQL Server.