Data Engineer, Contract

View full description

Requirements:

• Strong understanding of data warehouse concepts and dimensional modeling
• Proficiency with PostgreSQL and Amazon Redshift
• Experience with AWS Data Migration Service and Change Data Capture methodologies
• Hands-on experience with ELT/ETL tools, particularly Stitch
• Proficiency in Python programming for data transformation and pipeline development
• Experience with dbt for data transformations and testing
• Familiarity with workflow orchestration tools, specifically Dagster
• Knowledge of Apache Superset for data visualization
• Understanding of containerization concepts, Kubernetes, and AWS EKS
• Strong SQL skills for complex data manipulations and optimizations
• Ability to implement and maintain efficient data pipeline architectures

Responsibilities:

• Manage ELT processes using Stitch, including configuration, monitoring, and troubleshooting
• Maintain and update AWS Data Migration Service (DMS) tasks for data replication from PostgreSQL to Redshift, with emphasis on Change Data Capture (CDC) implementations
• Design, implement, and optimize data models within our Redshift data warehouse following best practices
• Develop and maintain data transformation pipelines using Python, dbt, AWS Lambda, and Dagster
• Create and maintain data marts for various business domains
• Support containerized applications running on AWS EKS (Kubernetes)
• Collaborate with engineering team to ensure data quality and accessibility