Contractor: Lead Data Engineering Services

View full description

Requirements:

• Mastered proficiency in SQL, Python, and relational datastores.
• Proficiency in building and maintaining data pipelines and DAG tooling (Dagster, Airflow, etc.).
• Advanced experience with event-based pipelines and CDC tooling.
• Advanced experience in managing large-scale data migrations in relational datastores.
• Advanced experience in optimizing SQL query performance.
• Advanced experience with data testing strategies for business logic alignment.
• Experience with DBT orchestration and best practices.
• Experience enabling monitoring, health checks, and alerting on data systems and pipelines.
• Experience establishing and maintaining a data catalog with business-related metadata.
• Experience building tools and automation for data infrastructure.
• Experience with AWS, GCP, and Terraform is a plus.
• Experience in document, graph or schema-less datastores is a plus.

Responsibilities:

• Work alongside app developers and data stakeholders to implement data system changes.
• Lead initiatives, including problem definition scoping, design, and planning through epics and blueprints.
• Develop documentation, technical presentations, discussion points, and conduct incident reviews.
• Build and maintain data pipelines and DAG tooling.
• Establish and maintain a data catalog with business-related metadata.