Data Engineer (Remote in North Carolina)

View full description

Requirements:

• 5+ years of experience as a Data Engineer with successful data warehouse/lake implementation.
• Deep expertise in Snowflake or similar tools for building data systems.
• Strong skills in HiveQL and SQL, with knowledge of data warehousing concepts.
• Proficient programming skills in Python.
• Understanding of data architectures and patterns.
• Experience with Apache Spark for large-scale processing is a plus.
• Familiarity with dbt for modeling in Snowflake preferred.
• Experience with Google Cloud Platform (GCP) and data services is a plus.
• Excellent communication skills for cross-functional collaboration.
• Strong problem-solving skills and dedication to scalable data solutions.
• Snowflake certification is preferred.

Responsibilities:

• Design and develop data pipelines using tools like Apache Airflow or Snowflake's external tables.
• Translate HiveQL queries to Snowflake SQL for efficient data processing.
• Utilize dbt in Snowflake for data modeling, focusing on governance.
• Configure and manage data pipelines in Google Cloud Platform (GCP).
• Collaborate with analysts to understand data requirements for migration.
• Monitor and optimize data pipeline performance.
• Implement automated testing for data quality post-migration.
• Document the migration process and support the migrated data warehouse.