Senior Data Engineer - Data Corpus

View full description

Requirements:

• Senior Level Data Professional with a minimum of 4 years of experience (ideal 6+ years).
• Experience with Cloud technologies, specifically GCP (required), with AWS/Azure as a plus.
• Experience working with BigQuery and advanced SQL knowledge.
• Proficiency in Python and Airflow.
• Experience with big data at terabyte/petabyte scale.
• Data Architecture/solution design experience.
• Familiarity with Agile methodology and Jira.
• Experience in data warehousing and analytical data modeling.
• Knowledge of CI/CD pipelines and Git.
• Experience in building reliable ETL pipelines and datasets for BI tools (Looker preferred).
• Basic statistical knowledge and ability to produce high-quality technical documentation.

Responsibilities:

• Build and maintain a unified and standardized data warehouse, Corpus, at SoundCloud.
• Abstract the complexity of SoundCloud’s vast data ecosystem.
• Collaboration with business reporting, data science, and product teams.
• Gather and refine requirements, design data architecture and solutions.
• Build ETL pipelines using Airflow to land data in BigQuery.
• Model and build the business-ready data layer for dashboarding tools.