Senior Data Engineer
New
M
MediaRadarAdvertising, Market Research
United StatesFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years
- Required Skills
- AWSPythonSQLETLAirflowClickhousePostgresdbt
Requirements
- 8+ years of experience in data engineering or ETL with a strong record as a hands-on engineer.
- Expert-level SQL and RDBMS skills (SQL Server, Postgres) including schema design and performance tuning.
- Hands-on experience with AWS cloud infrastructure.
- Proficiency in Python for building and automating data pipelines.
- Proven experience with open-source data pipeline and orchestration tools (e.g., Airflow, Dagster).
- Hands-on experience with modern data tools like ClickHouse and dbt.
- Experience using AI coding tools such as GitHub Copilot, Cursor, or Claude.
- Demonstrated ability to independently prototype, benchmark, and evaluate new technologies.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Experience in Advertising, Media, or Market Research is a plus.
- Familiarity with containerization (Docker, Kubernetes) and infrastructure-as-code is a plus.
- Experience with real-time/streaming data technologies like Kafka is a plus.
Responsibilities
- Lead, manage, and grow a distributed team of data engineers across North America and India.
- Champion the use of AI coding assistants and prompt-based development to accelerate engineering workflows.
- Personally build proofs-of-concept to validate new tools and patterns like ClickHouse, dbt, and open-source orchestration.
- Shape the technical vision for the ETL and data platform while balancing flexibility, cost, and performance.
- Drive the migration from Azure Databricks toward an open, flexible architecture.
- Design, build, and optimize robust ETL pipelines for high-volume data delivery.
- Establish testing frameworks, QA plans, and CI/CD practices to ensure data integrity.
- Mentor team members through design guidance and code reviews.
View Full Description & ApplyYou'll be redirected to the employer's site
