Senior Data Engineer
New
J
JobgetherIT Security
Based in United StatesFull-TimeSenior
Salary148,800 - 181,700 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- PythonSQLGitSnowflakeAirflowData engineeringBigQuerydbt
Requirements
- 5+ years of experience building and maintaining production data pipelines.
- Expert-level proficiency with dbt (staging, mart architecture, incremental models, macros, testing).
- Deep expertise in API-based data ingestion (OAuth2, rate limiting, retry strategies).
- Strong Python skills for production-grade extraction and automation.
- Fluent SQL skills and hands-on experience with a cloud data warehouse (BigQuery, Snowflake).
- Experience with orchestration technologies (Airflow, Dagster, or dbt Cloud Jobs).
- Proficiency with Git and collaborative software development workflows.
- Experience managing schema drift, idempotency, backfills, and incremental loading.
- Strong problem-solving and stakeholder-management abilities.
Responsibilities
- Design and build reliable data ingestion pipelines using third-party connectors, APIs, webhooks, file drops, CDC, and batch loads.
- Develop robust API integrations covering authentication, token management, pagination, and incremental retrieval.
- Build comprehensive data-quality testing and monitoring for freshness, volume, and anomaly detection.
- Own complete domain pipelines including staging, mart models, quality tests, and orchestration.
- Architect clean, well-documented data as a single source of truth for analytics and AI applications.
- Establish engineering standards, perform code reviews, and mentor team members.
View Full Description & ApplyYou'll be redirected to the employer's site
