Senior Data Engineer, Tech Foundations
New
A
AirbnbData engineering
US - Remote EligibleFull-TimeSenior
Salary196,000 - 230,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of relevant industry experience
- Required Skills
- PythonSQLSparkScalaData modeling
Requirements
- Have 5+ years of relevant industry experience.
- Hold a Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field, or have equivalent practical experience.
- Have a track record of independently delivering complex data engineering projects from requirements and design through implementation and production ownership.
- Demonstrate strong SQL expertise and programming skills in Python or Scala.
- Have hands-on experience with Apache Spark or similar distributed processing technologies and large-scale analytical storage systems.
- Have data modeling experience, including fact and dimension design, slowly changing dimensions, incremental processing, and historical data management.
- Have experience integrating APIs, enterprise applications, event data, and transactional systems, including managing schema changes and source reliability.
- Have experience building reliable pipelines and executing migrations and backfills while preserving correctness and downstream compatibility.
- Have implemented data quality controls, observability, lineage, and governance practices, and troubleshot production data issues.
- Be able to diagnose bottlenecks and optimize distributed computation, storage, and query execution.
- Have experience contributing to design and code reviews, sharing knowledge, and supporting other engineers.
Responsibilities
- Design, build, and operate data pipelines across AI usage and cost, Unit Economics, enterprise applications, and financial metrics.
- Partner with stakeholders to define AI adoption, consumption, and spending measurements and implement consistent data models.
- Evolve Unit Economics datasets to connect revenue and cost drivers.
- Build ingestion and transformation pipelines for Jira and other enterprise applications.
- Translate requirements into source contracts, reusable fact and dimension models, and technical designs.
- Develop configurable pipelines and shared components for onboarding data sources, products, and business requirements.
- Implement testing, reconciliation, anomaly detection, and monitoring for data accuracy, completeness, and availability.
- Plan and execute migrations and historical backfills, including validation, cutovers, and recovery planning.
- Optimize distributed processing, storage, and query performance to improve freshness and reduce compute costs.
- Own production reliability through on-call participation, incident response, and runbook improvements; contribute to design reviews and mentor engineers.
View Full Description & ApplyYou'll be redirected to the employer's site