Senior Data Engineer - Data Platform
New
V
VidaHealthcare technology
Listing location: United States; Workplace type: RemoteFull-TimeSenior
Salary160,000 - 170,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years building production data systems.
- Required Skills
- PythonSQLData modelingDistributed Systems
Requirements
- Have a bachelor's degree at a minimum.
- Have 5+ years building production data systems.
- Demonstrate strong SQL and data modeling fundamentals, including grain, keys, history, and dimensional modeling.
- Have experience designing and operating batch and asynchronous data pipelines, including distributed-system failure modes.
- Have experience with a cloud data platform and understand storage, query performance, and cost.
- Apply data correctness practices including validation, idempotency, handling late and duplicated records, schema changes, backfills, and reprocessing.
- Have working proficiency in Python for pipelines, services, tooling, and tests.
- Be able to change production systems in ordered, reversible steps without breaking consumers.
- Communicate clearly in writing, document technical decisions, and explain changes to people outside engineering.
Responsibilities
- Own production data systems and domains from ingestion through delivery.
- Design ingestion patterns for incomplete, duplicated, delayed, malformed, and changing partner data.
- Define contracts between source systems, ingestion, transformation, and downstream consumers.
- Design data models with clear grain, keys, history, and definitions.
- Evolve schemas, pipelines, and datasets safely using retries, backfills, and replay.
- Improve pipeline performance, observability, and failure handling.
- Work with Engineering, Product, Operations, and Analytics to clarify data requirements.
View Full Description & ApplyYou'll be redirected to the employer's site
