Senior Autonomy Data Engineer
New
T
Torc RoboticsAutonomous Vehicles
Remote - USFull-TimeSenior
Salary160,800 - 193,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- Bachelor’s degree in Computer Science, Computer Engineering, Software Engineering, Electrical Engineering or a related field with 6+ years of data engineering experience or a Master’s with 4+ years.
- Required Skills
- AWSPythonSQLTerraformRedshift
Requirements
- Bachelor’s degree with 6+ years or Master’s with 4+ years of data engineering experience.
- Strong proficiency in Python and SQL.
- Deep experience with cloud data infrastructure (AWS S3, Glue Athena, Redshift).
- Proficiency with infrastructure-as-code tools (Terraform, Cloud Formation).
- Understanding of data partitioning strategies and columnar storage formats (Parquet, Orc).
- Experience building data pipelines for time-series and binary data.
- Proven ability to evaluate and integrate open-source tooling.
- Strong instincts for delivering data quality through monitoring, validation and lineage tracking.
Responsibilities
- Own the design and organization of the program’s data lake, including schema definitions, partitioning strategy and metadata indexing.
- Design and maintain end-to-end pipelines that ingest high-bandwidth sensor logs from vehicles into cloud storage.
- Develop data validation and integrity checks for sensor data.
- Implement retention, tiering and lifecycle policies for data.
- Build tooling to query raw logs to produce curated training and evaluation datasets.
- Build automation to run cost-effective pseudo-labeling workflows.
- Deploy and maintain data visualization tooling to support log review, annotation QA, and autonomy debugging.
- Establish and document data contracts between the data services and model training consumers.
- Mentor junior engineers and raise the team’s capabilities in data infrastructure scalability.
View Full Description & ApplyYou'll be redirected to the employer's site
