Software Engineer II, Data Engineering
New
T
TorcAutonomous Vehicles
US Pay RangeFull-TimeMiddle
Salary$139,000 — $166,800 USD
Apply NowOpens the employer's application page
Job Details
- Experience
- Bachelor’s degree plus 4+ years of experience, or Master’s degree plus 0-3+ years of experience.
- Required Skills
- AWSDockerPythonSQLApache AirflowBashNosqlCI/CDLinuxTerraform
Requirements
- Bachelor’s Degree in CS, Robotics, Electrical Engineering or related technical field with 4+ years of experience, or Master’s Degree with 0-3+ years of experience
- Proficiency in deploying, troubleshooting, monitoring, and maintaining Linux systems
- Practical experience building and maintaining workloads in public cloud environments
- Knowledge of database architectures including relational, NoSQL, vector stores, and data warehouses
- Practical experience with Linux and Bash scripting
- Practical experience with Docker and containerization
- Experience implementing workflow patterns using directed acyclic graphs like Apache Airflow or AWS Step Functions
- Strong commitment to test-driven development, CI/CD, and infrastructure as code
Responsibilities
- Create robust and resilient pipelines to process massive daily volumes of data created by vehicle fleets and simulation environments
- Build and support scalable pipelines as part of Torc’s Data Factory to delivery data for ML training at scale
- Scale Torc’s data lake through a distributed storage system, data crawling and discovery
- Promote and protect the integrity of data through validation, versioning, data provenance, and governance
- Support the expansion of Torc’s data lake through acquisition of additional data sets from internal and external sources
- Contribute to the design, architecture and delivery of cloud-based solutions
- Collaborate with teams specializing in perception, planning, control, mapping and vehicle testing
- Support the implementation of emerging cloud-based capabilities to improve safety-critical software development
- Participate in the team’s on-call rotation during business hours
View Full Description & ApplyYou'll be redirected to the employer's site
