Software Engineer II, Data Engineering
New
T
TorcAutonomous Vehicles
Remote first team, Business hoursFull-TimeMiddle
Salary$139,000 — $166,800 USD
Apply NowOpens the employer's application page
Job Details
- Experience
- Bachelor’s degree plus 4+ years of experience, or Master’s degree plus 0-3+ years of experience.
- Required Skills
- AWSDockerPythonSQLBashData engineeringNosqlCI/CDLinuxTerraform
Requirements
- Bachelor’s degree in Computer Science, Robotics, Electrical Engineering or related technical field with 4+ years of experience, OR a Master’s degree with 0-3+ years of experience.
- Experience deploying, troubleshooting, monitoring, and maintaining Linux systems.
- Experience building and maintaining workloads in public cloud environments.
- Knowledge of different database architectures (relational, NoSQL, vector stores, data warehousing, clustered/distributed stores).
- Practical experience with Linux and Bash scripting.
- Practical experience with Docker and containerization.
- Implementation of workflow patterns using directed acyclic graphs (e.g., Apache Airflow, AWS Step Functions).
- Strong commitment to test-driven development, continuous integration and delivery (CI/CD), and infrastructure as code.
Responsibilities
- Create robust and resilient pipelines to process massive daily volumes of data created by vehicle fleets and simulation environments.
- Build and support scalable pipelines as part of Torc’s Data Factory to deliver data for ML training at scale.
- Scale Torc’s data lake through a distributed storage system, data crawling, and discovery.
- Promote and protect the integrity of data through validation, versioning, data provenance, and governance.
- Support the expansion of Torc’s data lake through acquisition of additional data sets from internal and external sources.
- Contribute to the design, architecture, and delivery of cloud-based solutions.
- Collaborate with teams specializing in perception, planning, control, mapping, and vehicle testing.
- Support the implementation of emerging cloud-based capabilities to improve software testing for self-driving vehicles.
- Participate in the team’s on-call rotation to support deployed systems during business hours.
View Full Description & ApplyYou'll be redirected to the employer's site
