Software Engineer III, Data Platform
New
A
Agility RoboticsRobotics Automation
This is a fully remote role with the option to work hybrid if a commutable distance from our Salem, OR, Pittsburgh, PA, or Fremont, CA offices.Full-TimeSenior
Salary144,000 - 224,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 3-5 years
- Required Skills
- AWSPythonJavaApache KafkaPrometheusSparkScala
Requirements
- 3-5 years of experience building and scaling cloud-based data platforms(AWS, GCP, or Azure)
- Proficient in big data frameworks like Spark, Kafka, Beam, Flink etc
- Familiarity with OSS data formats like Parquet, Arrow, Iceberg and protocols like Avro and Protobuf
- Experience with observability tools(e.g. OpenTelemetry, Prometheus etc) and implementing metrics, tracing and logging systems
- Strong proficiency in Python and at least one JVM language (Java or Scala)
- Experience with microservices
- Proven experience handling diverse data types—specifically combining unstructured data (logs/video) with structured telemetry
Responsibilities
- Design and implement scalable data pipelines for ingesting and processing telemetry, logs and sensor data from our fleet of robots and associated cloud software
- Develop systems to handle complex multimodal logs, ensuring precise synchronization between video, audio, IMU, and joint-state data for downstream analysis
- Contribute to the development of data ingestion agents running on-robot to manage high-volume data throughput
- Implement and optimize data formats (e.g., MCAP, Parquet) specifically tuned for the storage and rapid querying of rich multimodal robotics recordings
- Develop and maintain observability systems using tools like fluentbit, OpenTelemetry etc enabling real-time monitoring
- Use Spark, Kafka, or Flink to transform raw robot data into structured datasets ready for business intelligence
- Work closely with AI and Hardware teams to ensure data tools meet the needs of those training the next generation of humanoid models
- Build and optimize tools for internal stakeholders for business intelligence and long-horizon fleet analytics and forecasting
View Full Description & ApplyYou'll be redirected to the employer's site