Software Engineer III, Data Platform

New
A
Agility RoboticsRobotics Automation
This is a fully remote role with the option to work hybrid if a commutable distance from our Salem, OR, Pittsburgh, PA, or Fremont, CA offices.Full-TimeSenior
Salary144,000 - 224,000 USD per year
Apply NowOpens the employer's application page

Job Details

Experience
3-5 years
Required Skills
AWSPythonJavaApache KafkaPrometheusSparkScala

Requirements

  • 3-5 years of experience building and scaling cloud-based data platforms(AWS, GCP, or Azure)
  • Proficient in big data frameworks like Spark, Kafka, Beam, Flink etc
  • Familiarity with OSS data formats like Parquet, Arrow, Iceberg and protocols like Avro and Protobuf
  • Experience with observability tools(e.g. OpenTelemetry, Prometheus etc) and implementing metrics, tracing and logging systems
  • Strong proficiency in Python and at least one JVM language (Java or Scala)
  • Experience with microservices
  • Proven experience handling diverse data types—specifically combining unstructured data (logs/video) with structured telemetry

Responsibilities

  • Design and implement scalable data pipelines for ingesting and processing telemetry, logs and sensor data from our fleet of robots and associated cloud software
  • Develop systems to handle complex multimodal logs, ensuring precise synchronization between video, audio, IMU, and joint-state data for downstream analysis
  • Contribute to the development of data ingestion agents running on-robot to manage high-volume data throughput
  • Implement and optimize data formats (e.g., MCAP, Parquet) specifically tuned for the storage and rapid querying of rich multimodal robotics recordings
  • Develop and maintain observability systems using tools like fluentbit, OpenTelemetry etc enabling real-time monitoring
  • Use Spark, Kafka, or Flink to transform raw robot data into structured datasets ready for business intelligence
  • Work closely with AI and Hardware teams to ensure data tools meet the needs of those training the next generation of humanoid models
  • Build and optimize tools for internal stakeholders for business intelligence and long-horizon fleet analytics and forecasting
View Full Description & ApplyYou'll be redirected to the employer's site
144,000 - 224,000 USD per year
Apply Now