Senior Backend Engineer, Data Mining
159000 - 207000 USD per year
Company:Motional
Location:Boston, Pittsburgh, Las Vegas, EST, PST
Languages:English
Seniority level:Senior, 6+ years
Experience:6+ years
Skills:
AWSBackend DevelopmentDockerPythonSQLCloud ComputingData MiningMachine LearningSparkCI/CDLinuxSoftware Engineering
Requirements:
BS in Computer Science or equivalent professional experience. 6+ years designing, building, and operating large-scale distributed systems in production. Deep, hands-on expertise with Ray or Spark. Expert-level Python proficiency with strong software engineering fundamentals. Proven experience optimizing and scaling production data pipelines processing terabytes or petabytes of data. Strong SQL and data manipulation skills. Experience with cloud infrastructure (AWS preferred: S3, EC2, EKS, EMR, IAM). Mentoring junior engineers.
Responsibilities:
Architect the OmniTag Engine for high-throughput, low-latency backend systems. Scale multimodal data pipelines from ingestion to embedding storage. Evolve the Vector Search and Retrieval Engine for RAG-driven dataset creation. Own Data Quality and Observability for multimodal data preprocessing pipelines. Collaborate on Encoder-Decoder Adaptation for ML engineers. Drive Production Reliability for the OmniTag data platform.
