Senior Software Engineer, Data Processing
New
USFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- AWSBackend DevelopmentPythonData engineeringDistributed Systems
Requirements
- 5+ years of experience building and operating production-grade backend or data processing systems at scale.
- Strong experience designing and maintaining large-scale data pipelines in high-volume, distributed environments.
- Proficiency in Python for backend and data engineering development.
- Hands-on experience with distributed data processing systems and cloud infrastructure, particularly AWS.
- Strong ability to work with messy, high-variance, multimodal datasets and extract structure from ambiguity.
- Experience with system design, performance optimization, and building reliable, production-critical infrastructure.
- Strong attention to detail combined with a bias for action and delivery in fast-moving environments.
- Excellent problem-solving skills with a proactive, ownership-driven mindset.
Responsibilities
- Design, build, and operate scalable data ingestion and processing systems that transform raw multimodal data into structured, validated, AI-ready datasets.
- Own end-to-end data pipelines, including ingestion, validation, transformation, tracking, and downstream delivery at scale.
- Develop modality-specific processing logic for complex data types such as medical imaging, audio, video, and unstructured text data.
- Build reusable parsers, validators, normalization workflows, and internal tooling to standardize and industrialize data processing.
- Optimize distributed data systems for performance, reliability, throughput, and cost efficiency across large-scale workloads.
- Diagnose bottlenecks and ensure system robustness as data volume, complexity, and modalities continue to grow.
- Implement strong data quality, security, and compliance mechanisms, including handling sensitive or regulated data (e.g., PHI) with appropriate safeguards.
- Collaborate cross-functionally with Product, Data, and Partner Engineering teams to support new data modalities and evolving requirements.
View Full Description & ApplyYou'll be redirected to the employer's site