Senior ML / AI Engineer
New
J
JobgetherHealthcare AI
Based in United StatesFull-TimeSenior
Salary$150,000–$210,000
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- AWSPostgreSQLPythonKubernetesTerraformMLOpsLangChain
Requirements
- 5+ years of experience building and deploying ML/AI systems in production.
- Hands-on LLM application development experience within the last 1–2 years.
- Strong Python expertise with typed, tested, production-grade development.
- Practical expertise with RAG, embeddings, vector search, and agent orchestration (LangGraph/LangChain).
- Experience self-hosting models using frameworks like vLLM or TGI on GPU infrastructure.
- Hands-on AWS or cloud experience including Kubernetes, Terraform, CI/CD, and observability.
- Experience with AI quality, risk management, and reliability strategies.
- Experience with regulated data and security frameworks such as HIPAA, SOC 2, or ISO 27001.
- Experience with PostgreSQL/pgvector, MongoDB/DocumentDB, SQS, and Cognito/OIDC.
- Frontend experience with React and TypeScript.
- Ability to work collaboratively with strong written communication and technical judgment.
Responsibilities
- Design, build, and deploy production-grade agentic AI systems using dynamic tool calling, structured outputs, and multi-agent orchestration.
- Develop and maintain RAG pipelines covering ingestion, embeddings, hybrid retrieval, and quality evaluation.
- Operate self-hosted LLM and VLM inference services on AWS GPU infrastructure with throughput optimization.
- Own the MLOps and AI governance layer, including offline evaluation, canary releases, and production monitoring.
- Implement strict access controls and security protections for sensitive member and client data.
- Develop and maintain AWS infrastructure using EKS, Terraform, and RDS/pgvector.
- Mentor engineers and promote strong standards for typed, tested, and maintainable code.
View Full Description & ApplyYou'll be redirected to the employer's site
