Senior Data Scientist, Agentic AI Systems
New
A
AxleBioscience IT
Remote position within the United StatesFull-TimeSenior
Salary130,000 - 150,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 5 years building and operating production software or data systems, including 2 years shipping LLM-powered applications.
- Required Skills
- PostgreSQLPythonKubernetesFastAPICI/CD
Requirements
- Bachelor’s degree in Data Science, Computer Science, Bioinformatics, or related field (or equivalent experience).
- At least 5 years building and operating production software or data systems.
- At least 2 years shipping LLM-powered applications (agents, retrieval, or evaluation).
- Experience with structured output, tool/function calling, and schema validation.
- Experience building evaluation systems for non-deterministic AI tasks.
- Ability to own a service end-to-end from schema design through deployment and operation.
- Proficiency in Python, FastAPI, Pydantic, and pytest.
- Strong understanding of LLM application engineering (prompt design, context, structured generation, tracing).
- Experience with PostgreSQL including embeddings and vector search.
- Experience with containerization and Kubernetes for operational deployment.
- Experience with Git-based CI/CD workflows.
- Ability to obtain and maintain a Public Trust Security clearance.
Responsibilities
- Build agentic AI systems including conversation logic and confirmation steps for rare disease research workflows.
- Model outputs in Pydantic using structured output and tool calling to ensure typed, validated, and traceable data.
- Write, version, and regression test prompts for clinical and scientific reasoning tasks.
- Develop evaluation systems using golden sets, offline regression suites, and model-based graders.
- Ensure LLM workflows are performant under load, implementing async design and failure handling.
- Log system actions, latency, and reasoning to ensure transparency for staff review.
- Translate research requirements into data models and system behavior.
- Contribute to manuscripts, conference abstracts, and posters as an author.
View Full Description & ApplyYou'll be redirected to the employer's site
