Senior Data Scientist
Company:Plum Inc
Location:United States
Languages:English
Seniority level:Senior, 3+ years
Experience:3+ years
Skills:
AWSPythonCloud ComputingData AnalysisMachine LearningMLFlowAPI testingData science
Requirements:
- Master’s degree in Computer Science, Engineering, Physics, or related technical field or equivalent work experience.
- 3+ years of experience developing and deploying machine learning pipelines in production.
- 1+ years of experience building Generative AI or LLM-based applications.
- Strong programming skills in Python.
- Hands-on experience in ML/AI frameworks (e.g., LangChain, Transformers, LLM APIs).
- Deep understanding of LLM evaluation, prompt engineering, and text generation quality metrics.
- Experience designing and implementing RAG architectures.
- Hands-on experience with Databricks, MLflow, or similar platforms.
- Experience with cloud infrastructure (AWS preferred) and MLOps practices.
- Strong problem-solving skills and ability to lead through ambiguity.
- Excellent communication and documentation habits.
Responsibilities:
- Design and architect end-to-end Generative AI pipelines using LLMs.
- Integrate open-source and proprietary LLMs via APIs and custom orchestration.
- Build and optimize workflows using frameworks like LangChain.
- Design and implement RAG architecture.
- Develop methods to evaluate and compare LLM outputs.
- Build automated and scalable LLM evaluation pipelines.
- Implement monitoring, observability, and logging for GenAI workflows.
- Collaborate with cross-functional teams to integrate generative outputs.
