- Design, develop, and maintain scalable data pipelines for feature stores, model-training, and inference services.
- Build and optimize workflows for semantic representation of unstructured data.
- Architect and implement analytics and dashboarding solutions with natural language querying.
- Define and execute processes for prompt engineering, orchestration, and model fine-tuning.
- Oversee vector data stores and develop indexing for RAG workflows.
- Partner with stakeholders to gather requirements for LLM initiatives.
- Create and maintain comprehensive documentation.
- Stay informed on emerging methodologies in data engineering, MLOps, and LLM operations.
AWSPythonSQL+17 more