Senior/Staff ML Engineer

5+ years in Data Science or ML engineering with a strong focus on ML or NLP systems. 1+ year focused on Gen-AI or LLM systems. Strong Python and SQL skills. Experience creating automated evaluation suites for LLM outputs and using results to guide iterative improvements. Knowledge of prompt engineering, RAG techniques, vector search, embeddings, fine-tuning, and model selection across multiple providers. Ability to communicate complex AI trade-offs clearly.

Design and own comprehensive evaluations that measure accuracy, completeness, style, hallucination rate, bias, and safety. Tune and iterate on RAG pipelines, prompt chains, conversation loops, provider selections, and fine-tunes. Build reusable data and evaluation pipelines, a shared semantic layer, and monitoring dashboards. Optimize for cost and latency, continuously benchmarking models and negotiating trade-offs. Implement robust data governance and lineage practices. Document best practices and share knowledge.