Open Source AI Engineer - Evals

Posted 1 day agoViewed

View full description

📍 Location: United States

💸 Salary: 150000.0 - 185000.0 USD per year

🔍 Industry: AI

🏢 Company: Arize AI👥 51-100💰 $38,000,000 Series B over 2 years agoArtificial Intelligence (AI)Machine Learning Information Technology Software

🗣️ Languages: English

🪄 Skills: PythonData AnalysisMachine Learning

Requirements:

Familiarity with popular LLM frameworks
Fluent in Python, TypeScript is a plus
Understanding of NLP evaluation methods
Contributions to open source projects
Familiarity with ML observability tools

Responsibilities:

Design and architect new LLM eval frameworks
Curate datasets and develop benchmarked metrics
Collaborate with the AI open source community
Prototype and iterate on LLM techniques
Integrate insights on LLM behavior
Write documentation and tutorials