Technical Solutions Architect, Evals & Fine-Tuning
New
I
Innodata Inc.Data Engineering AI
Remote - United StatesFull-TimeSenior
Salary140,000 - 160,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years of experience in applied ML, ML engineering, ML research, or technical solutions roles, with at least 2+ years focused specifically on LLM evaluation and/or post-training.
- Required Skills
- PythonMachine LearningPyTorchLLM
Requirements
- 7+ years of experience in applied ML, ML engineering, ML research, or technical solutions.
- At least 2+ years focused specifically on LLM evaluation and/or post-training.
- Hands-on experience fine-tuning LLMs including SFT, RLHF, DPO, or KTO.
- Deep familiarity with LLM evaluation methodology such as benchmark construction and human eval workflow design.
- Strong fluency in Python and the modern LLM toolchain.
- Proficiency with Hugging Face, PyTorch, and vLLM.
- Experience with evaluation frameworks such as lm-evaluation-harness or lighteval.
- Ability to communicate complex technical concepts to both research scientists and non-technical stakeholders.
- Consultative mindset with ability to own recommendations.
- Bachelor’s or advanced degree in CS, Machine Learning, Computational Linguistics, or equivalent experience.
Responsibilities
- Lead technical discovery with prospective and existing customers to understand model objectives, gaps, and constraints.
- Design end-to-end solutions across the post-training stack including SFT data curation, preference data collection, golden datasets, and custom benchmarks.
- Architect engagements that combine Innodata’s platforms with a global SME workforce.
- Author technical proposals, SOWs, solution diagrams, and pricing models in partnership with sales and delivery teams.
- Run technical workshops, POCs, and pilot designs to prove value and de-risk programs.
- Serve as the ongoing technical advisor during delivery to keep solutions aligned with original intent.
- Feed customer signal back into Innodata’s R&D and product roadmap.
- Stay current on state-of-the-art eval methodologies and post-training paradigms.
- Represent Innodata externally at customer reviews and conferences.
View Full Description & ApplyYou'll be redirected to the employer's site
