Research Scientist
New
O
OpenRouterAI Infrastructure
Remote (US)Full-Time
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLMachine LearningNLP
Requirements
- MS or PhD in a quantitative field such as machine learning, statistics, computer science, mathematics, or computational linguistics.
- Track record of original research via first-author publications or significant open-source contributions.
- Deep expertise in statistics, experimental design, and causal inference.
- Strong programming skills in Python for building pipelines and running experiments.
- Proficiency in SQL for working with large-scale analytical databases.
- Hands-on experience with modern ML/NLP techniques like LLM evaluation, fine-tuning, embeddings, or RLHF.
- Familiarity with the current LLM landscape, model architectures, and provider ecosystems.
- Ability to work independently and self-direct a research agenda.
- Strong communication skills for explaining complex findings in papers, blog posts, and memos.
Responsibilities
- Own and pursue a research agenda focused on LLM evaluation, model quality, routing optimization, and AI usage patterns.
- Design novel evaluation frameworks and benchmarks that go beyond standard leaderboards using real-world generation data.
- Conduct large-scale empirical studies on LLM behavior, comparing models across providers and analyzing performance trends.
- Develop the statistical and mathematical foundations behind routing systems and heuristics for model selection.
- Identify opportunities to apply research findings to the OpenRouter platform.
- Collaborate with external researchers, model providers, and the open-source community.
- Translate research findings into actionable improvements for product and engineering teams.
View Full Description & ApplyYou'll be redirected to the employer's site
