AI Evaluation Engineer - Business & Operations Domain
New
G
Gramian Consulting GroupIT Professional Services
Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Pakistan, Indonesia, Kenya, Nigeria, Turkey, Vietnam, minimum 4h PST overlapContractMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 3–10 years
- Required Skills
- Business AnalysisBusiness OperationsData analytics
Requirements
- 3–10 years of experience in operations, analytics, consulting, business systems, or related domains
- Strong analytical thinking and operational problem-solving skills
- Experience working with operational workflows, reporting systems, CRM tools, or business analytics
- Good understanding of cross-functional business processes and dependencies
- Experience with spreadsheets, dashboards, operational reporting, or workflow automation
- Strong written communication and documentation skills
- Exposure to AI systems, automation platforms, or evaluation workflows is preferred
- Ability to design realistic and structured operational scenarios for evaluation purposes
Responsibilities
- Design realistic business and operational workflow scenarios for AI evaluation systems
- Create structured tasks involving analytics, reporting, operational reasoning, and process optimization
- Develop clear task specifications, expected outcomes, and validation logic
- Identify operational edge cases, bottlenecks, and workflow failure scenarios
- Evaluate AI-generated outputs for reasoning quality, usefulness, and accuracy
- Contribute expertise across business operations, analytics, automation, or operational systems
- Review and improve workflow complexity, clarity, and evaluation quality
- Collaborate with reviewers and researchers to refine AI benchmark scenarios
- Help create realistic multi-step business and operational problem-solving tasks
View Full Description & ApplyYou'll be redirected to the employer's site
