Business Analyst - AI Response Evaluation Specialist
New
G
Gramian ConsultancyAI evaluation
Workable workplace: remote; Workable locations: United States; Location: United StatesContractMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 3 years of professional experience as a Business Analyst or in a similar analytical role.
- Required Skills
- SQLBusiness AnalysisMicrosoft Power BITableauMicrosoft Excel
Requirements
- Hold a bachelor's degree in Business Administration, Finance, Computer Science, or a related field.
- Have at least 3 years of professional experience as a Business Analyst or in a similar analytical role.
- Demonstrate analytical thinking, problem-solving, and decision-making skills.
- Be proficient in Excel and have experience with SQL, Power BI, Tableau, or comparable analytical and reporting tools.
- Have experience gathering requirements, documenting functional specifications, and mapping business processes.
- Be able to compare complex information against defined criteria with strong attention to detail.
- Have written communication, reporting, and documentation skills.
- Be able to collaborate with cross-functional teams and manage multiple priorities independently.
- Be willing to work five days per week, including weekends when required, with two weekdays off during the project.
Responsibilities
- Gather, analyze, and document business requirements, stakeholder expectations, and project objectives.
- Compare chatbot responses and assess their accuracy, relevance, completeness, and alignment with evaluation criteria.
- Conduct structured evaluations and provide evidence-based assessments of AI-generated outputs.
- Translate business requirements into functional specifications, evaluation criteria, and actionable documentation.
- Analyze workflows, business processes, and data to identify gaps, inefficiencies, and improvement opportunities.
- Create reports, dashboards, process maps, and other project documentation.
- Support project planning, testing, implementation, and user acceptance testing (UAT).
- Collaborate with technical teams and business stakeholders to ensure project requirements are understood and met.
- Track project progress, risks, dependencies, and key performance indicators (KPIs).
- Present findings, insights, and recommendations; maintain evaluation quality and meet project deadlines and task completion targets.
View Full Description & ApplyYou'll be redirected to the employer's site
