Senior Efficacy Research and Psychometrics Analyst, Khan Kids
J
JobgetherEducation technology
Based in United StatesContractSenior
Salary$137,871–$155,105 USD annual compensation range for candidates based in the United States.
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLLookerR
Requirements
- Have an advanced degree, such as a PhD or Master’s, in psychometrics, educational measurement, quantitative methods, or a related discipline, or equivalent applied experience.
- Have strong knowledge of psychometric methods, including item analysis, reliability and validity evidence, growth modeling, and Item Response Theory (IRT).
- Be proficient with SQL and a statistical programming language such as R or Python for data extraction, cleaning, analysis, and visualization.
- Have experience building dashboards and data pipelines, and experience with or willingness to learn business intelligence tools such as Looker.
- Be familiar with responsible education-research data-sharing practices, student privacy considerations such as FERPA and COPPA, and pseudonymized or deidentified data.
- Communicate quantitative and psychometric findings clearly to technical and non-technical audiences, including product teams, funders, and school partners.
- Have project management and organizational skills to coordinate external partners, research activities, recurring deliverables, and multiple priorities.
- Demonstrate analytical thinking, attention to detail, and commitment to data quality and research rigor.
- Translate research evidence into practical recommendations that inform product or program decisions.
- Bring cross-cultural competency, self-awareness, and the ability to contribute to inclusive, collaborative working environments.
- Experience with early childhood education or assessment of young learners is a plus.
- Experience designing quasi-experimental studies in school or program settings is advantageous.
- Experience with Spanish-language assessment or dual-language learner measurement is a plus.
Responsibilities
- Serve as the technical point of contact for external psychometric research partners, supporting study design, data sharing, analysis, and interpretation.
- Extract, clean, validate, and securely share assessment data with research partners on recurring schedules.
- Analyze item difficulty, score distributions, growth analyses, concurrent validity, and Item Response Theory-based scoring.
- Translate research findings into product improvements, including potential scoring model changes and assessment discontinuation rules.
- Collaborate with research partners on technical documentation, including assessment technical manuals.
- Recruit and onboard school and district research sites, execute MOUs, align consent and participant incentive procedures, and coordinate site visits for child assessment data collection.
- Coordinate data-sharing agreements with legal and external organizations, including agreements involving pseudonymized and identified data.
- Coordinate ongoing efficacy studies and contribute to planning future research initiatives.
- Own and maintain the product KPI dashboard with engineering, including integrations with App Store Connect and Google Play Console.
- Lead recurring app performance reporting, business reviews, target-setting, and ad hoc SQL analyses.
View Full Description & ApplyYou'll be redirected to the employer's site
