AI Benchmark Engineer - Spanish (Argentina)
L
LiltArtificial Intelligence
Argentina (Remote)ContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Spanish (native fluency); English (high proficiency)
- Experience
- 5+ years
- Required Skills
- PythonLLM
Requirements
- 5+ years of industry experience in software engineering.
- Proven track record at leading technology companies or graduation from top-tier engineering universities.
- Native or near-native Spanish fluency with deep understanding of grammar and phrasing.
- High English proficiency.
- Strong proficiency in Python and standard shell scripting.
- Extensive experience with Terminal/CLI-based development workflows.
- Working familiarity with coding agents.
- Deep technical understanding of multilingual text processing (encoding, Unicode, locale-dependent conventions, text I/O).
- Must be able to commit to a minimum of 2 hours per day or 10 hours per week.
Responsibilities
- Design and build realistic task environments using datasets and files in Spanish.
- Develop robust solutions (reference implementations) and write deterministic verifier scripts.
- Evaluate coding agents by identifying AI failure points in native language tasks.
- Analyze execution logs and calibrate task difficulty for various model tiers.
- Participate in a 4-layer human quality control process, including creation, review, and audit.
- Ensure benchmark integrity, grammatical accuracy, and fairness in multilingual environments.
View Full Description & ApplyYou'll be redirected to the employer's site
