AI Benchmark Engineer | Native Language Specialist - Portuguese (Brazil)
New
L
LiltArtificial Intelligence
Brazil (Remote)ContractMiddle
Salary50 - 75 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Portuguese (Brazil), English
- Experience
- 1+ years
- Required Skills
- PythonPrompt EngineeringLLM
Requirements
- 1+ years of industry experience in software or prompt engineering.
- Proven track record at technology companies or top-tier engineering universities.
- Native or near-native fluency in Portuguese (Brazil).
- High English proficiency.
- Strong proficiency in Python.
- Strong proficiency in standard shell scripting.
- Strong proficiency in data processing.
- Extensive experience with Terminal/CLI-based development workflows.
- Working familiarity with coding agents.
- Technical understanding of multilingual text processing (Unicode, encoding, locale-dependent conventions, text I/O).
Responsibilities
- Design and build realistic task environments using datasets and files in Portuguese (Brazil).
- Identify failure points in LLMs during tasks conducted in Portuguese.
- Develop reliable, deterministic verifier scripts for task solutions.
- Analyze execution logs and calibrate task difficulty across various model tiers.
- Participate in a 4-layer human quality control and audit process.
- Ensure benchmark integrity, fairness, and grammatical accuracy.
View Full Description & ApplyYou'll be redirected to the employer's site
