Applied AI Engineer
New
P
PlentiFinancial compliance software
Pracę zdalną z dowolnego miejsca w PolsceFull-TimeSenior
Salary180 - 220 PLN per hour net b2b
Apply NowOpens the employer's application page
Job Details
- Languages
- Polish (C1); English (B2+)
- Required Skills
- PythonPrompt Engineering
Requirements
- Have very good Python skills and practical experience working with LLM model APIs.
- Have practical prompt engineering experience, including prompt design and optimization, structured outputs, and methods to reduce hallucinations.
- Have experience building evaluation sets, measuring solution quality, and iteratively improving results.
- Be able to design experiments, test hypotheses, and compare models and approaches using measurable results.
- Understand cost and throughput considerations for LLM solutions, including model selection, image-versus-text processing, and batching.
- Understand reliability issues in LLM-generated results, including hallucinations, data validation, and traceability.
- Be able to work independently at a senior level and mentor less experienced engineers.
- Have English proficiency of at least B2+ and Polish proficiency of at least C1.
- Practical experience extracting and structuring data from PDFs, scans, and other unstructured sources using LLMs is an advantage.
Responsibilities
- Develop production LLM solutions that extract structured data from documents, PDFs, and scans according to a defined data model.
- Design, test, and optimize prompts, including structured outputs and methods to reduce hallucinations and model errors.
- Create evaluation sets and reference data, and define metrics for measuring extraction quality.
- Design and run experiments, analyze results, and compare models and approaches.
- Identify causes of model errors and low performance, formulate hypotheses, and iteratively improve solutions based on data.
- Monitor AI solution quality in production, detect regressions, and identify areas for optimization.
- Optimize processing costs and throughput through model selection, image-versus-text processing decisions, and batching.
- Validate extracted results and ensure extracted data can be traced to its source in the document.
- Work independently on technical solutions and collaborate with other engineers on their development.
View Full Description & ApplyYou'll be redirected to the employer's site