Senior AI Engineer (Python, AWS, AI/LLM, APIs)
New
E
emagine PolskaEducational technology
Remote with the first day onboarding in Warsaw and occasional visits once per quarterContractSenior
SalaryUp to 180 pln/h on b2b
Apply NowOpens the employer's application page
Job Details
- Languages
- English B1
- Required Skills
- AWSPostgreSQLPythonSQLETLFastAPI
Requirements
- Strong Python development experience in production systems.
- AWS experience with S3, Glue, and Aurora.
- Experience with data pipelines, ETL, or batch processing.
- Strong SQL and PostgreSQL experience.
- Experience with schema design and migrations.
- Production experience with LLMs for OCR, content processing, or enrichment.
- Write strongly typed Python code using mypy.
- Follow CI/CD processes with automated checks including ruff and pytest.
- Prompt engineering or context engineering experience is a plus.
- Experience with vector databases such as Weaviate, Pinecone, Qdrant, or pgvector is a plus.
- Knowledge of embeddings, semantic search, and RAG is a plus.
- Experience with FastAPI or Airflow/MWAA is a plus.
Responsibilities
- Build and maintain multi-stage data ingestion pipelines.
- Design and implement idempotent, restartable batch-processing workflows.
- Use S3 as the core storage layer for raw and processed data.
- Implement content ingestion, book identity assignment, PDF-to-markdown conversion, structure extraction, hierarchical chunking, and embedding generation.
- Use LLMs and OCR models to extract structured data from PDFs.
- Generate structured metadata and enrich content for downstream use cases.
- Maintain PostgreSQL (Aurora) as the system of record and design SQL schemas and versioned migrations.
- Implement reconciliation logic across S3, PostgreSQL (Aurora), and Weaviate.
- Work with Weaviate for vector search and semantic retrieval, and support RAG-based applications.
- Build REST APIs using FastAPI and integrate with internal and external systems.
View Full Description & ApplyYou'll be redirected to the employer's site
