Senior Product Data Engineer
New
J
JobgetherData Products
Based in Europe with significant working-hours overlap with EET/Tallinn time., EET (Eastern European Time)Full-TimeSenior
SalaryAnnual salary range of €90,000–€140,000, depending on location, employment type, skills, and experience.
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSAirflowSparkPySpark
Requirements
- Strong professional knowledge of Apache Spark, with PySpark preferred.
- Proven experience building ETL/ELT pipelines and processing data at significant scale.
- Experience working with unstructured, messy, and complex datasets.
- Hands-on experience with workflow orchestration tools such as Airflow or AWS Step Functions.
- Familiarity with the AWS ecosystem, particularly services such as Glue and EMR.
- Demonstrated ability to ship complete production features from idea and scoping through iteration.
- Hands-on experience building and deploying agentic or LLM-powered features in production.
- Practical understanding of LLM trade-offs involving cost, latency, performance, and capability.
- Strong system design and software engineering fundamentals.
- Experience working autonomously and taking ownership of complex technical problems.
Responsibilities
- Design, build, and operate data products that transform raw social and public data into consistent, customer-facing insights.
- Develop large-scale ETL/ELT pipelines and data processing systems using Spark, with PySpark as a preferred technology.
- Own projects end-to-end, from discovery, planning, and scoping through architecture, implementation, production release, and iteration.
- Contribute to the development of AI-assisted search, recommendations, and other intelligent product capabilities using LLMs and embeddings.
- Build and operate LLM-powered and agentic features in production environments.
- Design reliable workflows and orchestration processes using tools such as Airflow or AWS Step Functions.
- Monitor system performance, reliability, data quality, and operational costs as data volumes and product usage grow.
View Full Description & ApplyYou'll be redirected to the employer's site
