(911) Senior Data Engineer (Scala and Spark)

Posted 8 days agoViewed

View full description

💎 Seniority level: Senior, 5+ years

📍 Location: Latin America

🔍 Industry: Insurance Industry

🏢 Company: Nearsure👥 501-1000 Staffing Agency Outsourcing Software

🗣️ Languages: English

⏳ Experience: 5+ years

🪄 Skills: AWSPythonSQLApache AirflowETLKubernetesSparkScala

Requirements:

Bachelor's Degree in Computer Science or related field
5+ years experience with Python and Scala for data engineering
5+ years experience with AWS ecosystem
3+ years experience with Kubernetes
2+ years experience with Scala and Spark for data processing
Expert in SQL programming

Responsibilities:

Design, develop, maintain, and enhance data engineering solutions
Build scalable pipelines focusing on data quality
Integrate business knowledge with technical functionalities
Collaborate with application engineers and data scientists
Automate existing code and processes