Big Data Engineer

View full description

Requirements:

• 3 years of experience in data engineering.
• Strong experience with Python or Scala and Spark, processing large datasets.
• Solid experience in Cloud platforms (Azure or AWS).
• Hands-on experience building data pipelines (CI/CD).
• Experience with testing (unit, integration, etc.).
• Knowledge of SQL and NoSQL databases.

Responsibilities:

• Participating in the design and development of Data solutions for challenging projects.
• Develop projects from scratch with minimal supervision and strong team collaboration.
• Be a key player in fostering best practices, clean, and reusable code.
• Develop ETLs using Spark (Python/Scala).
• Work on cloud-based projects (Azure/AWS).
• Build scalable pipelines using a variety of technologies.