Big Data Engineer

View full description

Requirements:

• At least 4 years of experience in software/data engineering.
• Experience in designing architectures.
• Strong proficiency in Python or Scala and Spark for processing large data volumes.
• Solid experience with cloud platforms (Azure or AWS).
• Experience in creating CI/CD data pipelines.
• Familiarity with testing methodologies (unit and integration).
• Knowledge of SQL and NoSQL databases.
• Good command of English (mandatory).
• Desirable experience with BI tools like Power BI, and technologies like Databricks, Snowflake, Fabric, and IaC.

Responsibilities:

• Engage in projects from initial client interactions to understand business needs and propose suitable technical solutions.
• Develop projects from scratch with minimal supervision, collaborating with the team.
• Participate in architecture design and decision-making in a constructive environment.
• Contribute to good practices for clean and reusable code.
• Develop ETLs using Spark in Python or Scala.
• Execute projects in cloud environments like Azure or AWS.
• Build scalable pipelines using various technologies.