Apply

Senior Big Data Engineer

Posted 2 months agoViewed

View full description

💎 Seniority level: Senior, At least 4 years

📍 Location: Spain

🔍 Industry: Technology

🏢 Company: Plain Concepts👥 251-500ConsultingAppsMobile AppsInformation TechnologyMobile

🗣️ Languages: English

⏳ Experience: At least 4 years

🪄 Skills: AWSPythonSQLAgileAzureNosqlSparkCI/CDScala

Requirements:
  • At least 4 years of experience in software or data engineering.
  • Experience in designing architectures.
  • Solid experience in Python or Scala and Spark for handling large data volumes.
  • Strong experience in Cloud services (Azure or AWS).
  • Experience in creating data pipelines (CI/CD).
  • Experience in testing (unit tests, integration tests, etc.).
  • BI experience (Power BI) is a plus.
  • Familiarity with Databricks, Snowflake, or Fabric is a plus.
  • Experience with Infrastructure as Code (IaC) is a plus.
  • Knowledge of SQL and NoSQL databases.
  • Good level of English is essential.
  • Ability to work as a team player.
Responsibilities:
  • Involved in projects from initial client interactions to understand business needs and propose suitable technical solutions.
  • Develop projects from scratch with minimal supervision and team collaboration.
  • Participate in architectural designs and decision-making in a constructive co-creation environment.
  • Key role in developing best practices, clean and reusable code.
  • Create ETLs using Spark (Python/Scala).
  • Work on cloud projects (Azure/AWS).
  • Build scalable pipelines with various technologies.
Apply