Senior Data Engineer, Data Platform

Posted 7 days agoViewed

💎 Seniority level: Senior, 5+ years

📍 Location: United States, Canada

🔍 Industry: Data Engineering

🏢 Company: VTEX👥 1001-5000💰 over 3 years ago🫂 Last layoff over 2 years agoE-Commerce SaaS Information Technology Software

🗣️ Languages: English

⏳ Experience: 5+ years

🪄 Skills: AWSDockerPythonApache AirflowCloud ComputingETLGCPKafkaKubernetesAzureData engineeringNosqlTerraformData modeling

Posted about 1 month ago

📍 Canada

🧭 Full-Time

🔍 Technology for small businesses

🔧 Requirements

Proven ability to lead and collaborate in team environments.
Strong coding skills in Python and SQL.
Expertise in building and maintaining ETL pipelines using tools like Airflow and dbt.
Experience with AWS tools such as Redshift, Glue, and Lambda.
Familiarity with handling large datasets using tools like Spark.
Experience with Terraform for infrastructure management.
Knowledge of dimensional modelling, star schemas, and data warehousing.

💡 Responsibilities

Design, develop, and maintain batch and real-time data pipelines within cloud infrastructure (preferably AWS).
Develop tools that automate processes and set up monitoring systems.
Collaborate with teams to extract actionable insights from data.
Lead initiatives to propose new technologies, participate in design and code reviews, and maintain data integrity.

AWSPythonSQLApache AirflowETLSparkTerraform

Posted about 1 month ago