Senior Data Engineer

Posted 16 days agoViewed

💎 Seniority level: Senior, 5+ years

📍 Location: Japan

🔍 Industry: Conversational commerce technology

🗣️ Languages: English, Japanese

⏳ Experience: 5+ years

🪄 Skills: PythonSQLData engineeringScala

5+ years of experience in data engineering or related roles.
Strong analytical skills with the ability to manipulate and interpret complex datasets.
Proficiency in SQL and experience with databases such as MySQL and BigQuery.
Experience in both Python and Scala is preferred.
Knowledge of dbt is a must.
Experience with data platforms like Airflow, Dataproc, Great Expectations.
Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams.
Demonstrated ability to work independently and manage multiple projects simultaneously.
English proficiency is a must. Conversational Japanese is nice to have.

Design, develop, and optimize data pipelines to ingest data into our data lakehouse.
Implement and manage ETL processes using Google Cloud Composer, Dataproc, and dbt.
Develop data transformations within a medallion architecture (bronze, silver, gold layers).
Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements.
Implement data quality checks and monitoring.
Monitor and optimize the performance of BigQuery datasets and queries.
Document processes, designs, and architectural decisions.
Design and develop a read-optimized data warehouse layer.
Troubleshoot daily reporting pipelines.
Conducting code reviews and providing mentorship to junior engineers.

Posted about 1 month ago

📍 United States, United Kingdom, Singapore, Indonesia, Germany, France, Japan, Australia

🔍 Customer engagement platform

5+ years of hands-on experience in data engineering, cloud data warehouses, and ETL development.
Proven expertise in designing and optimizing data pipelines and architectures.
Strong proficiency in advanced SQL and data modeling techniques.
Experience leading impactful data projects from conception to deployment.
Effective collaboration skills with cross-functional teams and stakeholders.
In-depth understanding of technical architecture and data flow in a cloud-based environment.
Ability to mentor and guide junior team members.
Passion for building scalable data solutions.
Strong analytical and problem-solving skills with attention to detail.
Experience with large event-level data aggregation.
Familiarity with data governance principles.

Lead the design, implementation, and monitoring of scalable data pipelines and architectures using tools like Snowflake and dbt.
Develop and maintain robust ETL processes to ensure high-quality data ingestion, transformation, and storage.
Collaborate with data scientists, analysts, and engineers to implement data solutions for customer engagement.
Optimize and manage data flows across various platforms and applications.
Ensure data quality, consistency, and governance through best practices.
Work with large-scale event-level data to support business intelligence and analytics.
Implement and maintain data products using advanced techniques.
Collaborate with cross-functional teams to deliver valuable data solutions.
Evaluate and integrate new data technologies to enhance data infrastructure.

SQLBusiness IntelligenceETLSnowflakeData engineeringCollaborationCompliance

Posted about 1 month ago

🔧 Requirements