Senior Data Engineer

New
W
WOO XCrypto trading
This role is fully remote within APACFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Languages
Mandarin is the team’s main working language; clearly communicate technical details and business requirements in Mandarin. Strong English communication skills are a nice to have.
Required Skills
PythonSQLApache AirflowApache KafkaSparkData modeling

Requirements

  • Have data engineering experience within crypto or Web3, including responsibility for production pipelines or a data platform.
  • Have strong Python and SQL skills.
  • Have experience building maintainable data processing workflows.
  • Have hands-on experience with Airflow, Kafka, and Spark.
  • Have experience with data warehouses, ETL/ELT pipelines, and data modelling.
  • Be able to investigate data discrepancies, troubleshoot pipeline failures, and resolve underlying causes.
  • Be able to work independently.
  • Be able to communicate technical details and business requirements clearly in Mandarin.
  • Experience at a centralised crypto exchange, particularly with trading, order, or account data, is a nice to have.
  • BI experience supporting dashboards, defining metrics, or preparing datasets for business users is a nice to have.
  • Strong English communication skills are a nice to have.

Responsibilities

  • Build and maintain batch and streaming data pipelines using Python, SQL, Kafka, and Spark.
  • Develop and operate Airflow workflows, including scheduling, dependency management, retries, and recovery.
  • Design and maintain data models and warehouse datasets for analytics and reporting.
  • Improve data quality and freshness through validation, monitoring, and investigation of upstream and downstream issues.
  • Optimise pipeline and query performance and manage processing and storage costs.
  • Work with data users to define datasets and metrics.
  • Document data flows, transformations, and dependencies.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now