Senior Data Engineer
New
W
WOO XCrypto trading
This role is fully remote within APACFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Mandarin is the team’s main working language; clearly communicate technical details and business requirements in Mandarin. Strong English communication skills are a nice to have.
- Required Skills
- PythonSQLApache AirflowApache KafkaSparkData modeling
Requirements
- Have data engineering experience within crypto or Web3, including responsibility for production pipelines or a data platform.
- Have strong Python and SQL skills.
- Have experience building maintainable data processing workflows.
- Have hands-on experience with Airflow, Kafka, and Spark.
- Have experience with data warehouses, ETL/ELT pipelines, and data modelling.
- Be able to investigate data discrepancies, troubleshoot pipeline failures, and resolve underlying causes.
- Be able to work independently.
- Be able to communicate technical details and business requirements clearly in Mandarin.
- Experience at a centralised crypto exchange, particularly with trading, order, or account data, is a nice to have.
- BI experience supporting dashboards, defining metrics, or preparing datasets for business users is a nice to have.
- Strong English communication skills are a nice to have.
Responsibilities
- Build and maintain batch and streaming data pipelines using Python, SQL, Kafka, and Spark.
- Develop and operate Airflow workflows, including scheduling, dependency management, retries, and recovery.
- Design and maintain data models and warehouse datasets for analytics and reporting.
- Improve data quality and freshness through validation, monitoring, and investigation of upstream and downstream issues.
- Optimise pipeline and query performance and manage processing and storage costs.
- Work with data users to define datasets and metrics.
- Document data flows, transformations, and dependencies.
View Full Description & ApplyYou'll be redirected to the employer's site