Data Engineer
Q
QodeData Engineering
VietnamFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 6+ years
- Required Skills
- AWSPostgreSQLPythonSQLApache AirflowMongoDBdbtDatabricksPySpark
Requirements
- 6+ years of experience in Data Engineering
- Proven hands-on ownership of production data pipelines
- Strong experience building ETL/ELT pipelines with full load, incremental load, and CDC-based patterns
- Understanding of CDC correctness, idempotency, deduplication, and reconciliation
- Hands-on experience with OLTP databases (MongoDB, PostgreSQL/RDS)
- Practical experience with schema design and relational modeling
- Experience migrating or syncing data between operational systems and analytical platforms
- Strong SQL skills (joins, CTEs, window functions, query optimization)
- Strong Python or PySpark experience
- Experience with production pipeline reliability, monitoring, and incident handling
- Hands-on AWS data pipeline experience (S3, Lambda, IAM, RDS, DMS, SQS, Kinesis, Glue)
Responsibilities
- Design and build production-grade data pipelines using batch, streaming, incremental, and CDC-based patterns.
- Build ingestion workflows from operational systems such as MongoDB, PostgreSQL, RDS, APIs, and event streams.
- Design and operate data migration workflows, including full load, incremental sync, CDC replay, cutover, rollback, and reconciliation.
- Convert semi-structured or NoSQL data into reliable relational and analytical models.
- Build and optimize data processing jobs using Python, PySpark, Spark SQL, SQL, and Databricks.
- Orchestrate workflows using Apache Airflow and manage connectors using Airbyte or similar tools.
- Maintain data quality, observability, alerting, backfills, and production reliability across pipelines.
- Work with AWS services such as S3, Lambda, IAM, EC2, RDS, DMS, SQS, Kinesis, or similar services.
- Build modular, testable transformation layers using dbt where appropriate.
- Document data flows, source-to-target mapping, pipeline behavior, data contracts, and operational runbooks.
View Full Description & ApplyYou'll be redirected to the employer's site
