Big Data Engineer
New
S
Satori AnalyticsData & AI
Work remotely from anywhere in European economic Area (EU, Switzerland etc.) or UK (up to 6 weeks per year)Full-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 3–8 years of experience
- Required Skills
- PostgreSQLPythonSQLETLSparkCI/CDdbtPySpark
Requirements
- 3–8 years of experience in data engineering, big data, or related roles.
- Strong SQL skills for querying, transformation, performance tuning, and data modeling.
- Strong Python programming and scripting experience for ETL development, automation, and data processing.
- Hands-on experience with Apache Spark and PySpark for large-scale batch or streaming data processing.
- Experience building and maintaining ETL/ELT pipelines in enterprise or on-premise environments.
- Experience with relational databases and warehouse/lake platforms such as PostgreSQL or Hive.
- Ability to implement data quality checks, testing, monitoring, and pipeline troubleshooting.
Responsibilities
- Design, build, and maintain data pipelines that serve models, data, and AI workflows to internal and client-facing applications.
- Work across database types—relational, vector, and graph—modelling and storing data appropriately for each access pattern.
- Build and maintain dbt models, writing transformation logic, tests, and documentation that ensure data quality and traceability.
- Instrument pipelines with logging, metrics, and tracing, and diagnose/resolve production data issues.
- Write clean, tested, production-quality code and contribute to CI/CD pipelines and infrastructure-as-code.
- Participate in code reviews, design discussions, and retrospectives.
View Full Description & ApplyYou'll be redirected to the employer's site
