Senior Data Engineer
New
Latin AmericaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years
- Required Skills
- PythonSQLApache AirflowETLGCPSparkBigQuery
Requirements
- 4+ years working as a Data Engineer in modern cloud environments.
- 2+ years hands-on experience in GCP (BigQuery, Dataflow, Dataform, Composer, Dataproc, Pub/Sub).
- Strong experience with distributed data processing frameworks (Apache Beam / Google Cloud Dataflow, Apache Spark, or Apache Flink).
- Proficiency in Python for pipeline development.
- Proficiency in SQL (Oracle + BigQuery dialects ideal).
- Experience with Apache Airflow for orchestration.
- Experience with big data workloads, batch/streaming pipelines, and large-scale data migrations.
- Experience with data warehousing (BigQuery, Snowflake, Databricks a plus).
Responsibilities
- Design, build, and optimize large-scale distributed data pipelines using Apache Beam / Google Cloud Dataflow, Apache Spark, or Apache Flink.
- Develop ETL/ELT workflows on GCP integrating multiple structured and unstructured data sources.
- Address schema, type conversion, and performance optimization challenges when migrating data warehouses to BigQuery.
- Implement observability, monitoring, logging, and error-handling within pipelines.
- Collaborate with Data Analysts to integrate validation rules, QA checks, and automated testing into the pipeline lifecycle.
- Support large-scale data migrations and performance tuning for high-volume workloads.
View Full Description & ApplyYou'll be redirected to the employer's site
