Senior Data Engineer (GCP Cloud)
New
Remote-first role based in BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Advanced English
- Required Skills
- DockerPythonApache AirflowCloud ComputingGCPData engineeringCI/CDBigQuerydbt
Requirements
- Advanced English (mandatory) for meetings, documentation, and stakeholder communication.
- Proven experience working with Google Cloud Platform (GCP) in data engineering contexts.
- Hands-on experience with BigQuery, Cloud Storage, Cloud Composer, and/or Dataflow.
- Strong proficiency in Python for data engineering and backend development.
- Experience with Apache Beam for distributed data processing.
- Experience with Apache Airflow for workflow orchestration.
- Solid understanding of CI/CD practices for data pipelines.
- Experience working with YAML/YML configurations.
- Familiarity with Docker for containerization.
- Hands-on experience with dbt for data transformation and modeling.
- Strong knowledge of version control, testing, documentation, and software engineering best practices.
Responsibilities
- Design, develop, and maintain scalable data pipelines in cloud environments.
- Implement distributed data processing solutions using Apache Beam.
- Orchestrate data workflows and pipelines using Apache Airflow.
- Develop robust Python-based data engineering solutions following best practices.
- Leverage GCP services including BigQuery, Cloud Storage, and Cloud Composer.
- Build and maintain CI/CD pipelines for data workflows and deployments.
- Use YAML/YML configurations to support automation and infrastructure standardization.
- Containerize applications and services using Docker.
- Develop, test, and document data transformation models using dbt.
- Optimize and manage analytical workloads using BigQuery.
View Full Description & ApplyYou'll be redirected to the employer's site
