Data Engineer
New
9
99x BrazilInsurance technology
São Paulo, São Paulo, BrazilFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years of hands-on experience in Data Engineering or related fields
- Required Skills
- AWSPythonApache AirflowETLSnowflakedbtAWS Lambda
Requirements
- Bachelor’s degree in computer science, Information Technology, or a related field.
- 4+ years of hands-on experience in Data Engineering or related fields.
- Experience building and optimizing data pipelines.
- Strong proficiency in Google BigQuery, including query design and optimization, or an equivalent data warehouse such as Snowflake.
- Knowledge of dbt for data transformation and model management.
- Proficiency in Python for scripting, data manipulation, and automation.
- Solid experience with Apache Airflow for workflow orchestration and task automation.
- Extensive experience building and maintaining ETL pipelines.
- Familiarity with AWS, including tools such as S3, Lambda, Redshift, or Glue.
- Knowledge of data warehousing best practices and architecture.
Responsibilities
- Design, develop, and optimize ETL pipelines integrating large data sets from various sources.
- Build and maintain data models using Google BigQuery or Snowflake and dbt.
- Develop Python scripts for data ingestion, transformation, and automation.
- Implement and manage data workflows using Apache Airflow.
- Collaborate with data scientists, analysts, and other stakeholders to support data availability, reliability, and performance.
- Troubleshoot data systems, identify issues, and improve performance.
- Use AWS cloud platforms for data pipeline scalability and storage.
- Ensure data integrity, consistency, and security across systems.
- Own end-to-end data engineering tasks and mentor junior team members.
- Improve data processing and delivery, and contribute to complex data architectures.
View Full Description & ApplyYou'll be redirected to the employer's site
