Pessoa Engenheira de Dados Pleno
New
J
JobgetherData engineering
Based in BrazilFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonSQLApache AirflowGCPGitAzureData engineeringTerraform
Requirements
- Bachelor’s degree in Systems Analysis and Development, Computer Science, Computer Engineering, or a related field.
- Advanced SQL and Python skills.
- Practical professional experience in data engineering and building data pipelines.
- Experience integrating data sources and systems, including databases, APIs, and SFTP.
- Experience with workflow orchestration tools, preferably Apache Airflow.
- Familiarity with Git-based version control, preferably GitFlow.
- Hands-on experience with Terraform.
- Experience with cloud environments such as AWS, Azure, or GCP.
- Experience troubleshooting and using logging, alerts, and data pipeline monitoring.
- Understanding of DataOps principles, CI/CD practices, and data modeling.
- Strong analytical and problem-solving skills, with attention to data quality and system reliability.
- Good communication and collaboration skills, including the ability to support and guide junior professionals.
Responsibilities
- Develop and evolve the data platform by designing and implementing end-to-end data pipelines.
- Define and implement automated data testing practices to improve data quality and optimize processing and storage performance.
- Establish observability and monitoring practices, investigate incidents, and troubleshoot pipeline issues.
- Participate in data architecture decisions covering storage models, integrations, scalability, and platform design.
- Develop and maintain batch and streaming data ingestion processes.
- Support junior team members by sharing knowledge and providing technical guidance.
- Ensure compliance with data security and governance policies.
- Monitor pipeline performance, interpret system alerts, and proactively identify potential issues.
- Improve data engineering practices, reliability, and operational efficiency.
View Full Description & ApplyYou'll be redirected to the employer's site
