Staff Data Platform Infrastructure Engineer - Technology

Posted 1 day agoViewed
São PauloFull-TimeData Platform
Company:Truelogic
Location:São Paulo
Languages:English
Seniority level:Principal, 10+ years
Experience:10+ years
Skills:
AWSPythonSQLApache AirflowCloud ComputingETLGCPJenkinsKubernetesSnowflakeCI/CDTerraformData modelingSoftware Engineering
Requirements:
Relevant Bachelor degree or other equivalent Software Engineering background. 10+ years of experience as an infrastructure / data platform / big data software engineer. Experience with AWS/GCP cloud services such as GCS/S3, Lambda/Cloud Function, EMR/Dataproc, Glue/Dataflow, Athena. IaC design and hands-on experience. Familiarity designing CI/CD pipelines with Jenkins, Github Actions, or similar tools. Experience in designing, building and maintaining enterprise systems in a big data environment on public cloud. Strong SQL abilities and hands-on experience with SQL, performing analysis and performance optimizations. Hands-on experience in Python or equivalent programming language. Experience with administering data warehouse solutions (like Bigquery/ Redshift/ Snowflake). Experience with data modeling, data catalog concepts, data formats, data pipelines/ETL design, implementation and maintenance. Experience with Airflow and DBT - advantage Experience with Kubernetes using GKE or EKS - advantage.. Experience with development practices – Agile, TDD - advantage.
Responsibilities:
Design and build a highly scalable data platform to support data pipelines for diversified and complex data flows. Track and identify relevant new technologies in the market and push their implementation into our pipelines through research and POC activities. Deliver scalable, reliable and reusable data solutions. Leading, building and continuously improving our data gathering, modeling, reporting capabilities and self-service data platforms. Working closely with Data Engineers, Data Analysts, Data Scientists, Product Owners, and Domain Experts to identify data needs. Develop processes and tools to monitor, analyze, maintain and improve data operation, performance and usability.
Similar Jobs:
Posted about 3 hours ago
BrazilFull-TimeHospitality / Marketplace
Remote - Senior QA Automation Engineer - Hospitality / Marketplace - Brazil
Company:Truelogic
Posted about 4 hours ago
BrazilFull-TimeSoftware Development
Staff Engineer
Company:RecargaPay
Posted about 6 hours ago
United States, Latin America, IndiaFull-TimeData Strategy
Senior Consultant, AI & Data Strategy
Company:phData