Senior Data & Platform Engineer
New
Based in BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- AWSPostgreSQLPythonSQLApache AirflowKubernetesSnowflakeTerraformdbtDatadog
Requirements
- 5+ years of experience in data engineering or combined data/platform engineering roles.
- Deep expertise in Snowflake, including performance tuning, schema design, access control, and cost optimization.
- Strong hands-on experience with dbt and Apache Airflow, including DAG development, modeling patterns, testing, and troubleshooting.
- Advanced proficiency in SQL and strong Python programming skills for ETL and automation workflows.
- Working knowledge of Kubernetes (EKS), including deployment, debugging, and resource management.
- Strong experience with Terraform for infrastructure provisioning in cloud-based data environments.
- Hands-on experience with Datadog for monitoring, observability, and SLA tracking.
- Familiarity with AWS services such as RDS and S3.
- Experience with CI/CD practices for data engineering workflows and production deployments.
- Strong understanding of data quality, lineage, and cataloging practices.
Responsibilities
- Take full ownership of the data platform’s reliability, ensuring robust performance across ingestion pipelines, transformations, storage layers, and observability systems.
- Design, build, and maintain scalable data pipelines using Apache Airflow, supporting both batch and near-real-time processing workflows.
- Manage and optimize Snowflake data warehouse architecture, including schema design, clustering strategies, access control, and cost governance.
- Develop and maintain dbt transformation models, including incremental processing strategies, dependency management, and documentation standards.
- Deploy and operate platform services on Kubernetes (EKS), managing workloads, debugging production issues, and optimizing resource utilization.
- Provision and manage infrastructure using Terraform across Snowflake, Airflow, and supporting cloud services.
- Write high-quality SQL and Python code for ETL processes, data modeling, and platform automation.
- Manage PostgreSQL operational databases, including query optimization, indexing, replication, and schema migrations.
- Lead implementation of CDC-based ingestion pipelines using tools such as Debezium for real-time data streaming.
- Build and maintain observability, alerting, and SLA monitoring using Datadog across the entire data platform.
View Full Description & ApplyYou'll be redirected to the employer's site
