Senior Data & Platform Engineer
New
T
TruelogicVeterinary Technology
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- AWSPostgreSQLPythonSQLApache AirflowKubernetesSnowflakeTerraformdbtDatadog
Requirements
- 5+ years of experience in data engineering or a combined data and infrastructure role.
- Proven track record of building production-grade data platforms from the ground up.
- Deep expertise in Snowflake, including schema design, performance tuning, access control, and advanced cost optimization.
- Strong, hands-on experience with dbt (modeling patterns, incremental strategies, testing).
- Strong, hands-on experience with Airflow (writing DAGs, managing dependencies, debugging).
- Advanced proficiency in SQL and solid programming skills in Python for ETL and automation.
- Working knowledge of Kubernetes, with the ability to deploy workloads, read pod logs, and manage Helm charts independently.
- Extensive experience using Terraform for infrastructure provisioning.
- Hands-on experience with Datadog for observability, monitoring, and SLA visibility.
- Familiarity with AWS data-adjacent services like RDS and S3.
- Fluency in utilizing AI-based development assistants for code development and debugging.
Responsibilities
- Take end-to-end ownership of the data platform's reliability, encompassing pipelines, warehousing, transformations, and observability.
- Design, build, and maintain robust data pipelines using Apache Airflow, orchestrating complex workflows across batch and near-real-time workloads.
- Manage and optimize the primary Snowflake data warehouse, handling schema design, clustering keys, materialized views, access controls, and strict cost governance.
- Build and maintain the dbt transformation layer, including model design, incremental strategies, dependency management, and documentation.
- Deploy and operate data platform services on Kubernetes (EKS), independently managing workloads, debugging pod issues, and tuning resource requests.
- Provision and manage data platform infrastructure, including Snowflake resources and Airflow, utilizing Terraform.
- Write high-quality SQL and Python for ETL tooling, pipeline logic, and data product delivery.
- Manage PostgreSQL as a source-of-truth operational database, focusing on query optimization, indexing, replication, and migrations.
- Lead the transition toward change data capture (CDC) for data ingestion, utilizing tools like Debezium.
- Implement comprehensive observability, SLA tracking, and alerting across the data platform using Datadog.
View Full Description & ApplyYou'll be redirected to the employer's site
