Senior/Lead Data Engineer
New
T
TruelogicAI Software
Location: Mexico CityFull-TimeLead
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLGitSparkdbtDatabricks
Requirements
- Expertise in SQL and dimensional modeling methodologies.
- Proven ability to design idempotent pipelines.
- Extensive experience with production-grade Python engineering.
- Strong capability to diagnose and resolve Spark / PySpark jobs.
- Deep understanding of Delta Lake features.
- Hands-on expertise with dbt.
- Experience authoring and deploying jobs using Databricks Asset Bundles (DAB).
- Experience operating within a Unity Catalog environment.
- Strong adherence to disciplined Git workflows and documentation practices.
- Experience provisioning and utilizing Service Principals and secret management tools.
- Experience leading technical initiatives and establishing architectural standards.
Responsibilities
- Design and build robust, idempotent data pipelines from scratch utilizing a modern data stack.
- Design star and snowflake schemas, writing precise, grain-aware SQL to construct scalable data marts.
- Write production-grade, unit-tested Python code at the module level.
- Build and test dbt models across staging, intermediate, and mart layers.
- Author and deploy jobs using Databricks Asset Bundles (DAB).
- Implement rigorous data quality checks at source, intermediate, and destination layers.
- Maintain data governance through comprehensive dbt tests and strict documentation.
- Operate securely within a multi-repository architecture using service principals.
- Own data pipelines end-to-end and mentor mid-level engineers through code reviews.
- Define overarching technical direction and architectural standards.
View Full Description & ApplyYou'll be redirected to the employer's site
