Senior Data Platform and Automation Engineer
New
J
JobgetherData platforms
Based in BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 6+ years of experience in software engineering, data engineering, or equivalent demonstrated technical expertise; 6+ years of hands-on experience with Python, SQL, distributed processing, data modeling, and modern data engineering frameworks.
- Required Skills
- PythonSQLSparkCI/CDData modelingDatabricks
Requirements
- Bachelor's degree in Computer Science, Data Engineering, Software Engineering, or a related STEM field, or a Bachelor's degree combined with a Master's or higher qualification in STEM.
- 6+ years of experience in software engineering, data engineering, or equivalent demonstrated technical expertise.
- 6+ years of hands-on experience with Python, SQL, distributed processing, data modeling, and modern data engineering frameworks.
- Strong experience with cloud data platforms and data governance capabilities, including data catalogs, metadata, lineage, data quality, and access controls.
- Practical experience with Databricks, Unity Catalog, Data Lake, Apache Spark, or comparable technologies.
- Experience implementing CI/CD pipelines, automated testing, environment separation, and production deployments.
- Experience developing secure APIs, MCP servers, or tools for enterprise and AI-enabled applications.
- Strong understanding of enterprise identity, RBAC, service accounts, secrets management, authorization, and least-privilege security.
- Demonstrated full-lifecycle engineering experience covering architecture, development, deployment, production support, and operational improvement.
- GitLab CI/CD or comparable tooling is a plus.
- Knowledge of policy-as-code, infrastructure-as-code, and configuration-driven platform approaches is desirable.
- Experience building data marketplaces, governance platforms, internal developer platforms, or similar enterprise capabilities is advantageous.
Responsibilities
- Architect and develop secure, scalable data platform and governance automation capabilities using reusable, configuration-driven patterns.
- Build automated controls for metadata, data ownership, lineage, data quality, access management, and policy enforcement.
- Implement enterprise security capabilities, including identity management, authorization, role-based access control, least privilege, auditability, service accounts, and credential management.
- Develop secure APIs, MCP tools, and integrations for enterprise and AI-enabled applications.
- Design and maintain automated validation, testing, deployment, and monitoring processes across development and production environments.
- Establish observability for platform health, data quality, governance policies, system failures, and operational performance.
- Own production-quality code, automated tests, technical documentation, and operational guidance throughout the software and data engineering lifecycle.
- Collaborate with domain experts, product managers, governance teams, and engineers to translate requirements into reliable platform services.
- Contribute to architecture decisions, technical standards, and continuous improvement; mentor engineers and provide technical guidance.
- Support production environments and troubleshoot issues across architecture, development, deployment, and ongoing operations.
View Full Description & ApplyYou'll be redirected to the employer's site
