Senior DataOps Engineer
New
J
JobgetherData platforms
Based in MexicoFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonMongoDBSparkTerraformDatabricksGitHub Actions
Requirements
- Strong experience supporting production data platforms, cloud infrastructure, or DataOps environments.
- Hands-on experience administering Databricks workspaces, jobs, workflows, compute resources, cluster policies, and access controls.
- Experience supporting Apache Spark, Delta Lake, and Delta Live Tables workloads.
- Strong knowledge of AWS services, including EC2, VPC, IAM, S3, security groups, CloudWatch, and cloud networking.
- Experience with infrastructure as code using Terraform, Terraform Enterprise, or comparable tools.
- Production experience supporting MariaDB/MySQL and MongoDB environments.
- Strong understanding of monitoring, observability, alerting, incident management, and production support practices.
- Experience with CI/CD, Git, GitHub Actions, and scripting with Bash, Python, PowerShell, or similar languages.
- Troubleshooting skills across performance, connectivity, permissions, certificates, TLS, and service integrations.
- Experience with root-cause analysis, post-incident reviews, recovery procedures, and on-call operations.
- Understanding of IAM, role-based access control, secrets management, certificates, and secure connectivity.
- Nice to have: Unity Catalog, Databricks SQL, Databricks CLI, REST APIs, Kubernetes, observability platforms, incident-management platforms, and database administration tools.
Responsibilities
- Administer Databricks workspaces, compute configurations, jobs, workflows, libraries, permissions, and integrations.
- Support Unity Catalog and implement data access governance and data-sharing controls.
- Monitor and troubleshoot Spark jobs, Delta Lake workloads, Delta Live Tables, and data pipelines.
- Maintain secure integrations between Databricks and AWS services, including S3, IAM, and VPC connectivity.
- Support AWS infrastructure and production MariaDB/MySQL and MongoDB environments.
- Build observability solutions with dashboards, logs, metrics, and alerts across platforms and infrastructure.
- Lead production incident investigation, mitigation, recovery, stakeholder communication, and root-cause analysis.
- Develop infrastructure-as-code and automation using Terraform, Git, GitHub Actions, CI/CD pipelines, and scripting languages.
- Manage security controls, secrets, certificates, TLS configurations, service accounts, and IAM roles.
- Collaborate with engineering, analytics, security, infrastructure, database, and application teams on capacity, performance, cost visibility, and resource utilization.
View Full Description & ApplyYou'll be redirected to the employer's site
