Senior DataOps Engineer
O
OportunFinancial services
Location: Remote - MXFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSMongoDBMySQLSparkTerraformDatabricksGitHub Actions
Requirements
- Bring strong experience supporting production data platforms, cloud infrastructure, or DataOps environments.
- Have hands-on experience administering Databricks workspaces, jobs, workflows, compute, cluster policies, and access controls.
- Have experience supporting Spark, Delta Lake, and Delta Live Tables workloads.
- Bring strong experience with AWS services including EC2, VPC, IAM, S3, security groups, CloudWatch, and networking.
- Have experience with infrastructure as code using Terraform and Terraform Enterprise or similar tools.
- Have experience supporting MariaDB/MySQL and MongoDB in production environments.
- Understand monitoring, observability, alerting, and incident-management practices.
- Have experience with CI/CD, Git, GitHub Actions, and automation using Bash, Python, PowerShell, or similar scripting languages.
- Be experienced troubleshooting platform performance, connectivity, permissions, certificates, TLS, and integration issues.
- Have experience with production support, root-cause analysis, post-incident reviews, and on-call operations.
- Understand IAM, RBAC, secrets management, certificates, and secure connectivity.
- Communicate and collaborate across Data Engineering, Analytics, Security, Infrastructure, Database, and application teams.
Responsibilities
- Administer Databricks workspaces, cluster policies, compute configurations, jobs, workflows, libraries, service principals, permissions, and integrations.
- Support Unity Catalog access governance, catalog and schema permissions, and secure data sharing.
- Monitor and troubleshoot Delta Live Tables, Spark jobs, Delta Lake workloads, and data pipelines.
- Maintain secure Databricks integrations with AWS services, including S3, IAM, networking, and external data sources.
- Support AWS infrastructure used by the data platform, including EC2, VPC, IAM, security groups, networking, patching, and operational access.
- Support MariaDB/MySQL and MongoDB environments, including monitoring, backups, performance troubleshooting, and recovery.
- Build and maintain monitoring, dashboards, logs, metrics, and alerts across platform services.
- Lead production incident investigation, mitigation, recovery, communication, and root-cause analysis during on-call support.
- Build and maintain infrastructure automation using Terraform, Git, GitHub Actions, CI/CD pipelines, and scripting.
- Improve operational readiness through runbooks, recovery procedures, architecture diagrams, standards, escalation paths, and documentation.
View Full Description & ApplyYou'll be redirected to the employer's site
