Senior Platform Engineer, Data

New

EnsembleHealthcare revenue cycle

Source API remote eligibility restrictions: United StatesFull-TimeSenior

Salary101,600 - 152,400 USD per year

Apply NowOpens the employer's application page

Job Details

Experience: 6+ years of hands-on engineering experience; 3+ years working with Microsoft Azure services in a production environment; 2+ years of hands-on Azure networking experience; 2+ years developing with Apache Spark and Databricks; 4+ years of production SQL development.
Required Skills: PythonSQLMicrosoft AzureSparkTerraformAzure DevOps

Have 6+ years of hands-on engineering experience, with meaningful experience in data engineering and cloud platform or infrastructure domains.
Have 3+ years of production experience with Microsoft Azure services, including ADF, ADLS Gen2, Databricks, Azure Functions, Service Bus, Event Hub, and Azure Monitor.
Have 2+ years of hands-on Azure networking experience with VNets, NSGs, Private Endpoints, Private DNS, service endpoints, and firewall configurations.
Have 2+ years developing with Apache Spark and Databricks, including Delta Lake table design, schema evolution, and performance optimization.
Have 4+ years of production SQL development, including complex transformations, query tuning, indexing, and data modeling.
Have strong Python development skills applied to data engineering, pipeline orchestration, or platform tooling.
Have demonstrated infrastructure-as-code experience; Terraform is preferred, with Bicep or ARM also accepted.
Have hands-on experience building and maintaining CI/CD pipelines in Azure DevOps.
Have experience with event-driven architectures using Azure Service Bus, Event Hub, or equivalent messaging platforms.
Have working knowledge of Azure identity and access management, including Azure AD, Managed Identities, RBAC, and Key Vault.
Have a strong understanding of automated testing, code reviews, telemetry, iterative delivery, and DevOps.
Have a bachelor's degree in Computer Science, Engineering, or Information Systems, or equivalent practical experience.

Design, build, test, deploy, monitor, and improve data pipelines using Azure Data Factory, Databricks, Apache Spark, and Python.
Implement Delta Lake patterns on Azure Data Lake Storage, including table design, schema evolution, Z-ordering, VACUUM, and partition strategies.
Build and maintain event-driven integrations using Azure Service Bus, Event Hub, and Azure Functions.
Provision and manage Azure infrastructure using Terraform, Bicep, or ARM templates.
Design and operate Azure platform services, including Data Factory, Databricks, Data Lake Storage Gen2, Key Vault, and Azure Monitor.
Design and troubleshoot secure Azure networking, including VNets, subnets, NSGs, Private Endpoints, Private DNS Zones, and service endpoints.
Build and maintain Azure DevOps CI/CD pipelines for testing, validation, and deployment of data pipelines, notebooks, and infrastructure code.
Write maintainable Python and SQL; develop automated tests and participate in code and design reviews.
Monitor platform performance, pipeline SLAs, and compute costs; support incident response and continuous improvement.
Partner with data, analytics, data science, and cloud/infrastructure teams, and mentor junior and mid-level engineers.

View Full Description & ApplyYou'll be redirected to the employer's site