Senior Data Engineer
New
N
NextechHealthcare technology
100% Remote in the United StatesFull-TimeSenior
SalaryGenerous annual bonus opportunity
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years of production experience in data engineering roles
- Required Skills
- PythonMicrosoft SQL ServerAzureSparkDatabricksPySpark
Requirements
- Have 7+ years of production experience in data engineering, including building and maintaining data pipelines at scale.
- Demonstrate advanced proficiency with Python and PySpark or Apache Spark in production data engineering environments.
- Have hands-on production experience with Databricks, Microsoft Fabric, or comparable modern data platforms.
- Have designed, implemented, and operated lakehouse architectures using Delta Lake, Parquet, or equivalent technologies.
- Have experience designing AI-ready schemas, semantic layers, or metadata structures for downstream AI or machine learning query patterns, or building automated validation for programmatically generated queries.
- Have experience with agentic or automation-driven data quality workflows, such as AI-assisted reconciliation or agent-grounded semantic layers.
- Demonstrate the ability to partner directly with product, analytics, finance, or business stakeholders to shape data requirements.
- Be familiar with Microsoft Azure concepts, including PaaS, IaaS, Azure SQL, and hybrid cloud models.
- Be willing and able to develop deeper operational expertise in Azure SQL and SQL Server environments.
- Have meaningful experience mentoring junior or mid-level engineers on technical standards, architecture patterns, and data engineering practices.
- Preferred: production experience with Azure SQL, SQL Server, or Azure SQL Managed Instance; T-SQL and PowerShell; or infrastructure-as-code tools such as Terraform, Bicep, or Azure Resource Manager templates.
- Preferred: familiarity with streaming data technologies such as Azure Event Hubs or Apache Kafka, data mesh principles, regulated industries, HIPAA, FHIR, or HL7.
Responsibilities
- Design and build data pipelines and lakehouse solutions using Databricks, Microsoft Fabric, PySpark, and Python.
- Design AI-ready schemas, semantic layers, and metadata structures for reliable AI agent queries.
- Build automated validation processes for agent-generated queries.
- Pilot agentic automation for data quality and reconciliation workflows, measuring accuracy and maintaining rollback plans.
- Curate and maintain the semantic layer that grounds AI agents and reduces errors caused by ambiguous data.
- Catalog and steward enterprise data assets for analytics, financial planning, and product engineering.
- Partner with Product Engineering, FP&A, and other stakeholders to identify data requirements.
- Troubleshoot performance issues and support SQL Server and Azure SQL environments.
- Mentor junior engineers on data engineering practices, architecture patterns, and technical standards.
- Contribute to data protection, security, and compliance reviews, including HIPAA requirements where relevant.
View Full Description & ApplyYou'll be redirected to the employer's site
