Senior Data & Analytics Engineer
New
L
Lanter Delivery SystemsLogistics and transportation
Source API remote eligibility restrictions: United StatesFull-TimeSenior
Salary165,000 - 175,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of experience in data engineering, analytics engineering, BI engineering, or a related field.
- Required Skills
- PythonSQLGitSparkDatabricksAzure DevOpsPySpark
Requirements
- Have 5+ years of experience in data engineering, analytics engineering, BI engineering, or a related field.
- Have strong, recent, hands-on experience developing production pipelines with Python and Spark/PySpark.
- Bring advanced SQL skills and hands-on experience with Databricks and Azure Data Lake.
- Have experience with Azure DevOps or comparable technologies.
- Have experience designing integrated enterprise models and dimensional data marts, including grain, keys, conformed dimensions, history, and slowly changing dimensions.
- Have experience implementing automated and regression testing, data-quality controls, and pipeline validation.
- Have experience operating production data solutions, including monitoring, optimization, troubleshooting, recovery, and cost management.
- Have experience with Git, code review, CI/CD, reusable development practices, and technical documentation.
- Be able to translate complex business requirements into scalable data and analytics solutions.
- Experience in logistics, transportation, supply chain, or another operationally complex environment is preferred.
- Experience supporting data governance, AI, or advanced analytics initiatives is preferred.
Responsibilities
- Build and operate ETL/ELT pipelines using Databricks, SQL, Python, Spark/PySpark, and Azure Data Lake.
- Develop an integrated enterprise gold-layer model spanning source systems, customers, and operating companies.
- Build dimensional serving-layer and data-mart models, defining grain, keys, conformed dimensions, historical data, and slowly changing dimensions.
- Implement automated regression testing with defined inputs and expected outputs to validate pipelines and transformations.
- Own orchestration, observability, performance, failure diagnosis, replay and recovery, root-cause fixes, and cost management for assigned production solutions.
- Partner with stakeholders to reconcile business definitions and establish data requirements, rules, ownership, and governance standards.
- Apply engineering practices including Git, code review, reusable components, automated testing, controlled deployments, and technical documentation.
- Develop analytics and reporting solutions using Sigma, Power BI, or comparable platforms.
- Support data initiatives across business units and industry verticals, including AI, operational visibility, and analytics enablement.
- Own deliverables independently and provide technical guidance on complex data and analytics needs.
View Full Description & ApplyYou'll be redirected to the employer's site