Senior Data Engineer
New
C
Climb Group, Inc.Data and AI
United States (Remote)Full-TimeSenior
SalaryCompetitive base salary with performance-based bonuses
Apply NowOpens the employer's application page
Job Details
- Experience
- 6+ years
- Required Skills
- SQLCloud ComputingData engineeringSparkCI/CDData modelingDatabricksPySpark
Requirements
- 6+ years in data engineering or analytics engineering.
- Advanced experience building production data pipelines with Apache Spark (PySpark and SQL), including performance optimization.
- Hands-on production experience with Databricks (Delta Lake, Jobs, Workflows, Unity Catalog).
- Deep experience with at least one major cloud (AWS, Azure, or GCP).
- Strong SQL and data modeling fundamentals.
- Track record of building and operating production-grade data pipelines.
- Ability to work directly with client stakeholders to translate business requirements.
- Demonstrated ability to independently own a data engineering workstream from design through production.
Responsibilities
- Own one or more data engineering workstreams from technical design through production deployment and handoff.
- Design and implement scalable data models and lakehouse architectures.
- Optimize performance and cost across Databricks and the underlying cloud infrastructure.
- Orchestrate workflows using Databricks Workflows, Delta Live Tables, or equivalent tooling.
- Implement governance, security, observability, and lineage with Unity Catalog, and stand up CI/CD for data.
- Design and build AI-ready data platforms that enable reliable analytics and machine learning.
- Work directly with client stakeholders to gather requirements and translate them into technical solutions.
- Review code, mentor junior engineers, and maintain engineering standards.
- Contribute reusable accelerators, frameworks, and best practices back to the practice.
View Full Description & ApplyYou'll be redirected to the employer's site
