Director of Data Engineering
R
Red VenturesData Engineering
Remote - USFull-TimeDirector
Salary$190,000 - $240,000 per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 8-10 years of data or software engineering experience, including 5+ years managing engineering teams and at least 1 year managing managers
- Required Skills
- AWSPythonSQLETLData engineeringSparkScalaDatabricksDistributed Systems
Requirements
- 8-10 years of data or software engineering experience
- 5+ years managing engineering teams
- 1+ years managing managers
- Deep hands-on experience building large-scale Spark applications for batch and streaming workloads
- Experience with modern lakehouse platforms (Databricks or similar)
- Expertise with Spark RDD and DataFrame/Dataset APIs
- Experience with Spark Structured Streaming and SparkSQL
- Strong programming background in Python and/or Scala
- SQL fluency across large-scale datasets
- Hands-on experience with AWS data services (Kinesis, S3, Lambda, DynamoDB)
- Experience with ANSI SQL relational databases (Oracle, SQL Server, Postgres, MySQL)
- Strong grounding in distributed systems and distributed data processing frameworks
Responsibilities
- Lead a team of data engineers and engineering managers building large-scale, real-time data pipelines in Spark
- Act as the primary technical liaison to business leadership, translating trade-offs between technology and business priorities
- Set the multi-year technical direction for Data Engineering and communicate strategy across technical and business audiences
- Partner with data scientists, analysts, and business stakeholders to turn requirements into data products
- Represent Data Engineering in cross-functional and executive planning
- Set architectural direction and standards for data movement, from streaming ingestion through ETL to analytics
- Manage and develop data engineering managers, building growth paths and providing direct coaching
View Full Description & ApplyYou'll be redirected to the employer's site
