Lead Data Engineer
New
MassachusettsFull-TimeLead
Salary120,000 - 130,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Project ManagementPythonSQLAgileArtificial IntelligenceGitCI/CDBigQueryLLM
Requirements
- Proven expertise in leading data engineering teams through technical authority.
- Fluency with the GCP data stack including BigQuery, Dataflow, and Cloud Storage.
- Advanced skills in BI tools and SQL for building effective data models and dashboards.
- Expert in Python and experience with TDD and modular testing strategies.
- Competence in Git and CI/CD pipeline design with automated testing.
- Experience integrating AI and LLM tools into engineering practices.
- Strong project management and Agile methodology experience.
- Excellent communication skills for diverse audiences, from stakeholders to engineers.
Responsibilities
- Set the technical direction for the data platform — define architecture, standards, and roadmap.
- Architect the data platform end-to-end using BigQuery, Dataflow, airflow, and others.
- Establish standards for data modeling and serving across tools and dashboards.
- Mentor data engineers and analysts through technical challenges and skill development.
- Champion best engineering practices including TDD, modular testing, and CI/CD pipelines.
- Optimize costs and performance by addressing slow queries and improving data handling.
- Leverage AI tools to enhance research, code reviews, and engineering workflows.
- Create documentation and teach methodologies that contribute to long-term team success.
View Full Description & ApplyYou'll be redirected to the employer's site
