Lead Data & AI Platform Engineer
New
T
TicketmasterData & AI Platform
Remote, United KingdomFull-TimeLead
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonData engineeringSparkCI/CDDatabricksNLPGenerative AIPySpark
Requirements
- Strong hands-on experience with Databricks, Spark/PySpark, Delta Lake, and cloud data platforms.
- Hands-on experience designing and operating Databricks lakehouse architectures.
- Experience building and operating Databricks Genie or comparable natural-language analytics experiences.
- Experience with Databricks governance including Unity Catalog, lineage, and access controls.
- Experience building batch and streaming ingestion pipelines from multiple enterprise systems.
- Experience using Databricks AI capabilities and/or developing AI/ML solutions with Python (NLP, Generative AI, embeddings, vector search).
- Understanding of how to evaluate AI-generated answers for accuracy and business usefulness.
- Experience building analytics and reporting solutions for business and executive users.
- Strong engineering practices including version control, automated testing, CI/CD, DevOps, and performance optimization.
- Proven technical leadership with the ability to independently lead complex initiatives and communicate with stakeholders.
- Experience coaching, mentoring, or managing engineers/data scientists.
Responsibilities
- Lead the architecture and ongoing evolution of the Databricks platform for customer operations, analytics, automation, and AI use cases.
- Design, build, review, and optimize scalable Databricks pipelines that ingest data into trusted, reusable data products.
- Establish clear data architecture, modeling, quality, governance, lineage, access, observability, and reliability standards using Databricks and Unity Catalog.
- Design, build, and improve Databricks Genie spaces, including semantic models and verified queries.
- Apply machine learning, NLP, Generative AI, and operational analytics where they provide clear business value.
- Partner with cross-functional teams to turn business questions into scalable data and intelligence solutions.
- Provide hands-on technical leadership through design reviews, coding, troubleshooting, and optimization.
- Coach, mentor, and manage engineers and data scientists to support their career growth.
View Full Description & ApplyYou'll be redirected to the employer's site
