Senior GenAI Data Engineer
E
EnrouteAdvertising Technology
Mexico. Argentina. PeruFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- SQLCI/CDData modelingDatabricksPrompt EngineeringLangChain
Requirements
- Advanced experience with Databricks Lakehouse architecture.
- Strong proficiency in advanced SQL development and data modeling.
- Hands-on experience building RAG (Retrieval-Augmented Generation) pipelines using Vector Search.
- Experience integrating LLM APIs (e.g., OpenAI, Anthropic) into data workflows.
- Practical experience using AI for data enrichment, anomaly detection, and automated classification.
- Proficiency with LLM orchestration frameworks such as LangChain or LlamaIndex.
- Strong understanding of Tool Calling/Function Calling for secure LLM interaction with SQL databases and APIs.
- Experience with Prompt Engineering and guardrailing techniques.
- Nice to have: Expertise in Databricks Mosaic AI and Unity Catalog.
- Nice to have: Experience with GitHub workflows and CI/CD pipelines (e.g., Jenkins).
- Nice to have: Proficiency with YAML configuration files.
Responsibilities
- Architect and deploy AI agents for NLP-based data generation, automated data enrichment, and complex data reasoning within Databricks.
- Develop "Chat with your Data" features to enable natural language querying of the data warehouse.
- Integrate LLMs into data workflows to drive automation and intelligence.
- Develop scalable data models to support analytics and AI use cases.
- Implement AI-driven enhancements for data quality, such as anomaly detection and enrichment.
- Collaborate with cross-functional teams to improve data reliability.
- Optimize the performance and scalability of data and AI workflows.
- Support automation efforts through CI/CD practices and ensure pipeline traceability.
View Full Description & ApplyYou'll be redirected to the employer's site
