Engenheiro de Dados Sênior | IA Generativa, Dados e MDM
New
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLKafkaAzureSparkDatabricksGenerative AIPySpark
Requirements
- Solid experience as a Data Engineer or Senior Data Engineer.
- Strong proficiency in Python for data engineering and AI development.
- Advanced SQL skills for structured data exploration.
- Hands-on experience with Databricks, PySpark, and Apache Spark.
- Proven experience building and maintaining scalable data pipelines.
- Experience with cloud environments, specifically Azure Databricks.
- Knowledge of Gemini and Generative AI solutions.
- Experience with LLMs, AI-powered applications, and intelligent workflows.
- Familiarity with RAG architectures and recommendation systems.
- Experience with near real-time data processing using Kafka.
- Experience with MLOps and deploying ML models.
- Experience with CI/CD pipelines, particularly GitHub and GitHub Actions.
Responsibilities
- Develop, optimize, and maintain scalable data pipelines using Databricks, Spark, and PySpark.
- Integrate, transform, and process customer data across large-scale environments.
- Build and maintain cloud-based Big Data products ensuring scalability and data quality.
- Support initiatives for MDM, data quality, and Golden Record management.
- Design data solutions supporting Generative AI, LLMs, and autonomous intelligent agents.
- Implement RAG architectures and near real-time processing using Kafka.
- Deploy ML models using MLOps practices within Databricks.
- Maintain CI/CD pipelines with GitHub Actions.
View Full Description & ApplyYou'll be redirected to the employer's site
