Pessoa Engenheira de Dados Sênior
New
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLETLKafkaAirflowSparkdbtDatabricks
Requirements
- Strong experience in Data Engineering in cloud, hybrid, or enterprise environments.
- Advanced knowledge of SQL and Python for data processing and pipeline development.
- Hands-on experience with tools such as Spark, Databricks, Airflow, dbt, AWS Glue, Kafka, or equivalent.
- Solid understanding of data lake, lakehouse, and data warehouse architectures.
- Experience with ETL/ELT pipelines, orchestration, monitoring, and failure handling strategies.
- Knowledge of data quality practices, testing, observability, and performance optimization.
- Experience handling multiple data formats and complex integration scenarios.
- Strong understanding of data governance, security, and access control models.
- Experience working with distributed systems and large-scale data environments.
- Strong analytical thinking, organization, and attention to detail.
Responsibilities
- Design, build, and maintain scalable data pipelines across batch, near real-time, and streaming architectures.
- Integrate diverse data sources including APIs, databases, files, logs, and enterprise systems.
- Develop reliable data layers for analytics, AI applications, RAG pipelines, embeddings, and automation workflows.
- Implement robust processes for ingestion, transformation, modeling, validation, monitoring, and optimization of data flows.
- Prepare and optimize datasets for AI systems, including LLMs, semantic search, and agent-based applications.
- Enforce data governance practices such as lineage tracking, data contracts, versioning, and documentation.
- Ensure compliance with security, privacy, LGPD, anonymization, and data masking requirements.
- Collaborate with AI, ML, platform, and product teams to ensure timely, high-quality data delivery.
View Full Description & ApplyYou'll be redirected to the employer's site
