Engenheiro de Dados Sênior
New
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years
- Required Skills
- AWSPythonSQLETLSparkData modelingDatabricks
Requirements
- 7+ years of experience in data engineering or related roles within complex, enterprise-grade environments.
- Strong hands-on experience with Databricks ecosystem and its core components (Unity Catalog, Delta Lake, Jobs, Workflows, DLT, SQL Editor).
- Advanced knowledge of Apache Spark for both batch and streaming processing.
- Strong proficiency in Python.
- Solid experience working with AWS cloud services and distributed data architectures.
- Strong understanding of ETL/ELT processes, data modeling (relational and dimensional), and data quality best practices.
- Experience integrating with relational databases such as Db2 and SQL Server via JDBC or similar connectors.
- Proven ability to design and operate scalable, secure, and high-performance data platforms.
- Strong communication skills and ability to collaborate in agile, cross-functional environments.
Responsibilities
- Design, build, and maintain scalable and high-performance data pipelines in cloud environments, ensuring reliability and governance across the full data lifecycle.
- Develop and optimize data processing workflows using Databricks, including Unity Catalog, Delta Lake, Workflows, Jobs, DLT, and SQL-based transformations.
- Implement batch and streaming data solutions using Apache Spark and Python notebooks for ingestion, transformation, and analytics.
- Integrate and manage data from multiple sources, ensuring consistency, quality, and alignment with enterprise data architecture standards.
- Work within AWS-based environments, ensuring secure, scalable, and high-availability data processing solutions.
- Design and support ETL/ELT processes and dimensional and relational data models for analytical and operational use cases.
- Collaborate with cross-functional teams to define data requirements and ensure delivery of high-impact data solutions.
View Full Description & ApplyYou'll be redirected to the employer's site
