Engenharia de Dados (Databricks)
New
J
JobgetherData Engineering
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLCloud ComputingETLDatabricksPySpark
Requirements
- Solid professional experience as a Senior Data Engineer.
- Strong hands-on expertise with Databricks and cloud-based data architecture.
- Proven experience designing, developing, and evolving data pipelines.
- Strong knowledge of ETL/ELT processes and large-scale data processing.
- Professional experience with Python and PySpark/Spark.
- Solid SQL skills.
- Experience with Delta Lake and Lakehouse architecture.
- Knowledge of Databricks Workflows/Jobs and data pipeline orchestration.
- Understanding of best practices related to performance optimization, data governance, monitoring, and solution maintenance.
- Hands-on and autonomous profile, with the ability to take ownership of technical challenges and drive solutions forward.
- Strong analytical and problem-solving skills, with a continuous improvement mindset.
Responsibilities
- Design, develop, and continuously evolve scalable data solutions within cloud environments.
- Build, maintain, and optimize data pipelines for processing and transforming large volumes of data.
- Use Databricks, Python, PySpark/Spark, SQL, Delta Lake, and Lakehouse architecture to deliver robust data engineering solutions.
- Develop and manage Databricks Workflows and Jobs, ensuring effective pipeline orchestration.
- Apply best practices for data performance, governance, monitoring, reliability, and operational support.
- Analyze technical and business requirements and translate them into sustainable, high-quality data solutions.
- Identify opportunities to improve architecture, processes, automation, and overall efficiency.
- Work autonomously while collaborating with data and technology teams to evolve the organization's data capabilities.
View Full Description & ApplyYou'll be redirected to the employer's site
