Mid Data Engineer
New
J
JobgetherData analytics
Based in BrazilFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- At least three years of experience as a Data Engineer, Analytics Engineer, or in a similar role.
- Required Skills
- PythonSQLETLAgile methodologiesDatabricksPySpark
Requirements
- Hold a bachelor’s degree in Computer Science or a related field.
- Have at least three years of experience as a Data Engineer, Analytics Engineer, or in a similar role.
- Have advanced proficiency in SQL and Python for data transformation, processing, and automation.
- Have practical experience with PySpark and Databricks or other data lake platforms.
- Be familiar with medallion architecture, including bronze, silver, and gold data layers.
- Have experience developing ETL pipelines and supporting machine learning operations.
- Have an understanding of advanced analytics techniques and strong analytical thinking and problem-solving skills.
- Be familiar with Agile methodologies and collaborative development practices.
- Be able to work effectively with technical and non-technical stakeholders.
- Familiarity with Sigma Computing, Qlik or similar data visualization platforms, AI and machine learning frameworks, or R is a plus.
Responsibilities
- Develop, maintain, and optimize Databricks ETL pipelines for data ingestion, integration, and processing.
- Gather requirements with technical teams and business stakeholders and design scalable data solutions.
- Manage the data lifecycle from data lake ingestion through bronze, silver, and gold layers.
- Prepare datasets for reporting and visualization.
- Implement data transformation, processing, and automation logic using SQL, Python, and PySpark.
- Support advanced analytics initiatives and machine learning operations in Databricks.
- Build, maintain, and improve dashboards and reports.
- Investigate data challenges and implement optimization solutions.
View Full Description & ApplyYou'll be redirected to the employer's site
