Data Engineer

New
C
CI&TData & AI
BrazilFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Required Skills
PythonSQLAzureCI/CDDatabricksAzure DevOpsPySpark

Requirements

  • Professional experience in Data Engineering.
  • Experience with Microsoft Azure.
  • Experience with Databricks and PySpark.
  • Solid knowledge of Python and SQL.
  • Experience with ETL/ELT processes.
  • Knowledge of conceptual, logical, and physical data modeling.
  • Experience with Azure Data Factory (ADF), Azure Data Lake Storage, Synapse, and Spark.
  • Knowledge of Git/GitHub and Azure DevOps.
  • Knowledge of CI/CD practices.
  • Experience with data integration and processing.

Responsibilities

  • Develop and maintain ETL/ELT pipelines.
  • Implement integrations between different data sources.
  • Develop and optimize conceptual, logical, and physical data models.
  • Support cloud data migration and integration projects.
  • Implement data quality, monitoring, and governance practices.
  • Automate data engineering and deployment processes.
  • Document processes, solutions, and best practices.
  • Collaborate with technical, business, and data science teams.
  • Adhere to data architecture standards.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now