Mid Level Data Engineer
New
C
CI&TData & AI
BrazilFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Advanced English (B2+)
- Required Skills
- PythonKafkaMicrosoft SQL ServerMySQLAzureData engineeringDatabricksPySpark
Requirements
- Professional experience in Data Engineering.
- Hands-on experience with Databricks and PySpark.
- Experience developing and maintaining data pipelines.
- Solid understanding of Data Lake concepts and data processing.
- Knowledge of Python.
- Experience with Azure.
- Familiarity with Kafka and data streaming/integration concepts.
- Experience working with databases such as MySQL, SQL Server, or Couchbase.
- Advanced English (B2+), with the ability to communicate effectively in meetings and with international teams.
Responsibilities
- Design, develop, and maintain data pipelines using Databricks and PySpark.
- Work with Data Lake environments and modern data engineering practices.
- Develop data ingestion, transformation, and processing workflows.
- Integrate data from different sources and databases.
- Ensure data pipelines are reliable, scalable, and maintainable.
- Work with technologies such as Python, Azure, and Kafka.
- Interact with relational and NoSQL databases, including MySQL, SQL Server, and Couchbase.
- Troubleshoot data pipeline issues and contribute to continuous improvements.
- Collaborate with international teams and stakeholders in an English-speaking environment.
View Full Description & ApplyYou'll be redirected to the employer's site
