Data Engineer (Databricks)
New
J
JobgetherFinancial/Agribusiness
BrazilFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PostgreSQLSQLApache AirflowMongoDBApache KafkaCassandraNosqlSparkdbtDatabricks
Requirements
- Experience with Apache Spark for distributed data processing.
- Experience with Apache Airflow for data pipeline orchestration.
- Knowledge of Apache Kafka for real-time data processing and integrations.
- Experience with dbt (Data Build Tool) for data transformation and modeling.
- Experience working with SQL and NoSQL databases, including PostgreSQL, MongoDB, and Cassandra.
- Experience with cloud data platforms such as Databricks, AWS Glue, and BigQuery.
- Knowledge of implementing and maintaining Data Lake and Data Lakehouse architectures.
- Ability to analyze business requirements and translate them into efficient data solutions.
- Strong problem-solving skills and attention to data quality, reliability, and performance.
Responsibilities
- Develop and evolve data platforms focused on commercial credit and agribusiness solutions.
- Design functional and data models aligned with business requirements and technical objectives.
- Build, maintain, and optimize scalable and reliable data pipelines using modern processing technologies.
- Perform data ingestion, transformation, validation, and availability processes while ensuring quality and performance.
- Develop and maintain data architectures based on Data Lake and Data Lakehouse concepts.
- Collaborate with multidisciplinary teams to understand requirements and deliver effective data solutions.
- Apply best practices in data engineering, automation, and pipeline reliability.
- Support continuous improvements in data processing efficiency and platform scalability.
View Full Description & ApplyYou'll be redirected to the employer's site
