Senior Databricks Data Engineer
New
J
JobgetherData Engineering
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPostgreSQLKafkaMongoDBAirflowCassandraSparkdbtDatabricks
Requirements
- Solid professional experience in Data Engineering and data architecture.
- Advanced knowledge of Azure Data Factory and Databricks.
- Hands-on experience with Apache Spark and distributed data processing.
- Proven experience building and maintaining both batch and streaming data pipelines.
- Knowledge of orchestration technologies such as Airflow.
- Familiarity with Kafka and dbt.
- Experience working with both SQL and NoSQL databases, including technologies such as PostgreSQL, MongoDB, and Cassandra.
- Knowledge of cloud data platforms and services across AWS and GCP.
- Practical experience with Data Lake and Data Lakehouse architectures.
- Understanding of data governance, quality, and security practices.
- Strong analytical and problem-solving abilities.
- Ability and willingness to mentor other engineers and contribute to technical decision-making.
Responsibilities
- Define and implement Data Engineering solutions that effectively connect business requirements with technology capabilities.
- Design, build, and evolve scalable data architectures, including Data Lake and Data Lakehouse environments.
- Develop and manage robust batch and streaming data pipelines designed for scalability, reliability, and performance.
- Assess and improve processes for data collection, organization, transformation, and availability.
- Ensure data quality, governance, security, and performance throughout the data lifecycle.
- Partner closely with Data and Business teams to support data-driven decision-making and strategic initiatives.
- Help define data strategies and architectural approaches aligned with business objectives.
- Share technical expertise and mentor other Data Engineering professionals, supporting knowledge development across the team.
View Full Description & ApplyYou'll be redirected to the employer's site
