Senior Data Engineer
New
J
JobgetherData engineering
The role can be performed remotely from Brazil.Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Fluent English; the original listing references B2 (upper-intermediate) proficiency.
- Experience
- Extensive experience in data engineering
- Required Skills
- PythonSQLApache AirflowGCPAmazon Web ServicesSparkScalaDatabricksPySpark
Requirements
- Have extensive experience in data engineering, distributed processing, and large-scale data pipeline design.
- Demonstrate advanced SQL proficiency, including complex query development and optimization.
- Have experience with relational and non-relational databases, including performance tuning and scalability.
- Have hands-on experience with Google Cloud Platform (GCP) or Amazon Web Services (AWS).
- Have practical experience with Databricks or Apache Flink, orchestration tools such as Apache Airflow or Google Cloud Composer, and streaming services.
- Have hands-on experience with Apache Spark using Scala or PySpark.
- Have good programming skills in Python or Java.
- Have experience designing and implementing scalable Data Lake and Lakehouse architectures.
- Be able to design end-to-end data solutions and make sound technical decisions.
- Be fluent in English; the original listing references B2 (upper-intermediate) proficiency.
- This opportunity is exclusively for people with disabilities (PWD).
Responsibilities
- Design, develop, and maintain scalable data pipelines for large-scale processing and analytics.
- Architect and implement data solutions using distributed processing technologies and cloud platforms.
- Design and optimize advanced SQL queries for analytical environments.
- Manage and optimize relational and non-relational databases using performance tuning and scalability strategies.
- Build and maintain data processing workflows with Apache Spark and Python or Java.
- Implement and optimize Data Lake and Lakehouse architectures.
- Work with Databricks or Apache Flink, orchestration tools, and streaming services.
- Collaborate with technical teams and business stakeholders to define requirements and architectural approaches.
View Full Description & ApplyYou'll be redirected to the employer's site
