Senior Data Engineer
New
J
JobgetherInformation Technology
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Fluent English (B2 level or higher)
- Required Skills
- PythonSQLApache AirflowCloud ComputingJavaData engineeringSparkDatabricks
Requirements
- Advanced experience in Data Engineering fundamentals, including distributed processing and large-scale pipeline design.
- Strong proficiency in SQL, including advanced query optimization techniques.
- Experience with relational and non-relational databases, including performance tuning and scalability strategies.
- Hands-on experience with at least one major cloud platform, such as Google Cloud Platform or Amazon Web Services.
- Practical experience with modern data stack technologies, including distributed processing frameworks such as Databricks or Apache Flink.
- Experience with orchestration tools such as Apache Airflow, Composer, or similar technologies.
- Strong programming experience in Python or Java.
- Experience designing and implementing scalable Data Lake and Lakehouse architectures.
- Ability to design data architectures and provide strategic technical guidance.
- Strong analytical thinking and ability to solve complex technical challenges.
- Fluent English skills (B2 level or higher), with confidence communicating in technical and business discussions.
- Ability to collaborate effectively in diverse, distributed, and cross-functional teams.
Responsibilities
- Design and develop scalable data architectures, including Data Lake and Lakehouse solutions.
- Build, maintain, and optimize large-scale data pipelines for distributed processing environments.
- Apply advanced SQL techniques to develop efficient queries and improve analytical workloads.
- Work with relational and non-relational databases, applying performance tuning and scalability strategies.
- Develop and maintain data processing solutions using technologies such as Apache Spark with Scala or PySpark.
- Implement and improve data workflows using modern orchestration tools and frameworks.
- Work with cloud platforms to design reliable and scalable data solutions.
- Support the implementation of streaming and real-time data processing capabilities.
- Analyze business and technical requirements to translate them into effective data solutions.
- Collaborate with technical and business stakeholders, communicating solutions clearly in English.
View Full Description & ApplyYou'll be redirected to the employer's site
