Analista de Engenharia de Dados Sênior
New
J
JobgetherData Engineering
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonSQLApache AirflowData engineeringSparkCI/CDPySpark
Requirements
- Bachelor's degree or equivalent higher education.
- Solid professional experience with PySpark and distributed data processing frameworks.
- Strong knowledge of Apache Airflow, Apache Spark, and Hadoop where applicable.
- Proficiency in programming languages, particularly Python.
- Hands-on experience with AWS services such as EMR, Lambda, DynamoDB, and S3.
- Good knowledge of SQL databases and data processing concepts.
- Familiarity with DevOps practices, CI/CD pipelines, and modern software delivery processes.
- Strong analytical skills and the ability to translate complex business rules into technical solutions.
- Critical thinking, efficiency, and a mindset oriented toward optimization.
- Clear communication and collaboration skills.
Responsibilities
- Develop and maintain scalable, efficient, and resilient data pipelines using PySpark and distributed processing frameworks.
- Modernize legacy data processes by migrating them to scalable distributed-processing architectures.
- Design and implement data processing solutions within AWS environments.
- Build and evolve Data Products and implement complex data transformations across large-scale datasets.
- Support data quality initiatives by developing monitoring applications, dashboards, and underlying data flows.
- Collaborate with product teams, data analysts, and other stakeholders to translate requirements into effective data solutions.
- Optimize data architectures focusing on performance, governance, scalability, and cost efficiency.
View Full Description & ApplyYou'll be redirected to the employer's site
