Senior AWS Data Engineer - Databricks
New
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years of professional experience in Data Engineering
- Required Skills
- AWSPythonSQLData modelingDatabricks
Requirements
- 4+ years of professional experience in Data Engineering, including proven experience in senior-level roles.
- Strong hands-on experience with Databricks, preferably with at least 3 years working on enterprise-scale implementations.
- Advanced knowledge of AWS cloud services and Databricks integration within AWS environments.
- Solid expertise in data modeling, Delta Lake architecture, data warehousing concepts, and ETL/ELT processes.
- Advanced proficiency in Python and SQL for large-scale data processing and transformation.
- Experience designing and implementing distributed data architectures and high-performance processing pipelines.
- Practical experience with data mapping, migration projects, and integration of legacy or heterogeneous data sources.
- Ability to independently lead end-to-end technical deliveries and make sound architectural and engineering decisions.
- Strong focus on scalability, performance optimization, governance, security, and data quality.
- Excellent communication, collaboration, and stakeholder management skills.
- Strong analytical thinking and problem-solving capabilities in complex technical environments.
Responsibilities
- Analyze and map data sources, identifying structures, relationships, business rules, and integration requirements.
- Lead the migration of raw and legacy data into Databricks environments, ensuring data integrity, traceability, and quality throughout the process.
- Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, Delta Lake, Python, SQL, and AWS services.
- Implement business rules and data transformations required to support operational and regulatory reporting processes.
- Build, validate, and optimize regulatory reports while ensuring compliance with established standards, controls, and deadlines.
- Contribute to data architecture decisions and support the design of modern cloud-based data solutions within the AWS and Databricks ecosystem.
- Ensure compliance with governance, security, privacy, and data quality standards across all stages of the data lifecycle.
- Troubleshoot and resolve complex technical issues related to data platforms, pipelines, and cloud infrastructure.
- Provide technical leadership, mentoring, and knowledge sharing to less experienced team members.
- Collaborate closely with business stakeholders, regulatory teams, and multidisciplinary technical teams to deliver high-quality solutions.
View Full Description & ApplyYou'll be redirected to the employer's site
