Senior AWS Data Platform Engineer
New
J
JobgetherCloud data engineering
Work remotely from Brazil.Full-TimeSenior
SalaryFor Brazil, the advertised gross monthly salary is up to R$27,000 BRL
Apply NowOpens the employer's application page
Job Details
- Languages
- Advanced English proficiency at C1 level
- Required Skills
- PythonSQLSparkTerraformPySpark
Requirements
- Demonstrated hands-on experience designing and developing data platforms using AWS services, particularly AWS Glue, EMR, and Lake Formation.
- Strong programming skills in Python and practical experience developing production-grade data engineering solutions.
- Advanced SQL skills and experience building and optimizing complex data pipelines.
- Experience using Apache Spark and PySpark for distributed data processing.
- Hands-on experience implementing Apache Hudi or Apache Iceberg in data platforms.
- Practical knowledge of Terraform and infrastructure-as-code principles for cloud infrastructure automation.
- Understanding of data security, governance, quality assurance, monitoring, and performance optimization.
- Advanced English proficiency at C1 level.
- Experience in financial services or investment banking, Apache Flink or Kafka Streams, and event-driven architectures is an advantage.
Responsibilities
- Design, build, and manage AWS cloud data platforms using services such as AWS Glue, EMR, Lake Formation, EC2, and CloudWatch.
- Develop, maintain, and optimize data pipelines using Python, PySpark, and advanced SQL.
- Implement Apache Hudi or Apache Iceberg to support modern data platform architectures.
- Automate infrastructure provisioning and deployments using Terraform and infrastructure-as-code practices.
- Implement data validation, cleansing, security, governance, and monitoring mechanisms.
- Monitor and optimize data platform performance, scalability, and resource utilization.
- Collaborate with engineering teams and stakeholders to deliver dependable, secure, and scalable data products.
- Contribute to modern data architecture initiatives and continuous improvements in cloud data engineering.
View Full Description & ApplyYou'll be redirected to the employer's site