Data Engineer (Alteryx | AWS)
New
BrazilFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- SQLApache AirflowApache KafkaNosqlSparkdbtDatabricks
Requirements
- Professional experience working with data engineering projects and pipeline development.
- Experience with Apache Spark, Apache Airflow, Apache Kafka, and dbt.
- Strong knowledge of SQL and NoSQL databases, including PostgreSQL, MongoDB, and Cassandra.
- Experience with cloud data platforms including AWS Glue, Databricks, and BigQuery.
- Experience implementing Data Lake and Data Lakehouse architectures.
- Understanding of data governance, scalability, performance optimization, and cloud-based data processing.
- Ability to analyze existing solutions and adapt them to modern engineering standards.
- Strong problem-solving skills and ability to collaborate in technical environments.
- Familiarity with Data Mesh concepts and distributed data architectures.
Responsibilities
- Maintain scalable and reliable data pipelines using modern distributed processing technologies.
- Migrate existing workflows and code developed in Alteryx to AWS-based solutions using services such as AWS Glue.
- Analyze, rewrite, and restructure existing programs to align with cloud-native development standards.
- Rebuild data pipelines to improve performance, scalability, maintainability, and governance.
- Migrate workflows into a Data Mesh ecosystem and ensure integration with data domains.
- Support orchestration and integration processes across data platforms.
- Develop solutions following best practices for data engineering, architecture, and operational reliability.
- Collaborate with technical teams to optimize data processing and improve platform capabilities.
View Full Description & ApplyYou'll be redirected to the employer's site
