Senior Data Engineer, AWS
New
C
CI&TData engineering
Listing location: Brazil; Workplace type: Remote; Structured job location: BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSApache AirflowSparkPySpark
Requirements
- Have solid experience with AWS.
- Work with AWS Glue, EMR, Athena, DynamoDB, Lake Formation, S3, EventBridge, and Redshift.
- Use Apache Spark, PySpark, Airflow, Iceberg or Delta, and lakehouse and data warehouse concepts.
- Apply data contracts and schema evolution.
- Work with data governance and data lineage, including OpenLineage.
- Use CloudWatch and Datadog for governance and monitoring.
- Work with Amazon Bedrock, MCP Server, AI agents, prompt engineering, RAG, embeddings, guardrails, and evaluation.
- Apply spec-driven development, automation, and DevOps practices.
- Balance costs, performance, and scalability.
- Have experience with capacity planning and incident resolution.
Responsibilities
- Develop modern data pipelines and platforms.
- Optimize data pipelines and platforms.
- Evolve modern data pipelines and platforms.
View Full Description & ApplyYou'll be redirected to the employer's site
