Senior Data Engineer (AWS)
New
C
CapnexusRetail Software
USAContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of hands-on data engineering experience with at least 2+ years in AWS cloud environments.
- Required Skills
- AWSPythonSQLTerraformGitHub ActionsAWS LambdaPySpark
Requirements
- 5+ years of hands-on data engineering experience.
- 2+ years of experience in AWS cloud environments.
- Strong proficiency in Python and SQL.
- Hands-on PySpark or Scala coding experience for AWS Glue ETL.
- Proven experience with AWS Glue, AWS Step Functions, AWS Lambda, and Amazon S3.
- Proficiency with AWS Lambda Powertools.
- Working knowledge of Apache Iceberg table format.
- Hands-on experience with Terraform, AWS CloudFormation, or AWS CDK.
- Experience with AWS Lake Formation for access control.
- Solid understanding of DynamoDB data modeling and DAX.
- Experience with Amazon Athena performance tuning.
- Experience with GitHub Actions or equivalent CI/CD tooling.
Responsibilities
- Design and implement a multi-zone enterprise data lake on Amazon S3.
- Build batch and streaming data ingestion pipelines using AWS Glue, Amazon Kinesis, and containerized applications.
- Write PySpark and Python ETL code for AWS Glue jobs using Apache Iceberg.
- Implement data governance with AWS Lake Formation including table and column-level permissions.
- Provision AWS data infrastructure as code using Terraform, CloudFormation, or CDK.
- Integrate CI/CD pipelines using GitHub Actions for automated deployment.
- Develop and deploy AWS Lambda functions using AWS Lambda Powertools.
- Design entity resolution pipelines to deduplicate and merge customer records.
- Support Azure-to-AWS data lake migrations using AWS DataSync.
View Full Description & ApplyYou'll be redirected to the employer's site
