Lead Data Engineer - AWS
New
T
Tiger AnalyticsData analytics
Workable workplace: remote; Workable locations: Dallas, Texas, United StatesFull-TimeLead
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 8-12 years in Data Engineering
- Required Skills
- PythonSQLTerraformLangChain
Requirements
- Bring 8-12 years of experience in Data Engineering, with a heavy focus on the AWS Cloud stack.
- Have deep hands-on experience with AWS Glue, Athena, EMR, and Redshift.
- Be proficient in LangChain or LlamaIndex integrated with AWS services to handle unstructured text, images, and PDFs.
- Have experience deploying infrastructure using AWS CDK or Terraform.
- Demonstrate advanced SQL, Python, and PySpark skills tailored to distributed processing on AWS.
Responsibilities
- Architect data pipelines using Amazon Bedrock and Amazon SageMaker to build, deploy, and scale Generative AI applications.
- Implement and optimize vector search capabilities using Amazon OpenSearch Serverless or specialized vector engines for RAG.
- Build scalable, event-driven ETL pipelines using AWS Lambda, AWS Glue, and Amazon Kinesis.
- Manage large-scale data lakehouses leveraging Amazon S3, AWS Lake Formation, and Amazon Redshift.
- Integrate AWS Step Functions and SageMaker Pipelines to automate foundation-model fine-tuning and deployment.
View Full Description & ApplyYou'll be redirected to the employer's site
