Elasticsearch Data Engineer
New
C
CapgeminiInsurance Data Engineering
Hyderabad, Telangana, India. Pune, Maharashtra, IndiaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Experience
- At least 5 years of experience as an Elasticsearch Data Engineer
- Required Skills
- AWSPythonElasticSearchETLKubernetesSparkdbt
Requirements
- At least 5 years of experience as an Elasticsearch Data Engineer - ELK (Elasticsearch, Logstash, and Kibana) stack Expert knowledge
- Java Spring Boot
- IBM ACE Programming
- BS in Computer Science, Data Engineering, or similar
- Full English Fluency
- Elasticsearch: cluster optimization, query development, data modeling, performance tuning & administration
- Deep experience with Spark, Python and ETLs and Amazon EMR
- Hands-on experience with DBT for data transformation and modeling
- Apache Airflow, AWS Step Functions, or similar
- Expert knowledge of Amazon S3 and Apache Iceberg for data storage and management
- Experience with Kubernetes
- Experience with Dremio, Looker, or equivalent business view/semantic layer technologies
- AWS Cloud – Intermediate, AWS Lambda, Step Functions, IAM, SNS, API Gateway, VPC, Transit Gateway
Responsibilities
- Design, build, and manage end-to-end data pipelines across the medallion architecture—specifically the bronze, silver (base vault with DBT and orchestration tools, business vault), and gold layers.
- Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation.
- Develop and automate data transformations for the base vault using DBT (Data Build Tool) to standardize and model data efficiently.
View Full Description & ApplyYou'll be redirected to the employer's site
