Tech./B.E./M.Tech./MCA or equivalent in computer science
3-4 years of experience in Data Engineering
Experience with AWS Stack used for Data engineering EC2, S3, Athena, Redshift, EMR, ECS, Lambda, and Step functions
Experience in Hadoop, Mapreduce, Pig, Spark, Glue
Hands on experience with Python for orchestration of data pipelines and Data engineering tasks
Experience in writing analytical queries using SQL
Experience in Airflow
Experience in Docker
Proficient in in Git
Responsibilities:
Create and maintain various data pipelines for the GroundTruth platform.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
Work with stakeholders including the Product, Analytics and Client Services teams to assist with data-related technical issues and support their data infrastructure needs.
Prepare detailed specifications and low-level design.
Participate in code reviews.
Test the product in controlled, real situations before going live.
Maintain the application once it is live.
Contribute ideas to improve the location platform.