Software Engineer (Data Platform)
New
IndiaFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 4–6 years
- Required Skills
- AWSPythonETLJavaKafkaGoSparkLinux
Requirements
- 4–6 years of professional software engineering experience building scalable backend or data-intensive systems.
- Strong experience in cloud-native development, particularly on AWS environments.
- Proficiency in Java and GoLang, with working knowledge of Python.
- Hands-on experience with large-scale data platforms, including data lake ingestion, storage, and query systems.
- Experience working with distributed systems and streaming technologies such as Kafka and Apache Spark.
- Familiarity with Apache Hudi is highly preferred, along with AWS services such as EKS, S3, Glue, and Athena.
- Strong understanding of system design principles including APIs, authentication, messaging, logging, monitoring, and testability.
- Experience with large-scale ETL pipelines and data processing workflows.
- Strong Linux/Unix troubleshooting skills in distributed cloud environments.
- Bachelor’s degree in Computer Science or related field.
Responsibilities
- Design, build, and enhance scalable data frameworks and backend services powering next-generation platform capabilities in a large distributed environment.
- Develop and optimize high-throughput data pipelines for ingestion, processing, storage, and querying of security-related data at scale.
- Participate in architecture discussions, technical design reviews, and planning sessions with engineering and architecture teams.
- Collaborate with operations and site reliability teams to ensure systems are production-ready, observable, resilient, and maintainable.
- Contribute to platform evolution by improving standards around performance, security, reliability, and operational excellence.
- Support development of frameworks enabling advanced analytics and automated threat detection capabilities.
View Full Description & ApplyYou'll be redirected to the employer's site