- Utilize Java, including Spring Boot, to build robust and high-performance data processing services within our data platform
- Implement real-time data streaming solutions using Kafka, ensuring timely data ingestion and availability
- Collaborate closely with cross-functional teams to comprehend data requirements, identify opportunities for data optimization, and support data-driven initiatives
- Lead the design, development, and maintenance of efficient and scalable data pipelines, facilitating data collection, processing, and transformation from diverse sources
- Leverage AWS services for data storage, processing, and analytics, adhering to security and performance best practices
- Monitor and troubleshoot service performance, proactively identifying bottlenecks and implementing optimizations
- Uphold data integrity, reliability, and availability by implementing effective ETL processes and conducting data quality checks
AWSPythonETL+7 more