Senior Data Engineer (SQL, Python, Java) - Banking

View full description

Requirements:

• 8+ years' experience as a data engineer or similar role.
• Proficiency in SQL, Python, Java and/or other programming languages for data processing and manipulation.
• Experience with relational and NoSQL databases, OLAP tools, vector stores (PGVector, FAISS, Chroma) and data modeling concepts.
• Strong understanding of distributed computing frameworks (e.g., Apache Spark, Apache Flink, Apache Storm).
• Familiarity with data visualization tools and strong experience with data pipeline tools and metadata stores (Informatica).
• Understanding of data and query optimization, query profiling, and query performance monitoring tools and techniques.
• Solid understanding of ETL/ELT processes, data validation, and data security best practices.
• Experience in version control systems (Git) and CI/CD pipelines.
• Familiarity with cloud-based data platforms will be a plus.

Responsibilities:

• Collaborate with business stakeholders and PO to understand data requirements and translate them into technical solutions.
• Implement data models and schemas to support analytics, reporting, and machine learning initiatives.
• Optimize data processing and storage solutions for performance, scalability, and cost-effectiveness.
• Ensure data quality and integrity by implementing data validation, monitoring, and error handling mechanisms.
• Collaborate with data analysts and data scientists to provide them with clean, reliable, and accessible data for analysis and modeling.
• Stay current with emerging technologies and best practices in data engineering and recommend innovative solutions to enhance our data capabilities.
• Provide Production L3 support as required.