Member of Staff, Regulatory Software Engineering (Remote)

View full description

Requirements:

• Strong proficiency in Java (Java 8+ preferred) with a focus on data-related frameworks and libraries (e.g., Apache Kafka, Spark, Avro).
• Experience in handling large datasets, including data cleaning, transformation, and aggregation techniques.
• Proficiency in working with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB) and an understanding of database design principles.
• Familiarity with BI tools like Tableau, Power BI, or Looker to create and manage reports and visualizations.
• Experience working with cloud platforms (e.g., AWS, Azure) for data storage and processing is a plus.
• Strong analytical and problem-solving skills to derive insights from data and enhance data processing workflows.

Responsibilities:

• Design, build, and optimize data pipelines and workflows to process, clean, and transform data using Java.
• Work with various data sources (SQL, NoSQL, cloud data storage) and build integrations to unify data for reporting and analytics.
• Work closely with tech lead/product management to understand data needs, build dashboards, and develop automated reporting solutions.
• Design and optimize storage solutions for structured and unstructured data, enhancing data retrieval and performance for BI purposes.
• Maintain comprehensive documentation of processes, code, and data flows. Follow best practices in code design and deployment to production.