Minimum 3-5 years of Python engineering experience.
Demonstrable experience building data processing systems using structured data, preferably using Apache Spark.
Good relational data modelling skills and SQL skills.
Ability and drive to work across the whole software development lifecycle (understanding requirements, contributing to designs, writing code, writing automated tests, providing production support, helping with deployments).
Very good English communication skills both written and verbal.
Responsibilities:
Design and build software that processes data through our medallion architecture running on Databricks in Microsoft Azure using Python and Apache Spark.
Apply relational data modeling skills and SQL knowledge in handling various data tasks efficiently.
Maintain an active role in every part of the software development lifecycle - from idea generation to deployment.
Facilitate open lines of communication to discuss project requirements, challenges, and solutions.
Contribute to the constant improvement of the software development lifecycle through your knowledge and ideas.
Troubleshoot any issues during the development process, providing timely and effective solutions.