Pyspark/Python Developer

View full description

Requirements:

• 8+ years of experience as a consultant in relevant technologies.
• Strong knowledge of PySpark, especially data frames and data processing techniques.
• Hands-on experience with Python programming.
• Good communication skills for direct collaboration with business teams and various stakeholders.
• Experience with Azure Data Bricks and ADLS-Gen2 is a plus.
• Familiarity with GIT for version control.
• SQL knowledge to process data from traditional systems.

Responsibilities:

• Develop and maintain data processing workflows using PySpark.
• Collaborate with business units to understand requirements and present solutions.
• Work with various teams to ensure performance improvement in data processing.