Senior Data Engineer (Python) - (Remote)

View full description

Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.
• Minimum of 4 years of experience in data engineering.
• Proficiency in Python with at least 4 years of experience.
• Hands-on experience with big data technologies like Hadoop, Spark, or Kafka.
• Proficiency in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases like MongoDB.
• Experience with AWS cloud platforms.
• Strong understanding of data modeling, schema design, and data warehousing concepts.
• Excellent analytical and troubleshooting skills.
• Fluency in English and Spanish.

Responsibilities:

• Design, build, and maintain scalable data pipelines and ETL processes for large volumes of data.
• Develop and optimize data scraping solutions for efficient job data extraction.
• Collaborate with data scientists on AI-driven matching algorithms.
• Ensure data integrity and reliability through validation mechanisms.
• Analyze and optimize system performance, addressing challenges.
• Work with teams to efficiently deploy machine learning models.
• Stay updated on emerging technologies and best practices.
• Collaborate with various teams to understand and implement data requirements.
• Maintain documentation for systems and processes, ensuring compliance.