Python Engineer (Data Integrations)

View full description

Requirements:

• 2+ years of Python engineering experience (or equivalent expertise with :5000 hours of deliberate practice), with a strong focus on web scraping and data integrations.
• Expertise in Python and relevant libraries (BeautifulSoup, Selenium).
• Experience working with first-party and second-party data, integrating data from various sources (including APIs, web scraping, and partner data systems).
• Proven ability to scale scraping operations, manage proxies, IP rotation, and solve anti-scraping challenges.
• Strong understanding of web technologies (HTML, CSS, JavaScript) and RESTful APIs.
• Familiarity with databases (SQL and NoSQL) for handling, storing, and processing scraped data.
• Experience with cloud platforms (AWS, GCP, or Azure) and containerization tools (Docker, Kubernetes) is a plus.
• Strong problem-solving, debugging, and performance optimization skills.
• Excellent communication skills in English (Spanish is a plus).
• Ability to work independently and remotely in a fast-paced environment.

Responsibilities:

• Design, build, test, and maintain scalable Python-based solutions for first-party and second-party data integrations and web scraping.
• Collaborate with engineering and product teams to define integration and scraping requirements for both internal and external data sources.
• Develop efficient and maintainable scraping solutions to extract data from websites, APIs, and other digital platforms, ensuring high-quality data collection.
• Implement systems to handle data integration from external partners (second-party data) while ensuring compliance with data-sharing agreements.
• Optimize data scraping processes for speed, performance, and accuracy, handling large-scale data extractions.
• Monitor and troubleshoot issues related to data scraping, integrations, and related infrastructure.
• Use agile methodologies to manage tasks and deliverables, working closely with cross-functional teams.
• Ensure the accuracy, consistency, and security of data collected through scraping and integrations.
• Keep up-to-date with industry trends and best practices in data scraping, web technologies, and Python development.
• Contribute to the overall success of the team by taking on additional responsibilities as required in a dynamic environment.