Senior Data Collection Engineer
New
O
OnHiresB2B SaaS
Brazil. Secondary Locations: Mexico, Argentina, Uruguay, ColombiaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Required Skills
- DockerPythonSQLNosqlSeleniumRESTful APIsLinuxPlaywright
Requirements
- Strong commercial experience building high-volume web scraping and data collection systems using Python.
- Deep practical knowledge of anti-bot techniques, including browser fingerprinting, CAPTCHA solving, proxy management, and blocking mitigation.
- Strong understanding of asynchronous programming, browser automation, HTML parsing, HTTP protocols, and REST APIs.
- Hands-on experience with Playwright, Scrapy, Selenium, or similar scraping frameworks.
- Experience working with Docker, Linux, Git, and modern software development practices.
- Familiarity with SQL and NoSQL databases.
- Strong ownership mindset with the ability to independently drive complex technical projects.
- Fluent English communication skills.
Responsibilities
- Architect, build, and maintain the core infrastructure behind our large-scale asynchronous data collection platform.
- Design, implement, and continuously improve sophisticated anti-blocking strategies, including browser fingerprinting, proxy rotation, CAPTCHA handling, and other techniques.
- Design, develop, test, and maintain robust scraping components using Python and modern scraping frameworks such as Playwright, Scrapy, Selenium, Requests, and related tools.
- Build monitoring, alerting, and logging systems that help identify issues quickly and continuously improve scraper reliability and data quality.
- Develop and maintain scalable data ingestion pipelines and integrations with internal and external REST APIs.
- Contribute to infrastructure automation using Docker, CI/CD pipelines, Linux environments, and related DevOps practices.
- Work closely with other engineers to improve our scraping platform, establish engineering standards, and mentor less experienced teammates.
View Full Description & ApplyYou'll be redirected to the employer's site
