Senior Data Scraping Engineer
New
M
MindriftAI, Web Scraping
United StatesPart-TimeSenior
SalaryUp to 45 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- English proficiency: Upper-intermediate (B2) or above
- Experience
- 5+ years
- Required Skills
- AWSDockerPythonSeleniumLangChain
Requirements
- 5+ years of relevant experience in data engineering, web scraping, automation, or software development
- Strong experience in Python web scraping (BeautifulSoup, Selenium or similar)
- Experience with dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
- Proven ability to extract data from complex structures
- Solid background in data cleaning, normalization, and validation
- Experience handling anti-bot mechanisms and dynamic site structures at scale
- Experience with cloud infrastructure (AWS or equivalent) and containerization (Docker)
- Hands-on experience with LLM frameworks (LangChain, OpenRouter, or similar)
- English proficiency: Upper-intermediate (B2) or above
Responsibilities
- Own end-to-end data extraction workflows across complex websites
- Leverage internal tools (Apify, OpenRouter) alongside custom workflows
- Ensure reliable extraction from dynamic and interactive web sources
- Enforce data quality standards through validation checks and consistency controls
- Scale scraping operations for large datasets using efficient batching or parallelization
View Full Description & ApplyYou'll be redirected to the employer's site
