Senior Web Scraping Engineer — Labrynth

3+ years of professional experience working with web scraping or data collection at scale. Strong proficiency in Python and common scraping libraries/frameworks (Selenium, Playwright, BeautifulSoup, Scrapy, or similar). Solid understanding of HTML, CSS, JavaScript, HTTP, and browser behavior. Experience building automated, production-grade workflows (orchestrators/schedulers like Airflow, Prefect, Dagster, or similar). Experience building ETL/ELT pipelines and integrating with databases/storage. Hands-on experience with cloud platforms (AWS, GCP, or Azure). Strong experience with logging, monitoring, and alerting. Experience with containers (Docker). Familiarity with CI/CD workflows. Exposure to LLMs for parsing, information extraction, or automation.

Design, implement, and maintain web scraping pipelines. Build scrapers using tools like Selenium, Playwright, BeautifulSoup, Scrapy. Create automated workflows for scraping and data processing (containerization, cloud deployment, scheduling). Implement monitoring, alerting, and logging for jobs. Handle anti-bot measures and design resilient scrapers. Work with data engineering/product/ML teams to ensure data quality. Utilize LLMs for parsing, extraction, and prototyping new strategies. Write clean, well-tested code and contribute to team best practices. Continuously improve the scraping platform.