Scraping & Automation Developer (Full Remote within Spain)

View full description

Requirements:

• Experience with Puppeteer, Selenium or Playwright
• Strong JavaScript knowledge is highly preferred.
• Familiarity with containerized environments using Docker.
• Knowledge of bot adaptability and resilience measures
• Experience with NoSQL databases: Redis, Elasticsearch/OpenSearch (Nice to have)
• Knowledge of async messaging tools like RabbitMQ (Nice to have)
• Familiarity with AWS stack service (EC2,Lambda,S3,ECS,ECR,SQS) is a plus

Responsibilities:

• Design and implement robust automation flows using Puppeteer, Selenium, or Playwright.
• Simulate real user interactions: mouse movements, clicks, scrolling, keyboard input, drag-and-drop, and more.
• Automate authentication workflows, including handling login forms, multi-factor authentication (2FA), token-based systems, and session persistence.
• Handle navigation across multi-step processes, complex flows, and conditional branching in UI behavior.
• Manage browser contexts, incognito modes, and session isolation for concurrent scraping tasks.
• Optimize automation speed and reliability by managing network throttling, timeouts, and request interception.
• Use request/response interception to modify payloads, inject headers or capture API data mid-session.
• Debug and trace issues in automation flows using built-in tools (e.g., Chrome DevTools Protocol) and custom logging.
• Knowledge in bot adaptability and resilience measures
• Develop high-performance web scrapers for static and dynamic websites, with focus on modularity and reuse.
• Analyze and interpret complex HTML structures, including nested elements, tables, and non-semantic markup.
• Handle dynamic behaviors like infinite scroll, AJAX-loaded content, delayed rendering, and embedded frames (iframes).
• Implement resilient scraping strategies for sites with frequent structural changes.
• Work with structured (JSON, XML) and unstructured data, including cleaning, parsing, and transforming it into usable formats.
• Handle cookies, session storage, and authentication headers to maintain access to gated content.
• Build scrapers that are production-ready, fault-tolerant, and easy to debug and monitor.
• Write clean, modular code following SOLID principles and clean architecture.