Ruby Engineer - Web Scraping (Remote)
S
SearchApiWeb Scraping
LithuaniaFull-TimeSenior
Salary not disclosed
Job Details
- Languages
- English
- Required Skills
- AWSBackend DevelopmentPostgreSQLPythonSoftware DevelopmentJavascriptRubyRuby on RailsAPI testingRedisWebRTCCI/CDTerraformProblem SolvingWritten communicationDebuggingCustomer support
Requirements
- Deep technical skills in browser automation, CDP internals, anti-bot evasion, concurrency, or infrastructure
- Strong problem solver
- Ruby on Rails 8.1
- Ruby 3.4
- Hotwire (Stimulus.JS + Turbo)
- TailwindCSS (TailwindUI components)
- PostgreSQL
- Redis
- Sidekiq
- Terraform + AWS
- Experience with AI tools like Cursor, Claude, ChatGPT
- Ability to evaluate AI output
- Experience with web fundamentals: HTTP, TLS, CSS selectors, XPath, JavaScript
- Experience with browser automation, scraping, and data extraction
- Fluent in English, written and spoken
- BSc or higher in CS or equivalent technical field
- CDP (Chrome DevTools Protocol) specialists
- Anti-bot and evasion experts (Cloudflare, Akamai, DataDome, PerimeterX)
- Concurrency experts: fibers, ractors, threads in Ruby
- Browser automation engineers (Puppeteer, Playwright internals)
- Network debugging (Wireshark, Burp Suite, Proxyman)
- TLS/JA3/WebRTC fingerprinting experience
- Infrastructure: Terraform, AWS/ECS, Prometheus, Grafana
- Experience at scale: billions of requests
Responsibilities
- Fix broken parsers
- Add new elements to existing search engines
- Build and ship new search engine integrations
- Reverse engineer website protections and anti-bot systems
- Debug browser automation issues (CDP, fingerprinting, evasion)
- Create and improve documentation pages
- Develop landing pages and admin dashboard features
- Review PRs and help test
- Talk to customers directly
- Rotate on customer support
- Proactively update customers on progress
- Improve browser automation and debug performance at scale (for Senior Engineers)
- Optimize concurrency (fibers, ractors, threads) (for Senior Engineers)
- Handle complex challenges: TLS fingerprinting, JA3, WebRTC, CDP internals (for Senior Engineers)
- Improve API monitoring (logging, real-time analytics, anomaly detection) (for Senior Engineers)
- Architect and build new systems from scratch (for Senior Engineers)
- Lead technical decisions and mentor engineers (for Senior Engineers)
- Choose what to work on as you develop product intuition (for Senior Engineers)
