Web Scraping Specialist
New
M
MLabsAI Development
New York, New York, United States. Florida, United States. New Jersey, United States, 6-hour overlap with the core team's schedule/ESTFull-Time
Salary$75,000 to $100,000
Apply NowOpens the employer's application page
Job Details
- Required Skills
- AWSPythonGCPJavascriptMongoDBCassandraNosqlSelenium
Requirements
- Demonstrated ability to extract data from complex websites with minimal supervision, supported by a portfolio of past projects.
- Advanced skills in Python or JavaScript, specifically with libraries and frameworks such as BeautifulSoup, Scrapy, or Selenium.
- Strong knowledge of asynchronous programming, multithreading, and distributed scraping architectures.
- In-depth knowledge of HTML, CSS, JavaScript, and the Document Object Model (DOM).
- Experience with NoSQL databases (e.g., MongoDB, Cassandra), including the ability to design efficient storage solutions.
- Experience deploying and managing large-scale scraping jobs using cloud services such as AWS, Google Cloud, or Azure.
Responsibilities
- Write, test, and refine high-performance code to extract data from various online sources, ensuring maximum reliability and efficiency.
- Manage complex data retrieval tasks, including handling pagination and dynamic content loaded via AJAX.
- Clean and format extracted data to ensure it meets rigorous quality standards for downstream analysis and processing.
- Store and manage scraped data in appropriate databases, optimizing for both access speed and long-term data integrity.
- Regularly monitor scraping processes and infrastructure to identify and resolve issues, ensuring a continuous and stable data flow.
View Full Description & ApplyYou'll be redirected to the employer's site
