The Wayback Machine - https://web.archive.org/web/20221022214424/https://github.com/topics/web-scraping
Here are
3,420 public repositories
matching this topic...
Crawlee—A web scraping and browser automation library for Node.js that helps you build reliable crawlers. Fast.
Updated
Oct 21, 2022
TypeScript
List of libraries, tools and APIs for web scraping and data processing.
Updated
Oct 10, 2022
Makefile
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Updated
Aug 8, 2022
Python
Selenium-python but lighter: Helium is the best Python library for web automation.
Updated
May 24, 2022
Python
PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
A Devtools driver for web automation and scraping
Updated
Oct 9, 2022
Python
Learn Python for the next 30 (or so) Days.
Updated
Sep 21, 2022
HTML
Snoop — инструмент разведки на основе открытых данных (OSINT world)
Updated
Oct 18, 2022
Python
General Assembly's 2015 Data Science course in Washington, DC
Updated
Oct 6, 2022
Jupyter Notebook
Simple web scraping for R
The Python Code Tutorials
Updated
Sep 25, 2022
Jupyter Notebook
The complete web scraping toolkit for PHP.
Collection of scripts corresponding to LucidProgramming YouTube tutorials
Updated
Sep 17, 2022
Python
Faster requests on Python 3
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes.
UI.Vision: Open-Source RPA Software (formerly Kantu) - Modern Robotic Process Automation with Selenium IDE++
Updated
Oct 5, 2022
JavaScript
A JavaScript library for generating random user agents with data that's updated daily.
Updated
Oct 22, 2022
JavaScript
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Updated
May 10, 2022
Ruby
Nextjs server to query websites with GraphQL
Updated
Oct 5, 2022
JavaScript
Improve this page
Add a description, image, and links to the
web-scraping
topic page so that developers can more easily learn about it.
Curate this topic
Add this topic to your repo
To associate your repository with the
web-scraping
topic, visit your repo's landing page and select "manage topics."
Learn more
You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session.
You signed out in another tab or window. Reload to refresh your session.
