website-scraper

Download website to local directory (including all css, images, js, etc.)

A new web development methodology for JavaScript & C# developers. A super fast and very easy to use CMS.

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.

Plugin for website-scraper which returns html for dynamic websites using puppeteer

A server to collect & archive websites, also supports video downloads

Plugin for website-scraper which returns html for dynamic websites using PhantomJS.

Wayback Machine Downloader. 🔥 Download your entire archived websites from the Internet Archive Wayback Machine.

🕸 Builds and serves RSS feeds via HTTP. Generate your own feeds or start instantly with the included configs.

A spider to crawl webpages

Now you can keep track of your followers from YouTube, Instagram and Twitter accounts - Followers scraper API on AWS serverless

JSON collection of scraped file extensions, along with their description and type, from FileInfo.com

Bandwidth efficient scheduled downloads

Scraping websites made easy! A minimalistic yet powerful tool for collecting data from websites.

Website Penetration Testing Tool With Dos Attack Feature

Alexa Bulk Website Rank Checker PHP Script 2020 Latest! you can grab 200+ URL's website ranking at once!

Article Dataset Generator for Internet News Sites. Crawls news sites, analyses them with NLP (sentiment analysis), and pushes to a database.

Download ALL the images (JPEG/GIF/PNG) from any Tumblr website! This project employs Python3 and BeautifulSoup4 to scrape a Tumblr site (with the url provided by the user) to download, page by page, all the images from the Tumblr site's posts. Ideal for archiving other peoples' Tumblrs <3

Scrapes any website to retrieve all hyperlinks from it in a matter of seconds. Scraping made easy!

Simple library which parses web pages into objects usin attributes

This is a python based website crawling script equipped with Random time intervals, User Agent switching and IP rotation through proxy server capabilities to trick the website robot and avoid getting blocked.

Plugin for website-scraper which allows to save resources to existing directory

Run the following python code with a text file in the same directory containing the words for which you need the mnemonic.

Simple program which is able to extract the video stream from online streaming sites and show it using VLC

Python application that scraps diverse sources for covid-19 papers, applies NLP transformations and stores them in a dataset for visualizing on a Flask web application.

Universal Web-page Scraper for NodeJS

Airbnb listing scraper

Yet another telegram bot for flibusta library.

This is a website url scraper built using python.

All match details of Pakistan Super League teams. All data is scraped from www.psl-t20.com website using python.