🤖 Scrape data from HTML websites automatically by just providing examples

The crawler opened source by tap4.ai

Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.

A universal solution for web crawling lists. 抓取网页列表的通用解决方案

Spiderbuf 是一个专注于 Python 爬虫练习的网站。提供丰富的爬虫教程、爬虫案例解析和爬虫练习题。Python爬虫开发强化练习，在矛与盾的攻防中不断提高技术水平，通过大量的爬虫实战掌握常见的爬虫与反爬套路。 引导式爬虫案例 + 免费爬虫视频教程，以闯关的形式挑战各个爬虫任务，培养爬虫开发的直觉及经验，验证自身爬虫开发与反爬虫实力的时候到了。

👾 CLI MetaSpy (Facebook, Instagram) scraper and crawler - instagram account, facebook accounts, pages and search

Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis

Scraper for https://marvelsnapzone.com to retrieve metadata of Marvel SNAP cards.

newbing api by PlayWright

A collection of Bangla newspaper and blog crawlers. Can be used to mine bangla text data for Natural Language Processing tasks.

Reddit Media Downloader is a Python application designed to simplify the process of downloading images and GIFs from Reddit. It allows users to specify a subreddit and number of posts to fetch, then automatically retrieves and downloads all available media files. The app features built-in cache logic, which remembers previously downloaded posts to

A web crawler which crawls the stackoverflow website.

crawling google full size image

A Fast and Light Python Spider Framework 🕷️

A Web Crawler developed in Python.

爬虫练手项目（几个音乐平台）

Python script to crawl a website and see if it links to any expired domains.

Dark Web Crawler

基于scrapy的应用商店爬虫，包括应用信息本身及其评论

A web crawler written in python3