A next-generation crawling and spidering framework.
-
Updated
Aug 26, 2024 - Go
A next-generation crawling and spidering framework.
🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
The unix-way web crawler
Performs useful checks against a website, such as 404 errors reporting, structured data validation...
Go application. Crawls the Steam store and collects Game records based on search criteria.
This repo show how to Scrape different type of data
An experimental web crawler to visualise & map the connections between domains
Add a description, image, and links to the web-spider topic page so that developers can more easily learn about it.
To associate your repository with the web-spider topic, visit your repo's landing page and select "manage topics."