Crawlers


3822
pholcus — [Crawler for Golang] Pholcus is a distributed, high concurrency and powerful web crawler software.
Crawlers
2708
p2pspider — DHT Spider + BitTorrent Client = P2P Spider
BitTorrent Crawlers Scrapers P2P
1576
gocrawl — Polite, slim and concurrent web crawler.
Crawlers
766
soup — Web Scraper in Go, similar to BeautifulSoup
Scrapers Crawlers
655
fetchbot — A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
Crawlers
351
ants-go — open source, distributed, restful crawler engine in golang
Crawlers
237
gcse — Project for Go Search, a search engine for finding popular and relevant packages.
Applications Crawlers
85
go-simstore — simhash storage and searching
Nice! Crawlers
52
owlcrawler — Crawl the web using nats.io and Go
Crawlers
16
crawl — Lightweight library for scalable crawlers in Go.
Crawlers
12 repos

Once a week...

... I send out a list of most interesting Go libraries and apps to my 50 subscribers.
Want to get it?
 
(Sent via MailChimp)