Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Nginx Blacklist | 118 | 10 years ago | ||||||||
Block web crawlers (automated bots) from accessing your website served with nginx. | ||||||||||
Django Email Obfuscator | 40 | 47 | 7 years ago | 6 | February 10, 2017 | mit | Python | |||
Django template filter to protect email addresses from crawlers | ||||||||||
Crawlerandvalidator | 25 | 8 years ago | Python | |||||||
Openvenues | 21 | 9 years ago | mit | HTML | ||||||
Email Scraper | 19 | 7 years ago | 2 | Python | ||||||
Frisbee | 19 | 1 | 4 years ago | 7 | May 30, 2019 | 3 | mit | Python | ||
Collect email addresses by crawling search engine results. | ||||||||||
Rippled Network Crawler | 16 | 2 | 1 | 3 years ago | 26 | September 10, 2015 | isc | JavaScript | ||
Crawls all nodes in rippled network | ||||||||||
Email_spider | 14 | 12 years ago | 1 | Ruby | ||||||
A simple Ruby web spider that uses Anemone to crawl every page of a site looking for email addresses. Stores the results with SQLite3 using Data Mapper. | ||||||||||
Crawling Emails | 8 | 7 years ago | Shell | |||||||
Very simple bash script to crawl email addresses from a specific website. | ||||||||||
Website_extractor | 7 | 9 years ago | PHP | |||||||
This is an In-Memory Web Crawler & Scraper built to extract data in small runs from public websites. The current implementation takes a .csv of urls and crawls the sites, extracting basic info about the site like emails, phone numbers, addresses, & specified terms. |