Dotnetcrawler
DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-w
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Scalpel | 38 | 3 months ago | 4 | June 02, 2022 | 10 | apache-2.0 | Python | |||
| A fast and powerful web scraping library | ||||||||||
| Scrapyd Mongodb | 12 | 7 years ago | 2 | August 13, 2017 | mit | Python | ||||
| Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management | ||||||||||
| Scrapy Dblite | 12 | 4 | 8 years ago | 1 | January 14, 2016 | bsd-2-clause | Python | |||
| Simple library for storing Scrapy Items in sqlite database | ||||||||||
| Lua Xpath | 10 | 8 years ago | 2 | gpl-3.0 | Shell | |||||
| A Lua XPath library based on libxml2. | ||||||||||
| Awesome Scrapy | 8 | 4 years ago | unlicense | |||||||
| 🕶 Awesome list of Scrapy tools and libraries | ||||||||||
| Library_information_extract | 5 | 7 years ago | Java | |||||||
| Scrapy와 MapReduce를 이용하여 도서정보 추출-분석 | ||||||||||
Alternatives To DotnetcrawlerSelect To Compare
Alternative Project Comparisons
Popular Libraries Projects
Popular Scrapy Projects
Popular Libraries Categories
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
C Sharp
Pipeline
Scraper
Crawler
Downloader
Web Crawler
Scrapy
Entity Framework
Ddd Architecture