Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for c sharp crawler
c-sharp
x
crawler
x
62 search results found
Awesome Crawler
⭐
5,859
A collection of awesome web crawler,spider in different languages
Dotnetspider
⭐
3,747
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
Puppeteer Sharp
⭐
3,163
Headless Chrome .NET API
Hawk
⭐
2,638
visualized crawler & ETL IDE written with C#/WPF
Abot
⭐
1,991
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
Tumblthree
⭐
922
A Tumblr Blog Backup Application
Tumblthree
⭐
552
A Tumblr and Twitter Blog Backup Application
Swarm
⭐
495
An example of use of compute shaders and procedural instancing.
Html2article
⭐
425
Html网页正文提取
Xhs Spider
⭐
296
小红书数据采集、网站图片、视频资源批量下载工具,颜值超高的数据采集工具(批量下载,视频提取,图片,去
Ruiji.net
⭐
261
crawler framework, distributed crawler extractor
Drill
⭐
256
Search files without indexing, but clever crawling
Awesome Crawler Cn
⭐
243
互联网爬虫,蜘蛛,数据采集器,网页解析器的汇总,因新技术不断发展,新框架层出不穷,此文会不断更新..
Infinitycrawler
⭐
221
A simple but powerful web crawler library for .NET
Strong Web Crawler
⭐
204
基于C#.NET+PhantomJS+Sellenium的高级网络爬虫程序。可执行Javascrip
Acm Statistics
⭐
137
An online tool (crawler) to analyze users performance in online judges (coding competition websites). Supported OJ: POJ, HDU, HYSBZ, CodeForces, UVA, ICPC Live Archive, FZU, SPOJ, Timus (URAL), LeetCode_CN, CSU, LibreOJ, 洛谷, 牛客OJ, Lutece (UESTC), AtCoder, AIZU, CodeChef, El Judge, BNUOJ, Codewars, UOJ, NBUT, 51Nod, DMOJ, VJudge
Httpcode.core
⭐
134
简单、易用、高效 一个有态度的开源.Net Http请求框架!可以用制作爬虫,api请求等等。
Csharpcrawler
⭐
118
C#爬虫示例程序,想学习爬虫入门知识的可以看过来。后续会慢慢加入更多爬虫相关的知识。
Abotx
⭐
106
Cross Platform C# Web crawler framework, headless browser, parallel crawler. Please star this project! +1.
Prerender_asp_mvc
⭐
83
Prerende client for asp.net mvc
Scrapingspider
⭐
73
业余时间开发的,支持多线程,支持关键字过滤,支持正文内容智能识别的爬虫。
Dandy Dungeon
⭐
64
A collection of implementations of a simple 2D dungeon crawling game
Dotnetcrawler
⭐
63
DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-w
Moviecrawler
⭐
60
Movie Crawler
Webreaper
⭐
59
Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.
Jcs
⭐
57
Joomla Vulnerability Component Scanner
Tumbltwo
⭐
56
TumblTwo, an Improved Fork of TumblOne, a Tumblr Downloader.
Custom Crawler
⭐
55
🌌 High productivity semi-automatic crawler generator 🛠️🧰
Skyscraper
⭐
48
An asynchronous web scraper / web crawler using async / await and Reactive Extensions
Webcrawler
⭐
47
Just a simple web crawler which return crawled links as IObservable using reactive extension and async await.
Apsoft Web Scanner V2
⭐
43
Powerful dork searcher and vulnerability scanner for windows platform
Local Api Client Csharp
⭐
39
This .NET Standard package provides convenient access to the Local API REST interface of the Kameleo Client.
Azuresearchcrawler
⭐
35
A simple web crawler, using Abot, that indexes page contents into Azure Search.
Crawlersamples
⭐
34
This is a Puppeteer+AngleSharp crawler console app samples, used C# 7.1 coding and dotnet core build.
Spiderx
⭐
34
A simple web-crawler development framework based on .Net Core.
Harvest
⭐
32
A C# multithreaded crawler library
Webcrawler
⭐
32
一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。
Dhtspider
⭐
29
A Very Simple Spider With DHT Crawler, Written by C#.
Github Action Rss Crawler
⭐
28
Auto crawl RSS feeds using Github Action
Biliranking
⭐
27
哔哩哔哩数据分析整理,月刊鬼畜榜数据及图片专用生成工具
Tenteikura
⭐
26
A minimal multithreaded web crawler
Mechanize.net
⭐
25
Stateful programmatic web browsing, based on Python-Mechanize, which is based on Andy Lester’s Perl module WWW::Mechanize.
Sqloogle
⭐
21
Crawl, Index, and Search Your SQL.
Chegg Solutions Saver
⭐
20
Because Chegg only gave few days to access their solutions for free when I rent their books so I decided to create a web crawler to save all the needed solutions offline.
Animedl
⭐
19
⚡️An API for downloading or streaming your favorite anime.
Koromo Copy App
⭐
19
Cross-Platform program to extract images, text, music from many sites
Unity3d Advanced Grid Movement
⭐
15
An more advanced approach for grid based movement in Unity3d games.
Dotnetthirdpartynotices
⭐
15
A .NET tool to generate file with third party legal notices
Weaver
⭐
15
A customizable web crawler.
Netcrawlerdetect
⭐
14
A .net standard port of JayBizzle's CrawlerDetect project (https://github.com/JayBizzle/Crawler-Detect).
Gac4net
⭐
12
google app information ninja ,crawl google app information
Webcrawler
⭐
12
Web Crawler build on C#
Spidey
⭐
11
A multi threaded web crawler library that is generic enough to allow different engines to be swapped in.
Webcrawling101 Deprecated
⭐
9
Ever wanted to learn the basics of writing a Web Crawler / Scrapper ? Look no further !
Sql Crawler
⭐
8
Connect to multiple SQL database servers and run queries to collect data.
Vcrawler Engine
⭐
8
database and sites api + WPF client
Gallery Explorer
⭐
8
Gallery Information Explorer
Lightnovelsniffer
⭐
8
C# .Net 4.5 Web crawler to create PDF and Epub version of online light novels
Sitecore.algolia
⭐
7
Sitecore search provider for Algolia
Shaman.scraping
⭐
7
A C# library for reading/writing WARC files and scraping websites.
Apple Store Crawler
⭐
7
A simple, scalable scrapper for apps data being listed on Apple's AppStore
Krawlr
⭐
7
C# & Selenium web page crawler
Web Crawler
⭐
7
web-crawling (use Abot2), feed-crawling (use FeedReader)
Curso Criacao De Bots
⭐
7
Xtr
⭐
7
A tool to crawl and parse web pages
Cambridgedictionary
⭐
6
Porting a crawler to CSharp
Scrapy.net
⭐
6
Scrapy the web scraping tool - a naive implementation in C#
Ftp Crawler
⭐
6
Basic file crawler written for fun.
Indeedjobanalyzer
⭐
6
an analyzer of local job statistics based on Indeed
Katelyn
⭐
6
Well known for Crawling.
Baidu Hi Crawler
⭐
6
Crawler for Baidu Hi, which is a blog space which will be closed on May 2015.
Totalrecall
⭐
5
Crawl and index your (static) asp.net website for searching using an MSBuild target. Simple search query interface. Uses Lucene.Net and NCrawler.
Colid Indexing Crawler Service
⭐
5
The Indexing Crawler Service (ICS) repository is part of the Corporate Linked Data Catalog - short: COLID - application. It is responsible to extract data from a RDF storage system, transform and enrich the data and finally to send it via a message queue to the DMP Webservice for indexing.
Vc Module Sitemaps
⭐
5
Sitemaps management module
R6siege Player Info Crawler
⭐
5
It's a simples Crawler that get's every match info of a Rainbow Six Siege player.
Neoblock Mongo Storage
⭐
5
Storage Neo Block Data to Mongodb
Migale
⭐
5
Migale was born out of a need to extract data quickly and with a very low development cost. This package is not intended to replace complete and structured libraries like DotnetSpider.
Dowload Image Ptt
⭐
5
PTT圖片下載器 (C# WinForm) For Windows
Backpacklogin
⭐
5
▶️ A .NET core library to handle the login to Backpack.tf. Backpack.tf is a trading site for Team Fortress 2, Counter-Strike: Global Offensive, and Dota 2. Community item pricing, item trading and stats, and much more.
Giveawaymachine
⭐
5
Crawls for Active Giveaways of Gleam.IO and automatically enter
Related Searches
C Sharp Unity (13,521)
C Sharp Video Game (8,498)
C Sharp Azure (4,292)
C Sharp Unity3d (4,236)
C Sharp Wpf (3,118)
C Sharp Visual Studio (2,839)
C Sharp Command Line (2,702)
C Sharp Asp Net Core (2,668)
C Sharp Sql (2,429)
C Sharp Microsoft (2,368)
1-62 of 62 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.