Star/Please Star

StarStar

If you think this tool is good, please gently click the Star button in the upper right corner at this page to increase the project exposure, thank you! The software is completely free (except for commercial use), only ask everyone to Star and promote it to other friends in need, thank you!

/EasySpider: Visual Code-Free Web Crawler

//

A visual browser automation test/data collection/crawler software, which can be used to design and execute tasks in a code-free visual way. You only need to select the content you want to operate on the web page and follow the prompts to complete the design and execution of the task. At the same time, the software can also be executed separately in the command line, so that it can be easily embedded into other systems.

/Official Website

www.easyspider.cn

Visit the official website of EasySpider: www.easyspider.net

1/Example 1

-> -> -> ->

(Right click) Select a large product block -> The software will automatically detect similar blocks -> Click the 'Select All' option -> Click the 'Select Child Elements' option -> Click the 'Collect Data' option, you can collect the information of all products, and will be saved by sub-field.

2/Example 2

->

(Right Click) Select a product title, the same type of title will be automatically matched, click the 'Select All' option -> Click the 'Collect Data' option, you can collect the title information of all products.

At the same time, if you select the 'Loop-click every element' option after selecting all, you can automatically open the details page of each product, and then can set to collect the information of the details page.

/More Features

More features please scroll to the bottom of this page to view.

/Download EasySpider

Releases Page

Refer to the Releases Page to download the latest version of EasySpider.

/Documentation

Ebayhttps://blog.csdn.net/ihero/article/details/130805504

Documentation can be found from GitHub Wiki.

/Video Tutorials

Bilibili/B:

EasySpider -

-

++

JS -

- 58

MacOSeBay

JS

-

OCR

IPIP -

Python

-

MySQL

Cloudflare

Refer to Youtube Playlist to see the video tutorials of EasySpider.

/Sample Tasks

Examples0EasySpidertasksEasySpider

Download sample tasks from the Examples folder of this project, rename them to numbers greater than 0, import them into the tasks folder in EasySpider, and then open them in EasySpider.

/Declaration

/********

This software is for learning and communication only. It is strictly forbidden to use the software for any illegal operations, such as crawling government/military websites that are not allowed to be crawled. All consequences caused by the use of this software are at the user's own risk, and the author is not responsible for any consequences.

---

For the crawler operations of government and military websites, the author will not answer any questions in order to avoid violating relevant national laws, regulations and policies.

[email protected]

Meanwhile, the software is protected by patent rights. If it is used for commercial purposes, such as using the software to make profits, selling the collected data, or integrating the software into your own system, please contact the author by email: [email protected]

QQ

682921940GithubIssueQQ

/Publications

• This software has been accepted by The Web Conference (WWW) 2023 (CCF A): EasySpider: A No-Code Visual System for Crawling the Web, April 2023.

• 20225

• WEB20206

/Compilation Instructions

Refer to Compilation Instructions.

/Supported Features

58

58