Awesome Open Source

Programming Languages

Search results for crawler dsl

10 search results found

Ferret ⭐ 5,540

Declarative web scraping

Wombat ⭐ 1,297

Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.

Skrape.it ⭐ 714

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

Netdiscovery ⭐ 557

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

A Ruby DSL for structured web crawling, with a robust caching system.

Crawler ⭐ 141

Scala DSL for web crawling

A simple Ruby directory crawler DSL

A mean little DSL'd poltergeist (capybara) based web crawler that stuffs data into your Rails app.

Lisp web crawler and scrapper

Containerized Ferret worker

a groory spider .

Wgit allows you to crawl and extract the data you want from the web

A small but powerful library for mining data from web pages and HTML documents. Athena provides an easy to use DSL for crawling HTML pages and extracting information from them.

Elixir web crawler

Related Searches

Python Crawler (4,545)

Ruby Dsl (1,239)

Javascript Crawler (1,142)

Crawler Scrapy (988)

Scraper Crawler (988)

Java Crawler (807)

Crawler Spider (709)

Kotlin Dsl (630)

1-10 of 10 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.