Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Govuk_crawler_worker

A worker that will consume GOV.UK URLs from a message queue and crawl them, saving the output to disk
Stars
17
License
mit
Open Issues
7
Most Recent Commit
a year ago
Programming Language
Go
Total Releases
1
Latest Release
December 05, 2022
Categories
Repo
Suggest An Alternative To govuk_crawler_worker
Popular Govuk Projects
Govuk Frontend ⭐ 967
GOV.UK Frontend contains the code you need to start building a user interface for government platforms and services.
dependent packages 142total releases 58latest release December 08, 2023most recent commit 3 months agonpm govuk-frontend} Downloads
Govuk_frontend_toolkit ⭐ 400
❗️GOV.UK Frontend Toolkit is deprecated, and will only receive major bug fixes and security patches.
dependent packages 8total releases 98latest release June 25, 2021most recent commit 3 years agorubygems govuk_frontend_toolkit} Downloads
Govuk React ⭐ 387
An implementation of the GOV.UK Design System in React using CSSinJS
dependent packages 83total releases 29latest release October 01, 2023most recent commit 3 months agonpm @govuk-react/constants} Downloads
Popular Crawler Projects
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Lux ⭐ 24,752
👾 Fast and simple video download library and CLI tool written in Go
dependent packages 8total releases 40latest release November 06, 2023most recent commit 18 days ago
Colly ⭐ 21,902
Elegant Scraper and Crawler Framework for Golang
dependent packages 328total releases 22latest release March 08, 2022most recent commit a month ago
Popular Legal Categories
Government
Law
Gdpr
Politics
Civic Tech
Govuk
Gov
License Management
Related Searches
Golang Crawler
Golang Message Queue
Golang Govuk

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Golang
Crawler
Message Queue
Govuk
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.