Colly Postgres Storage
PostgreSQL storage for colly web scraper framework
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Kuwala | 610 | 2 years ago | 22 | apache-2.0 | JavaScript | |||||
| Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data science models and products with a focus on geospatial data. Currently, the following data connectors are available worldwide: a) High-resolution demographics data b) Point of Interests from Open Street Map c) Google Popular Times | ||||||||||
| Nodejs Stuff | 484 | 5 years ago | other | |||||||
| Node.js libs I want to keep in mind. | ||||||||||
| Readablewebproxy | 195 | 5 months ago | 6 | bsd-3-clause | Python | |||||
| Rewriting web proxy and archival tool. At this point, it just tries to download all the things. | ||||||||||
| How To | 70 | 3 months ago | 43 | mit | Python | |||||
| 📚 Doing all sorts of things, the DataMade way | ||||||||||
| Property_web_scraper | 61 | a year ago | 7 | mit | JavaScript | |||||
| Web based UI to make scraping data from real estate websites super simple | ||||||||||
| Scraper | 47 |  | 2 | 2 years ago | 12 | June 02, 2022 | 11 | mit | TypeScript | |
| Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom. | ||||||||||
| Ttc_subway_times | 40 | 3 years ago | 27 | gpl-3.0 | Jupyter Notebook | |||||
| A scraper to grab and publish TTC subway arrival times. | ||||||||||
| Scraping_tweets_celery_rabbitmq_docker_cluster | 36 | 5 years ago | 1 | Python | ||||||
| Scraping tweets quickly using celery, RabbitMQ and Docker cluster | ||||||||||
| Social_scrapers | 28 | 10 years ago | Python | |||||||
| Various Python scripts to scrape sites that store data about you. | ||||||||||
| Financial Scraper | 20 | 8 months ago | JavaScript | |||||||
| Gathers financial data and saves it to postgres. (Cronjob) | ||||||||||
Alternatives To Colly Postgres StorageSelect To Compare
Alternative Project Comparisons
Popular Scraper Projects
Popular Postgresql Projects
Popular Data Processing Categories
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Golang
Postgresql
Scraper
Crawler