Awesome Open Source

Programming Languages

Search results for python data collection

data-collection x

43 search results found

Airbyte ⭐ 12,918

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Python library and web service for Open Source Software Health and Sustainability metrics & data collection. You can find our documentation and new contributor information easily here: https://oss-augur.readthedocs.io/en/main/ and learn more about Augur at our website https://augurlabs.io

📱🌐📋 wq: a modular framework supporting web / native apps for mobile surveys and geospatial data collection. Powered by Django REST Framework, Redux, React, and Material UI.

Library ⭐ 133

xk media library

☁🌐 wq's db library, extending Django REST framework to support apps for geospatial field data collection, citizen science, and crowdsourcing.

Funded_nisl ⭐ 93

FUNDED is a novel learning framework for building vulnerability detection models.

Xtcryptosignals ⭐ 61

Cryptocurrencies price data collection, price tickers, signals notifications, charts, Telegram bot and more.

Low-code Python library enabling access to APIs, tools, data sources in seconds.

Pyradios ⭐ 53

Python client for the Radio Browser API

Open, extensible Python injector/profiler/analyzer

Song Describer ⭐ 48

Song Describer is a data collection platform for annotating music with textual descriptions.

Instamatic ⭐ 48

Python program for automated electron diffraction data collection

Arcreactor ⭐ 32

open-source intelligence gathering for SIEMs <3

🌎 Data collection of geographical divisions of Brazil by IBGE

Xeno Canto Py ⭐ 25

Python wrapper for the xeno-canto.org API to aid in downloading and managing recordings.

The official Python library for ODK 🐍

Xlsform Converter ⭐ 20

💡📋 xlsconv: Command-line tool to convert questionnaires from Open Data Kit's XLSForm format into Django models and HTML (for use with https://wq.io/).

FACT is a tool to collect, process and visualise forensic data from clusters of machines running in the cloud or on-premise.

Qrealtime ⭐ 18

This is a QGIS plugin which enables automatic survey form creation from GIS layers and uploading to ODK aggregate server. User can import existing data into GIS layers or enable sync with regular interval.

Georegistry + Data Collection + Microplanning

Coletores ⭐ 17

Coletores de dados sobre remunerações do sistema de justiça brasileiro

Mailinglistscraper ⭐ 15

A python web scraper for public email lists.

A web scraper for TikTok using Playwright

Stock Fundamental Data Scraping And Analysis ⭐ 14

Project on building a web crawler to collect the fundamentals of the stock and review their performance in one go

Ornitholog ⭐ 14

Open-source Twitter collection and archiving tool for tracking specific topics and collecting bulk data.

Fast and differentiable particle accelerator optics simulation for reinforcement learning and optimisation applications.

Wakeword Data Collector ⭐ 12

A prototype CLI in Python where a user can collect all of the recordings needed to produce a wakeword

Selenium Image Crawler ⭐ 10

Selenium Image Crawler

Webtrench ⭐ 10

A powerful and easy-to-use web scrapper for collecting data from the web. Supports scraping of images, text, videos, meta data, and more. Ideal for machine learning and deep learning engineers. Download and extract data with just one line of code

API (Python) for Eurostat data collections upload

Collects a multimodal dataset of Wikipedia articles and their images

Multi Modal Automation Suite ⭐ 9

image based automation environment

Goblyn is a Python tool focused to enumeration and capture of website files metadata.

Pyscrapify ⭐ 6

PyScrapify is a modular Python web scraper framework built on top of Selenium and BeautifulSoup. Easily extendable with new scrapers off of BaseScraper class. Avoid the bloat of creating web scrapers in Python!

Discord data collection bot

open source library from digipodium

Standalone web application for collecting a large amount of voices read aloud from the manuscript efficiently.

Systemanalysisdesign ⭐ 6

Term Project repository for System Analysis and Design course in ITM, Seoultech.

Autodidaqt ⭐ 6

AutodiDAQt is DAQ + UI generation + Reactivity + Instruments

Stockdata_automaticupdate_windpyapi ⭐ 5

Use Wind's API in Python to build an automatic update scheme for Mainland Chinese stocks' data

Labjack Controller ⭐ 5

Easily stream data from LabJack T4 and T7 devices.

Leauge Of Legends Challenger Stats ⭐ 5

Leauge of Legends Challenger Stats

Simple Twitter Collector ⭐ 5

A simple tweet collector wrapper built on top of tweepy and optionally integrated with Google Drive. It will collect all the tweet, user, media and location fields and dump it to a json file.

A Python module to fetch data from the Kobo API

Ccxt Ohlcv Fetcher ⭐ 5

fetches historical OHLC values from most crypto exchanges using ccxt library. saves candles to a sqlite database per symbol.

Related Searches

Python Django (28,897)

Python Dataset (14,792)

Python Machine Learning (14,099)

Python Deep Learning (13,092)

Python Jupyter Notebook (12,976)

Python Database (10,521)

Python Testing (9,479)

Python Plugin (9,225)

Python Search (5,981)

Python Json (5,730)

1-43 of 43 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.