Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for data collection
data-collection
x
124 search results found
Easyspider
⭐
20,149
A visual no-code/code-free web crawler/spider易采集:一个可视化浏览器自动化测试/数据采集/爬虫软件,可以无代码图形化
Airbyte
⭐
12,918
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
Snowplow
⭐
6,677
The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP
Cloudquery
⭐
5,380
The open source high performance data integration platform built for developers.
Hertzbeat
⭐
4,035
An open source, real-time monitoring system with custom-monitoring, high performance cluster, prometheus-like and agentless.
Jitsu
⭐
3,723
Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
Plan
⭐
774
Player Analytics plugin for Minecraft Server platforms - View player activity of your server with ease. 📆
Collect
⭐
697
ODK Collect is an Android app for filling out forms. It's been used to collect billions of data points in challenging environments around the world. Contribute and make the world a better place! ✨📋✨
Augur
⭐
556
Python library and web service for Open Source Software Health and Sustainability metrics & data collection. You can find our documentation and new contributor information easily here: https://oss-augur.readthedocs.io/en/main/ and learn more about Augur at our website https://augurlabs.io
Iot Dc3
⭐
432
IoT DC3 is an open source, distributed Internet of Things (IoT) platform based on Spring Cloud. It is used for rapid development of IoT projects and management of IoT devices. It is a set of solutions for IoT system.
Zdh_web
⭐
379
大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台,包含数据采集,调度,权限,审批
Reaper
⭐
355
Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Walkeros
⭐
269
Unified and privacy-centric event data collection for digital analytics
Wq
⭐
250
📱🌐📋 wq: a modular framework supporting web / native apps for mobile surveys and geospatial data collection. Powered by Django REST Framework, Redux, React, and Material UI.
Android_viewtracker
⭐
184
A data collection library for click and exposure event with the UI.
Disable Firefox Telemetry And Data Collection
⭐
163
How to disable Firefox Telemetry and Data Collection
Buz
⭐
155
Serverless multi-protocol + multi-destination event collection system.
Library
⭐
133
xk media library
Wq.db
⭐
115
☁🌐 wq's db library, extending Django REST framework to support apps for geospatial field data collection, citizen science, and crowdsourcing.
Wq.app
⭐
115
💻📱 wq's app library: a JavaScript framework powering offline-first web & native apps for geospatial data collection, mobile surveys, and citizen science. Powered by Redux, React, Material UI and Maplibre GL.
Build
⭐
108
ODK Build is a drag-and-drop form designer for ODK XForms. Thousands of users around the world depend on it for their data collection campaigns. Contribute and make the world a better place! ✨📝✨
Form Gear
⭐
106
FormGear is a framework engine for dynamic form creation and complex form processing and validation for data collection.
Classifai
⭐
96
🔥 One of the most comprehensive open-source data annotation platform.
Funded_nisl
⭐
93
FUNDED is a novel learning framework for building vulnerability detection models.
Akvo Flow
⭐
65
A data collection and monitoring tool that works anywhere.
Opencamera Sensors
⭐
65
Android app for synchronized recording of video and IMU data with advanced camera options, useful for 3D reconstruction, SLAM, AR, video stabilization. Supports remote control over network.
Briefcase
⭐
62
ODK Briefcase is a Java application for fetching and pushing forms and their contents. It helps make billions of data points from ODK portable. Contribute and make the world a better place! ✨💼✨
Xtcryptosignals
⭐
61
Cryptocurrencies price data collection, price tickers, signals notifications, charts, Telegram bot and more.
Ros2_data_collection
⭐
59
Collect, validate and send data reliably from ROS 2 to create APIs and dashboards.
Coughcheckapp
⭐
59
Development of AI audio app to compare the cough of a Coronavirus (COVID-19) infected individual with the cough of an uninfected individual.
Android Amap Track Collect
⭐
57
这阵子由于项目需要,需要从手机上采集用户的运动轨迹数据,这样的功能大家都见到的很多了,比如咕咚、悦动
Zdh_server
⭐
56
数据采集平台zdh,etl 处理服务
Pyradios
⭐
53
Python client for the Radio Browser API
Drivers
⭐
53
Low-code Python library enabling access to APIs, tools, data sources in seconds.
V5_datacollection
⭐
53
数据采集器,爬虫,采集,行业软件,欢迎Star! 解决问题&接受各种意见建议.
Esplogger
⭐
53
An Arduino library providing a minimal interface to log data on flash memory and SD cards with ESP8266 and ESP32
Pptop
⭐
53
Open, extensible Python injector/profiler/analyzer
Elk_twitter
⭐
52
This is a data pipeline for Twitter (ETL) using the elastic stack Elasticsearch, Logstash and Kibana (version 6.1)
Noise2noise Audio_denoising_without_clean_training_data
⭐
52
Source code for the paper titled "Speech Denoising without Clean Training Data: a Noise2Noise Approach". Paper accepted at the INTERSPEECH 2021 conference. This paper tackles the problem of the heavy dependence of clean speech data required by deep learning based audio denoising methods by showing that it is possible to train deep speech denoising networks using only noisy speech samples.
Javarosa
⭐
51
The core library that many of the ODK tools are built around. It's written in Java, implements the ODK XForms spec, and runs on mobile devices and cloud servers. ✨🏗✨
Song Describer
⭐
48
Song Describer is a data collection platform for annotating music with textual descriptions.
Instamatic
⭐
48
Python program for automated electron diffraction data collection
Rtdl
⭐
39
rtdl makes it easy to build and maintain a real-time data lake
Shifting
⭐
32
A privacy-focused list of alternatives to mainstream services to help the competition.
Arcreactor
⭐
32
open-source intelligence gathering for SIEMs <3
Apiconnectors
⭐
32
A curated list of example code to collect data from Web APIs using DataPrep.Connector.
Ibge
⭐
31
🌎 Data collection of geographical divisions of Brazil by IBGE
Central Frontend
⭐
29
Vue.js based frontend for ODK Central
Xforms Spec
⭐
29
The XForms-derived specification used in the ODK ecosystem. If you are interested in building a tool that is compliant with the forms rendered by ODK tools, this is the place to start. ✨⚒✨
App Designer
⭐
27
A design environment for creating, customizing, and previewing your forms, data curation, and visualization applications.
Itri Speech Recognition Dataset Generation
⭐
26
Automatic Speech Recognition Dataset Generation
Xeno Canto Py
⭐
25
Python wrapper for the xeno-canto.org API to aid in downloading and managing recordings.
Xstate Wizards
⭐
24
Simplifying massive data collection UIs with state machines and spawned actors.
Skunkworks Crow
⭐
23
Skunkworks-crow is an Android app for sharing filled forms stored in ODK Collect from one device to another
Sdndiagnostics
⭐
23
SdnDiagnostics is a PowerShell module that is designed to simplify the diagnostic troubleshooting and data collection process when troubleshooting issues related to Microsoft Software Defined Network.
Data Collection Ios
⭐
22
Mobile data collection app using the iOS Runtime SDK.
Ingestly Client Javascript
⭐
22
Ingestly Client JavaScript SDK for modern web analytics.
Pyodk
⭐
22
The official Python library for ODK 🐍
Babler
⭐
21
Data Collection System For NLP/Speech Recognition
Xlsform Converter
⭐
20
💡📋 xlsconv: Command-line tool to convert questionnaires from Open Data Kit's XLSForm format into Django models and HTML (for use with https://wq.io/).
Data Collection Dotnet
⭐
19
Data collection application built using the .NET Runtime SDK.
Logpeck
⭐
18
Simple, RESTful Log Collector
Carp.core Kotlin
⭐
18
Infrastructure-agnostic framework for distributed data collection.
Qrealtime
⭐
18
This is a QGIS plugin which enables automatic survey form creation from GIS layers and uploading to ODK aggregate server. User can import existing data into GIS layers or enable sync with regular interval.
Fact
⭐
18
FACT is a tool to collect, process and visualise forensic data from clusters of machines running in the cloud or on-premise.
Iaso
⭐
18
Georegistry + Data Collection + Microplanning
Data Collection
⭐
17
Amadeus for Developers APIs Testing Data Collection
Pulr
⭐
17
pull devices and transform data into events
Coletores
⭐
17
Coletores de dados sobre remunerações do sistema de justiça brasileiro
Wearables
⭐
17
Data collection framework for wearable sensors
Akvo Flow Mobile
⭐
17
Akvo Flow app
Mailinglistscraper
⭐
15
A python web scraper for public email lists.
Pytok
⭐
15
A web scraper for TikTok using Playwright
Ingestly Endpoint
⭐
14
Ingestly Endpoint for Real-Time Analytics powered by Fastly & Google BigQuery
Twitter Crawler
⭐
14
REST and STREAMING crawlers of Twitter (java)
Stock Fundamental Data Scraping And Analysis
⭐
14
Project on building a web crawler to collect the fundamentals of the stock and review their performance in one go
Opendatacapture
⭐
14
An open-source, user-friendly web application for electronic data capture
Ornitholog
⭐
14
Open-source Twitter collection and archiving tool for tracking specific topics and collecting bulk data.
Cocoafrica
⭐
13
A Curation Tool and Dataset of Common Objects in the Context of Africa
Wakeword Data Collector
⭐
12
A prototype CLI in Python where a user can collect all of the recordings needed to produce a wakeword
Cheetah
⭐
12
Fast and differentiable particle accelerator optics simulation for reinforcement learning and optimisation applications.
Data Science Cell Training
⭐
12
This is the official repository of the Data Science 📊 Cell Training journey provided by the CIT Club.
Alba
⭐
11
Sistema para escalonamento e orquestração de execuções, visando a automatização de processos do DadosJusBR
Rfid Based Attendance System Using Arduino
⭐
11
DEPRECATED - no longer actively maintained
Opencamera Sensors
⭐
11
Android app for synchronized recording of video and IMU data on one or multiple smartphones with advanced camera options, useful for 3D reconstruction, SLAM, AR, video stabilization. Supports remote control over network.
Selenium Image Crawler
⭐
10
Selenium Image Crawler
Dayz Reforger
⭐
10
A general purpose Discord bot to handle DayZ Killfeed, stats, alarms and factions' armbands using Nitrado log files.
Webtrench
⭐
10
A powerful and easy-to-use web scrapper for collecting data from the web. Supports scraping of images, text, videos, meta data, and more. Ideal for machine learning and deep learning engineers. Download and extract data with just one line of code
Myowebtoolkit
⭐
10
Web tools to do research with Myo
Aws Spot Price History
⭐
9
automating aws spot price history retrieval
Multi Modal Automation Suite
⭐
9
image based automation environment
Pyrostat
⭐
9
API (Python) for Eurostat data collections upload
Pywikimm
⭐
9
Collects a multimodal dataset of Wikipedia articles and their images
Goblyn
⭐
9
Goblyn is a Python tool focused to enumeration and capture of website files metadata.
Citi Map
⭐
9
Citi Map is an open source tool for creating personal data maps
Impact Events Dataset
⭐
9
This repository contains a novel time-series dataset for impact detection and localization on a plastic thin-plate, towards Structural Health Monitoring applications, using ceramic piezoelectric transducers (PZTs) connected to an Internet of Things (IoT) device.
Validate
⭐
8
ODK Validate is a Java application for confirming that a form is valid and compliant with the ODK XForms specification. Contribute and make the world a better place! ✨🔍✨
Where To Buy
⭐
7
🏠 Help Crain's readers decide where to buy real estate
Opc Ua Umati Mssql Grafana
⭐
7
OPC Router Docker Sample for a Umati MSSQL communication with Grafana Dashboard
Covid Fighters
⭐
7
Data collection and label tool for COVID-19 disease chest scans
1-100 of 124 search results
Next >
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.