The Top 111 Datasets Open Source Projects

Awesome Open Source

Awesome Open Source

Combined Topics

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210

The Top 111 Datasets Open Source Projects

Categories > Data Processing > Datasets

Awesome Public Datasets ⭐ 45,332

A topic-centric list of HQ open datasets.

Pix2code ⭐ 11,272

pix2code: Generating Code from a Graphical User Interface Screenshot

Datasets ⭐ 8,699

🤗 The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools

Label Studio ⭐ 6,227

Label Studio is a multi-type data labeling and annotation tool with standardized output format

Datasette ⭐ 5,280

An open source multi-tool for exploring and publishing data

Doccano ⭐ 5,075

Open source annotation tool for machine learning practitioners.

Akshare ⭐ 3,796

AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库

Fastest dataset optimization and management for machine and deep learning. Stream data real-time & version-control it. http://activeloop.ai

Datasets ⭐ 2,916

TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...

Awesome Json Datasets ⭐ 2,351

A curated list of awesome JSON datasets that don't require authentication.

Cluedatasetsearch ⭐ 1,874

搜索所有中文NLP数据集，附常用英文NLP数据集

Pipedream ⭐ 1,727

Connect APIs, remarkably fast. Free for developers.

Chineseglue ⭐ 1,487

Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard

Gopup ⭐ 1,478

数据接口：百度、谷歌、头条、微博指数,宏观数据，利率数据，货币汇率，千里马、独角兽公司，新闻联播文字稿，影视票房数据，高校名单，疫情数据…

Codesearchnet ⭐ 1,449

Datasets, tools, and benchmarks for representation learning of code.

Satellite Image Deep Learning ⭐ 1,423

Resources for deep learning with satellite & aerial imagery

Coco Annotator ⭐ 1,299

✏️ Web-based image segmentation tool for object detection, localization, and keypoints

Colour ⭐ 1,243

Colour Science for Python

Pytorch Cpp ⭐ 1,108

C++ Implementation of PyTorch Tutorials for Everyone

Dataframes.jl ⭐ 1,099

In-memory tabular data in Julia

Benchmark datasets, data loaders, and evaluators for graph machine learning

Entity Recognition Datasets ⭐ 986

A collection of corpora for named entity recognition (NER) and entity recognition tasks. These annotated datasets cover a variety of languages, domains and entity types.

Pydataset ⭐ 889

Instant access to many datasets in Python.

Conversational Datasets ⭐ 886

Large datasets for conversational AI

Open source audio annotation tool for humans™

Awesome Transit ⭐ 748

Community list of transit APIs, apps, datasets, research, and software 🚌🌟🚋🌟🚂

A large collection of system log datasets for AI-powered log analytics

Voice_datasets ⭐ 620

🔊 A comprehensive list of open-source datasets for voice and sound computing (95+ datasets).

Datasets ⭐ 611

Machine learning datasets used in tutorials on MachineLearningMastery.com

Datasets For Recommender Systems ⭐ 610

This is a repository of a topic-centric public data sources in high quality for Recommender Systems (RS)

Awesome Twitter Data ⭐ 578

A list of Twitter datasets and related resources.

Annotated Semantic Relationships Datasets ⭐ 575

A collections of public and free annotated datasets of relationships between entities/nominals (Portuguese and English)

Awesome Dataset Tools ⭐ 555

🔧 A curated list of awesome dataset tools

Projects ⭐ 547

🪐 End-to-end NLP workflows from prototype to production

Chinese Nlp Corpus ⭐ 517

Collections of Chinese NLP corpus

Awesome Robotics ⭐ 513

A curated list of awesome links and software libraries that are useful for robots.

Open Machine Learning

Awesome Cybersecurity Datasets ⭐ 473

A curated list of amazingly awesome Cybersecurity datasets

Easy access to official spatial data sets of Brazil in R and Python

Animal Matting ⭐ 462

Github repository for the paper End-to-end Animal Image Matting

Open3d Ml ⭐ 449

An extension of Open3D to address 3D Machine Learning tasks

Awesome Autonomous Vehicle ⭐ 441

无人驾驶的资源列表中文版

Awesome Holistic 3d ⭐ 425

A list of papers and resources (data,code,etc) for holistic 3D reconstruction in computer vision

Video Understanding Dataset ⭐ 398

A collection of recent video understanding datasets, under construction!

Paperrobot ⭐ 392

Code for PaperRobot: Incremental Draft Generation of Scientific Ideas

Therapeutics Data Commons: Machine Learning Foundation for Therapeutics

Dr.sure ⭐ 372

🏫DeepLearning学习笔记以及Tensorflow、Pytorch的使用心得笔记。Dr. Sure会不定时往项目中添加他看到的最新的技术，欢迎批评指正。

Medical Datasets ⭐ 372

tracking medical datasets, with a focus on medical imaging

3d Pointcloud ⭐ 365

Papers and Datasets about Point Cloud.

Cluecorpus2020 ⭐ 347

Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料

Awesome Segmentation Saliency Dataset ⭐ 343

A collection of some datasets for segmentation / saliency detection. Welcome to PR...😄

Cleora AI is a general-purpose model for efficient, scalable learning of stable and inductive entity embeddings for heterogeneous relational data.

Create full-fledged APIs for static datasets without writing a single line of code.

Simple downloader for pre-trained word vectors

Meglass ⭐ 290

An eyeglass face dataset collected and cleaned for face recognition evaluation, CCBR 2018.

Kartaslov ⭐ 287

Открытые лингвистические датасеты: тональный словарь русского языка, датасет по семантике, ассоциативный граф и датасет по орфографическим ошибкам и опечаткам.

Open Bandit Pipeline: a python library for bandit algorithms and off-policy evaluation

Retriever ⭐ 251

Quickly download, clean up, and install public datasets into a database management system

Annotation_tools ⭐ 251

Visipedia Annotation Tools

Machine Learning Resources ⭐ 251

A curated list of awesome machine learning frameworks, libraries, courses, books and many more.

Automated Resume Screening System ⭐ 245

Automated Resume Screening System using Machine Learning (With Dataset)

Datasets ⭐ 240

source{d} datasets ("big code") for source code analysis and machine learning on source code

Ner Datasets ⭐ 234

Datasets to train supervised classifiers for Named-Entity Recognition in different languages (Portuguese, German, Dutch, French, English)

Indonlu ⭐ 230

The first-ever vast natural language processing benchmark for Indonesian Language. We provide multiple downstream tasks, pre-trained IndoBERT models, and a starter code! (AACL-IJCNLP 2020)

Aidl_kb ⭐ 222

A Knowledge Base for the FB Group Artificial Intelligence and Deep Learning (AIDL)

A Modular Optimization framework for Localization and mApping (MOLA)

Nlp_datasets ⭐ 214

My NLP datasets for Russian language

Datasaurus ⭐ 205

R Package 📦 Containing the Datasaurus Dozen datasets 📊

Complete Life Cycle Of A Data Science Project ⭐ 205

Complete-Life-Cycle-of-a-Data-Science-Project

Exposure_correction ⭐ 186

Project page of the paper "Learning Multi-Scale Photo Exposure Correction" (CVPR 2021).

Unify Emotion Datasets ⭐ 177

A Survey and Experiments on Annotated Corpora for Emotion Classification in Text

Pin, Discover and Share Resources

Links to Russian corpora + Python functions for loading and parsing

Awesome Nlp Polish ⭐ 168

A curated list of resources dedicated to Natural Language Processing (NLP) in polish. Models, tools, datasets.

Robotcar Dataset Sdk ⭐ 161

Software Development Kit for the Oxford Robotcar Dataset

Idenprof ⭐ 157

IdenProf dataset is a collection of images of identifiable professionals. It is been collected to enable the development of AI systems that can serve by identifying people and the nature of their job by simply looking at an image, just like humans can do.

Awesome Colour ⭐ 154

Curated list of awesome colour science resources 😎

Remo Python ⭐ 153

🐰 Python lib for remo - the app for annotations and images management in Computer Vision

Gekko Datasets ⭐ 149

Gekko Trading Bot dataset dumps. Ready to use and download history files in SQLite format.

Wb_srgb ⭐ 140

White balance camera-rendered sRGB images (CVPR 2019) [Matlab & Python]

Firstcoursenetworkscience ⭐ 139

Tutorials, datasets, and other material associated with textbook "A First Course in Network Science" by Menczer, Fortunato & Davis

Bird Recognition Review ⭐ 138

A list of useful resources in the bird sound (song and calls) recognition, such as datasets, papers, links to open source projects and competitions

Multi_object_datasets ⭐ 136

Multi-object image datasets with ground-truth segmentation masks and generative factors.

Datumaro ⭐ 128

Dataset Management Framework, a Python library and a CLI tool to build, analyze and manage Computer Vision datasets.

Doppelganger ⭐ 123

[IMC 2020 (Best Paper Finalist)] Using GANs for Sharing Networked Time Series Data: Challenges, Initial Promise, and Open Questions

Aesthetics ⭐ 120

Image Aesthetics Toolkit - includes Fisher Vector implementation, AVA (Image Aesthetic Visual Analysis) dataset and fast multi-threaded downloader

Aspect Based Sentiment Analysis ⭐ 119

Aspect-Based Sentiment Analysis Experiments

Crossweigh ⭐ 119

CrossWeigh: Training Named Entity Tagger from Imperfect Annotations

Persian Swear Words ⭐ 118

دیتاست کلمات نامناسب و بد فارسی برای فیلتر کردن متن ها

Cholera ⭐ 113

R Package for Analyzing John Snow's 1854 Cholera Map

Nlu_datasets_with_task_oriented_dialogue ⭐ 112

datasets of natural language understanding and dialogue state tracking

Conversationalir ⭐ 111

Overview of venues, research themes and datasets relevant for conversational search.

Opendatasets ⭐ 108

A Python library for downloading datasets from Kaggle, Google Drive, and other online sources.

Transitland Datastore ⭐ 101

Transitland's centralized web service API for both querying and editing aggregated transit data from around the world

Nottingham Dataset ⭐ 98

Cleaned version of the Nottingham dataset

Ake Datasets ⭐ 97

Large, curated set of benchmark datasets for evaluating automatic keyphrase extraction algorithms.

Bumblebee ⭐ 96

🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF and PySpark)

Photogrammetry_datasets ⭐ 94

Collection of 350+ datasets for photogrammetry

Kaggle Code ⭐ 93

A repository for some of the code I use in kaggle data science & machine learning tasks.

Json2python Models ⭐ 91

Generate Python model classes (pydantic, attrs, dataclasses) based on JSON datasets with typing module support

1-100 of 111 projects

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210