Awesome Open Source
Awesome Open Source
Combined Topics
datasets x
Advertising 📦 10
All Projects
Application Programming Interfaces 📦 124
Applications 📦 192
Artificial Intelligence 📦 78
Blockchain 📦 73
Build Tools 📦 113
Cloud Computing 📦 80
Code Quality 📦 28
Collaboration 📦 32
Command Line Interface 📦 49
Community 📦 83
Companies 📦 60
Compilers 📦 63
Computer Science 📦 80
Configuration Management 📦 42
Content Management 📦 175
Control Flow 📦 213
Data Formats 📦 78
Data Processing 📦 276
Data Storage 📦 135
Economics 📦 64
Frameworks 📦 215
Games 📦 129
Graphics 📦 110
Hardware 📦 152
Integrated Development Environments 📦 49
Learning Resources 📦 166
Legal 📦 29
Libraries 📦 129
Lists Of Projects 📦 22
Machine Learning 📦 347
Mapping 📦 64
Marketing 📦 15
Mathematics 📦 55
Media 📦 239
Messaging 📦 98
Networking 📦 315
Operating Systems 📦 89
Operations 📦 121
Package Managers 📦 55
Programming Languages 📦 245
Runtime Environments 📦 100
Science 📦 42
Security 📦 396
Social Media 📦 27
Software Architecture 📦 72
Software Development 📦 72
Software Performance 📦 58
Software Quality 📦 133
Text Editors 📦 49
Text Processing 📦 136
User Interface 📦 330
User Interface Components 📦 514
Version Control 📦 30
Virtualization 📦 71
Web Browsers 📦 42
Web Servers 📦 26
Web User Interface 📦 210

The Top 97 Datasets Open Source Projects

Categories > Data Processing > Datasets
Awesome Public Datasets ⭐ 42,808
A topic-centric list of HQ open datasets.
Pix2code ⭐ 11,108
pix2code: Generating Code from a Graphical User Interface Screenshot
Datasets ⭐ 6,533
🤗 The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools
Datasette ⭐ 4,553
An open source multi-tool for exploring and publishing data
Doccano ⭐ 4,163
Open source text annotation tool for machine learning practitioner.
Label Studio ⭐ 3,979
Label Studio is a multi-type data labeling and annotation tool with standardized output format
Akshare ⭐ 2,856
AkShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库
Datasets ⭐ 2,627
TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...
Awesome Json Datasets ⭐ 2,189
A curated list of awesome JSON datasets that don't require authentication.
Cluedatasetsearch ⭐ 1,411
搜索所有中文NLP数据集，附常用英文NLP数据集
Pipedream ⭐ 1,401
Serverless integration and compute platform. Free for developers.
Chineseglue ⭐ 1,391
Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard
Codesearchnet ⭐ 1,350
Datasets, tools, and benchmarks for representation learning of code.
Colour ⭐ 1,079
Colour Science for Python
Coco Annotator ⭐ 1,045
✏️ Web-based image segmentation tool for object detection, localization and keypoints
Pytorch Cpp ⭐ 976
C++ Implementation of PyTorch Tutorials for Everyone
Gopup ⭐ 969
数据接口：百度、谷歌、头条、微博指数,宏观数据，利率数据，货币汇率，千里马、独角兽公司，新闻联播文字稿，影视票房数据，高校名单，疫情数据…
Dataframes.jl ⭐ 911
In-memory tabular data in Julia
Pydataset ⭐ 871
Instant access to many datasets in Python.
Entity Recognition Datasets ⭐ 851
A collection of corpora for named entity recognition (NER) and entity recognition tasks. These annotated datasets cover a variety of languages, domains and entity types.
Conversational Datasets ⭐ 809
Large datasets for conversational AI
Audino ⭐ 723
Open source audio annotation tool for humans™
Ogb ⭐ 715
Benchmark datasets, data loaders, and evaluators for graph machine learning
Awesome Transit ⭐ 693
Community list of transit APIs, apps, datasets, research, and software 🚌🌟🚋🌟🚂
Hub ⭐ 638
The fastest way to access and manage datasets for PyTorch and TensorFlow. Easily build scalable data pipelines. Leading Data 2.0 http://activeloop.ai
Datasets For Recommender Systems ⭐ 541
This is a repository of a topic-centric public data sources in high quality for Recommender Systems (RS)
Annotated Semantic Relationships Datasets ⭐ 537
A collections of public and free annotated datasets of relationships between entities/nominals (Portuguese and English)
Loghub ⭐ 511
A large collection of system log datasets for AI-powered log analytics
Awesome Twitter Data ⭐ 501
A list of Twitter datasets and related resources.
Openml ⭐ 475
Open Machine Learning
Datasets ⭐ 474
Machine learning datasets used in tutorials on MachineLearningMastery.com
Awesome Dataset Tools ⭐ 466
🔧 A curated list of awesome dataset tools
Awesome Robotics ⭐ 455
A curated list of awesome links and software libraries that are useful for robots.
Voice_datasets ⭐ 428
🔊 A comprehensive list of open-source datasets for voice and sound computing (50+ datasets).
Chinese Nlp Corpus ⭐ 402
Collections of Chinese NLP corpus
Video Understanding Dataset ⭐ 379
A collection of recent video understanding datasets, under construction!
Geobr ⭐ 379
Easy access to official spatial data sets of Brazil in R and Python
Awesome Autonomous Vehicle ⭐ 368
无人驾驶的资源列表中文版
Paperrobot ⭐ 363
Code for PaperRobot: Incremental Draft Generation of Scientific Ideas
Awesome Holistic 3d ⭐ 363
A list of papers and resources (data,code,etc) for holistic 3D reconstruction in computer vision
Dr.sure ⭐ 359
🏫DeepLearning学习笔记以及Tensorflow、Pytorch的使用心得笔记。Dr. Sure会不定时往项目中添加他看到的最新的技术，欢迎批评指正。
Awesome Cybersecurity Datasets ⭐ 342
A curated list of amazingly awesome Cybersecurity datasets
Animal Matting ⭐ 330
Github repository for the paper End-to-end Animal Image Matting
Chakin ⭐ 323
Simple downloader for pre-trained word vectors
Projects ⭐ 317
🪐 End-to-end NLP workflows from prototype to production
Awesome Segmentation Saliency Dataset ⭐ 303
A collection of some datasets for segmentation / saliency detection. Welcome to PR...😄
Meglass ⭐ 274
An eyeglass face dataset collected and cleaned for face recognition evaluation, CCBR 2018.
Medical Datasets ⭐ 267
tracking medical datasets, with a focus on medical imaging
Kartaslov ⭐ 266
Cluecorpus2020 ⭐ 258
Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
Open3d Ml ⭐ 244
An extension of Open3D to address 3D Machine Learning tasks
Annotation_tools ⭐ 242
Visipedia Annotation Tools
Retriever ⭐ 237
Quickly download, clean up, and install public datasets into a database management system
Datasets ⭐ 228
source{d} datasets ("big code") for source code analysis and machine learning on source code
Aidl_kb ⭐ 218
A Knowledge Base for the FB Group Artificial Intelligence and Deep Learning (AIDL)
Ner Datasets ⭐ 218
Datasets to train supervised classifiers for Named-Entity Recognition in different languages (Portuguese, German, Dutch, French, English)
Tdc ⭐ 217
Therapeutics Data Commons: Machine Learning Datasets for Therapeutics
Machine Learning Resources ⭐ 215
A curated list of awesome machine learning frameworks, libraries, courses, books and many more.
Automated Resume Screening System ⭐ 214
Automated Resume Screening System using Machine Learning (With Dataset)
Mola ⭐ 201
A Modular Optimization framework for Localization and mApping (MOLA)
Zr Obp ⭐ 195
Open Bandit Pipeline: a python library for bandit algorithms and off-policy evaluation
Datasaurus ⭐ 190
R Package 📦 Containing the Datasaurus Dozen datasets 📊
Nlp_datasets ⭐ 183
My NLP datasets for Russian language
Indonlu ⭐ 173
The first-ever vast natural language processing benchmark for Indonesian Language. We provide multiple downstream tasks, pre-trained models, and a starter code! (AACL-IJCNLP 2020)
Unify Emotion Datasets ⭐ 166
A Survey and Experiments on Annotated Corpora for Emotion Classification in Text
Robotcar Dataset Sdk ⭐ 152
Software Development Kit for the Oxford Robotcar Dataset
Corus ⭐ 148
Links to Russian corpora + Python functions for loading and parsing
Gekko Datasets ⭐ 145
Gekko Trading Bot dataset dumps. Ready to use and download history files in SQLite format.
Idenprof ⭐ 143
IdenProf dataset is a collection of images of identifiable professionals. It is been collected to enable the development of AI systems that can serve by identifying people and the nature of their job by simply looking at an image, just like humans can do.
Awesome Nlp Polish ⭐ 141
A curated list of resources dedicated to Natural Language Processing (NLP) in polish. Models, tools, datasets.
3d Pointcloud ⭐ 133
Papers and Datasets about Point Cloud.
Pins ⭐ 133
Pin, Discover and Share Resources
Remo Python ⭐ 132
🐰 Python lib for remo - the app for annotations and images management in Computer Vision
Cleora ⭐ 128
Cleora AI is a general-purpose model for efficient, scalable learning of stable and inductive entity embeddings for heterogeneous relational data.
Complete Life Cycle Of A Data Science Project ⭐ 123
Complete-Life-Cycle-of-a-Data-Science-Project
Multi_object_datasets ⭐ 119
Multi-object image datasets with ground-truth segmentation masks and generative factors.
Aspect Based Sentiment Analysis ⭐ 114
Aspect-Based Sentiment Analysis Experiments
Bird Recognition Review ⭐ 111
A list of useful resources in the bird sound (song and calls) recognition, such as datasets, papers, links to open source projects and competitions
Cholera ⭐ 110
R Package for Analyzing John Snow's 1854 Cholera Map
Aesthetics ⭐ 110
Image Aesthetics Toolkit - includes Fisher Vector implementation, AVA (Image Aesthetic Visual Analysis) dataset and fast multi-threaded downloader
Nlu_datasets_with_task_oriented_dialogue ⭐ 101
datasets of natural language understanding and dialogue state tracking
Transitland Datastore ⭐ 99
Transitland's centralized web service API for both querying and editing aggregated transit data from around the world
Nottingham Dataset ⭐ 91
Cleaned version of the Nottingham dataset
Doppelganger ⭐ 89
[IMC 2020 (Best Paper Finalist)] Using GANs for Sharing Networked Time Series Data: Challenges, Initial Promise, and Open Questions
Wb_srgb ⭐ 83
White balance camera-rendered sRGB images (CVPR 2019) [Matlab & Python]
Openml R ⭐ 80
R package to interface with OpenML
Atis_dataset ⭐ 78
The ATIS (Airline Travel Information System) Dataset
Crossweigh ⭐ 78
CrossWeigh: Training Named Entity Tagger from Imperfect Annotations
Dareblopy ⭐ 78
Data Reading Blocks for Python
Exposure_correction ⭐ 74
Reference code for the paper "Learning to Correct Overexposed and Underexposed Photos". Our method is a coarse-to-fine deep learning model to correct badly-exposed photographs.
Persian Swear Words ⭐ 70
Persian (Farsi) Swear Words + .json Datasets
Wongnai Corpus ⭐ 56
Collection of Wongnai's datasets
Personas ⭐ 48
Datasets for Deep learning Personas
Describing_a_knowledge_base ⭐ 38
Code for Describing a Knowledge Base
French Sentiment Analysis Dataset ⭐ 35
A collection of over 1.5 Million tweets data translated to French, with their sentiment.
Commons ⭐ 34
⛲️ Commons Marketplace client & server to explore, download, and publish open data sets in the Ocean Protocol Network.
Segmentation_wbc ⭐ 33
White blood cell (WBC) image datasets
1-97 of 97 projects
Advertising 📦 10
All Projects
Application Programming Interfaces 📦 124
Applications 📦 192
Artificial Intelligence 📦 78
Blockchain 📦 73
Build Tools 📦 113
Cloud Computing 📦 80
Code Quality 📦 28
Collaboration 📦 32
Command Line Interface 📦 49
Community 📦 83
Companies 📦 60
Compilers 📦 63
Computer Science 📦 80
Configuration Management 📦 42
Content Management 📦 175
Control Flow 📦 213
Data Formats 📦 78
Data Processing 📦 276
Data Storage 📦 135
Economics 📦 64
Frameworks 📦 215
Games 📦 129
Graphics 📦 110
Hardware 📦 152
Integrated Development Environments 📦 49
Learning Resources 📦 166
Legal 📦 29
Libraries 📦 129
Lists Of Projects 📦 22
Machine Learning 📦 347
Mapping 📦 64
Marketing 📦 15
Mathematics 📦 55
Media 📦 239
Messaging 📦 98
Networking 📦 315
Operating Systems 📦 89
Operations 📦 121
Package Managers 📦 55
Programming Languages 📦 245
Runtime Environments 📦 100
Science 📦 42
Security 📦 396
Social Media 📦 27
Software Architecture 📦 72
Software Development 📦 72
Software Performance 📦 58
Software Quality 📦 133
Text Editors 📦 49
Text Processing 📦 136
User Interface 📦 330
User Interface Components 📦 514
Version Control 📦 30
Virtualization 📦 71
Web Browsers 📦 42
Web Servers 📦 26
Web User Interface 📦 210