Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Dataset Multilingual Open Source Projects

Open source projects categorized as Python Dataset Multilingual
Categories > Data Processing > Dataset
Categories > Text Processing > Multilingual
The Pile ⭐ 1,048
total releases 1most recent commit a year ago
Multilingual_text_to_speech ⭐ 740
An implementation of Tacotron 2 that supports multilingual experiments with parameter-sharing, code-switching, and voice cloning.
most recent commit 6 months ago
Github Typo Corpus ⭐ 289
GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors
most recent commit 4 years ago
Xl Sum ⭐ 209
This repository contains the code, data, and models of the paper titled "XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages" published in Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021.
most recent commit a year ago
Mtdata ⭐ 115
A tool that locates, downloads, and extracts machine translation corpora
total releases 21most recent commit a year ago
Ml Mkqa ⭐ 94
We introduce MKQA, an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically diverse languages (260k question-answer pairs in total). The goal of this dataset is to provide a challenging benchmark for question answering quality across a wide set of languages. Please refer to our paper for details, MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering
most recent commit 2 years ago
Mmner ⭐ 69
Massively Multilingual Transfer for NER
most recent commit 3 years ago
Anuvaad ⭐ 65
State of the art open-source translation for Indic languages.
total releases 7most recent commit 3 years ago
Glot500 ⭐ 65
Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages (ACL'23)
most recent commit 5 months ago
Mlma_hate_speech ⭐ 54
Dataset and code of our EMNLP 2019 paper "Multilingual and Multi-Aspect Hate Speech Analysis"
most recent commit 5 months ago
Xpersona ⭐ 51
XPersona: Evaluating Multilingual Personalized Chatbot
most recent commit 2 years ago
Ewiser ⭐ 40
A Word Sense Disambiguation system integrating implicit and explicit external knowledge.
most recent commit 3 years ago
Okapi ⭐ 36
Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
most recent commit 8 months ago
Extractive_rc_by_runtime_mt ⭐ 30
Code and datasets of "Multilingual Extractive Reading Comprehension by Runtime Machine Translation"
most recent commit 5 years ago
Exams Qa ⭐ 23
A Multi-subject High School Examinations Dataset for Cross-lingual and Multilingual Question Answering
most recent commit 2 years ago
Meta Transfer Learning ⭐ 22
Implementation of meta-transfer-learning (ACL 2020)
most recent commit 4 years ago
Ckanext Fluent ⭐ 22
Multilingual fields for CKAN
most recent commit a year ago
Stsb Multi Mt ⭐ 15
Machine translated multilingual STS benchmark dataset.
most recent commit 4 months ago
Stable Diffusion Pokemon ⭐ 14
A demo of fine tune Stable Diffusion on Pokemon-Blip-Captions in English, Japanese and Chinese Corpus
most recent commit a year ago
Babelnet Sememe Prediction ⭐ 13
Code and data of the AAAI-20 paper "Towards Building a Multilingual Sememe Knowledge Base: Predicting Sememes for BabelNet Synsets"
most recent commit 4 years ago
Language Agnostic Contextualized Encoders ⭐ 7
most recent commit 3 years ago
Xstance ⭐ 6
A Multilingual Multi-Target Dataset for Stance Detection
most recent commit 4 years ago
Webcorpus ⭐ 5
Generate large textual corpora for almost any language by crawling the web
most recent commit 2 years ago
The 3 Latest Releases In Python Dataset Multilingual Open Source Projects
Mtdata ⭐ 115
A tool that locates, downloads, and extracts machine translation corpora
total releases 21latest release November 25, 2022most recent commit a year ago
Anuvaad ⭐ 65
State of the art open-source translation for Indic languages.
total releases 7latest release April 11, 2021most recent commit 3 years ago
The Pile ⭐ 1,048
total releases 1latest release October 17, 2020most recent commit a year ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.