Awesome Open Source
Awesome Open Source
Combined Topics
albert x
bert x

The Top 67 Bert Albert Open Source Projects on Github

Topic > Albert
Topic > Bert
Deep learning (DL) approaches use various processing layers to learn hierarchical representations of data. Recently, many methods and designs of natural language processing (NLP) models have shown significant development, especially in text mining and analysis. For learning vector-space representations of text, there are famous models like Word2vec, GloVe, and fastText. In fact, NLP took a big step forward when BERT and recently GTP-3 came out. Deep Learning algorithms are unable to deal with textual data in their natural language data form which is typically unstructured information; they require special representation of data as inputs instead. Usually, natural language text data needs to be converted into internal representations form that DL algorithms can read such as feature vectors, hence the necessity to use representation learning models. These models have shown a big leap during the last years. Their set ranges from the methods that embed words into distributed representations and use the language modeling objective to adjust them as model parameters (like Word2vec, fastText, and GloVe), to recently transfer learning models (like ELMo, BERT, ULMFiT, XLNet, ALBERT, RoBERTa, and GPT-2). These last use larger corpora, more parameters, more computing resources, and instead of assigning each word with a fixed vector, they use multilayer neural networks to calculate dynamic representations for the words according to their context, which is especially useful for the words with multiple meanings.
1-67 of 67 projects

Related Projects

Python Bert Projects (700)
Nlp Bert Projects (442)
Transformer Bert Projects (285)
Pytorch Bert Projects (263)
Jupyter Notebook Bert Projects (252)
Python Nlp Bert Projects (242)
Natural Language Processing Bert Projects (213)
Bert Model Projects (195)
Deep Learning Bert Projects (186)
Python Pytorch Bert Projects (176)
Python Transformer Bert Projects (163)
Tensorflow Bert Projects (151)
Nlp Transformer Bert Projects (129)
Python Natural Language Processing Bert Projects (127)
Nlp Natural Language Processing Bert Projects (118)
Machine Learning Bert Projects (115)
Pytorch Nlp Bert Projects (113)
Jupyter Notebook Nlp Bert Projects (113)
Python Deep Learning Bert Projects (111)
Bert Ner Projects (103)
Python Tensorflow Bert Projects (101)
Deep Learning Nlp Bert Projects (98)
Text Classification Bert Projects (97)
Bert Language Model Projects (97)
Pytorch Transformer Bert Projects (92)
Bert Roberta Projects (78)
Sentiment Analysis Bert Projects (77)
Python Pytorch Nlp Bert Projects (72)
Tensorflow Nlp Bert Projects (72)
Python Bert Ner Projects (71)
Python Albert Projects (70)
Machine Learning Nlp Bert Projects (69)
Python Machine Learning Bert Projects (68)
Jupyter Notebook Transformer Bert Projects (68)
Bert Question Answering Projects (67)
Python Nlp Transformer Bert Projects (64)
Natural Language Processing Transformer Bert Projects (64)
Python Text Classification Bert Projects (63)
Python Pytorch Transformer Bert Projects (62)
Bert Huggingface Projects (60)
Deep Learning Transformer Bert Projects (59)
Python Nlp Natural Language Processing Bert Projects (58)
Deep Learning Natural Language Processing Bert Projects (57)
Bert Gpt 2 Projects (54)
Nlp Bert Language Model Projects (54)
Jupyter Notebook Deep Learning Bert Projects (54)
Pytorch Natural Language Processing Bert Projects (53)
Bert Named Entity Recognition Projects (53)
Jupyter Notebook Pytorch Bert Projects (53)
Jupyter Notebook Natural Language Processing Bert Projects (53)
Python Deep Learning Nlp Bert Projects (52)
Python Bert Albert Projects (47)
Pytorch Nlp Transformer Bert Projects (46)
Bert Transfer Learning Projects (46)
Bert Pretrained Models Projects (45)
Python Bert Language Model Projects (45)