Awesome Open Source
Awesome Open Source

The Top 117 Python Natural Language Processing Bert Open Source Projects on Github

Topic > Bert
Categories > Machine Learning > Natural Language Processing
Deep learning (DL) approaches use various processing layers to learn hierarchical representations of data. Recently, many methods and designs of natural language processing (NLP) models have shown significant development, especially in text mining and analysis. For learning vector-space representations of text, there are famous models like Word2vec, GloVe, and fastText. In fact, NLP took a big step forward when BERT and recently GTP-3 came out. Deep Learning algorithms are unable to deal with textual data in their natural language data form which is typically unstructured information; they require special representation of data as inputs instead. Usually, natural language text data needs to be converted into internal representations form that DL algorithms can read such as feature vectors, hence the necessity to use representation learning models. These models have shown a big leap during the last years. Their set ranges from the methods that embed words into distributed representations and use the language modeling objective to adjust them as model parameters (like Word2vec, fastText, and GloVe), to recently transfer learning models (like ELMo, BERT, ULMFiT, XLNet, ALBERT, RoBERTa, and GPT-2). These last use larger corpora, more parameters, more computing resources, and instead of assigning each word with a fixed vector, they use multilayer neural networks to calculate dynamic representations for the words according to their context, which is especially useful for the words with multiple meanings.
1-100 of 117 projects

Related Projects

Python Machine Learning Projects (15,209)
Python Deep Learning Projects (12,666)
Python Tensorflow Projects (8,302)
Python Pytorch Projects (8,107)
Python Neural Network Projects (4,244)
Python Nlp Projects (4,228)
Python Data Science Projects (4,215)
Python Keras Projects (3,652)
Python Deep Learning Pytorch Projects (2,788)
Python Deep Learning Tensorflow Projects (2,614)
Python Artificial Intelligence Projects (2,545)
Python Natural Language Processing Projects (2,426)
Python Machine Learning Data Science Projects (1,923)
Python Machine Learning Tensorflow Projects (1,852)
Python Cnn Projects (1,844)
Python Ai Projects (1,810)
Python Deep Learning Neural Network Projects (1,767)
Python Machine Learning Neural Network Projects (1,664)
Python Tensorflow Keras Projects (1,630)
Python Deep Neural Networks Projects (1,536)
Python Classification Projects (1,496)
Nlp Natural Language Processing Projects (1,494)
Machine Learning Natural Language Processing Projects (1,472)
Python Visualization Projects (1,472)
Python Dataset Projects (1,416)
Python Tutorial Projects (1,292)
Python Chatbot Projects (1,250)
Python Machine Learning Pytorch Projects (1,231)
Jupyter Notebook Natural Language Processing Projects (1,039)
Deep Learning Natural Language Processing Projects (1,034)
Python Web Projects (1,033)
Python Sentiment Analysis Projects (1,028)
Python Machine Learning Nlp Projects (934)
Python Transformer Projects (868)
Python Parser Projects (820)
Python Deep Learning Artificial Intelligence Projects (794)
Python Nlp Natural Language Processing Projects (760)
Python Machine Learning Natural Language Processing Projects (738)
Python Bert Projects (700)
Python Elasticsearch Projects (692)
Python Text Classification Projects (676)
Python Deep Learning Nlp Projects (658)
Python Pytorch Neural Network Projects (626)
Python Speech Recognition Projects (610)
Python Google Projects (602)
Python Deep Learning Natural Language Processing Projects (545)
Python Unsupervised Learning Projects (506)
Python Tensorflow Pytorch Projects (497)
Python Pytorch Nlp Projects (480)
Python Transfer Learning Projects (472)
Machine Learning Nlp Natural Language Processing Projects (466)
Python Search Projects (451)
Python Word2vec Projects (451)
Nlp Bert Projects (442)
Python Svm Projects (433)
Python Seq2seq Projects (396)
Python Benchmark Projects (376)
Python Embeddings Projects (370)
Python Spacy Projects (369)
Python Named Entity Recognition Projects (366)
Pytorch Natural Language Processing Projects (360)
Python Tensorflow Nlp Projects (358)
Python Search Engine Projects (354)
Natural Language Processing Sentiment Analysis Projects (342)
Python Attention Projects (340)
Python Demo Projects (329)
Python Information Retrieval Projects (323)
Tensorflow Natural Language Processing Projects (316)
Python Ner Projects (302)
Python Question Answering Projects (297)
Python Language Model Projects (296)
Python Pytorch Transformer Projects (295)
Transformer Bert Projects (285)
Python Knowledge Graph Projects (283)
Neural Network Natural Language Processing Projects (282)
Python Mxnet Projects (275)
Jupyter Notebook Nlp Natural Language Processing Projects (269)
Deep Learning Nlp Natural Language Processing Projects (268)
Pytorch Bert Projects (263)
Python Deep Learning Tensorflow Pytorch Projects (259)
Python Awesome Projects (258)
Python Word Embeddings Projects (256)
Python Chinese Projects (255)
Python Tf Idf Projects (253)
Python Pytorch Natural Language Processing Projects (252)
Jupyter Notebook Bert Projects (252)
Python Machine Learning Nlp Natural Language Processing Projects (249)
Python Tensorflow Classification Projects (246)
Python Nlp Bert Projects (242)
Python Machine Learning Pytorch Neural Network Projects (229)
Python Nlp Sentiment Analysis Projects (226)
Python Representation Learning Projects (226)
Python Machine Learning Deep Projects (14)
Python Machine Learning Deep Tensorflow Projects (5)
Python Machine Learning Deep Pytorch Projects (3)