Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Fast Sentence Transformers

This repository, called fast sentence transformers, contains code to run 5X faster sentence transformers using tools like quantization and ONNX.
Stars
43
License
mit
Open Issues
2
Most Recent Commit
a year ago
Programming Language
Python
Total Releases
7
Latest Release
May 09, 2022
Categories
Repo
Alternatives To Fast Sentence Transformers
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Deepsparse2,729pypi deepsparse-nightly} Downloads33 months ago141December 07, 202328otherPython
Sparsity-aware deep learning inference runtime for CPUs
Sparseml1,910pypi sparseml} Downloads53 months ago37December 04, 202360apache-2.0Python
Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
Kobert1,035
a year ago5apache-2.0Jupyter Notebook
Korean BERT pre-trained cased (KoBERT)
Bolt823
a year ago38mitC++
Bolt is a deep learning library with high performance and heterogeneous flexibility.
Nncf725pypi nncf} Downloads63 months ago16November 16, 202346apache-2.0Python
Neural Network Compression Framework for enhanced OpenVINO™ inference
Fastt5280
2 years ago14April 05, 202213apache-2.0Python
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
Browser Ml Inference221
2 years agoapache-2.0Jupyter Notebook
Edge Inference in Browser with Transformer NLP model
Onnxt5136
3 years ago11January 28, 20213apache-2.0Python
Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.
Clip Onnx122
9 months ago2mitPython
It is a simple library to speed up CLIP inference up to 3x (K80 GPU)
Optimum Transformers71
2 years ago3April 01, 20221gpl-3.0Python
Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.
Alternatives To Fast Sentence Transformers
Select To Compare
Deepsparse ⭐ 2,729
Sparsity-aware deep learning inference runtime for CPUs
dependent packages 3total releases 141most recent commit 3 months agopypi deepsparse-nightly} Downloads
Nncf ⭐ 725
Neural Network Compression Framework for enhanced OpenVINO™ inference
dependent packages 6total releases 16most recent commit 3 months agopypi nncf} Downloads


Suggest An Alternative To fast-sentence-transformers
Alternative Project Comparisons
Fast Sentence Transformers vs Deepsparse
Fast Sentence Transformers vs Sparseml
Fast Sentence Transformers vs Kobert
Fast Sentence Transformers vs Bolt
Fast Sentence Transformers vs Nncf
Fast Sentence Transformers vs Fastt5
Fast Sentence Transformers vs Browser Ml Inference
Fast Sentence Transformers vs Onnxt5
Fast Sentence Transformers vs Clip Onnx
Fast Sentence Transformers vs Optimum Transformers
Popular Onnx Projects
Yolov5 ⭐ 44,755
YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
dependent packages 2total releases 3latest release June 08, 2022most recent commit 3 months agopypi ultralytics-yolov5} Downloads
Netron ⭐ 26,068
Visualizer for neural network, deep learning and machine learning models
dependent packages 70total releases 610latest release December 09, 2023most recent commit 7 days agopypi netron} Downloads
Ncnn ⭐ 19,097
ncnn is a high-performance neural network inference framework optimized for the mobile platform
dependent packages 1total releases 26latest release October 27, 2023most recent commit 22 days agopypi ncnn} Downloads
Onnx ⭐ 16,275
Open standard for machine learning interoperability
dependent packages 493total releases 31latest release October 26, 2023most recent commit 3 months agopypi onnx} Downloads
Clip As Service ⭐ 12,160
🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
dependent packages 14total releases 56latest release December 20, 2019most recent commit 3 months agopypi bert-serving-client} Downloads
Popular Natural Language Processing Projects
Transformers ⭐ 124,049
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
dependent packages 2,484total releases 125latest release November 15, 2023most recent commit 19 days agopypi transformers} Downloads
Ailearning ⭐ 37,934
AiLearning：数据分析+机器学习实战+线性代数+PyTorch+NLTK+TF2
dependent packages 2total releases 8latest release March 20, 2022most recent commit 2 months agonpm ailearning} Downloads
Bert ⭐ 36,099
TensorFlow code and pre-trained models for BERT
dependent packages 10total releases 5latest release August 11, 2020most recent commit 6 months agopypi bert-tensorflow} Downloads
Made With Ml ⭐ 35,496
Learn how to design, develop, deploy and iterate on production-grade ML applications.
total releases 5latest release May 15, 2019most recent commit 5 months ago
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Related Searches
Python Natural Language Processing
Python Embeddings
Natural Language Processing Embeddings
Python Onnx
Python Sentence Transformers
Natural Language Processing Onnx
Natural Language Processing Sentence Transformers
Embeddings Onnx
Embeddings Sentence Transformers

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Natural Language Processing
Embeddings
Onnx
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.