Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Llama 2 Open Source Llm Cpu Inference

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
Alternatives To Llama 2 Open Source Llm Cpu Inference
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Tensorflow180,196327783 months ago46October 23, 20192,049apache-2.0C++
An Open Source Machine Learning Framework for Everyone
Onnxruntime11,668nuget Microsoft.ML.OnnxRuntime} Downloads8883 months ago39November 20, 20232,222mitC++
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
Deepo6,312
a year ago1mitPython
Setup and customize deep learning environment in seconds.
Paddlex4,510pypi paddlex} Downloads24 months ago54December 10, 2021538apache-2.0Python
PaddlePaddle End-to-End Development Toolkit（『飞桨』深度学习全流程开发工具）
Serve3,844pypi torchserve} Downloads153 months ago22October 12, 2023332apache-2.0Java
Serve, optimize and scale PyTorch models in production
Ctranslate22,437pypi ctranslate2} Downloads233 months ago103December 05, 2023110mitC++
Fast inference engine for Transformer models
Decanlp2,330
4 months ago24bsd-3-clausePython
The Natural Language Decathlon: A Multitask Challenge for NLP
Addons1,674
5 months ago86apache-2.0Python
Useful extra functionality for TensorFlow 2.x maintained by SIG-addons
Sod1,651
9 months ago5otherC
An Embedded Computer Vision & Machine Learning Library (CPU Optimized & IoT Capable)
Mshadow1,036
5 years ago58otherC++
Matrix Shadow:Lightweight CPU/GPU Matrix and Tensor Template Library in C++/CUDA for (Deep) Machine Learning
Alternatives To Llama 2 Open Source Llm Cpu Inference
Select To Compare
Tensorflow ⭐ 180,196
An Open Source Machine Learning Framework for Everyone
dependent packages 78total releases 46most recent commit 3 months ago
Serve ⭐ 3,844
Serve, optimize and scale PyTorch models in production
dependent packages 15total releases 22most recent commit 3 months agopypi torchserve} Downloads
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103most recent commit 3 months agopypi ctranslate2} Downloads


Suggest An Alternative To Llama-2-Open-Source-LLM-CPU-Inference
Alternative Project Comparisons
Llama 2 Open Source Llm Cpu Inference vs Tensorflow
Llama 2 Open Source Llm Cpu Inference vs Onnxruntime
Llama 2 Open Source Llm Cpu Inference vs Deepo
Llama 2 Open Source Llm Cpu Inference vs Paddlex
Llama 2 Open Source Llm Cpu Inference vs Serve
Llama 2 Open Source Llm Cpu Inference vs Ctranslate2
Llama 2 Open Source Llm Cpu Inference vs Decanlp
Llama 2 Open Source Llm Cpu Inference vs Addons
Llama 2 Open Source Llm Cpu Inference vs Sod
Llama 2 Open Source Llm Cpu Inference vs Mshadow
Popular Cpu Projects
Popular Deep Learning Projects
Transformers ⭐ 124,049
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
dependent packages 2,484total releases 125latest release November 15, 2023most recent commit 23 days agopypi transformers} Downloads
Stable Diffusion Webui ⭐ 118,856
Stable Diffusion web UI
total releases 2latest release January 17, 2022most recent commit 3 months ago
Opencv ⭐ 75,512
Open Source Computer Vision Library
dependent packages 37total releases 29latest release February 15, 2023most recent commit 11 days ago
Pytorch ⭐ 74,794
Tensors and Dynamic neural networks in Python with strong GPU acceleration
dependent packages 8,272total releases 39latest release November 15, 2023most recent commit 3 months agopypi torch} Downloads
Popular Hardware Categories
Arduino
Raspberry Pi
Camera
Sensor
Gpu
Firmware
Usb
Keyboard
Cpu
Arm
Related Searches
Python Deep Learning
Python Machine Learning
Python Natural Language Processing
Machine Learning Natural Language Processing
Deep Learning Natural Language Processing
Python Cpu
Python Language Model
Deep Learning Language Model
Deep Learning Cpu
Machine Learning Language Model

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Deep Learning
Machine Learning
Natural Language Processing
Cpu
Language Model
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.