Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Ray_vllm_inference

A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
Stars
5
License
apache-2.0
Open Issues
1
Most Recent Commit
6 months ago
Programming Language
Python
Categories
Repo
Alternatives To Ray_vllm_inference
Select To Compare
Stable Diffusion Webui ⭐ 118,856
Stable Diffusion web UI
total releases 2most recent commit 5 months ago
Pytorch ⭐ 74,794
Tensors and Dynamic neural networks in Python with strong GPU acceleration
dependent packages 8,272total releases 39most recent commit 5 months agopypi torch} Downloads
Keras ⭐ 61,137
Deep Learning for humans
dependent packages 697total releases 87most recent commit 22 days agopypi keras} Downloads
Yolov5 ⭐ 44,755
YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
dependent packages 2total releases 3most recent commit 5 months agopypi ultralytics-yolov5} Downloads
Gfpgan ⭐ 33,600
GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration.
dependent packages 9total releases 11most recent commit 5 months agopypi gfpgan} Downloads


Suggest An Alternative To ray_vllm_inference
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Related Searches
Python Pytorch
Python Llm
Python Ray
Python Mlops
Pytorch Mlops
Llm Llmops
Pytorch Ray
Python Llmops
Pytorch Llm
Python Model Serving

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Pytorch
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.