Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Petals | 8,040 | 1 | 6 months ago | 18 | November 20, 2023 | 76 | mit | Python | ||
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading | ||||||||||
Chat.petals.dev | 240 | 9 months ago | 9 | Python | ||||||
💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client |