Awesome Open Source

Programming Languages

Search results for llamacpp llm inference

llm-inference x

9 search results found

Inferflow ⭐ 135

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

Llmunity ⭐ 130

Integrate LLM models in Unity!

Ialacol ⭐ 127

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

Llm Api ⭐ 109

Run any Large Language Model behind a unified API

AI-powered cybersecurity chatbot designed to provide helpful and accurate answers to your cybersecurity-related queries and also do code analysis and scan analysis.

Neural Speed ⭐ 77

An innovation library for efficient LLM inference via low-bit quantization and sparsity

Companionllm ⭐ 21

CompanionLLM - A framework to finetune LLMs to be your own sentient conversational companion

Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve.

Modal LLM LLama.cpp based model deployment as part of series of Model as a Service (MaaS)

Related Searches

Llm Llamacpp (63)

Python Llamacpp (61)

Python Llm Inference (53)

1-9 of 9 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.