Awesome Open Source

Programming Languages

Search results for llms llamacpp

5 search results found

Nitro ⭐ 1,115

A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API

Llama Cpp Agent ⭐ 114

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). It provides a simple yet robust interface using llama-cpp-python, allowing users to chat with LLM models, execute structured function calls and get structured output.

AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve.

Autocompleter ⭐ 6

Auto Complete anything using a gguf model

Related Searches

Natural Language Processing Llms (80)

Large Language Models Llms (78)

Artificial Intelligence Llms (77)

Openai Llms (74)

Python Llamacpp (68)

1-5 of 5 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.