Awesome Open Source

Programming Languages

Search results for llmops

119 search results found

Llm Inference Solutions ⭐ 12

A collection of all available inference solutions for the LLMs

Arcee Python ⭐ 12

The Arcee client for executing domain-adpated language model routines

Python Sdk ⭐ 12

AGiXT is a dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

Llmtracer ⭐ 10

Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp

Openserver ⭐ 9

Open Server is an OpenAI API Compatible Server for generating text, images, embeddings, and storing them in vector databases. It also includes a chat functionality.

Odin Tabs ⭐ 9

The Odin Tabs extension is a browser extension that allows you to navigate through your browser tabs using speech recognition and the Large Language Model (LLM) of your choice.

Mirascope ⭐ 9

The most pythonic LLM application building experience

Analyzing and scoring reasoning traces of LLMs

Prompt Engineering and Dev-Ops toolkit for applications powered by Language Models

Semi Agent ⭐ 7

A simple AI Agent Framework using table software like Excel/Google Sheets as GUI

Bigbertha ⭐ 7

BigBertha is an architecture design that demonstrates how automated LLMOps (Large Language Models Operations) can be achieved on any Kubernetes cluster using open source container-native technologies 🌟

Awesome Llm Productization ⭐ 6

Awesome-LLM-Productization: a curated list of tools/tricks/news/regulations about AI and Large Language Model (LLM) productization

Auditing with LLM evals for LLM applications.

The Python package for phospho, the LLM analytics platform

Ray_vllm_inference ⭐ 5

A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.

Matcha Examples ⭐ 5

Example workflows for matcha - a tool to provision environments in Azure

Llm Prompt Testing ⭐ 5

Prompt Testing framework for LLMs (specifically OpenAI models). Compute NLP and Responsible AI metrics for each model-generated answer.

🦄 Consume any LLM from any provider, using the OpenAI API

Webextllm ⭐ 5

Web extension that embeds LLMs in your browser to power AI in web apps

101-119 of 119 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.