Tools /LLM Tools

LLM Tools Tools

Find open-source LLM tools, runtimes, inference frameworks, model management platforms, fine-tuning tools, and LLM application platforms.

AI tools category hero

17 LLM Tools

AI-Infra-Guard open-source project logo

AI-Infra-Guard

AI-Infra-Guard is Tencent Zhuque Lab's open-source platform for authorized AI infrastructure, MCP, agent-skill, and LLM security assessment.

LocalSelf-hostedWindows
Open Source Advanced Apache-2.0
GitHub 6.6k
Soup open-source project logo

Soup

Soup is an open-source CLI for configuring, fine-tuning, evaluating, exporting, and operating language models through repeatable local workflows.

LocalSelf-hostedWindows
Open Source Advanced Apache-2.0
GitHub 7.4k
Uber official organization mark used for the ADR open-source project

ADR

ADR is Uber's open-source toolkit for observing AI agent activity, benchmarking security defenses, and detecting risky behavior with…

LocalSelf-hostedmacOS
Open Source Advanced Apache-2.0
GitHub 1.6k
aisuite open-source multi-provider LLM library cover

aisuite

aisuite is an MIT-licensed Python library that unifies chat completions across LLM providers and adds tools, MCP, policies,…

OnlineLocalSelf-hosted
Open Source Advanced MIT
GitHub 16.3k
Promptfoo open-source project logo

Promptfoo

Promptfoo is an open-source open-source llm tool for developers building applications, inference services, and data pipelines around language…

LocalSelf-hostedWindows
Open Source Advanced MIT
GitHub 25.5k
Langfuse open-source project logo

Langfuse

Langfuse is an open-source open-source llm tool for developers building applications, inference services, and data pipelines around language…

LocalSelf-hostedWindows
Open Source Advanced MIT
GitHub 35.1k
DeepSpeed open-source project logo

DeepSpeed

DeepSpeed is an open-source open-source llm tool for developers building applications, inference services, and data pipelines around language…

LocalSelf-hostedWindows
Open Source Advanced Apache-2.0
GitHub 43.2k
SGLang open-source project logo

SGLang

SGLang is an open-source open-source llm tool for developers building applications, inference services, and data pipelines around language…

LocalSelf-hostedWindows
Open Source Advanced Apache-2.0
GitHub 36.5k

Unsloth

Unsloth is an open-source open-source llm tool for developers building applications, inference services, and data pipelines around language…

LocalSelf-hostedWindows
Open Source Advanced Apache-2.0
GitHub 76.9k

LlamaFactory

LlamaFactory is an open-source open-source llm tool for developers building applications, inference services, and data pipelines around language…

LocalSelf-hostedWindows
Open Source Advanced Apache-2.0
GitHub 75.1k
Mem0 open-source project logo

Mem0

Mem0 is an open-source open-source llm tool for developers building applications, inference services, and data pipelines around language…

LocalSelf-hostedWindows
Open Source Advanced Apache-2.0
GitHub 64.2k
LiteLLM open-source project logo

LiteLLM

LiteLLM is an open-source open-source llm tool for developers building applications, inference services, and data pipelines around language…

LocalSelf-hostedWindows
Open Source Advanced MIT
GitHub 54.7k