vLLM
vLLM is an open-source open-source llm tool for developers building applications, inference services, and data pipelines around language…
LocalSelf-hostedWindows
Open Source
Advanced Apache-2.0
LLM Tools Tools
Find open-source LLM tools, runtimes, inference frameworks, model management platforms, fine-tuning tools, and LLM application platforms.
17 tools
Transformers
Transformers is an open-source open-source llm tool for developers building applications, inference services, and data pipelines around language…
LocalSelf-hostedWindows
Open Source
Advanced Apache-2.0
LlamaIndex
LlamaIndex is an open-source open-source llm tool for developers building applications, inference services, and data pipelines around language…
LocalSelf-hostedWindows
Open Source
Advanced MIT
LangChain
LangChain is an open-source open-source llm tool for developers building applications, inference services, and data pipelines around language…
LocalSelf-hostedWindows
Open Source
Advanced MIT
NextAI Translator
NextAI Translator (formerly OpenAI Translator) is an open-source AI translation tool with selection translation, screenshot OCR, polishing, summaries,…
OnlineLocalWeb
Open Source
Intermediate AGPL-3.0