Top 1.2% on pypi.org
Top 0.7% downloads on pypi.org
Top 0.2% dependent packages on pypi.org
Top 0.3% dependent repos on pypi.org
Top 2.1% forks on pypi.org
Top 3.1% docker downloads on pypi.org
Top 0.7% downloads on pypi.org
Top 0.2% dependent packages on pypi.org
Top 0.3% dependent repos on pypi.org
Top 2.1% forks on pypi.org
Top 3.1% docker downloads on pypi.org
pypi.org : llama-cpp-python
Python bindings for the llama.cpp library
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/llama-cpp-python
License: MIT
Latest release: about 2 months ago
First release: about 2 years ago
Dependent packages: 136
Dependent repositories: 1,685
Downloads: 370,231 last month
Stars: 9,009 on GitHub
Forks: 1,119 on GitHub
Docker dependents: 74
Docker downloads: 609,661
See more repository details: repos.ecosyste.ms
Funding links: https://github.com/sponsors/abetlen
Last synced: about 18 hours ago
webscout 8.2.5 💰
Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt vi...117 versions - Latest release: about 15 hours ago - 1 dependent package - 5.01 thousand downloads last month - 224 stars on GitHub - 2 maintainers
logdetective 0.9.0
Log using LLM AI to search for build/test failures and provide ideas for fixing these.32 versions - Latest release: about 17 hours ago - 2.49 thousand downloads last month - 22 stars on GitHub - 2 maintainers
onprem 0.14.0
A tool for running on-premises large language models on non-public data77 versions - Latest release: 1 day ago - 3.81 thousand downloads last month - 715 stars on GitHub - 1 maintainer
justai 4.0.8
Makes working with LLMs like OpenAI GPT, Anthropic Claude, Google Gemini and Open source models s...78 versions - Latest release: 2 days ago - 2.12 thousand downloads last month - 0 stars on GitHub - 1 maintainer
agixt 1.7.9 💰
An Artificial Intelligence Automation Platform. AI Instruction management from various providers,...347 versions - Latest release: 2 days ago - 1 dependent repositories - 19.1 thousand downloads last month - 2,456 stars on GitHub - 1 maintainer
gguf-connector 1.4.6
GGUF connector(s) with GUI146 versions - Latest release: 4 days ago - 3 dependent packages - 6.25 thousand downloads last month - 6 stars on GitHub - 1 maintainer
r2r 3.5.17
SciPhi R2R216 versions - Latest release: 4 days ago - 21.1 thousand downloads last month - 1,103 stars on GitHub - 1 maintainer
pyllmsearch 0.9.0
LLM Powered Advanced RAG Application14 versions - Latest release: 6 days ago - 697 downloads last month - 581 stars on GitHub - 1 maintainer
autochat 0.17.0
Small OpenAI/Anthropic library to support chat templates, and function calls.48 versions - Latest release: 11 days ago - 1 dependent repositories - 2.82 thousand downloads last month - 2 stars on GitHub - 1 maintainer
Top 4.7% on pypi.org
108 versions - Latest release: 14 days ago - 3 dependent packages - 9 dependent repositories - 47.5 thousand downloads last month - 7,678 stars on GitHub - 1 maintainer
xinference 1.5.0
Model Serving Made Easy108 versions - Latest release: 14 days ago - 3 dependent packages - 9 dependent repositories - 47.5 thousand downloads last month - 7,678 stars on GitHub - 1 maintainer
Top 2.1% on pypi.org
261 versions - Latest release: 15 days ago - 1 dependent package - 11 dependent repositories - 145 thousand downloads last month - 57,616 stars on GitHub - 2 maintainers
langflow 1.3.4
A Python package with a built-in web application261 versions - Latest release: 15 days ago - 1 dependent package - 11 dependent repositories - 145 thousand downloads last month - 57,616 stars on GitHub - 2 maintainers
ollama 0.4.8
The official Python client for Ollama.34 versions - Latest release: 16 days ago - 65 dependent packages - 2.13 million downloads last month - 2,880 stars on GitHub - 1 maintainer
gpt-command-line 0.4.3
Command-line interface for ChatGPT and Claude18 versions - Latest release: 18 days ago - 1 dependent repositories - 1.12 thousand downloads last month - 690 stars on GitHub - 1 maintainer
Top 2.3% on pypi.org
50 versions - Latest release: 19 days ago - 13 dependent packages - 14 dependent repositories - 22.2 thousand downloads last month - 10,819 stars on GitHub - 1 maintainer
txtai 8.5.0
All-in-one open-source embeddings database for semantic search, LLM orchestration and language mo...50 versions - Latest release: 19 days ago - 13 dependent packages - 14 dependent repositories - 22.2 thousand downloads last month - 10,819 stars on GitHub - 1 maintainer
Top 9.2% on pypi.org
37 versions - Latest release: 23 days ago - 2 dependent packages - 1 dependent repositories - 2.4 thousand downloads last month - 573 stars on GitHub - 1 maintainer
kani 1.4.2 💰
kani (カニ) is a lightweight and highly hackable framework for chat-based language models with tool...37 versions - Latest release: 23 days ago - 2 dependent packages - 1 dependent repositories - 2.4 thousand downloads last month - 573 stars on GitHub - 1 maintainer
sdeul 0.1.5 💰
Structural Data Extractor using LLMs6 versions - Latest release: 29 days ago - 208 downloads last month - 0 stars on GitHub - 1 maintainer
semantic-router 0.1.7
Super fast semantic router for AI decision making89 versions - Latest release: 30 days ago - 5 dependent packages - 117 thousand downloads last month - 2,560 stars on GitHub - 1 maintainer
Top 9.6% on pypi.org
59 versions - Latest release: 30 days ago - 17 dependent packages - 1 dependent repositories - 1.79 million downloads last month - 11,462 stars on GitHub - 2 maintainers
outlines 0.2.3
Probabilistic Generative Model Programming59 versions - Latest release: 30 days ago - 17 dependent packages - 1 dependent repositories - 1.79 million downloads last month - 11,462 stars on GitHub - 2 maintainers
dbgpt 0.7.0
DB-GPT is an experimental open-source project that uses localized GPT large models to interact wi...32 versions - Latest release: about 1 month ago - 2.64 thousand downloads last month - 16,297 stars on GitHub - 4 maintainers
Top 1.5% on pypi.org
74 versions - Latest release: about 2 months ago - 37 dependent packages - 219 dependent repositories - 29.4 thousand downloads last month - 18,141 stars on GitHub - 2 maintainers
guidance 0.2.1
A guidance language for controlling large language models.74 versions - Latest release: about 2 months ago - 37 dependent packages - 219 dependent repositories - 29.4 thousand downloads last month - 18,141 stars on GitHub - 2 maintainers
llama-cpp-haystack 1.0.0
An integration between the llama.cpp LLM framework and Haystack10 versions - Latest release: 3 months ago - 750 downloads last month - 144 stars on GitHub - 1 maintainer
akasha-terminal 0.8.88
document QA(RAG) package using langchain and chromadb88 versions - Latest release: 3 months ago - 4.12 thousand downloads last month - 24 stars on GitHub - 1 maintainer
doc-comments-ai 0.1.18
LLM-powered code documentation generation19 versions - Latest release: 3 months ago - 889 downloads last month - 233 stars on GitHub - 1 maintainer
distilabel 1.5.3
Distilabel is an AI Feedback (AIF) framework for building datasets with and for LLMs.33 versions - Latest release: 3 months ago - 9.22 thousand downloads last month - 1 maintainer
llama-index-llms-llama-cpp 0.4.0 💰
llama-index llms llama cpp integration12 versions - Latest release: 3 months ago - 8 dependent packages - 10.2 thousand downloads last month - 8,974 stars on GitHub - 1 maintainer
flatpack 3.12.62
Ready-to-assemble AI1,444 versions - Latest release: 4 months ago - 68.3 thousand downloads last month - 3 stars on GitHub - 1 maintainer
flashrank 0.2.10 💰
Ultra lite & Super fast SoTA cross-encoder based re-ranking for your search & retrieval pipelines.27 versions - Latest release: 4 months ago - 1 dependent package - 93.7 thousand downloads last month - 788 stars on GitHub - 1 maintainer
translate-shell 0.0.52 💰
Translate text by google, bing, youdaozhiyun, haici, stardict, openai, large language model of lo...52 versions - Latest release: 4 months ago - 2 dependent repositories - 1.52 thousand downloads last month - 31 stars on GitHub - 1 maintainer
easy-llama 0.1.119
Text generation in Python, as easy as possible103 versions - Latest release: 5 months ago - 4.01 thousand downloads last month - 2 stars on GitHub - 1 maintainer
funcchain 0.3.6 💰
🔖 write prompts as python functions38 versions - Latest release: 5 months ago - 1 dependent package - 1 dependent repositories - 1.41 thousand downloads last month - 334 stars on GitHub - 1 maintainer
llama-index-packs-self-rag 0.3.0
llama-index packs self rag integration8 versions - Latest release: 6 months ago - 318 downloads last month - 3,477 stars on GitHub - 1 maintainer
zotero-cli-tool 1.6.8
Tinyscript tool for sorting and exporting Zotero references based on pyzotero31 versions - Latest release: 6 months ago - 1 dependent repositories - 786 downloads last month - 61 stars on GitHub - 1 maintainer
openvoicechat 0.2.4
OpenVoiceChat is an opensource library that allows you to have a natural voice conversation with ...10 versions - Latest release: 6 months ago - 139 downloads last month - 1 maintainer
nodetool 0.5.3
Nodetool is a no-code development environment for Artificial Intelligence, enabling the simple an...45 versions - Latest release: 6 months ago - 1.35 thousand downloads last month - 116 stars on GitHub - 1 maintainer
cappr 0.9.6
Completion After Prompt Probability. Make your LLM make a choice39 versions - Latest release: 6 months ago - 1.1 thousand downloads last month - 75 stars on GitHub - 1 maintainer
py-llm-core 3.5.0
PyLLMCore provides a light-weighted interface with LLMs51 versions - Latest release: 6 months ago - 1 dependent package - 1.8 thousand downloads last month - 124 stars on GitHub - 1 maintainer
bpm-ai-inference 0.3.6
Inference and server for local AI implementations of bpm-ai-core abstractions.17 versions - Latest release: 6 months ago - 471 downloads last month - 1 stars on GitHub - 1 maintainer
saga-llm-evaluation 0.12.1
Versatile Python library designed for evaluating the performance of large language models in Natu...11 versions - Latest release: 6 months ago - 364 downloads last month - 4 stars on GitHub - 1 maintainer
gptme-python 0.19.1 💰
gptme-python is now gptme46 versions - Latest release: 7 months ago - 1.77 thousand downloads last month - 312 stars on GitHub - 1 maintainer
semantic-chunkers 0.0.10
Super advanced chunking methods for AI12 versions - Latest release: 7 months ago - 10.8 thousand downloads last month - 216 stars on GitHub - 1 maintainer
freegenius 0.3.16 💰
FreeGenius AI, an advanced AI assistant that is capable of engaging in conversation and performin...219 versions - Latest release: 8 months ago - 8.72 thousand downloads last month - 126 stars on GitHub - 1 maintainer
streamtasks 0.1.13
A python task orchestrator to simplify real-time, static data pipelines.14 versions - Latest release: 8 months ago - 4.91 thousand downloads last month - 4 stars on GitHub - 1 maintainer
comma-agents 0.0.9
A way to elevate your AI workflow with Comma Agents, a versatile Python library designed for seam...9 versions - Latest release: 8 months ago - 232 downloads last month - 7 stars on GitHub - 1 maintainer
Top 8.2% on pypi.org
784 versions - Latest release: 9 months ago - 1 dependent repositories - 14 thousand downloads last month - 28,763 stars on GitHub - 2 maintainers
khoj-assistant 1.21.1 💰
khoj-assistant is now khoj784 versions - Latest release: 9 months ago - 1 dependent repositories - 14 thousand downloads last month - 28,763 stars on GitHub - 2 maintainers
arey 0.0.6
Simple large language model playground.5 versions - Latest release: 9 months ago - 352 downloads last month - 4 stars on GitHub - 1 maintainer
allmdev 1.5.5
A simple and efficient python library for fast inference of GGUF Large Language Models.37 versions - Latest release: 9 months ago - 646 downloads last month - 1 maintainer
doctoolsllm 0.99.0
(Now winston_doc) A perfect AI powered RAG for document query and summary. Supports ~all LLM and ...21 versions - Latest release: 10 months ago - 534 downloads last month - 46 stars on GitHub - 1 maintainer
weather-chatbot-phi3 0.1.23
An LLM Chatbot integrated with Open Weather API for Real-Time Weather Information.23 versions - Latest release: 10 months ago - 1.06 thousand downloads last month - 1 maintainer
ezlocalai 0.1.12 💰
ezlocalai is an easy to set up local multimodal artificial intelligence server with OpenAI Style ...10 versions - Latest release: 10 months ago - 313 downloads last month - 84 stars on GitHub - 1 maintainer
reverse-engineering-assistant 2.9.4 💰
An AI assistant for reverse engineering tasks6 versions - Latest release: 10 months ago - 264 downloads last month - 36,214 stars on GitHub - 1 maintainer
langport 0.3.11
A large language model serving platform.14 versions - Latest release: 10 months ago - 671 downloads last month - 92 stars on GitHub - 1 maintainer
llmflex 0.1.14
A python package for developing AI applications with local LLMs.19 versions - Latest release: 10 months ago - 461 downloads last month - 131 stars on GitHub - 1 maintainer
llama-cpp-agent 0.2.35
A framework for building LLM based AI agents with llama.cpp.73 versions - Latest release: 10 months ago - 10.4 thousand downloads last month - 484 stars on GitHub - 1 maintainer
ragstack-ai-langflow 1.0.6
RAGStack Langflow32 versions - Latest release: 10 months ago - 819 downloads last month - 7 stars on GitHub - 1 maintainer
autotx 0.1.3
A personal assistant for planning and executing on-chain transactions.8 versions - Latest release: 10 months ago - 342 downloads last month - 88 stars on GitHub - 1 maintainer
sibila 0.4.5
Structured queries from local or online LLM models15 versions - Latest release: 11 months ago - 485 downloads last month - 41 stars on GitHub - 1 maintainer
insuant 1.0.0a20
A Python package with a built-in web application4 versions - Latest release: 11 months ago - 129 downloads last month - 55,767 stars on GitHub - 1 maintainer
allm 1.0.9
A simple and efficient python library for fast inference of GGUF Large Language Models.10 versions - Latest release: 11 months ago - 209 downloads last month - 1 maintainer
furchain 0.1.6
FurChain is an innovative toolkit for creating and interacting with digital personas, complete wi...7 versions - Latest release: 11 months ago - 344 downloads last month - 1 stars on GitHub - 1 maintainer
querent 3.1.2
The Asynchronous Data Dynamo and Graph Neural Network Catalyst36 versions - Latest release: 11 months ago - 917 downloads last month - 2 stars on GitHub - 1 maintainer
sprite-ai 2.0.1 💰
Sprite AI is an AI companion for your desktop7 versions - Latest release: 11 months ago - 321 downloads last month - 11,503 stars on GitHub - 1 maintainer
flashembed 0.0.2 💰
Lightweight & Fast Python library to add low-footprint (all-MiniLM-* equivalent) multilingual ret...2 versions - Latest release: 11 months ago - 97 downloads last month - 6 stars on GitHub - 1 maintainer
voyage-agents 0.0.6
AI agent and tool calling library for small local models using llama.cpp.6 versions - Latest release: 11 months ago - 230 downloads last month - 2 stars on GitHub - 1 maintainer
h2ogpt 0.2.1
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports...2 versions - Latest release: 11 months ago - 99 downloads last month - 11,776 stars on GitHub - 1 maintainer
developergpt 0.7.5
DeveloperGPT is a LLM-powered command line tool that enables natural language to terminal command...30 versions - Latest release: 11 months ago - 1.09 thousand downloads last month - 40 stars on GitHub - 1 maintainer
getpaper 0.5.0
getpaper - papers download made easy!41 versions - Latest release: 11 months ago - 1 dependent repositories - 1.82 thousand downloads last month - 1 maintainer
bflower 1.0.0a35
A Python package with a built-in web application4 versions - Latest release: 12 months ago - 156 downloads last month - 1 maintainer
dfapp 0.0.1
A Python package with a built-in web application3 versions - Latest release: 12 months ago - 157 downloads last month - 7 stars on GitHub - 1 maintainer
grammarflow 0.1.1
Ensuring parsability of LLM responses in agent chains10 versions - Latest release: 12 months ago - 437 downloads last month - 9 stars on GitHub - 1 maintainer
bunkatopics 0.46.1
Bunkatopics is a Topic Modeling package and Exploration Module40 versions - Latest release: 12 months ago - 4.04 thousand downloads last month - 163 stars on GitHub - 1 maintainer
agent-dingo 1.0.0
A microframework for creating simple AI agents.3 versions - Latest release: 12 months ago - 183 downloads last month - 3,437 stars on GitHub - 1 maintainer
blendsql 0.0.141
Query language for blending SQL logic and LLM reasoning across multi-modal data. [Findings of ACL...27 versions - Latest release: 12 months ago - 1.18 thousand downloads last month - 95 stars on GitHub - 1 maintainer
grag 0.0.1
A simple package for implementing RAG2 versions - Latest release: 12 months ago - 110 downloads last month - 13 stars on GitHub - 2 maintainers
genius-chatbot 1.10.4
Use huggingface models to create an intelligent and scalable chatbot26 versions - Latest release: 12 months ago - 1 dependent package - 345 downloads last month - 1 stars on GitHub - 1 maintainer
recommender-agent 0.3.1
En el presente proyecto muestro la construcción de una sistema de recomendación, el sistema permi...5 versions - Latest release: 12 months ago - 146 downloads last month - 1 maintainer
r2ai 0.7.0 💰
Applying language models on radare2 for reverse engineering and fun purposes3 versions - Latest release: 12 months ago - 103 downloads last month - 262 stars on GitHub - 1 maintainer
vlite 0.2.7
A simple and blazing fast vector database13 versions - Latest release: about 1 year ago - 390 downloads last month - 1 maintainer
gigax 0.1
Call LLM-powered NPCs from your game, at runtime.1 version - Latest release: about 1 year ago - 84 downloads last month - 318 stars on GitHub - 1 maintainer
gptstonks-api 0.0.1
GPTStonks API allows interacting with financial data sources using natural language.1 version - Latest release: about 1 year ago - 60 downloads last month - 55 stars on GitHub - 1 maintainer
neogpt 0.1.0
NeoGPT: Chat effortlessly with Documents, YouTube Videos,Code, and Social Media Chats. Your go-to...1 version - Latest release: about 1 year ago - 74 downloads last month - 78 stars on GitHub - 2 maintainers
lime-green 0.1.0
A cli based micro-framework for LLM evals1 version - Latest release: about 1 year ago - 55 downloads last month - 0 stars on GitHub - 1 maintainer
verbolab 0.0.2
2 versions - Latest release: about 1 year ago - 94 downloads last month - 1 maintainerheadjack-keymaker 0.9.4
The most powerful, flexible and extensible way to control the output of large language models.23 versions - Latest release: about 1 year ago - 760 downloads last month - 6 stars on GitHub - 1 maintainer
vesslflow 0.6.13
VESSLFlow2 versions - Latest release: about 1 year ago - 88 downloads last month - 15,352 stars on GitHub - 1 maintainer
iauto 0.1.10
iauto is a low-code engine for building and deploying AI agents9 versions - Latest release: about 1 year ago - 2 dependent packages - 198 downloads last month - 85 stars on GitHub - 1 maintainer
Top 8.5% on pypi.org
45 versions - Latest release: about 1 year ago - 1 dependent repositories - 1.33 thousand downloads last month - 2,823 stars on GitHub - 1 maintainer
prompttools 0.0.46
Tools for LLM prompt testing and experimentation45 versions - Latest release: about 1 year ago - 1 dependent repositories - 1.33 thousand downloads last month - 2,823 stars on GitHub - 1 maintainer
mindsql 0.2.1
Text-2-SQL made easy in just a few lines of python.6 versions - Latest release: about 1 year ago - 347 downloads last month - 361 stars on GitHub - 1 maintainer
local-llm-function-calling 0.1.23
A tool for generating function arguments and choosing what function to call with local LLMs23 versions - Latest release: about 1 year ago - 627 downloads last month - 422 stars on GitHub - 1 maintainer
geniusrise-text 0.1.13
Text bolts for geniusrise14 versions - Latest release: about 1 year ago - 436 downloads last month - 5 stars on GitHub - 1 maintainer
llm-serve 0.0.1
An LLM inference solution to quickly deploy productive LLM service1 version - Latest release: about 1 year ago - 45 downloads last month - 1 maintainer
gguf-selector 0.0.5
GGUF selector5 versions - Latest release: about 1 year ago - 2 dependent packages - 259 downloads last month - 0 stars on GitHub - 1 maintainer
callgg 1.0.3
GGUF caller11 versions - Latest release: about 1 year ago - 1 dependent package - 541 downloads last month - 0 stars on GitHub - 1 maintainer
fastserveai 0.0.3 💰
'Machine Learning Serving focused on GenAI & LLMs with simplicity as the top priority.'3 versions - Latest release: about 1 year ago - 101 downloads last month - 58 stars on GitHub - 1 maintainer
opendatagen 0.0.35
Data preparation system to build controllable AI system33 versions - Latest release: about 1 year ago - 911 downloads last month - 15 stars on GitHub - 1 maintainer
llm-bash-helper 0.4.3
7 versions - Latest release: about 1 year ago - 298 downloads last month - 1 maintainerautologic 0.0.3
A framework for LLMs to self-compose reasoning structures3 versions - Latest release: about 1 year ago - 140 downloads last month - 57 stars on GitHub - 1 maintainer
bisheng-pybackend-libs 0.0.3
libraries for bisheng rt pybackend13 versions - Latest release: about 1 year ago - 242 downloads last month - 20 stars on GitHub - 1 maintainer
gpts 0.0.8
Unix language driver for software 2.08 versions - Latest release: about 1 year ago - 1 dependent package - 388 downloads last month - 0 stars on GitHub - 2 maintainers
llmagic 0.0.4
LLMagic: A Python toolkit for building Large Language Model (LLM) apps with efficient wrappers. S...4 versions - Latest release: about 1 year ago - 101 downloads last month - 1 maintainer
parrot1 0.1.2
A tool for writing a recap mail or report from a video recording of a call4 versions - Latest release: about 1 year ago - 124 downloads last month - 6 stars on GitHub - 1 maintainer
Past Dependents
Include Past Dependents
Check this option to include packages that no longer depend on this package in their latest version but previously did.
Filter by kind
All kinds
runtime
106
extra == "local"
11
extra == "llama-cpp"
8
extra == "all"
5
llama
5
extra == 'all'
4
extra == "llamacpp"
3
extra == "llama"
3
extra == 'llama-cpp'
2
extra == 'llamacpp'
2
extra == 'llama'
2
extra == 'local'
2
all
2
llama-cpp
2
extra == 'test'
2
demos
1
dev
1
extra == "all" or extra == "local-llm"
1
extra == 'backend'
1
extra == "inference"
1
extra == "cpp"
1
extra == 'gpt'
1
extra == "gguf"
1
extra == 'ggml'
1
extra == "ggml"
1
extra == 'full'
1
extra == "docs"
1
extra == 'dev'
1
extra == "dev"
1
extra == 'demos'
1
server
1
local
1
llama-cpporall
1
llamacpp
1
gpt
1
ggml
1
extra == "vectors"
1
extra == "test"
1
extra == "similarity"
1
extra == "server" or extra == "all"
1
extra == "server"
1
extra == 'providers'
1
extra == 'pipeline-llm'
1
extra == "pipeline-llm"
1
extra == 'pipeline'
1
extra == "pipeline"
1
extra == "local-llm" or extra == "all"
1
extra == 'llama-gpu'
1
extra == "llama-cpp-support" or extra == "all-with-extras"
1
extra == "llama-cpp" or extra == "os-models" or extra == "all"
1
extra == "llama-cpp" or extra == "os-models"
1
extra == "llama-cpp-dev"
1
extra == 'llama_cpp'
1