Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

llama-cpp-python

Python bindings for the llama.cpp library

Ecosystem
pypi.org
Latest Release
0.3.16
6 months ago
Versions
189
Downloads
453,301 last month
Dependent Packages
136
Dependent Repos
1,685
llama-cpp-agent 0.2.35
A framework for building LLM based AI agents with llama.cpp.
73 versions - Latest release: over 1 year ago - 8.4 thousand downloads last month - 579 stars on GitHub - 1 maintainer
sibila 0.4.5
Structured queries from local or online LLM models
15 versions - Latest release: over 1 year ago - 17 downloads last month - 42 stars on GitHub - 1 maintainer
allm 1.0.9
A simple and efficient python library for fast inference of GGUF Large Language Models.
10 versions - Latest release: over 1 year ago - 98 downloads last month - 1 maintainer
furchain 0.1.6
FurChain is an innovative toolkit for creating and interacting with digital personas, complete wi...
7 versions - Latest release: over 1 year ago - 45 downloads last month - 1 stars on GitHub - 1 maintainer
querent 3.1.2
The Asynchronous Data Dynamo and Graph Neural Network Catalyst
36 versions - Latest release: over 1 year ago - 101 downloads last month - 2 stars on GitHub - 1 maintainer
flashembed 0.0.2 πŸ’°
Lightweight & Fast Python library to add low-footprint (all-MiniLM-* equivalent) multilingual ret...
2 versions - Latest release: over 1 year ago - 27 downloads last month - 6 stars on GitHub - 1 maintainer
h2ogpt 0.2.1
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports...
2 versions - Latest release: over 1 year ago - 52 downloads last month - 12,011 stars on GitHub - 1 maintainer
developergpt 0.7.5
DeveloperGPT is a LLM-powered command line tool that enables natural language to terminal command...
30 versions - Latest release: over 1 year ago - 223 downloads last month - 45 stars on GitHub - 1 maintainer
bflower 1.0.0a35
A Python package with a built-in web application
4 versions - Latest release: over 1 year ago - 37 downloads last month - 1 maintainer
dfapp 0.0.1
A Python package with a built-in web application
3 versions - Latest release: almost 2 years ago - 33 downloads last month - 7 stars on GitHub - 1 maintainer
agent-dingo 1.0.0
A microframework for creating simple AI agents.
3 versions - Latest release: almost 2 years ago - 35 downloads last month - 3,437 stars on GitHub - 1 maintainer
grag 0.0.1
A simple package for implementing RAG
2 versions - Latest release: almost 2 years ago - 38 downloads last month - 14 stars on GitHub - 2 maintainers
genius-chatbot 1.10.4
Use huggingface models to create an intelligent and scalable chatbot
26 versions - Latest release: almost 2 years ago - 1 dependent package - 86 downloads last month - 1 stars on GitHub - 1 maintainer
r2ai 0.7.0 πŸ’°
Applying language models on radare2 for reverse engineering and fun purposes
3 versions - Latest release: almost 2 years ago - 30 downloads last month - 330 stars on GitHub - 1 maintainer
gigax 0.1
Call LLM-powered NPCs from your game, at runtime.
1 version - Latest release: almost 2 years ago - 18 downloads last month - 330 stars on GitHub - 1 maintainer
gptstonks-api 0.0.1
GPTStonks API allows interacting with financial data sources using natural language.
1 version - Latest release: almost 2 years ago - 9 downloads last month - 55 stars on GitHub - 1 maintainer
neogpt 0.1.0
NeoGPT: Chat effortlessly with Documents, YouTube Videos,Code, and Social Media Chats. Your go-to...
1 version - Latest release: almost 2 years ago - 12 downloads last month - 78 stars on GitHub - 2 maintainers
lime-green 0.1.0
A cli based micro-framework for LLM evals
1 version - Latest release: almost 2 years ago - 9 downloads last month - 0 stars on GitHub - 1 maintainer
verbolab 0.0.2
2 versions - Latest release: almost 2 years ago - 25 downloads last month - 1 maintainer
headjack-keymaker 0.9.4
The most powerful, flexible and extensible way to control the output of large language models.
23 versions - Latest release: almost 2 years ago - 85 downloads last month - 6 stars on GitHub - 1 maintainer
vesslflow 0.6.13
VESSLFlow
2 versions - Latest release: almost 2 years ago - 20 downloads last month - 15,352 stars on GitHub - 1 maintainer
iauto 0.1.10
iauto is a low-code engine for building and deploying AI agents
9 versions - Latest release: almost 2 years ago - 2 dependent packages - 54 downloads last month - 89 stars on GitHub - 1 maintainer
mindsql 0.2.1
Text-2-SQL made easy in just a few lines of python.
6 versions - Latest release: almost 2 years ago - 100 downloads last month - 421 stars on GitHub - 1 maintainer
local-llm-function-calling 0.1.23
A tool for generating function arguments and choosing what function to call with local LLMs
23 versions - Latest release: almost 2 years ago - 186 downloads last month - 431 stars on GitHub - 1 maintainer
geniusrise-text 0.1.13
Text bolts for geniusrise
14 versions - Latest release: almost 2 years ago - 209 downloads last month - 5 stars on GitHub - 1 maintainer
llm-serve 0.0.1
An LLM inference solution to quickly deploy productive LLM service
1 version - Latest release: almost 2 years ago - 21 downloads last month - 1 maintainer
fastserveai 0.0.3 πŸ’°
'Machine Learning Serving focused on GenAI & LLMs with simplicity as the top priority.'
3 versions - Latest release: almost 2 years ago - 37 downloads last month - 59 stars on GitHub - 1 maintainer
opendatagen 0.0.35
Data preparation system to build controllable AI system
33 versions - Latest release: almost 2 years ago - 191 downloads last month - 15 stars on GitHub - 1 maintainer
llm-bash-helper 0.4.3
7 versions - Latest release: almost 2 years ago - 56 downloads last month - 1 maintainer
autologic 0.0.3
A framework for LLMs to self-compose reasoning structures
3 versions - Latest release: almost 2 years ago - 41 downloads last month - 60 stars on GitHub - 1 maintainer
bisheng-pybackend-libs 0.0.3
libraries for bisheng rt pybackend
13 versions - Latest release: almost 2 years ago - 197 downloads last month - 31 stars on GitHub - 1 maintainer
gpts 0.0.8
Unix language driver for software 2.0
8 versions - Latest release: about 2 years ago - 1 dependent package - 388 downloads last month - 0 stars on GitHub - 2 maintainers
parrot1 0.1.2
A tool for writing a recap mail or report from a video recording of a call
4 versions - Latest release: about 2 years ago - 31 downloads last month - 6 stars on GitHub - 1 maintainer
llmtopic 0.0.3
A library for extracting topics from text documents using llms.
3 versions - Latest release: about 2 years ago - 32 downloads last month - 7 stars on GitHub - 1 maintainer
aiconfig-extension-llama 0.0.2
Model Parser extension for Llama
2 versions - Latest release: about 2 years ago - 44 downloads last month - 1,052 stars on GitHub - 4 maintainers
samosila-core 0.0.7
7 versions - Latest release: about 2 years ago - 47 downloads last month - 1 maintainer
flying-delta-llms-llama-cpp 0.1.1
llama-index llms llama cpp integration
2 versions - Latest release: about 2 years ago - 3 dependent packages - 9 downloads last month - 1 maintainer
local-llm 0.1.1 πŸ’°
Local-LLM is a llama.cpp server in Docker with OpenAI Style Endpoints.
43 versions - Latest release: about 2 years ago - 1 dependent package - 1 dependent repositories - 499 downloads last month - 84 stars on GitHub - 1 maintainer
coconut-ai 1.0.0
Coconut AI
6 versions - Latest release: about 2 years ago - 14 downloads last month - 2 stars on GitHub - 1 maintainer
cllm-python 0.0.8
cLLM is an Open-source library that use llama-cpp-python and llama.cpp and provide a Low and High...
9 versions - Latest release: about 2 years ago - 53 downloads last month - 21 stars on GitHub - 1 maintainer
locallm 0.5.3
An api to query local language models using different backends
9 versions - Latest release: about 2 years ago - 31 downloads last month - 7 stars on GitHub - 2 maintainers
gguf-llama 0.0.18
Wrapper for simplified use of Llama2 GGUF quantized models.
9 versions - Latest release: about 2 years ago - 1 dependent package - 83 downloads last month - 5 stars on GitHub - 1 maintainer
libre-chat 0.0.6
Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capa...
2 versions - Latest release: about 2 years ago - 84 downloads last month - 125 stars on GitHub - 1 maintainer
tool-llama 0.0.7
Open source library of large model usage tools.(εΌ€ζΊε€§ζ¨‘εž‹δ½Ώη”¨ε·₯ε…·ηš„εΊ“.)
7 versions - Latest release: about 2 years ago - 15 downloads last month - 5 stars on GitHub - 1 maintainer
text2tags-lib 0.0.7
Use a finetune of Llama-7b and llama cpp to predict Danbooru tags from natural text.
6 versions - Latest release: about 2 years ago - 50 downloads last month - 0 stars on GitHub - 1 maintainer
libreassist 0.0.1
An open-source library LibreAssist is a Local Assistance here to help you with your needs on your...
1 version - Latest release: about 2 years ago - 14 downloads last month - 1 maintainer
llm-http-api 0.0.2
HTTP API for LLM with OpenAI compatibility
2 versions - Latest release: about 2 years ago - 16 downloads last month - 6 stars on GitHub - 1 maintainer
llama_cpp_openai 0.1.1
Lightweight OpenAI API server on top of Llama local models. Suitable for combined use with Micros...
1 version - Latest release: about 2 years ago - 24 downloads last month - 1 maintainer
fendi 0.0.0.13 πŸ’°
An auto py builder for ChatBots on top of streamlit app's - LLaMa's powered APS
5 versions - Latest release: about 2 years ago - 12 downloads last month - 4,843 stars on GitHub - 4 maintainers
genflow 0.6.0a2
A Python package with a built-in web application
3 versions - Latest release: about 2 years ago - 20 downloads last month - 1 maintainer
basicscore 0.0.3 πŸ’°
Creates basicness-scores of software
4 versions - Latest release: about 2 years ago - 54 downloads last month - 9,085 stars on GitHub - 1 maintainer
antar 0.0.1.dev0
1 version - Latest release: about 2 years ago - 47 downloads last month - 1 maintainer
qualtop-llmapi 0.47
Experimental libraries for communication with LLMs.
35 versions - Latest release: about 2 years ago - 40 downloads last month - 1 maintainer
python-aiconfig-llama 0.0.1
LLama extension for AIConfig Library
1 version - Latest release: over 2 years ago - 5 downloads last month - 1,052 stars on GitHub - 1 maintainer
talk-codebase 0.1.50
talk-codebase is a powerful tool for querying and analyzing codebases.
40 versions - Latest release: over 2 years ago - 420 downloads last month - 452 stars on GitHub - 1 maintainer
exponential 0.5.3
A Python package with a built-in web application
1 version - Latest release: over 2 years ago - 1 dependent repositories - 10 downloads last month - 1 maintainer
convince 0.0.2
Better instruction following for large language models
2 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 28 downloads last month - 2 stars on GitHub - 1 maintainer
esa-local-llm 0.0.15
ESA Local-LLM is a llama.cpp server in Docker with OpenAI Style Endpoints.
2 versions - Latest release: over 2 years ago - 1 dependent package - 12 downloads last month - 5,486 stars on GitHub - 1 maintainer
Top 6.0% on pypi.org
lmql 0.7.3
A query language for language models.
23 versions - Latest release: over 2 years ago - 3 dependent packages - 2 dependent repositories - 2.2 thousand downloads last month - 4,011 stars on GitHub - 1 maintainer
confirms 0.2.0
Comprehension of trade term sheets and confirmations
3 versions - Latest release: over 2 years ago - 1 dependent repositories - 37 downloads last month - 4 stars on GitHub - 2 maintainers
Top 8.9% on pypi.org
llama2-wrapper 0.1.14
Use llama2-wrapper as your local llama2 backend for Generative Agents / Apps
14 versions - Latest release: over 2 years ago - 1 dependent repositories - 133 downloads last month - 1,958 stars on GitHub - 1 maintainer
pai-repl 0.1.19
Python REPL with LLM integration
20 versions - Latest release: over 2 years ago - 185 downloads last month - 1 maintainer
local-llama 1.0.3 πŸ’°
A flask server for a chrome extension that querys llm models
3 versions - Latest release: over 2 years ago - 45 downloads last month - 18 stars on GitHub - 1 maintainer
Top 7.1% on pypi.org
opencopilot-ai 0.3.8
OpenCopilot Backend
11 versions - Latest release: over 2 years ago - 3 dependent repositories - 39 downloads last month - 532 stars on GitHub - 2 maintainers
magic-assistant 0.0.1
An AI agent framework.
1 version - Latest release: over 2 years ago - 18 downloads last month - 36,364 stars on GitHub - 1 maintainer
forum 0.1.1 removed
2 versions - Latest release: over 2 years ago - 1 downloads last month - 1 maintainer
baby-code 0.0.4
4 versions - Latest release: over 2 years ago - 45 downloads last month - 1 maintainer
pxgpt 0.0.1
Your personal, powerful and private GPT.
3 versions - Latest release: over 2 years ago - 33 downloads last month - 55,573 stars on GitHub - 1 maintainer
peelml 0.0.4
Peel away the pain of ml deployment
5 versions - Latest release: over 2 years ago - 33 downloads last month - 1 maintainer
rlb 0.0.1
Racing Llama Benchmark is a benchmark tool for comparing llama.cpp performance against different ...
1 version - Latest release: over 2 years ago - 9 downloads last month - 1 stars on GitHub - 1 maintainer
langflow-mod 0.0.79.1
A Python package with a built-in web application
1 version - Latest release: over 2 years ago - 6 downloads last month - 13,967 stars on GitHub - 1 maintainer
agent-llm 1.1.41b0 πŸ’°
An Artificial Intelligence Automation Platform. AI Instruction management from various providers,...
2 versions - Latest release: over 2 years ago - 24 downloads last month - 2,983 stars on GitHub - 1 maintainer
pyama 0.1.0
"Flask frontend for llama.cpp models"
1 version - Latest release: almost 3 years ago - 36 downloads last month - 1 maintainer
Past Dependents
Include Past Dependents

Check this option to include packages that no longer depend on this package in their latest version but previously did.

Filter by Kind
All kinds runtime 55 extra == "local" 5 llama 3 extra == "llama-cpp" 3 extra == "llamacpp" 2 llama-cpporall 1 extra == 'test' 1 extra == 'providers' 1 extra == 'local' 1 extra == "llama-cpp" or extra == "os-models" or extra == "all" 1 extra == 'full' 1 extra == "dev" 1 extra == 'backend' 1
Links
Registry pypi.org
Source Repository
Docs Documentation
JSON API View JSON
CodeMeta codemeta.json
Package Details
PURL pkg:pypi/llama-cpp-python
spec
License MIT
First Release almost 3 years ago
Last Synced 1 day ago
Repository
Stars 9,873 on GitHub
Forks 1,262 on GitHub
Docker Dependents 74
Docker Downloads 609,661
repos.ecosyste.ms
Rankings on pypi.org
Overall Top 1.2%
Downloads Top 0.7%
Dependent packages Top 0.2%
Dependent repos Top 0.3%
Forks Top 2.1%
Docker downloads Top 3.1%
Funding
https://github.com/sponsors/abetlen