Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

Top 1.2% on pypi.org
Top 0.7% downloads on pypi.org
Top 0.2% dependent packages on pypi.org
Top 0.3% dependent repos on pypi.org
Top 2.1% forks on pypi.org
Top 3.1% docker downloads on pypi.org

pypi.org : llama-cpp-python

Python bindings for the llama.cpp library

Registry - Source - Documentation - JSON
purl: pkg:pypi/llama-cpp-python
License: MIT
Latest release: about 2 months ago
First release: about 2 years ago
Dependent packages: 136
Dependent repositories: 1,685
Downloads: 370,231 last month
Stars: 9,009 on GitHub
Forks: 1,119 on GitHub
Docker dependents: 74
Docker downloads: 609,661
See more repository details: repos.ecosyste.ms
Funding links: https://github.com/sponsors/abetlen
Last synced: 1 day ago

llama-cpp-agent 0.2.35
A framework for building LLM based AI agents with llama.cpp.
73 versions - Latest release: 10 months ago - 10.4 thousand downloads last month - 484 stars on GitHub - 1 maintainer
sibila 0.4.5
Structured queries from local or online LLM models
15 versions - Latest release: 10 months ago - 485 downloads last month - 41 stars on GitHub - 1 maintainer
allm 1.0.9
A simple and efficient python library for fast inference of GGUF Large Language Models.
10 versions - Latest release: 11 months ago - 209 downloads last month - 1 maintainer
furchain 0.1.6
FurChain is an innovative toolkit for creating and interacting with digital personas, complete wi...
7 versions - Latest release: 11 months ago - 344 downloads last month - 1 stars on GitHub - 1 maintainer
querent 3.1.2
The Asynchronous Data Dynamo and Graph Neural Network Catalyst
36 versions - Latest release: 11 months ago - 917 downloads last month - 2 stars on GitHub - 1 maintainer
flashembed 0.0.2 πŸ’°
Lightweight & Fast Python library to add low-footprint (all-MiniLM-* equivalent) multilingual ret...
2 versions - Latest release: 11 months ago - 97 downloads last month - 6 stars on GitHub - 1 maintainer
h2ogpt 0.2.1
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports...
2 versions - Latest release: 11 months ago - 99 downloads last month - 11,776 stars on GitHub - 1 maintainer
developergpt 0.7.5
DeveloperGPT is a LLM-powered command line tool that enables natural language to terminal command...
30 versions - Latest release: 11 months ago - 1.09 thousand downloads last month - 40 stars on GitHub - 1 maintainer
bflower 1.0.0a35
A Python package with a built-in web application
4 versions - Latest release: 11 months ago - 156 downloads last month - 1 maintainer
dfapp 0.0.1
A Python package with a built-in web application
3 versions - Latest release: 12 months ago - 157 downloads last month - 7 stars on GitHub - 1 maintainer
agent-dingo 1.0.0
A microframework for creating simple AI agents.
3 versions - Latest release: 12 months ago - 189 downloads last month - 3,398 stars on GitHub - 1 maintainer
grag 0.0.1
A simple package for implementing RAG
2 versions - Latest release: 12 months ago - 110 downloads last month - 13 stars on GitHub - 2 maintainers
genius-chatbot 1.10.4
Use huggingface models to create an intelligent and scalable chatbot
26 versions - Latest release: 12 months ago - 1 dependent package - 345 downloads last month - 1 stars on GitHub - 1 maintainer
r2ai 0.7.0 πŸ’°
Applying language models on radare2 for reverse engineering and fun purposes
3 versions - Latest release: 12 months ago - 103 downloads last month - 262 stars on GitHub - 1 maintainer
gigax 0.1
Call LLM-powered NPCs from your game, at runtime.
1 version - Latest release: about 1 year ago - 84 downloads last month - 318 stars on GitHub - 1 maintainer
gptstonks-api 0.0.1
GPTStonks API allows interacting with financial data sources using natural language.
1 version - Latest release: about 1 year ago - 60 downloads last month - 55 stars on GitHub - 1 maintainer
neogpt 0.1.0
NeoGPT: Chat effortlessly with Documents, YouTube Videos,Code, and Social Media Chats. Your go-to...
1 version - Latest release: about 1 year ago - 80 downloads last month - 78 stars on GitHub - 2 maintainers
lime-green 0.1.0
A cli based micro-framework for LLM evals
1 version - Latest release: about 1 year ago - 55 downloads last month - 0 stars on GitHub - 1 maintainer
verbolab 0.0.2
2 versions - Latest release: about 1 year ago - 94 downloads last month - 1 maintainer
headjack-keymaker 0.9.4
The most powerful, flexible and extensible way to control the output of large language models.
23 versions - Latest release: about 1 year ago - 760 downloads last month - 6 stars on GitHub - 1 maintainer
vesslflow 0.6.13
VESSLFlow
2 versions - Latest release: about 1 year ago - 88 downloads last month - 15,352 stars on GitHub - 1 maintainer
iauto 0.1.10
iauto is a low-code engine for building and deploying AI agents
9 versions - Latest release: about 1 year ago - 2 dependent packages - 198 downloads last month - 85 stars on GitHub - 1 maintainer
mindsql 0.2.1
Text-2-SQL made easy in just a few lines of python.
6 versions - Latest release: about 1 year ago - 347 downloads last month - 361 stars on GitHub - 1 maintainer
local-llm-function-calling 0.1.23
A tool for generating function arguments and choosing what function to call with local LLMs
23 versions - Latest release: about 1 year ago - 627 downloads last month - 422 stars on GitHub - 1 maintainer
geniusrise-text 0.1.13
Text bolts for geniusrise
14 versions - Latest release: about 1 year ago - 436 downloads last month - 5 stars on GitHub - 1 maintainer
llm-serve 0.0.1
An LLM inference solution to quickly deploy productive LLM service
1 version - Latest release: about 1 year ago - 45 downloads last month - 1 maintainer
fastserveai 0.0.3 πŸ’°
'Machine Learning Serving focused on GenAI & LLMs with simplicity as the top priority.'
3 versions - Latest release: about 1 year ago - 101 downloads last month - 58 stars on GitHub - 1 maintainer
opendatagen 0.0.35
Data preparation system to build controllable AI system
33 versions - Latest release: about 1 year ago - 911 downloads last month - 15 stars on GitHub - 1 maintainer
llm-bash-helper 0.4.3
7 versions - Latest release: about 1 year ago - 298 downloads last month - 1 maintainer
autologic 0.0.3
A framework for LLMs to self-compose reasoning structures
3 versions - Latest release: about 1 year ago - 140 downloads last month - 57 stars on GitHub - 1 maintainer
bisheng-pybackend-libs 0.0.3
libraries for bisheng rt pybackend
13 versions - Latest release: about 1 year ago - 242 downloads last month - 20 stars on GitHub - 1 maintainer
gpts 0.0.8
Unix language driver for software 2.0
8 versions - Latest release: about 1 year ago - 1 dependent package - 388 downloads last month - 0 stars on GitHub - 2 maintainers
parrot1 0.1.2
A tool for writing a recap mail or report from a video recording of a call
4 versions - Latest release: about 1 year ago - 124 downloads last month - 6 stars on GitHub - 1 maintainer
llmtopic 0.0.3
A library for extracting topics from text documents using llms.
3 versions - Latest release: about 1 year ago - 131 downloads last month - 5 stars on GitHub - 1 maintainer
aiconfig-extension-llama 0.0.2
Model Parser extension for Llama
2 versions - Latest release: about 1 year ago - 113 downloads last month - 866 stars on GitHub - 4 maintainers
samosila-core 0.0.7
7 versions - Latest release: about 1 year ago - 281 downloads last month - 1 maintainer
flying-delta-llms-llama-cpp 0.1.1
llama-index llms llama cpp integration
2 versions - Latest release: about 1 year ago - 3 dependent packages - 124 downloads last month - 1 maintainer
local-llm 0.1.1 πŸ’°
Local-LLM is a llama.cpp server in Docker with OpenAI Style Endpoints.
43 versions - Latest release: over 1 year ago - 1 dependent package - 1 dependent repositories - 1.53 thousand downloads last month - 84 stars on GitHub - 1 maintainer
coconut-ai 1.0.0
Coconut AI
6 versions - Latest release: over 1 year ago - 128 downloads last month - 2 stars on GitHub - 1 maintainer
cllm-python 0.0.8
cLLM is an Open-source library that use llama-cpp-python and llama.cpp and provide a Low and High...
9 versions - Latest release: over 1 year ago - 228 downloads last month - 15 stars on GitHub - 1 maintainer
locallm 0.5.3
An api to query local language models using different backends
9 versions - Latest release: over 1 year ago - 485 downloads last month - 7 stars on GitHub - 2 maintainers
gguf-llama 0.0.18
Wrapper for simplified use of Llama2 GGUF quantized models.
9 versions - Latest release: over 1 year ago - 1 dependent package - 422 downloads last month - 5 stars on GitHub - 1 maintainer
libre-chat 0.0.6
Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capa...
2 versions - Latest release: over 1 year ago - 135 downloads last month - 125 stars on GitHub - 1 maintainer
tool-llama 0.0.7
Open source library of large model usage tools.(εΌ€ζΊε€§ζ¨‘εž‹δ½Ώη”¨ε·₯ε…·ηš„εΊ“.)
7 versions - Latest release: over 1 year ago - 282 downloads last month - 4 stars on GitHub - 1 maintainer
text2tags-lib 0.0.7 removed
Use a finetune of Llama-7b and llama cpp to predict Danbooru tags from natural text.
6 versions - Latest release: over 1 year ago - 19 downloads last month - 0 stars on GitHub - 1 maintainer
libreassist 0.0.1
An open-source library LibreAssist is a Local Assistance here to help you with your needs on your...
1 version - Latest release: over 1 year ago - 63 downloads last month - 1 maintainer
llm-http-api 0.0.2
HTTP API for LLM with OpenAI compatibility
2 versions - Latest release: over 1 year ago - 86 downloads last month - 5 stars on GitHub - 1 maintainer
llama_cpp_openai 0.1.1
Lightweight OpenAI API server on top of Llama local models. Suitable for combined use with Micros...
1 version - Latest release: over 1 year ago - 65 downloads last month - 1 maintainer
fendi 0.0.0.13 πŸ’°
An auto py builder for ChatBots on top of streamlit app's - LLaMa's powered APS
5 versions - Latest release: over 1 year ago - 57 downloads last month - 4,843 stars on GitHub - 4 maintainers
genflow 0.6.0a2
A Python package with a built-in web application
3 versions - Latest release: over 1 year ago - 69 downloads last month - 1 maintainer
basicscore 0.0.3 πŸ’°
Creates basicness-scores of software
4 versions - Latest release: over 1 year ago - 242 downloads last month - 8,974 stars on GitHub - 1 maintainer
antar 0.0.1.dev0
1 version - Latest release: over 1 year ago - 54 downloads last month - 2 maintainers
qualtop-llmapi 0.47
Experimental libraries for communication with LLMs.
35 versions - Latest release: over 1 year ago - 286 downloads last month - 1 maintainer
python-aiconfig-llama 0.0.1
LLama extension for AIConfig Library
1 version - Latest release: over 1 year ago - 53 downloads last month - 866 stars on GitHub - 1 maintainer
talk-codebase 0.1.50
talk-codebase is a powerful tool for querying and analyzing codebases.
40 versions - Latest release: over 1 year ago - 1.26 thousand downloads last month - 452 stars on GitHub - 1 maintainer
exponential 0.5.3
A Python package with a built-in web application
1 version - Latest release: over 1 year ago - 1 dependent repositories - 58 downloads last month - 1 maintainer
convince 0.0.2
Better instruction following for large language models
2 versions - Latest release: over 1 year ago - 1 dependent package - 1 dependent repositories - 60 downloads last month - 2 stars on GitHub - 1 maintainer
esa-local-llm 0.0.15
ESA Local-LLM is a llama.cpp server in Docker with OpenAI Style Endpoints.
2 versions - Latest release: over 1 year ago - 1 dependent package - 93 downloads last month - 5,486 stars on GitHub - 1 maintainer
Top 6.0% on pypi.org
lmql 0.7.3
A query language for language models.
23 versions - Latest release: over 1 year ago - 3 dependent packages - 2 dependent repositories - 2.28 thousand downloads last month - 3,668 stars on GitHub - 1 maintainer
confirms 0.2.0
Comprehension of trade term sheets and confirmations
3 versions - Latest release: over 1 year ago - 1 dependent repositories - 76 downloads last month - 4 stars on GitHub - 2 maintainers
Top 8.9% on pypi.org
llama2-wrapper 0.1.14
Use llama2-wrapper as your local llama2 backend for Generative Agents / Apps
14 versions - Latest release: over 1 year ago - 1 dependent repositories - 683 downloads last month - 1,958 stars on GitHub - 1 maintainer
pai-repl 0.1.19
Python REPL with LLM integration
20 versions - Latest release: over 1 year ago - 888 downloads last month - 1 maintainer
local-llama 1.0.3 πŸ’°
A flask server for a chrome extension that querys llm models
3 versions - Latest release: over 1 year ago - 173 downloads last month - 17 stars on GitHub - 1 maintainer
Top 7.1% on pypi.org
opencopilot-ai 0.3.8
OpenCopilot Backend
11 versions - Latest release: over 1 year ago - 3 dependent repositories - 420 downloads last month - 532 stars on GitHub - 2 maintainers
magic-assistant 0.0.1
An AI agent framework.
1 version - Latest release: over 1 year ago - 53 downloads last month - 36,364 stars on GitHub - 1 maintainer
forum 0.1.1 removed
2 versions - Latest release: over 1 year ago - 1 downloads last month - 1 maintainer
baby-code 0.0.4
4 versions - Latest release: almost 2 years ago - 135 downloads last month - 1 maintainer
pxgpt 0.0.1
Your personal, powerful and private GPT.
3 versions - Latest release: almost 2 years ago - 143 downloads last month - 55,573 stars on GitHub - 1 maintainer
peelml 0.0.4
Peel away the pain of ml deployment
5 versions - Latest release: almost 2 years ago - 164 downloads last month - 1 maintainer
rlb 0.0.1
Racing Llama Benchmark is a benchmark tool for comparing llama.cpp performance against different ...
1 version - Latest release: almost 2 years ago - 58 downloads last month - 1 stars on GitHub - 1 maintainer
langflow-mod 0.0.79.1
A Python package with a built-in web application
1 version - Latest release: almost 2 years ago - 28 downloads last month - 13,967 stars on GitHub - 1 maintainer
agent-llm 1.1.41b0 πŸ’°
An Artificial Intelligence Automation Platform. AI Instruction management from various providers,...
2 versions - Latest release: almost 2 years ago - 125 downloads last month - 2,983 stars on GitHub - 1 maintainer
pyama 0.1.0
"Flask frontend for llama.cpp models"
1 version - Latest release: about 2 years ago - 46 downloads last month - 1 maintainer
Past Dependents
Include Past Dependents

Check this option to include packages that no longer depend on this package in their latest version but previously did.

Filter by kind
All kinds runtime 55 extra == "local" 5 llama 3 extra == "llama-cpp" 3 extra == "llamacpp" 2 llama-cpporall 1 extra == 'test' 1 extra == 'providers' 1 extra == 'local' 1 extra == "llama-cpp" or extra == "os-models" or extra == "all" 1 extra == 'full' 1 extra == "dev" 1 extra == 'backend' 1