Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "llama" keyword

myllm 4.8.26
A python package to interact with llm model supported by g4f and langchain.
214 versions - Latest release: 30 minutes ago - 1 dependent repositories - 3.04 thousand downloads last month - 3 stars on GitHub - 1 maintainer
chaincrafter 0.2.3
Seamless integration and composability for large language model apps.
5 versions - Latest release: 8 months ago - 53 downloads last month - 7 stars on GitHub - 1 maintainer
elia-chat 1.5.0
A powerful terminal user interface for interacting with large language models.
17 versions - Latest release: 1 day ago - 1.65 thousand downloads last month - 432 stars on GitHub - 1 maintainer
jllm 1.2.2 removed
Running Large Language Model easily, faster and low-cost
13 versions - Latest release: 7 months ago - 33 downloads last month - 2 stars on GitHub - 1 maintainer
llm-bench 0.4.19
Forked off of LLM Benchmark for Throughputs via Ollama
18 versions - Latest release: about 21 hours ago - 902 downloads last month - 0 stars on GitHub - 1 maintainer
freegenius 0.2.16 💰
FreeGenius AI, an advanced AI assistant that can talk and take multi-step actions. Supports numer...
122 versions - Latest release: about 8 hours ago - 3.89 thousand downloads last month - 91 stars on GitHub - 1 maintainer
langroid 0.1.245
Harness LLMs with Multi-Agent Programming
220 versions - Latest release: about 9 hours ago - 1 dependent repositories - 7.29 thousand downloads last month - 1,497 stars on GitHub - 1 maintainer
fjformer 0.0.57
Embark on a journey of paralleled/unparalleled computational prowess with FJFormer - an arsenal o...
46 versions - Latest release: 1 day ago - 1 dependent package - 1.15 thousand downloads last month - 21 stars on GitHub - 1 maintainer
llama_tools 0.1.12
Llama Tools: A collection of utilities for handling function calls with local llama.cpp models.
13 versions - Latest release: about 10 hours ago - 859 downloads last month - 1 maintainer
vllm-xft 0.3.3.1
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: 6 days ago - 107 downloads last month - 17,633 stars on GitHub - 1 maintainer
vllm-acc 0.4.1
A high-throughput and memory-efficient inference and serving engine for LLMs
7 versions - Latest release: 12 days ago - 1.19 thousand downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-infer 0.3.3
A high-throughput and memory-efficient inference and serving engine for LLMs
3 versions - Latest release: 24 days ago - 113 downloads last month - 17,633 stars on GitHub - 1 maintainer
llm_atc 0.1.7
Tools for fine tuning and serving LLMs
6 versions - Latest release: 6 months ago - 49 downloads last month - 17,633 stars on GitHub - 1 maintainer
hive-vllm 0.0.1
a
1 version - Latest release: 3 months ago - 8 downloads last month - 17,633 stars on GitHub - 1 maintainer
superlaser 0.0.6
An MLOps library for LLM deployment w/ the vLLM engine on RunPod's infra.
6 versions - Latest release: 2 months ago - 68 downloads last month - 17,633 stars on GitHub - 1 maintainer
nextai-vllm 0.0.7
A high-throughput and memory-efficient inference and serving engine for LLMs
6 versions - Latest release: 21 days ago - 128 downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-test01 0.1
A high-throughput and memory-efficient inference and serving engine for LLMs
1 version - Latest release: about 1 month ago - 12 downloads last month - 17,633 stars on GitHub - 1 maintainer
Top 3.4% on pypi.org
vllm 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
26 versions - Latest release: 11 days ago - 46 dependent packages - 5 dependent repositories - 520 thousand downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-online 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: 17 days ago - 265 downloads last month - 17,633 stars on GitHub - 1 maintainer
vllm-consul 0.2.1
A high-throughput and memory-efficient inference and serving engine for LLMs
5 versions - Latest release: 7 months ago - 43 downloads last month - 12,665 stars on GitHub - 1 maintainer
llm-swarm 0.1.1
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: 2 months ago - 75 downloads last month - 17,633 stars on GitHub - 1 maintainer
glai 0.1.3
Easy deployment of quantized llama models on cpu
11 versions - Latest release: 4 months ago - 113 downloads last month - 3 stars on GitHub - 1 maintainer
Top 4.8% on pypi.org
petals 2.2.0
Easy way to efficiently run 100B+ language models without high-end GPUs
18 versions - Latest release: 8 months ago - 4 dependent packages - 2 dependent repositories - 602 downloads last month - 8,730 stars on GitHub - 3 maintainers
test-petals 2.2.0.post1
Easy way to efficiently run 100B+ language models without high-end GPUs
1 version - Latest release: 6 months ago - 16 downloads last month - 8,203 stars on GitHub - 1 maintainer
fastapi-gen 0.5.1
Set up a modern REST API by running one command.
6 versions - Latest release: 25 days ago - 119 downloads last month - 3 stars on GitHub - 1 maintainer
Top 1.3% on pypi.org
gptcache 0.1.43
GPTCache, a powerful caching library that can be used to speed up and lower the cost of chat appl...
45 versions - Latest release: 6 months ago - 29 dependent packages - 1,266 dependent repositories - 127 thousand downloads last month - 6,477 stars on GitHub - 1 maintainer
gai-lib-gen 0.53
Gai/Gen is the Universal Multi-Modal Wrapper Library for LLM. The library is designed to provide ...
39 versions - Latest release: 4 months ago - 125 downloads last month - 16,707 stars on GitHub - 1 maintainer
llava-torch 1.2.2
Towards GPT-4 like large language and visual assistant.
6 versions - Latest release: 3 months ago - 679 downloads last month - 16,707 stars on GitHub - 1 maintainer
lisa-on-cuda 1.1.1
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and b...
9 versions - Latest release: 24 days ago - 215 downloads last month - 16,603 stars on GitHub - 1 maintainer
Top 8.2% on pypi.org
llmtuner 0.7.1
Easy-to-use LLM fine-tuning framework
30 versions - Latest release: about 15 hours ago - 1 dependent repositories - 1.6 thousand downloads last month - 20,012 stars on GitHub - 1 maintainer
Top 2.3% on pypi.org
ludwig 0.10.3
Declarative machine learning: End-to-end machine learning pipelines using data-driven configurati...
55 versions - Latest release: about 1 month ago - 1 dependent package - 119 dependent repositories - 4.35 thousand downloads last month - 10,859 stars on GitHub - 5 maintainers
moviechat 0.6.3
Long video understanding
10 versions - Latest release: 26 days ago - 1.13 thousand downloads last month - 408 stars on GitHub - 1 maintainer
pyaskit 1.4.2
AskIt: Unified programming interface for programming with large language models (GPT-3.5, GPT-4, ...
13 versions - Latest release: about 1 month ago - 105 downloads last month - 64 stars on GitHub - 1 maintainer
typegpt 0.3.2
TypeGPT - Make GPT safe for production
8 versions - Latest release: 2 days ago - 287 downloads last month - 10 stars on GitHub - 1 maintainer
easy-llama 0.1.25
Text generation in Python, as easy as possible
22 versions - Latest release: 1 day ago - 1.97 thousand downloads last month - 2 stars on GitHub - 1 maintainer
eidolon-ai-sdk 0.1.53
An open source sgent service SDK
42 versions - Latest release: 1 day ago - 2.3 thousand downloads last month - 71 stars on GitHub - 2 maintainers
langchain-llm 0.4.15
langchain llm wrapper
5 versions - Latest release: about 1 month ago - 557 downloads last month - 1,433 stars on GitHub - 1 maintainer
Top 4.7% on pypi.org
xinference 0.11.0
Model Serving Made Easy
60 versions - Latest release: 5 days ago - 3 dependent packages - 9 dependent repositories - 6.33 thousand downloads last month - 2,349 stars on GitHub - 1 maintainer
llama-api-server 0.3.5 💰
A OpenAI API compatible REST server for llama.
10 versions - Latest release: 9 months ago - 119 downloads last month - 172 stars on GitHub - 1 maintainer
local-llama 1.0.3 💰
A flask server for a chrome extension that querys llm models
3 versions - Latest release: 8 months ago - 38 downloads last month - 9 stars on GitHub - 1 maintainer
tool-helpers 0.1.1
Data tool helpers for PaddleNLP pre-training.
2 versions - Latest release: over 1 year ago - 1 dependent package - 7.59 thousand downloads last month - 11,341 stars on GitHub - 1 maintainer
Top 8.2% on pypi.org
spacy-llm 0.7.1 💰
Integrating LLMs into structured NLP pipelines
21 versions - Latest release: 4 months ago - 1 dependent package - 1 dependent repositories - 32.2 thousand downloads last month - 948 stars on GitHub - 1 maintainer
pypreprocess 1.2.0
Preprocess SDK
3 versions - Latest release: 5 months ago - 1 dependent package - 82 downloads last month - 1 maintainer
poe-api-wrapper 1.4.1
A simple, lightweight and efficient API wrapper for Poe.com
41 versions - Latest release: about 2 months ago - 1 dependent package - 15.8 thousand downloads last month - 553 stars on GitHub - 1 maintainer
easyeditor 0.0.1.dev0
easyeditor - Editing Large Language Models
1 version - Latest release: 7 months ago - 33 downloads last month - 1,344 stars on GitHub - 1 maintainer
Top 1.0% on pypi.org
paddlenlp 2.8.0
Easy-to-use and powerful NLP library with Awesome model zoo, supporting wide-range of NLP tasks f...
90 versions - Latest release: 22 days ago - 15 dependent packages - 438 dependent repositories - 43.1 thousand downloads last month - 11,391 stars on GitHub - 1 maintainer
Top 3.9% on pypi.org
openllm-client 0.4.44
OpenLLM Client: Interacting with OpenLLM HTTP/gRPC server, or any BentoML server.
74 versions - Latest release: 3 months ago - 2 dependent packages - 8 dependent repositories - 13.7 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
Top 2.2% on pypi.org
openllm 0.4.44
OpenLLM: Operating LLMs in production
153 versions - Latest release: 3 months ago - 3 dependent packages - 295 dependent repositories - 16.8 thousand downloads last month - 8,657 stars on GitHub - 2 maintainers
Top 9.2% on pypi.org
kani 1.0.1 💰
kani (カニ) is a lightweight and highly hackable framework for chat-based language models with tool...
25 versions - Latest release: 1 day ago - 2 dependent packages - 1 dependent repositories - 548 downloads last month - 525 stars on GitHub - 1 maintainer
gguf-core 0.0.38
a simple way to interact llama with gguf
38 versions - Latest release: 3 days ago - 1 dependent package - 622 downloads last month - 0 stars on GitHub - 1 maintainer
Top 6.0% on pypi.org
ms-swift 2.0.4
Swift: Scalable lightWeight Infrastructure for Fine-Tuning
25 versions - Latest release: 15 days ago - 2 dependent packages - 9 dependent repositories - 4.89 thousand downloads last month - 1,410 stars on GitHub - 1 maintainer
Top 7.9% on pypi.org
llama-recipes 0.0.1
Llama-recipes is a companion project to the Llama 2 model. It's goal is to provide examples to qu...
1 version - Latest release: 8 months ago - 2 dependent packages - 1 dependent repositories - 3.92 thousand downloads last month - 9,588 stars on GitHub - 2 maintainers
llama-index-readers-llama-parse 0.1.4
llama-index readers llama-parse integration
4 versions - Latest release: about 2 months ago - 6 dependent packages - 362 thousand downloads last month - 729 stars on GitHub - 1 maintainer
Top 4.2% on pypi.org
llama-hub 0.0.79
A library of community-driven data loaders for LLMs. Use with LlamaIndex and/or LangChain.
80 versions - Latest release: 3 months ago - 10 dependent packages - 4 dependent repositories - 37.8 thousand downloads last month - 3,395 stars on GitHub - 3 maintainers
llama-core 0.2.8
gguf connector core built on llama.cpp
28 versions - Latest release: 24 days ago - 3 dependent packages - 867 downloads last month - 0 stars on GitHub - 1 maintainer
insyt 0.0.1
Innovative Network Security Technologies
1 version - Latest release: about 2 months ago - 13 downloads last month - 54,564 stars on GitHub - 1 maintainer
torch-grammar 0.3.3 💰
Restrict LLM generations to a context-free grammar
8 versions - Latest release: 10 months ago - 376 downloads last month - 55,160 stars on GitHub - 1 maintainer
intelli 0.3.2
Create chatbots and AI agent workflows. Intelli provide unified layer to connect your data with m...
28 versions - Latest release: about 1 month ago - 1 dependent package - 404 downloads last month - 34 stars on GitHub - 1 maintainer
Top 2.9% on pypi.org
gguf 0.6.0 💰
Read and write ML models in GGUF for GGML
14 versions - Latest release: 5 months ago - 5 dependent packages - 56 dependent repositories - 132 thousand downloads last month - 55,160 stars on GitHub - 1 maintainer
gguf-selector 0.0.5
GGUF selector
5 versions - Latest release: 3 months ago - 2 dependent packages - 99 downloads last month - 0 stars on GitHub - 1 maintainer
gguf-modeldb 0.0.3
A Llama2 quantized gguf model db with over 80 preconfigured models downloadable in one line, easl...
8 versions - Latest release: 4 months ago - 1 dependent package - 233 downloads last month - 9 stars on GitHub - 1 maintainer
gguf-llama 0.0.18
Wrapper for simplified use of Llama2 GGUF quantized models.
9 versions - Latest release: 4 months ago - 1 dependent package - 145 downloads last month - 2 stars on GitHub - 1 maintainer
Top 3.3% on pypi.org
fast-tokenizer-python 1.0.2
PaddleNLP Fast Tokenizer Library written in C++
4 versions - Latest release: about 1 year ago - 2 dependent packages - 14 dependent repositories - 1.13 thousand downloads last month - 11,341 stars on GitHub - 1 maintainer
eidolon-ai-client 0.1.21
Eidolon python client and CLI
22 versions - Latest release: 7 days ago - 1 dependent package - 2.48 thousand downloads last month - 71 stars on GitHub - 1 maintainer
cria 1.6.5 💰
Run AI locally with as little friction as possible.
6 versions - Latest release: 14 days ago - 1 dependent package - 845 downloads last month - 102 stars on GitHub - 1 maintainer
chap 0.8.2
Interact with the OpenAI ChatGPT API (and other text generators)
12 versions - Latest release: 29 days ago - 4 dependent packages - 1 dependent repositories - 197 downloads last month - 12 stars on GitHub - 1 maintainer
callgg 1.0.3
GGUF caller
11 versions - Latest release: 3 months ago - 1 dependent package - 119 downloads last month - 0 stars on GitHub - 1 maintainer
Top 3.5% on pypi.org
openllm-core 0.4.44
OpenLLM Core: Core components for OpenLLM.
74 versions - Latest release: 3 months ago - 2 dependent packages - 8 dependent repositories - 13.9 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
langport 0.3.9
A large language model serving platform.
12 versions - Latest release: 4 months ago - 86 downloads last month - 80 stars on GitHub - 1 maintainer
docschat 4.0.0
Chat with your docs using langchain in a streamlit app with mistral or llama in ollama.
1 version - Latest release: 3 days ago - 1 maintainer
bleat 0.0.1
A CLI chatbot with Llama 3
1 version - Latest release: 26 days ago - 0 stars on GitHub - 1 maintainer
llm-benchmark 0.3.18
LLM Benchmark for Throughputs via Ollama
15 versions - Latest release: 15 days ago - 1.2 thousand downloads last month - 24 stars on GitHub - 1 maintainer
oxidized-transformers 0.1.0
Transformers library (not functional yet)
1 version - Latest release: 2 months ago - 12 downloads last month - 30 stars on GitHub - 1 maintainer
aitelegrambot 0.8.0
aitelegrambot is a Telegram bot that uses the Ollama backend to run the LLM rationalAI (by default).
16 versions - Latest release: 12 days ago - 524 downloads last month - 48,781 stars on GitHub - 1 maintainer
easy-lm-eval 0.1.2
A library for easy evaluation of language models
3 versions - Latest release: 2 months ago - 20 downloads last month - 3 stars on GitHub - 1 maintainer
google-jetstream 0.2.1
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting ...
4 versions - Latest release: 12 days ago - 11.6 thousand downloads last month - 126 stars on GitHub - 1 maintainer
freegeniusai 0.0.1 💰
FreeGenius AI, inspired by LetMeDoIt AI, offers a comprehensive suite of free, core AI features f...
1 version - Latest release: 3 months ago - 12 downloads last month - 31 stars on GitHub - 1 maintainer
healthsageai 0.1.7
HealthSage AI LLMs, Healthcare genAI platform
5 versions - Latest release: 17 days ago - 220 downloads last month - 1 maintainer
benchllama 0.2.7
Benchmark your local LLMs.
9 versions - Latest release: 3 months ago - 93 downloads last month - 17 stars on GitHub - 1 maintainer
llama-index-packs-panel-chatbot 0.1.4
llama-index packs panel_chatbot integration
5 versions - Latest release: 3 months ago - 34 downloads last month - 85 stars on GitHub - 1 maintainer
auto-subtitle-llama 1.0.6
Automatically generate, translate and embed subtitles into your videos
5 versions - Latest release: 2 months ago - 49 downloads last month - 11 stars on GitHub - 1 maintainer
nanodl 1.2.4.dev1 💰
A Jax-based library for designing and training transformer models from scratch.
6 versions - Latest release: 3 days ago - 110 downloads last month - 256 stars on GitHub - 1 maintainer
tinyllama 0.0.291
Model classes and pre-training utilities for a tiny version of Llama in PyTorch.
19 versions - Latest release: 3 months ago - 99 downloads last month - 2 stars on GitHub - 1 maintainer
m2pt 0.0.6 💰
M2PT - Pytorch
3 versions - Latest release: 4 months ago - 39 downloads last month - 11 stars on GitHub - 1 maintainer
switch-transformers 0.0.4 💰
SwitchTransformers - Pytorch
4 versions - Latest release: 4 months ago - 55 downloads last month - 14 stars on GitHub - 1 maintainer
gats-torch 0.0.1 💰
gats - Pytorch
1 version - Latest release: 4 months ago - 13 downloads last month - 8 stars on GitHub - 1 maintainer
repoagent 0.1.3
An LLM-Powered Framework for Repository-level Code Documentation Generation.
5 versions - Latest release: 2 months ago - 129 downloads last month - 144 stars on GitHub - 1 maintainer
rubber-ducky 1.1.0
AI Companion for Pair Programming
3 versions - Latest release: 5 months ago - 21 downloads last month - 12 stars on GitHub - 1 maintainer
atc-torch 0.0.1 💰
atc-torch - Pytorch
1 version - Latest release: 6 months ago - 17 downloads last month - 5 stars on GitHub - 1 maintainer
aidebug 0.1.6 💰
AI Coding Assistant Shell
9 versions - Latest release: 6 months ago - 46 downloads last month - 8,264 stars on GitHub - 1 maintainer
simple-ai-agents 0.3.0
Get up and running with Llama 2, Mistral, Gemma, and other large language models.
6 versions - Latest release: 4 months ago - 29 downloads last month - 54,564 stars on GitHub - 1 maintainer
airllm 2.8.3
AirLLM allows single 4GB GPU card to run 70B large language models without quantization, distilla...
26 versions - Latest release: 5 months ago - 752 downloads last month - 2,790 stars on GitHub - 1 maintainer
lorax-client 0.5.0
LoRAX Python Client
8 versions - Latest release: 22 days ago - 2.06 thousand downloads last month - 516 stars on GitHub - 1 maintainer
langware 0.1
Lightweight, powerful and hassle-free Langchain alternative.
1 version - Latest release: 6 months ago - 12 downloads last month - 0 stars on GitHub - 1 maintainer
genai_stack 0.2.6
End-to-End Secure & Private Generative AI for All
2 versions - Latest release: 6 months ago - 57 downloads last month - 112 stars on GitHub - 1 maintainer
higgsfield 0.1.1
Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for ...
4 versions - Latest release: 7 months ago - 1 dependent repositories - 2.83 thousand downloads last month - 3,251 stars on GitHub - 2 maintainers
xllm 0.3.24
Simple & Cutting Edge LLM Finetuning
40 versions - Latest release: 8 months ago - 1 dependent repositories - 160 downloads last month - 259 stars on GitHub - 1 maintainer
py-data-juicer 0.2.0
A One-Stop Data Processing System for Large Language Models.
5 versions - Latest release: 2 months ago - 96 downloads last month - 1,321 stars on GitHub - 1 maintainer
pai-easydist 0.1.0
Efficient Automatic Training System for Super-Large Models
1 version - Latest release: 8 months ago - 9 downloads last month - 66 stars on GitHub - 1 maintainer
rungpt 0.1.1
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
2 versions - Latest release: 8 months ago - 43 downloads last month - 134 stars on GitHub - 1 maintainer