Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "llama" keyword

poe-api-wrapper 1.4.1
A simple, lightweight and efficient API wrapper for Poe.com
41 versions - Latest release: 3 months ago - 1 dependent package - 18.9 thousand downloads last month - 612 stars on GitHub - 1 maintainer
llmdeploy 0.0.1
triton inference service of llama
1 version - Latest release: 12 months ago - 15 downloads last month - 2,405 stars on GitHub - 1 maintainer
fastapi-gen 0.5.1
Set up a modern REST API by running one command.
6 versions - Latest release: about 2 months ago - 43 downloads last month - 3 stars on GitHub - 1 maintainer
redco 0.4.16
NAACL '24 (Demo) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Tra...
17 versions - Latest release: about 2 months ago - 50 downloads last month - 41 stars on GitHub - 1 maintainer
vllm-acc 0.4.1
A high-throughput and memory-efficient inference and serving engine for LLMs
8 versions - Latest release: about 1 month ago - 306 downloads last month - 17,633 stars on GitHub - 1 maintainer
hive-vllm 0.0.1
a
1 version - Latest release: 3 months ago - 10 downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-infer 0.3.3
A high-throughput and memory-efficient inference and serving engine for LLMs
3 versions - Latest release: about 2 months ago - 29 downloads last month - 17,633 stars on GitHub - 1 maintainer
Top 3.4% on pypi.org
vllm 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
27 versions - Latest release: about 1 month ago - 46 dependent packages - 5 dependent repositories - 409 thousand downloads last month - 17,633 stars on GitHub - 2 maintainers
superlaser 0.0.6
An MLOps library for LLM deployment w/ the vLLM engine on RunPod's infra.
6 versions - Latest release: 3 months ago - 76 downloads last month - 17,633 stars on GitHub - 1 maintainer
byzerllm 0.1.89
ByzerLLM: Byzer LLM
96 versions - Latest release: 23 days ago - 1 dependent package - 2 dependent repositories - 3.05 thousand downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-test01 0.1
A high-throughput and memory-efficient inference and serving engine for LLMs
1 version - Latest release: 2 months ago - 9 downloads last month - 17,633 stars on GitHub - 1 maintainer
llm_atc 0.1.7
Tools for fine tuning and serving LLMs
6 versions - Latest release: 6 months ago - 47 downloads last month - 17,633 stars on GitHub - 1 maintainer
llm-swarm 0.1.1
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: 3 months ago - 48 downloads last month - 17,633 stars on GitHub - 1 maintainer
vllm-xft 0.3.3.1
A high-throughput and memory-efficient inference and serving engine for LLMs
3 versions - Latest release: about 1 month ago - 436 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-online 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: about 1 month ago - 42 downloads last month - 17,633 stars on GitHub - 1 maintainer
nextai-vllm 0.0.7
A high-throughput and memory-efficient inference and serving engine for LLMs
6 versions - Latest release: about 2 months ago - 33 downloads last month - 17,633 stars on GitHub - 1 maintainer
vllm-consul 0.2.1
A high-throughput and memory-efficient inference and serving engine for LLMs
5 versions - Latest release: 8 months ago - 16 downloads last month - 12,665 stars on GitHub - 1 maintainer
langchain-chatchat 0.3.0
Langchain-Chatchat(原Langchain-ChatGLM)基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答 | Langchain-Chatchat (...
3 versions - Latest release: about 1 month ago - 217 downloads last month - 28,773 stars on GitHub - 1 maintainer
insyt 0.0.1
Innovative Network Security Technologies
1 version - Latest release: 3 months ago - 25 downloads last month - 54,564 stars on GitHub - 1 maintainer
pai-easydist 0.1.0
Efficient Automatic Training System for Super-Large Models
1 version - Latest release: 9 months ago - 7 downloads last month - 66 stars on GitHub - 1 maintainer
py-data-juicer 0.2.0
A One-Stop Data Processing System for Large Language Models.
5 versions - Latest release: 3 months ago - 101 downloads last month - 1,321 stars on GitHub - 1 maintainer
gats-torch 0.0.1 💰
gats - Pytorch
1 version - Latest release: 5 months ago - 24 downloads last month - 8 stars on GitHub - 1 maintainer
mmgpt 0.0.1
An open-source framework for multi-modality instruction fine-tuning
1 version - Latest release: about 1 year ago - 19 downloads last month - 3,923 stars on GitHub - 1 maintainer
freegpt 1.3.4 💰
freeGPT provides free access to text and image generation models.
36 versions - Latest release: 8 months ago - 1.05 thousand downloads last month - 396 stars on GitHub - 1 maintainer
llama-server 0.2.2
LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
5 versions - Latest release: almost 1 year ago - 160 downloads last month - 104 stars on GitHub - 1 maintainer
megabots 0.0.11
🤖 Megabots provides State-of-the-art, production ready bots made mega-easy, so you don't have to ...
5 versions - Latest release: about 1 year ago - 1 dependent repositories - 32 downloads last month - 335 stars on GitHub - 1 maintainer
qnabot 0.0.6
Create a question answering over docs bot with one line of code.
6 versions - Latest release: about 1 year ago - 1 dependent repositories - 19 downloads last month - 335 stars on GitHub - 1 maintainer
Top 6.0% on pypi.org
ms-swift 2.0.4
Swift: Scalable lightWeight Infrastructure for Fine-Tuning
28 versions - Latest release: about 1 month ago - 2 dependent packages - 9 dependent repositories - 3.82 thousand downloads last month - 1,410 stars on GitHub - 1 maintainer
genai_stack 0.2.6
End-to-End Secure & Private Generative AI for All
2 versions - Latest release: 7 months ago - 51 downloads last month - 121 stars on GitHub - 1 maintainer
Top 4.7% on pypi.org
xinference 0.11.1
Model Serving Made Easy
65 versions - Latest release: 24 days ago - 3 dependent packages - 9 dependent repositories - 8.69 thousand downloads last month - 2,349 stars on GitHub - 1 maintainer
llama-trainer 0.2.1
Llama trainer utility
3 versions - Latest release: 9 months ago - 17 downloads last month - 6 stars on GitHub - 1 maintainer
dabot 2019.9.24
CLI tool to automate stuff on DeviantArt.com
12 versions - Latest release: over 4 years ago - 1 dependent repositories - 59 downloads last month - 20 stars on GitHub - 1 maintainer
easy-llama 0.1.26
Text generation in Python, as easy as possible
39 versions - Latest release: 23 days ago - 3.44 thousand downloads last month - 2 stars on GitHub - 1 maintainer
freegenius 0.2.22 💰
FreeGenius AI, an advanced AI assistant that can talk and take multi-step actions. Supports numer...
168 versions - Latest release: 23 days ago - 6.18 thousand downloads last month - 94 stars on GitHub - 1 maintainer
scalellm 0.0.9
A high-performance inference system for large language models.
4 versions - Latest release: 24 days ago - 771 downloads last month - 289 stars on GitHub - 1 maintainer
llava-torch 1.2.2
Towards GPT-4 like large language and visual assistant.
6 versions - Latest release: 4 months ago - 698 downloads last month - 16,707 stars on GitHub - 1 maintainer
gai-lib-gen 0.53
Gai/Gen is the Universal Multi-Modal Wrapper Library for LLM. The library is designed to provide ...
39 versions - Latest release: 5 months ago - 100 downloads last month - 16,707 stars on GitHub - 1 maintainer
lisa-on-cuda 1.1.1
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and b...
10 versions - Latest release: about 2 months ago - 90 downloads last month - 16,707 stars on GitHub - 1 maintainer
genoss 0.0.2a3
Replace OpenAI GPT with any LLMs in your app with one line. Common Inference API for all LLMs eit...
4 versions - Latest release: 10 months ago - 1 dependent repositories - 18 downloads last month - 738 stars on GitHub - 1 maintainer
billm 0.1.3
Tool for converting LLMs from uni-directional to bi-directional for tasks like classification and...
7 versions - Latest release: 2 months ago - 1.18 thousand downloads last month - 380 stars on GitHub - 1 maintainer
auto-subtitle-llama 1.0.6
Automatically generate, translate and embed subtitles into your videos
5 versions - Latest release: 3 months ago - 74 downloads last month - 14 stars on GitHub - 1 maintainer
ludwig-myelin 0.2.1
A deep learning experimentation toolbox
33 versions - Latest release: over 4 years ago - 1 dependent repositories - 75 downloads last month - 10,876 stars on GitHub - 1 maintainer
langroid 0.1.245
Harness LLMs with Multi-Agent Programming
233 versions - Latest release: 25 days ago - 1 dependent repositories - 7.45 thousand downloads last month - 1,779 stars on GitHub - 1 maintainer
easy-lm-eval 0.1.2
A library for easy evaluation of language models
3 versions - Latest release: 3 months ago - 61 downloads last month - 3 stars on GitHub - 1 maintainer
myllm 4.8.27
A python package to interact with llm model supported by g4f and langchain.
223 versions - Latest release: 23 days ago - 1 dependent repositories - 2.39 thousand downloads last month - 3 stars on GitHub - 1 maintainer
eidolon-ai-sdk 0.1.54
An open source sgent service SDK
54 versions - Latest release: 24 days ago - 2.68 thousand downloads last month - 71 stars on GitHub - 2 maintainers
gguf-selector 0.0.5
GGUF selector
5 versions - Latest release: 3 months ago - 2 dependent packages - 99 downloads last month - 0 stars on GitHub - 1 maintainer
easyinstruct 0.1.2
An Easy-to-use Instruction Processing Framework for Large Language Models.
8 versions - Latest release: 4 months ago - 1 dependent repositories - 110 downloads last month - 243 stars on GitHub - 3 maintainers
airllm 2.8.3
AirLLM allows single 4GB GPU card to run 70B large language models without quantization, distilla...
26 versions - Latest release: 6 months ago - 3.23 thousand downloads last month - 3,379 stars on GitHub - 1 maintainer
benchllama 0.2.7
Benchmark your local LLMs.
9 versions - Latest release: 4 months ago - 76 downloads last month - 17 stars on GitHub - 1 maintainer
translate-shell 0.0.51 💰
Translate text by google, bing, youdaozhiyun, haici, stardict, openai, large language model of lo...
51 versions - Latest release: 4 months ago - 2 dependent repositories - 293 downloads last month - 27 stars on GitHub - 1 maintainer
lorax-client 0.5.1
LoRAX Python Client
11 versions - Latest release: 24 days ago - 11.6 thousand downloads last month - 516 stars on GitHub - 1 maintainer
Top 2.2% on pypi.org
openllm 0.4.44
OpenLLM: Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in...
162 versions - Latest release: 4 months ago - 3 dependent packages - 295 dependent repositories - 15.4 thousand downloads last month - 8,657 stars on GitHub - 2 maintainers
Top 3.9% on pypi.org
openllm-client 0.4.44
OpenLLM Client: Interacting with OpenLLM HTTP/gRPC server, or any BentoML server.
83 versions - Latest release: 4 months ago - 2 dependent packages - 8 dependent repositories - 11.4 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
Top 3.5% on pypi.org
openllm-core 0.4.44
OpenLLM Core: Core components for OpenLLM.
83 versions - Latest release: 4 months ago - 2 dependent packages - 8 dependent repositories - 12.3 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
eidolon-ai-client 0.1.21
Eidolon python client and CLI
24 versions - Latest release: about 1 month ago - 1 dependent package - 2.44 thousand downloads last month - 71 stars on GitHub - 1 maintainer
llmapi-cli 1.1.1
Do you want to talk directly to the LLMs? Try llmapi.
9 versions - Latest release: about 1 year ago - 41 downloads last month - 36 stars on GitHub - 1 maintainer
bleat 0.0.1
A CLI chatbot with Llama 3
1 version - Latest release: about 2 months ago - 20 downloads last month - 0 stars on GitHub - 1 maintainer
intelli 0.3.2
Create chatbots and AI agent workflows. Intelli provide unified layer to connect your data with m...
28 versions - Latest release: 2 months ago - 1 dependent package - 234 downloads last month - 34 stars on GitHub - 1 maintainer
Top 1.0% on pypi.org
paddlenlp 2.8.0
Easy-to-use and powerful NLP library with Awesome model zoo, supporting wide-range of NLP tasks f...
90 versions - Latest release: about 2 months ago - 15 dependent packages - 438 dependent repositories - 42.3 thousand downloads last month - 11,391 stars on GitHub - 1 maintainer
jetson-examples 0.0.8
Running Gen AI models and applications on NVIDIA Jetson devices with one-line command
12 versions - Latest release: 29 days ago - 428 downloads last month - 3 stars on GitHub - 1 maintainer
llm-inference 0.0.6 💰
Large Language Models Inference API and Applications
5 versions - Latest release: 11 months ago - 57 downloads last month - 120 stars on GitHub - 1 maintainer
llm-benchmark 0.3.18
LLM Benchmark for Throughputs via Ollama
15 versions - Latest release: about 1 month ago - 711 downloads last month - 24 stars on GitHub - 1 maintainer
open-gpts 0.0.1rc1
An open-source implementation of large-scale language model (LLM).
1 version - Latest release: about 1 year ago - 6 downloads last month - 137 stars on GitHub - 1 maintainer
llamalogsdev 0.1.7
Client library for Llama Logs; https://llamalogs.com
4 versions - Latest release: about 4 years ago - 1 dependent repositories - 12 downloads last month - 1 maintainer
Top 1.3% on pypi.org
gptcache 0.1.43
GPTCache, a powerful caching library that can be used to speed up and lower the cost of chat appl...
45 versions - Latest release: 6 months ago - 29 dependent packages - 1,266 dependent repositories - 144 thousand downloads last month - 6,477 stars on GitHub - 1 maintainer
fuzy-jon 0.0.9
Fuzzy-JSON is a compact Python package with no dependencies, designed to address the pesky JSONDe...
9 versions - Latest release: 3 months ago - 1 dependent package - 3.01 thousand downloads last month - 10 stars on GitHub - 1 maintainer
Top 4.8% on pypi.org
petals 2.2.0
Easy way to efficiently run 100B+ language models without high-end GPUs
18 versions - Latest release: 9 months ago - 4 dependent packages - 2 dependent repositories - 516 downloads last month - 8,730 stars on GitHub - 3 maintainers
test-petals 2.2.0.post1
Easy way to efficiently run 100B+ language models without high-end GPUs
1 version - Latest release: 7 months ago - 19 downloads last month - 8,203 stars on GitHub - 1 maintainer
Top 4.7% on pypi.org
pyllamacpp 2.4.3
Python bindings for llama.cpp
18 versions - Latest release: 3 months ago - 5 dependent packages - 38 dependent repositories - 5 thousand downloads last month - 59 stars on GitHub - 1 maintainer
getllms 1.2
Download LLMs to use locally.
8 versions - Latest release: 4 months ago - 26 downloads last month - 0 stars on GitHub - 1 maintainer
callgg 1.0.3
GGUF caller
11 versions - Latest release: 3 months ago - 1 dependent package - 96 downloads last month - 0 stars on GitHub - 1 maintainer
agent-llm 1.1.41b0 💰
An Artificial Intelligence Automation Platform. AI Instruction management from various providers,...
2 versions - Latest release: about 1 year ago - 22 downloads last month - 2,456 stars on GitHub - 1 maintainer
picollm 1.0.0
picoLLM Inference Engine
1 version - Latest release: 24 days ago - 222 downloads last month - 60 stars on GitHub - 1 maintainer
picollmdemo 1.0.0
picoLLM Inference Engine demos
1 version - Latest release: 24 days ago - 178 downloads last month - 60 stars on GitHub - 1 maintainer
google-jetstream 0.2.1
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting ...
5 versions - Latest release: about 1 month ago - 11.6 thousand downloads last month - 126 stars on GitHub - 1 maintainer
fjformer 0.0.57
Embark on a journey of paralleled/unparalleled computational prowess with FJFormer - an arsenal o...
52 versions - Latest release: 26 days ago - 1 dependent package - 1.27 thousand downloads last month - 21 stars on GitHub - 1 maintainer
pyfastedit 0.0.5
Editing large language models within 10 seconds
5 versions - Latest release: 11 months ago - 34 downloads last month - 1,183 stars on GitHub - 1 maintainer
Top 9.2% on pypi.org
kani 1.0.1 💰
kani (カニ) is a lightweight and highly hackable framework for chat-based language models with tool...
26 versions - Latest release: 26 days ago - 2 dependent packages - 1 dependent repositories - 453 downloads last month - 525 stars on GitHub - 1 maintainer
llama-rs-python 0.1.0
Unofficial python bindings for llama-rs. 🐍❤️🦀
3 versions - Latest release: about 1 year ago - 49 downloads last month - 70 stars on GitHub - 1 maintainer
Top 7.9% on pypi.org
textgen 1.1.1
Text Generation Model
23 versions - Latest release: 9 months ago - 3 dependent repositories - 142 downloads last month - 893 stars on GitHub - 1 maintainer
jllm 1.2.2 removed
Running Large Language Model easily, faster and low-cost
13 versions - Latest release: 8 months ago - 33 downloads last month - 2 stars on GitHub - 1 maintainer
process-supervision-torch 0.0.3 💰
Process SuperVision - Pytorch
2 versions - Latest release: 7 months ago - 23 downloads last month - 33 stars on GitHub - 1 maintainer
healthsageai 0.1.7
HealthSage AI LLMs, Healthcare genAI platform
5 versions - Latest release: about 1 month ago - 146 downloads last month - 1 maintainer
llm-bench 0.4.19
Forked off of LLM Benchmark for Throughputs via Ollama
21 versions - Latest release: 25 days ago - 1.41 thousand downloads last month - 0 stars on GitHub - 1 maintainer
freegeniusai 0.0.1 💰
FreeGenius AI, inspired by LetMeDoIt AI, offers a comprehensive suite of free, core AI features f...
1 version - Latest release: 3 months ago - 9 downloads last month - 31 stars on GitHub - 1 maintainer
llama2-py 0.0.6
Inference Llama 2 in one file of pure Python
6 versions - Latest release: 8 months ago - 134 downloads last month - 383 stars on GitHub - 1 maintainer
Top 6.0% on pypi.org
lmdeploy 0.4.1
A toolset for compressing, deploying and serving LLM
29 versions - Latest release: about 1 month ago - 1 dependent package - 2 dependent repositories - 4.88 thousand downloads last month - 2,405 stars on GitHub - 1 maintainer
meta-ai-api 1.1.7
Meta AI API Wrapper to interact with the Meta AI API
19 versions - Latest release: about 2 months ago - 1.21 thousand downloads last month - 77 stars on GitHub - 1 maintainer
llama-index-packs-panel-chatbot 0.1.4
llama-index packs panel_chatbot integration
5 versions - Latest release: 4 months ago - 20 downloads last month - 91 stars on GitHub - 1 maintainer
ragoon 💰
Improve large language models (LLM) retrieval using dynamic web-search based on blazingly fast qu...
1 version - 0 stars on GitHub
nanodl 1.2.4.dev1 💰
A Jax-based library for designing and training transformer models from scratch.
7 versions - Latest release: 28 days ago - 103 downloads last month - 256 stars on GitHub - 1 maintainer
zh-langchain 0.2.1
Chinese language processing library
12 versions - Latest release: 12 months ago - 1.09 thousand downloads last month - 28,260 stars on GitHub - 1 maintainer
gguf-llama 0.0.18
Wrapper for simplified use of Llama2 GGUF quantized models.
9 versions - Latest release: 5 months ago - 1 dependent package - 140 downloads last month - 2 stars on GitHub - 1 maintainer
Top 6.3% on pypi.org
agixtsdk 0.0.37 💰
The AGiXT SDK for Python.
40 versions - Latest release: about 1 month ago - 1 dependent package - 2 dependent repositories - 1.95 thousand downloads last month - 2,456 stars on GitHub - 1 maintainer
simple-ai-agents 0.3.0
Get up and running with Llama 2, Mistral, Gemma, and other large language models.
6 versions - Latest release: 5 months ago - 32 downloads last month - 54,564 stars on GitHub - 1 maintainer
open-gpt-torch 0.0.13
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
27 versions - Latest release: 11 months ago - 128 downloads last month - 137 stars on GitHub - 1 maintainer
rungpt 0.1.1
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
2 versions - Latest release: 9 months ago - 34 downloads last month - 137 stars on GitHub - 1 maintainer
llama_tools 0.1.18
Llama Tools: A collection of utilities for handling function calls with local llama.cpp models.
20 versions - Latest release: 24 days ago - 1.51 thousand downloads last month - 1 maintainer
formulaic-ai 0.1.0.4
The official Formulaic Python library
2 versions - Latest release: 3 months ago - 81 downloads last month - 5 stars on GitHub - 1 maintainer