Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org : split-markdown4gpt
A Python tool for splitting large Markdown files into smaller sections based on a specified token limit. This is particularly useful for processing large Markdown files with GPT models, as it allows the models to handle the data in manageable chunks.
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/split-markdown4gpt
Keywords: python, nlp, markdown, natural-language-processing, text-analysis, openai, text-summarization, summarization, text-processing, gpt, data-preprocessing, mistletoe, split-text, text-tokenization, openai-gpt, gpt-3, gpt-4, gpt-35-turbo, gpt-35-turbo-16k, markdown-processing
License: Apache-2.0
Latest release: 11 months ago
First release: 11 months ago
Dependent repositories: 1
Downloads: 97 last month
Stars: 16 on GitHub
Forks: 2 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 16 days ago