Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "fast-data-processing" keyword

View the packages on the pypi.org package registry that are tagged with the "fast-data-processing" keyword.

nemo-curator 0.7.1
Scalable Data Preprocessing Tool for Training Large Language Models
16 versions - Latest release: 20 days ago - 1.34 thousand downloads last month - 873 stars on GitHub - 5 maintainers
invisible-rabbit 0.5.0
Scalable Data Preprocessing Tool for Training Large Language Models
4 versions - Latest release: 6 months ago - 172 downloads last month - 868 stars on GitHub - 1 maintainer
invisible-unicorn 0.4.0
Scalable Data Preprocessing Tool for Training Large Language Models
1 version - Latest release: 7 months ago - 46 downloads last month - 868 stars on GitHub - 1 maintainer
Related Keywords
data 3 data-curation 3 data-prep 3 data-preparation 3 data-processing 3 data-processing-pipelines 3 data-quality 3 datacuration 3 datarecipes 3 deduplication 3 fine-tuning 3 large-language-models 3 large-scale-data-processing 3 llm 3 llm-data-quality 3 llmapps 3 python 3 semantic-deduplication 3