Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

proxy.golang.org "data-processing-pipelines" keyword

Top 5.6% on proxy.golang.org
github.com/NVIDIA/NeMo-Curator v1.0.0
Scalable data pre processing and curation toolkit for LLMs
11 versions - Latest release: 5 months ago - 918 stars on GitHub
Related Keywords
data 1 data-curation 1 data-prep 1 data-preparation 1 data-processing 1 data-quality 1 datacuration 1 datarecipes 1 deduplication 1 fast-data-processing 1 fine-tuning 1 large-language-models 1 large-scale-data-processing 1 llm 1 llm-data-quality 1 llmapps 1 python 1 semantic-deduplication 1