`github.com/NVIDIA/NeMo-Curator`

Scalable data pre processing and curation toolkit for LLMs

Ecosystem
proxy.golang.org

Latest Release
v1.0.0
5 months ago

Versions
11

Readme

PURL	`pkg:golang/github.com/%21n%21v%21i%21d%21i%21a/%21ne%21mo-%21curator` spec
License	Apache-2.0
First Release	almost 2 years ago
Last Synced	22 days ago

Keywords
data data-curation data-prep data-preparation data-processing data-processing-pipelines data-quality datacuration datarecipes deduplication fast-data-processing fine-tuning large-language-models large-scale-data-processing llm llm-data-quality llmapps python semantic-deduplication

Stars	918 on GitHub
Forks	130 on GitHub

repos.ecosyste.ms

Overall Top 5.6%

ecosyste.ms