nlp 56 tokenizer 33 python 31 natural-language-processing 29 machine-learning 21 spacy 14 nlp-library 14 ai 13 NLP 12 lemmatization 12 deep-learning 12 named-entity-recognition 12 text-processing 10 text-classification 10 artificial-intelligence 10 tokenize 9 data-science 9 text 9 llm 8 neural-networks 8 neural-network 8 morphological-analysis 7 segmentation 7 cython 7 transformer 7 tagging 7 entity-linking 7 token 6 parsing 6 universal-dependencies 5 natural language processing 5 multilingual 5 dependency-parsing 5 language 5 transformers 5 text-mining 4 ner 4 data 4 learning 4 embeddings 4 deep learning 4 openai 4 information-extraction 4 language-model 4 console 4 tokenisation 4 parser 4 preprocessing 4 bpe 4 unicode 4 pytorch 4 linguistics 3 processing 3 chinese 3 sentence-segmentation 3 hacktoberfest 3 text processing 3 language processing 3 sentiment-analysis 3 sentence boundary detection 3 tf-idf 3 tiktoken 3 lexer 3 stanza 3 sentence 3 language-detection 3 pos-tagging 3 part-of-speech-tagger 3 chatbot 3 artificial intelligence 3 cpp 3 zhuyin 3 machine-translation 3 XML 3 rust 3 augmentation 3 tokens 3 shell 3 morphology 3 terminal 3 tokeniser 3 large-language-models 3 language-models 3 gpt 3 natural 3 text-analysis 3 information-retrieval 2 romanisation 2 poj 2 transliterator 2 taiwan 2 transliteration 2 taiwanese 2 romanization 2 hokkien 2 taigi 2 cli 2 sentence-splitting 2 mmseg 2 word 2