golang 86 go 74 nlp 61 parser 42 natural-language-processing 37 lexer 35 social-sciences 25 llm 20 tokenization 20 openai 17 bpe 16 sentencepiece 13 token 13 tiktoken 12 ast 12 python 11 gpt 11 interpreter 11 parsing 9 go-library 9 llama 9 pos-tagging 9 text-processing 8 json 8 programming-language 8 ai 7 scanner 7 lex 7 anthropic 7 gemini 7 token-counting 6 wordpiece 6 golang-library 6 cli 6 huggingface 6 language 6 morphological-analysis 6 tokens 6 japanese 6 language-development 6 javascript 6 pure-go 6 unicode 6 opensource 6 mistral 6 virtlang 6 programming 6 lemmatization 5 machine-learning 5 search 5 query 5 parse 5 php 5 segmentation 5 machine-translation 4 condition 4 cpp 4 icu 4 text 4 text-processor 4 parsers 4 nlp-library 4 korean 4 rust 4 lemmatizer 4 korean-tokenizer 4 named-entity-recognition 3 dependency-parsing 3 julia 3 lexing 3 typescript 3 uax29 3 security 3 word-filter 3 json-parser 3 flex 3 regexp 3 yacc 3 japanese-language 3 hacktoberfest 3 stream 3 transliteration 3 claude 3 rfc4512 3 regex 3 embeddings 3 dependency-parser 3 ner 3 compiler 3 decoder 3 antlr 3 encoder 3 php-5 2 json-serialization 2 regular-expression 2 goselect 2 parsing-algorithms 2 queries 2 sql 2 decompounding 2