Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
packagist.org "tokenizer" keyword
Top 9.3% on packagist.org
11 versions - Latest release: over 4 years ago - 2 dependent packages - 3 dependent repositories - 37.4 thousand downloads total - 12 stars on GitHub - 1 maintainer
funivan/php-tokenizer 0.3.0
Wrapper around token_get_all. Easy to extract and modify php code.11 versions - Latest release: over 4 years ago - 2 dependent packages - 3 dependent repositories - 37.4 thousand downloads total - 12 stars on GitHub - 1 maintainer
vanderlee/comprehend 1.0.2
Framework for building BNF LR(1) parsers3 versions - Latest release: over 5 years ago - 14 downloads total - 5 stars on GitHub - 1 maintainer
didix16/php-grammar 1.0.1
A simple library for make Lexer and Parsers to build a language2 versions - Latest release: almost 3 years ago - 2 dependent packages - 2 dependent repositories - 4.81 thousand downloads total - 1 stars on GitHub - 1 maintainer
smaakvoldelen/tokenizer 1.0.1 removed 💰
A tool that uses regular expressions to split a given string into tokens.2 versions - Latest release: 5 months ago - 3 downloads total - 1 maintainer
Top 3.4% on packagist.org
1 version - Latest release: over 9 years ago - 14 dependent packages - 9 dependent repositories - 124 thousand downloads total - 48 stars on GitHub - 1 maintainer
jeremeamia/functionparser 1.0.0 abandoned
Function parser for PHP functions, methods, and closures1 version - Latest release: over 9 years ago - 14 dependent packages - 9 dependent repositories - 124 thousand downloads total - 48 stars on GitHub - 1 maintainer
sikessem/runtime removed
📦️ Install the SIKessEm Runtime (ske)Latest release: over 1 year ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
aurora-project/tokenizer 1.0.0 removed
Library for navigating PHP parser tokens1 version - Latest release: about 2 years ago
skel/core removed
📦️ Install the SIKessEm Runtime (ske)Latest release: over 1 year ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
apigen/token-reflection 1.4.0 removed
Library emulating the PHP internal reflection using just the tokenized source code.4 versions - Latest release: almost 10 years ago - 2 dependent repositories
Related Keywords
php
37
parser
31
token
18
lexer
13
openai
10
decode
9
encode
9
GPT-3
7
function
7
closure
7
gpt-2
6
ast
6
nlp
6
tokenization
5
tokens
5
query
5
library
5
tiktoken
5
html
5
javascript
5
serializable
5
serialize
5
php-library
5
laravel
4
parsing
4
reflection
4
bpe
4
compressor
4
generator
4
lambda
4
archiver
3
search
3
tokenize
3
stream
3
sikessem
3
math
3
compiler
3
language
3
php7
3
translator
3
xml
3
formatter
3
regex
3
php8
3
minifier
2
lex
2
pcre
2
minify
2
indonesia
2
css
2
template
2
phplrt
2
openie
2
validator
2
object
2
lemma
2
corenlp-server
2
bnf
2
abnf
2
json
2
string
2
ner
2
stanford
2
cl100k_base
2
sql
2
calculator
2
mathematicator
2
solr
2
elasticsearch
2
edismax
2
code-style
2
mysql
2
sql server
2
format
2
ngram
2
reformat
2
lexical-analysis
2
ske
2
binary
2
cli-app
2
HTML5
2
console-application
2
installer
2
runtime
2
script-compiler
2
class
2
engine
2
setup
2
standards
1
interfaces
1
doctrine
1
annotations
1
term
1
interoperability
1
microservice
1
contracts
1
lumen-package
1
static-analysis
1
spiral
1
invocation-locators
1