proxy.golang.org : github.com/shabbyrobe/gibberdet
Package gibberdet is a Go port of the gibberish detection algorithm implemented here: https://github.com/rrenaud/Gibberish-Detector. The author originally proposed the technique in an answer on SO and it works pretty well so it has quite a few ports: http://stackoverflow.com/questions/6297991/is-there-any-way-to-detect-strings-like-putjbtghguhjjjanika/6298040#comment-7360747 This implementation supports alphabets of arbitrary size, with arbitrary runes, with a significantly faster path for alphabets that are within the ASCII range. Choose or build an alphabet: Train the model. Use _lots_ of data: Or use one of the existing built models in `testdata/`, at the moment the [OANC](http://www.anc.org/data/oanc/download/) one is probably the best one in there. Save/load the model: Build the test threshold with some good and bad strings: Detect some gibberish. If the values aren't what you expect, use more training and test data:
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/shabbyrobe/gibberdet
License: MIT
Latest release: almost 2 years ago
First release: almost 4 years ago
Namespace: github.com/shabbyrobe
Last synced: 4 days ago