Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

Top 7.6% on proxy.golang.org
Top 4.8% dependent repos on proxy.golang.org
Top 8.8% forks on proxy.golang.org

proxy.golang.org : github.com/ekzhu/go-fasttext

Package fasttext provides a simple wrapper for Facebook fastText dataset (https://fasttext.cc/docs/en/crawl-vectors.html). It allows fast look-up of word embeddings from persistent data store (SQLite3). Installation After downloading a .vec data file from the fastText project, you can initialize the SQLite3 database (in your code): This will create a new file on your disk for the SQLite3 database. Once the above step is finished, you can start looking up word embeddings (in your code): Each word embedding vector is a slice of float32 with length of 300. Note that you only need to initialize the SQLite3 database once. The next time you use it you can skip the call to BuildDB. For faster querying during runtime, you can use an in-memory database. This creates an in-memory SQLite3 database which is a copy of the on-disk one. Using the in-memory version makes query time much faster, but takes a few minutes to load the database.

Registry - Source - Documentation - JSON
purl: pkg:golang/github.com/ekzhu/go-fasttext
Keywords: facebook, fasttext, golang, sqlite, wordembedding
License: MIT
Latest release: over 3 years ago
First release: over 3 years ago
Namespace: github.com/ekzhu
Dependent repositories: 1
Stars: 27 on GitHub
Forks: 4 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 14 days ago

    Loading...
    Readme
    Loading...