@sutysisku/tokenizer

About

sentence embeddings model tokenizer for la sutysisku

Build

npm build
npm login
npm publish --access=public

r=require('./sutysisku_tokenizer'); function createArrays(numArrays, arraySize) { return Array.from({length: numArrays}, () => Array.from({length: arraySize}, () => Math.round(Math.random() * 94) ) ); }

const arrays = createArrays(1600, 384); b = new r.Sisku({embeddings: arrays})

b.search([0,1],2)

🔋 Batteries Included

• wasm-bindgen for communicating between WebAssembly and JavaScript.
• console_error_panic_hook for logging panic messages to the developer console.
• LICENSE-APACHE and LICENSE-MIT: most Rust projects are licensed this way, so these are included for you

License

Licensed under either of

• Apache License, Version 2.0, (LICENSE-APACHE or http://www.apache.org/licenses/LICENSE-2.0)
• MIT license (LICENSE-MIT or http://opensource.org/licenses/MIT)

at your option.

Contribution

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.