Search results
461 packages found
Tiny JavaScript tokenizer.
React typeahead with Bootstrap styling
- auto complete
- auto suggest
- auto-complete
- auto-suggest
- autocomplete
- autosuggest
- bootstrap
- bootstrap tokenizer
- bootstrap typeahead
- bootstrap-tokenizer
- bootstrap-typeahead
- react
- react autocomplete
- react autosuggest
- View more
small commonmark compliant markdown parser with positional info and concrete tokens
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
- BPE
- encoder
- decoder
- tokenizer
- GPT
- GPT-2
- GPT-3
- GPT-3.5
- GPT-4
- NLP
- Natural Language Processing
- Text Generation
- OpenAI
- Machine Learning
A tool set for CSS: fast detailed parser (CSS → AST), walker (AST traversal), generator (AST → CSS) and lexer (validation and matching) based on specs and browser implementations
Chevrotain is a high performance fault tolerant javascript parsing DSL for building recursive decent parsers
JS tokenizer for LLaMA-based LLMs
React typeahead with Bootstrap styling
- auto complete
- auto suggest
- auto-complete
- auto-suggest
- autocomplete
- autosuggest
- bootstrap
- bootstrap tokenizer
- bootstrap typeahead
- bootstrap-tokenizer
- bootstrap-typeahead
- react
- react autocomplete
- react autosuggest
- View more
Simple algorithm to tokenize Chinese texts into words using CC-CEDICT.
stream-json is the micro-library of Node.js stream components for creating custom JSON processing pipelines with a minimal memory footprint. It can parse JSON files far exceeding available memory streaming individual primitives using a SAX-inspired API. I
General natural language (tokenizing, stemming (English, Russian, Spanish), part-of-speech tagging, sentiment analysis, classification, inflection, phonetics, tfidf, WordNet, jaro-winkler, Levenshtein distance, Dice's Coefficient) facilities for node.
- natural language processing
- artifical intelligence
- statistics
- Porter stemmer
- Lancaster stemmer
- tokenizer
- bigram
- trigram
- quadgram
- ngram
- stemmer
- bayes
- classifier
- phonetic
- View more
Parse PHP code from JS and returns its AST
Dot notation tokenizer
A promise based streaming tokenizer
JavaScript implementation of Japanese morphological analyzer
String Tokenizer for Node.js using ICU's BreakIterators
Wix Restaurants credit-cards tokenizer