Search results

gpt-turbo-plugin-stats

GPT Turbo plugin that calculates your conversation size and cost

• openai
• chatgpt
• chat
• gpt
• gpt3
• gpt-3
• gpt3.5
• gpt-3.5
• gpt4
• gpt-4
• completion
• chatcompletion
• conversation
• conversation ai
• View more

maxijonson

published 5.0.1 • a year agopublished 5.0.1 a year ago

nai-js-tokenizer

BPE tokenizer used for the NovelAI frontend.

• gpt
• gpt2
• pile
• sentencepiece
• nerdstash
• tokenizer
• novelai

ght901

published 1.1.0 • 2 months agopublished 1.1.0 2 months ago

@lenml/tokenizer-llama3_1

llama3_1 tokenizer for NodeJS/Browser

• llama
• llama2
• llama3
• chatgpt
• mistral
• tokenizer
• llama3_1

luke_zhang

published 1.1.2 • 15 days agopublished 1.1.2 15 days ago

@basd/search

A powerful and flexible text search library for JavaScript that enables you to build a simple text search engine.

• search
• text-search
• query
• query-parser
• parser
• tokenizer
• interpreter
• AST
• abstract-syntax-tree
• boolean-search
• evaluation
• normalization
• factory
• search-engine
• View more

basedwon

published 0.0.5 • 10 months agopublished 0.0.5 10 months ago

nlp-js-tools-english

POS Tagger and lemmatizer for javascript

• nlp
• tokenizer
• tokenize
• pos
• tagger
• Part-Of-Speech
• Tagger
• lemma
• lemmatizer
• javascript
• js
• nodejs
• node

jguyet

published 1.0.2 • 2 months agopublished 1.0.2 2 months ago

@novel-segment/util-compare

• NLP
• PanGuSegment
• PoS tagging
• analyzer
• async
• chinese
• chinese segmentation
• data
• dict
• dictionary
• file
• hanzi
• jieba
• load
• View more

bluelovers

published 1.0.26 • 5 months agopublished 1.0.26 5 months ago

parenthesis

Parse parentheses from a string

• paren
• parenthesis
• parse
• brackets
• parser
• regexp
• stringify
• tokenizer
• replace
• csv
• string

dy

published 3.1.8 • 3 years agopublished 3.1.8 3 years ago

@flowaccount/node-icu-tokenizer

String Tokenizer for Node.js using ICU's BreakIterators

• icu
• tokenize
• tokenizer

wickyorama

published 2.0.0 • a year agopublished 2.0.0 a year ago

@yozora/tokenizer-admonition

Tokenizer for processing admonitions

• yozora
• markdown
• tokenizer
• admonition

lemonclown

published 2.3.3 • 7 days agopublished 2.3.3 7 days ago

@yozora/tokenizer-inline-math

Tokenizer for processing inline math (formulas)

• yozora
• markdown
• tokenizer
• inlineMath
• formula
• inline formula
• inline math

lemonclown

published 2.3.3 • 7 days agopublished 2.3.3 7 days ago

@yozora/tokenizer-math

Tokenizer for processing fenced math block (formulas)

• yozora
• markdown
• tokenizer
• math
• formula
• fenced math block

lemonclown

published 2.3.3 • 7 days agopublished 2.3.3 7 days ago

@novel-segment/stringify

• NLP
• PanGuSegment
• PoS tagging
• analyzer
• async
• chinese
• chinese segmentation
• data
• dict
• dictionary
• file
• hanzi
• jieba
• load
• View more

bluelovers

published 1.0.17 • 9 months agopublished 1.0.17 9 months ago

@charlescoeder/react-native-kuromoji

A React Native supported JavaScript implementation of Japanese morphological analyzer

• japanese
• morphological analyzer
• nlp
• pos
• pos tagger
• tokenizer

charlescoeder

published 0.2.1 • 9 months agopublished 0.2.1 9 months ago

happynodetokenizer

A simple, Twitter-aware tokenizer.

• tokenise
• tokenize
• tokenising
• tokenizing
• tokeniser
• tokenizer
• token
• twitter
• NLP
• language
• text
• strings
• stanford
• dlatk

phughes

published 7.1.0 • 7 months agopublished 7.1.0 7 months ago

@novel-segment/sort-dict-table

• NLP
• PanGuSegment
• PoS tagging
• analyzer
• async
• chinese
• chinese segmentation
• data
• dict
• dictionary
• file
• hanzi
• jieba
• load
• View more

bluelovers

published 1.0.28 • 5 months agopublished 1.0.28 5 months ago

jsx-convert

A CLI tool for converting JSX files into standard JS.

• jsx
• transform
• jsx-transform
• convert
• parse
• tokenize
• tokenizer

yatchee

published 1.1.7 • 2 years agopublished 1.1.7 2 years ago

@novel-segment/sort-synonym

• NLP
• PanGuSegment
• PoS tagging
• analyzer
• async
• chinese
• chinese segmentation
• data
• dict
• dictionary
• file
• hanzi
• jieba
• load
• View more

bluelovers

published 1.0.24 • 5 months agopublished 1.0.24 5 months ago

mistral-tokenizer-js

JS tokenizer for Mistral-based LLMs

• mistral
• llm
• tokenizer

imone

published 1.0.0 • a year agopublished 1.0.0 a year ago

@novel-segment/pretty-diff

• NLP
• PanGuSegment
• PoS tagging
• analyzer
• async
• chinese
• chinese segmentation
• data
• dict
• dictionary
• file
• hanzi
• jieba
• load
• View more

bluelovers

published 1.0.25 • 5 months agopublished 1.0.25 5 months ago

@meepen/luaparse

A lua parser

• lua
• parser
• ast
• tokenizer

meepen

published 1.0.9 • 10 months agopublished 1.0.9 10 months ago