toggle the display of search filters (inactive)toggle the display of search filters (active)
Results 5 packages
Sort by PUB-AZS
A BPE tokeniser for use with OpenAI's models. It exposes APIs used for processing text using tokens.
Tiktoken is a BPE tokeniser for use with OpenAI's models. It exposes APIs used for processing text using tokens.
OpenAI's Tiktoken tokenizer for models: GPT-4, GPT-4o, GPT-4o-mini, o1, o1-mini, and o1-preview.#tokenizer#openai#gpt#gpt-4o#tiktoken
A flutter offline package for a fast BPE tokeniser for OpenAI models.
Tiktoken is a BPE tokeniser for use with OpenAI's models. It exposes APIs used for processing text using tokens.