openai/tiktoken

fast BPE tokenizer for OpenAI models

View on index · View in 3D Map

Related repos

• Fast and small JavaScript tokenizer for OpenAI models
• Playground for OpenAI tiktoken
• Run open-source or custom language models as OpenAI-style APIs with one command
• Community .NET library for OpenAI API
• Converts Gemini CLI to OpenAI API
• OpenAI API code examples and guides
• Rust OpenAI-compatible API gateway for Claude Code CLI
• Browser extension and desktop app for translation using ChatGPT API
• API for OpenAI Whisper with diarization
• run open-source AI models locally with private notes