dqbd/tiktokenizer

Playground for OpenAI tiktoken

View on index · View in 3D Map

Related repos

• fast BPE tokenizer for OpenAI models
• Brings code intelligence to an AI assistant
• Runtime instruments for iOS
• API for OpenAI Whisper with diarization
• Infrastructure for agentic reinforcement learning
• Open-source AI collaboration platform
• open-source platform for custom AI code agents
• Web interface for creating AI images and videos
• Generative AI studio for the Blender Video Editor
• OpenAI alternative for local hardware