Popular: Data updated October 27, 2026

Categories

Internet1,356
Communication321
Audio & video898
Graphics & design539
Office & productivity1,124
Developer tools3,134
AI tools529
Security & privacy385
System tools3,114
Games523
Education & science239
Network & IT284

Tokenizer: all versions and old releases

Contains Typescript and C# implementation of byte pair encoding (BPE) tokeniser for OpenAI LLMs, it is based on open sourced rust implementation in the OpenAI tiktoken.

Microsoft Corporation AI assistants & LLMs

1 versions of Tokenizer are listed here, from December 29, 2025 to the current 1.3.3. Each one links to the publisher’s own installer files.

2025: 1 1 25
VersionDateSizeFiles
1.3.3Latest December 29, 2025 — 64-bit ZIP

Most popular in AI assistants & LLMs

See all
  1. Claude CodeUnleash Claude’s raw power directly in your terminal. Search million-line codebases instantly. Turn hours-long workflows into a single command. Your tools. Your workflow. Your codebase, evolving at thought speed.
  2. Codex CLICodex CLI is an open‑source local coding agent that runs in your terminal, letting you write, edit, and understand code without leaving the command line.
  3. ChatGPTChatGPT Desktop Application
  4. GPT4AllGPT4All is a GUI application for loading and interacting with Generative AI models
  5. JanTurn your computer into an AI computer
  6. WSL ManagerA GUI to quickly manage your WSL2 instances.
  7. oh-my-pi⌥ AI Coding agent for the terminal — hash-anchored edits, optimized tool harness, LSP, Python, browser, subagents, and more
  8. T3 CodeT3 Code is a minimal web GUI for coding agents.
  9. CC SwitchA cross-platform desktop All-in-One assistant tool for Claude Code, Codex, OpenCode, openclaw & Gemini CLI.
  10. LobeHubAn open-source, modern-design AI chat framework. Supports Multi AI Providers (OpenAI / Claude 4 / Gemini / Ollama / DeepSeek / Qwen), Knowledge Base (file upload / knowledge management / RAG), Multi-Modals (Plugins/Artifacts) and Thinking.

More from Microsoft Corporation

See all
  • PowerShellPowerShell is a cross-platform task automation solution made up of a command-line shell, a scripting language, and a configuration management framework. PowerShell runs on Windows, Linux, and macOS.
  • PowerToysMicrosoft PowerToys is a set of utilities for power users to tune and streamline their Windows experience for greater productivity.
  • NuGetThe package manager for .NET
  • Microsoft Azure CLIThe Azure command-line interface (Azure CLI) is a set of commands used to create and manage Azure resources. The Azure CLI is available across Azure services and is designed to get you working quickly with Azure, with an emphasis on automation.
  • OpenSSH PreviewMicrosoft.OpenSSH.Preview
  • Bicep CLIA declarative language for describing and deploying Azure resources

Tags

Share