Skip to content

chore(deps): update tiktoken requirement from >=0.1.2 to >=0.12.0 in /utils#2649

Open
dependabot[bot] wants to merge 1 commit intomainfrom
dependabot/pip/utils/tiktoken-gte-0.12.0
Open

chore(deps): update tiktoken requirement from >=0.1.2 to >=0.12.0 in /utils#2649
dependabot[bot] wants to merge 1 commit intomainfrom
dependabot/pip/utils/tiktoken-gte-0.12.0

Conversation

@dependabot
Copy link
Copy Markdown
Contributor

@dependabot dependabot Bot commented on behalf of github May 7, 2026

Updates the requirements on tiktoken to permit the latest version.

Changelog

Sourced from tiktoken's changelog.

[v0.12.0]

  • Build wheels for Python 3.14
  • Build musllinux aarch64 wheels
  • Support for free-threaded Python
  • Update version of pyo3 and rustc-hash
  • Avoid use of blobfile for reading local files
  • Recognise gpt-5 model identifier
  • Minor performance improvement for file reading

[v0.11.0]

  • Support for GPT-5
  • Update version of pyo3
  • Use new Rust edition
  • Fix special token handling in encode_to_numpy
  • Better error handling
  • Improvements to private APIs

[v0.10.0]

  • Support for newer models
  • Improvements to private APIs

[v0.9.0]

  • Support for o1 and o3 models
  • Better error messages when loading invalid vocabulary files
  • Support for encoding to numpy arrays
  • Delayed imports when not strictly necessary

[v0.8.0]

  • Support for o1- and chatgpt-4o- models
  • Build wheels for Python 3.13
  • Add possessive quantifiers to limit backtracking in regular expressions, thanks to @​l0rinc!
  • Provide a better error message and type for invalid token decode
  • Permit tuples in type hints
  • Better error message for passing invalid input to get_encoding
  • Better error messages during plugin loading
  • Add a __version__ attribute
  • Update versions of pyo3, regex, fancy-regex
  • Drop support for Python 3.8

[v0.7.0]

  • Support for gpt-4o
  • Performance improvements

[v0.6.0]

  • Optimise regular expressions for a 20% performance improvement, thanks to @​paplorinc!
  • Add text-embedding-3-* models to encoding_for_model
  • Check content hash for downloaded files

... (truncated)

Commits

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Updates the requirements on [tiktoken](https://github.com/openai/tiktoken) to permit the latest version.
- [Release notes](https://github.com/openai/tiktoken/releases)
- [Changelog](https://github.com/openai/tiktoken/blob/main/CHANGELOG.md)
- [Commits](openai/tiktoken@0.2.0...0.12.0)

---
updated-dependencies:
- dependency-name: tiktoken
  dependency-version: 0.12.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file python Pull requests that update python code labels May 7, 2026
@dependabot dependabot Bot requested a review from a team as a code owner May 7, 2026 03:11
@dependabot dependabot Bot added the dependencies Pull requests that update a dependency file label May 7, 2026
@dependabot dependabot Bot requested review from myronkaifung and removed request for a team May 7, 2026 03:11
@dependabot dependabot Bot added the python Pull requests that update python code label May 7, 2026
@vercel
Copy link
Copy Markdown

vercel Bot commented May 7, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
docs Ready Ready Preview, Comment May 7, 2026 3:14am

Request Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python Pull requests that update python code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants