Name python3-tiktoken
Version 0.12.0
Summary tiktoken is a fast BPE tokeniser for use with OpenAI's models
Description
Section devel/python
License MIT
Homepage
Recipe file recipes-python/tiktoken/python3-tiktoken_0.12.0.bb
recipes-python/tiktoken/python3-tiktoken-crates.inc
Layer meta-python-ai (whinlatter branch)
Inherits
  • cargo
  • cargo-update-recipe-crates
  • cargo_common
  • gcc
  • gcc-native
  • pypi
  • python3-dir
  • python3native
  • python3targetconfig
  • python_pep517
  • python_pyo3
  • python_setuptools3_rust
  • python_setuptools_build_meta
  • rust-common
  • rust-target-config
  • setuptools3-base
  • siteinfo
Dependencies
  • cargo-native
  • gcc-cross-i686
  • libstd-rs
  • python3
  • python3-build-native
  • python3-installer-native
  • python3-native
  • python3-setuptools-native
  • python3-setuptools-rust-native
  • python3-wheel-native
  • rust-native
  • virtual/compilerlibs
  • virtual/libc
PACKAGECONFIG options

Sources

https://files.pythonhosted.org/packages/source/t/tiktoken/tiktoken-0.12.0.tar.gz
crate://crates.io/aho-corasick/1.1.4
crate://crates.io/autocfg/1.5.0
crate://crates.io/bit-set/0.5.3
crate://crates.io/bit-vec/0.6.3
crate://crates.io/bstr/1.12.1
crate://crates.io/fancy-regex/0.13.0
crate://crates.io/heck/0.5.0
crate://crates.io/indoc/2.0.7
crate://crates.io/libc/0.2.177
crate://crates.io/memchr/2.7.6
crate://crates.io/memoffset/0.9.1
crate://crates.io/once_cell/1.21.3
crate://crates.io/portable-atomic/1.11.1
crate://crates.io/proc-macro2/1.0.103
crate://crates.io/pyo3/0.26.0
crate://crates.io/pyo3-build-config/0.26.0
crate://crates.io/pyo3-ffi/0.26.0
crate://crates.io/pyo3-macros/0.26.0
crate://crates.io/pyo3-macros-backend/0.26.0
crate://crates.io/quote/1.0.41
crate://crates.io/regex/1.12.2
crate://crates.io/regex-automata/0.4.13
crate://crates.io/regex-syntax/0.8.8
crate://crates.io/rustc-hash/2.1.1
crate://crates.io/rustversion/1.0.22
crate://crates.io/serde/1.0.228
crate://crates.io/serde_core/1.0.228
crate://crates.io/serde_derive/1.0.228
crate://crates.io/syn/2.0.108
crate://crates.io/target-lexicon/0.13.3
crate://crates.io/unicode-ident/1.0.22
crate://crates.io/unindent/0.2.4

Patches

Patch Status
files/Cargo.lock.patch Inappropriate [Yocto specific]

Other branches

This recipe in other branches of meta-python-ai:

Branch Recipe
master python3-tiktoken 0.12.0
whinlatter (Yocto Project 5.3) python3-tiktoken 0.12.0 (this recipe)
walnascar (Yocto Project 5.2) python3-tiktoken 0.9.0
styhead (Yocto Project 5.1) python3-tiktoken 0.8.0