Name python3-tiktoken
Version 0.7.0
Summary tiktoken is a fast BPE tokeniser for use with OpenAI's models
Description
Section base
License MIT
Homepage None
Recipe file recipes-python/tiktoken/python3-tiktoken_0.7.0.bb
recipes-python/tiktoken/python3-tiktoken-crates.inc
Layer meta-whisper (master branch)
Inherits
  • cargo
  • cargo-update-recipe-crates
  • cargo_common
  • gcc
  • gcc-native
  • python3-dir
  • python3native
  • python3targetconfig
  • python_pep517
  • python_pyo3
  • python_setuptools3_rust
  • python_setuptools_build_meta
  • rust-common
  • rust-target-config
  • setuptools3
  • setuptools3-base
  • siteinfo
Dependencies
  • cargo-native
  • gcc-cross-i686
  • libstd-rs
  • python3
  • python3-build-native
  • python3-installer-native
  • python3-native
  • python3-regex
  • python3-setuptools-native
  • python3-setuptools-rust-native
  • python3-wheel-native
  • rust-native
  • virtual/compilerlibs
  • virtual/libc
PACKAGECONFIG options

Sources

https://files.pythonhosted.org/packages/c4/4a/abaec53e93e3ef37224a4dd9e2fc6bb871e7a538c2b6b9d2a6397271daf4/tiktoken-0.7.0.tar.gz
crate://crates.io/aho-corasick/1.1.3
crate://crates.io/autocfg/1.3.0
crate://crates.io/bit-set/0.5.3
crate://crates.io/bit-vec/0.6.3
crate://crates.io/bitflags/2.5.0
crate://crates.io/bstr/1.9.1
crate://crates.io/cfg-if/1.0.0
crate://crates.io/fancy-regex/0.11.0
crate://crates.io/heck/0.4.1
crate://crates.io/indoc/2.0.5
crate://crates.io/libc/0.2.155
crate://crates.io/lock_api/0.4.12
crate://crates.io/memchr/2.7.2
crate://crates.io/memoffset/0.9.1
crate://crates.io/once_cell/1.19.0
crate://crates.io/parking_lot/0.12.3
crate://crates.io/parking_lot_core/0.9.10
crate://crates.io/portable-atomic/1.6.0
crate://crates.io/proc-macro2/1.0.84
crate://crates.io/pyo3/0.20.3
crate://crates.io/pyo3-build-config/0.20.3
crate://crates.io/pyo3-ffi/0.20.3
crate://crates.io/pyo3-macros/0.20.3
crate://crates.io/pyo3-macros-backend/0.20.3
crate://crates.io/quote/1.0.36
crate://crates.io/redox_syscall/0.5.1
crate://crates.io/regex/1.10.4
crate://crates.io/regex-automata/0.4.6
crate://crates.io/regex-syntax/0.8.3
crate://crates.io/rustc-hash/1.1.0
crate://crates.io/scopeguard/1.2.0
crate://crates.io/serde/1.0.203
crate://crates.io/serde_derive/1.0.203
crate://crates.io/smallvec/1.13.2
crate://crates.io/syn/2.0.66
crate://crates.io/target-lexicon/0.12.14
crate://crates.io/unicode-ident/1.0.12
crate://crates.io/unindent/0.2.3
crate://crates.io/windows-targets/0.52.5
crate://crates.io/windows_aarch64_gnullvm/0.52.5
crate://crates.io/windows_aarch64_msvc/0.52.5
crate://crates.io/windows_i686_gnu/0.52.5
crate://crates.io/windows_i686_gnullvm/0.52.5
crate://crates.io/windows_i686_msvc/0.52.5
crate://crates.io/windows_x86_64_gnu/0.52.5
crate://crates.io/windows_x86_64_gnullvm/0.52.5
crate://crates.io/windows_x86_64_msvc/0.52.5

Patches

None

Other branches

This recipe in other branches of meta-whisper:

Branch Recipe
master python3-tiktoken 0.7.0 (this recipe)