python3-tokenizers 0.22.2

Name python3-tokenizers
Version 0.22.2
Summary Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.
Description
Section devel/python
License Apache-2.0
Homepage https://github.com/huggingface/tokenizers
Recipe file recipes-devtools/python/python3-tokenizers_0.22.2.bb
recipes-devtools/python/python3-tokenizers-crates.inc
Layer meta-homeassistant (master branch)
Inherits
  • cargo
  • cargo-update-recipe-crates
  • cargo_common
  • gcc
  • gcc-native
  • pypi
  • python3-dir
  • python3native
  • python3targetconfig
  • python_maturin
  • python_pep517
  • python_pyo3
  • rust-common
  • rust-target-config
  • setuptools3-base
  • siteinfo
Dependencies
  • cargo-native
  • gcc-cross-i686
  • libstd-rs
  • python3
  • python3-build-native
  • python3-installer-native
  • python3-maturin-native
  • python3-native
  • rust-native
  • virtual/compilerlibs
  • virtual/libc
PACKAGECONFIG options
  • vardepvalue

Sources

https://files.pythonhosted.org/packages/source/t/tokenizers/tokenizers-0.22.2.tar.gz
crate://crates.io/ahash/0.8.12
crate://crates.io/aho-corasick/1.1.4
crate://crates.io/anstream/0.6.21
crate://crates.io/anstyle/1.0.13
crate://crates.io/anstyle-parse/0.2.7
crate://crates.io/anstyle-query/1.1.5
crate://crates.io/anstyle-wincon/3.0.11
crate://crates.io/autocfg/1.5.0
crate://crates.io/base64/0.13.1
crate://crates.io/bitflags/2.10.0
crate://crates.io/bumpalo/3.19.0
crate://crates.io/castaway/0.2.4
crate://crates.io/cc/1.2.48
crate://crates.io/cfg-if/1.0.4
crate://crates.io/colorchoice/1.0.4
crate://crates.io/compact_str/0.9.0
crate://crates.io/console/0.16.1
crate://crates.io/crossbeam-deque/0.8.6
crate://crates.io/crossbeam-epoch/0.9.18
crate://crates.io/crossbeam-utils/0.8.21
crate://crates.io/darling/0.20.11
crate://crates.io/darling_core/0.20.11
crate://crates.io/darling_macro/0.20.11
crate://crates.io/dary_heap/0.3.8
crate://crates.io/derive_builder/0.20.2
crate://crates.io/derive_builder_core/0.20.2
crate://crates.io/derive_builder_macro/0.20.2
crate://crates.io/either/1.15.0
crate://crates.io/encode_unicode/1.0.0
crate://crates.io/env_filter/0.1.4
crate://crates.io/env_logger/0.11.8
crate://crates.io/errno/0.3.14
crate://crates.io/esaxx-rs/0.1.10
crate://crates.io/fastrand/2.3.0
crate://crates.io/find-msvc-tools/0.1.5
crate://crates.io/fnv/1.0.7
crate://crates.io/futures/0.3.31
crate://crates.io/futures-channel/0.3.31
crate://crates.io/futures-core/0.3.31
crate://crates.io/futures-executor/0.3.31
crate://crates.io/futures-io/0.3.31
crate://crates.io/futures-macro/0.3.31
crate://crates.io/futures-sink/0.3.31
crate://crates.io/futures-task/0.3.31
crate://crates.io/futures-util/0.3.31
crate://crates.io/getrandom/0.3.4
crate://crates.io/heck/0.5.0
crate://crates.io/ident_case/1.0.1
crate://crates.io/indicatif/0.18.3
crate://crates.io/indoc/2.0.7
crate://crates.io/is_terminal_polyfill/1.70.2
crate://crates.io/itertools/0.14.0
crate://crates.io/itoa/1.0.15
crate://crates.io/jiff/0.2.16
crate://crates.io/jiff-static/0.2.16
crate://crates.io/js-sys/0.3.83
crate://crates.io/libc/0.2.177
crate://crates.io/linux-raw-sys/0.11.0
crate://crates.io/log/0.4.28
crate://crates.io/macro_rules_attribute/0.2.2
crate://crates.io/macro_rules_attribute-proc_macro/0.2.2
crate://crates.io/matrixmultiply/0.3.10
crate://crates.io/memchr/2.7.6
crate://crates.io/memoffset/0.9.1
crate://crates.io/minimal-lexical/0.2.1
crate://crates.io/mio/1.1.0
crate://crates.io/monostate/0.1.18
crate://crates.io/monostate-impl/0.1.18
crate://crates.io/ndarray/0.16.1
crate://crates.io/nom/7.1.3
crate://crates.io/num-complex/0.4.6
crate://crates.io/num-integer/0.1.46
crate://crates.io/num-traits/0.2.19
crate://crates.io/numpy/0.26.0
crate://crates.io/once_cell/1.21.3
crate://crates.io/once_cell_polyfill/1.70.2
crate://crates.io/onig/6.5.1
crate://crates.io/onig_sys/69.9.1
crate://crates.io/paste/1.0.15
crate://crates.io/pin-project-lite/0.2.16
crate://crates.io/pin-utils/0.1.0
crate://crates.io/pkg-config/0.3.32
crate://crates.io/portable-atomic/1.11.1
crate://crates.io/portable-atomic-util/0.2.4
crate://crates.io/ppv-lite86/0.2.21
crate://crates.io/proc-macro2/1.0.103
crate://crates.io/pyo3/0.26.0
crate://crates.io/pyo3-async-runtimes/0.26.0
crate://crates.io/pyo3-build-config/0.26.0
crate://crates.io/pyo3-ffi/0.26.0
crate://crates.io/pyo3-macros/0.26.0
crate://crates.io/pyo3-macros-backend/0.26.0
crate://crates.io/quote/1.0.42
crate://crates.io/r-efi/5.3.0
crate://crates.io/rand/0.9.2
crate://crates.io/rand_chacha/0.9.0
crate://crates.io/rand_core/0.9.3
crate://crates.io/rawpointer/0.2.1
crate://crates.io/rayon/1.11.0
crate://crates.io/rayon-cond/0.4.0
crate://crates.io/rayon-core/1.13.0
crate://crates.io/regex/1.12.2
crate://crates.io/regex-automata/0.4.13
crate://crates.io/regex-syntax/0.8.8
crate://crates.io/rustc-hash/2.1.1
crate://crates.io/rustix/1.1.2
crate://crates.io/rustversion/1.0.22
crate://crates.io/ryu/1.0.20
crate://crates.io/serde/1.0.228
crate://crates.io/serde_core/1.0.228
crate://crates.io/serde_derive/1.0.228
crate://crates.io/serde_json/1.0.145
crate://crates.io/shlex/1.3.0
crate://crates.io/signal-hook-registry/1.4.7
crate://crates.io/slab/0.4.11
crate://crates.io/smallvec/1.15.1
crate://crates.io/spm_precompiled/0.1.4
crate://crates.io/static_assertions/1.1.0
crate://crates.io/strsim/0.11.1
crate://crates.io/syn/2.0.111
crate://crates.io/target-lexicon/0.13.3
crate://crates.io/tempfile/3.23.0
crate://crates.io/thiserror/2.0.17
crate://crates.io/thiserror-impl/2.0.17
crate://crates.io/tokio/1.48.0
crate://crates.io/tokio-macros/2.6.0
crate://crates.io/unicode-ident/1.0.22
crate://crates.io/unicode-normalization-alignments/0.1.12
crate://crates.io/unicode-segmentation/1.12.0
crate://crates.io/unicode-width/0.2.2
crate://crates.io/unicode_categories/0.1.1
crate://crates.io/unindent/0.2.4
crate://crates.io/unit-prefix/0.5.2
crate://crates.io/utf8parse/0.2.2
crate://crates.io/version_check/0.9.5
crate://crates.io/wasi/0.11.1+wasi-snapshot-preview1
crate://crates.io/wasip2/1.0.1+wasi-0.2.4
crate://crates.io/wasm-bindgen/0.2.106
crate://crates.io/wasm-bindgen-macro/0.2.106
crate://crates.io/wasm-bindgen-macro-support/0.2.106
crate://crates.io/wasm-bindgen-shared/0.2.106
crate://crates.io/web-time/1.1.0
crate://crates.io/windows-link/0.2.1
crate://crates.io/windows-sys/0.61.2
crate://crates.io/wit-bindgen/0.46.0
crate://crates.io/zerocopy/0.8.31
crate://crates.io/zerocopy-derive/0.8.31

Patches

None

Other branches

This recipe in other branches of meta-homeassistant:

Branch Recipe
master python3-tokenizers 0.22.2 (this recipe)