@anush008/tokenizers

中文文档
0.6.0发布于 2026/03/19MITTypeScriptCommonJS零依赖构建来源已验证近 30 天下载 47.1万

HuggingFace 装饰器的多结构建筑

此软件包已被标记为弃用

This package has been archived. Please use the official and updated "huggingface/tokenizers" package.

运行依赖 0

没有声明运行依赖。

开发依赖 2