HuggingFace tokenizer support for Chonkie - extends @chonkiejs/core with real tokenization
^3.5.1
>=0.0.10
workspace:*
^6.0.1
^1.8.16
^4.20.6
^5.9.3
^3.2.4