# mlc-ai/tokenizers-cpp

> Universal cross-platform tokenizers binding to HF and sentencepiece

**Source**: https://4ort.xyz/entity/mlc-ai-tokenizers-cpp


## References

1. [Source](https://github.com/mlc-ai/tokenizers-cpp)