ByteTokenizer

── ByteTokenizer ───────────────────────────────────────────────────

Vocab is fixed at 256 — each UTF-8 byte maps to id == byte value. No OOV is possible (every input is a sequence of bytes). Useful as a robust multilingual fallback (ByT5, byte-level LMs).