Skip to content

Emit U+FFFD for malformed byte-fallback runs in BPE Decode - #1064

Open
Feldt wants to merge 1 commit into
google:devfrom
Feldt:fix/bpe-decode-invalid-utf8
Open

Emit U+FFFD for malformed byte-fallback runs in BPE Decode#1064
Feldt wants to merge 1 commit into
google:devfrom
Feldt:fix/bpe-decode-invalid-utf8

Commits

  1. Commits on Oct 20, 2026