How a tokeniser sees your sentence
Type a sentence and watch it split two ways: the classic method (BPE subword pieces) and our grammar-aware engine, which exposes the grammatical streams the model would learn from.
Type a sentence and watch it split two ways: the classic method (BPE subword pieces) and our grammar-aware engine, which exposes the grammatical streams the model would learn from.