No, a token is not a word. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		astrange 23 days ago \| parent \| context \| favorite \| on: Claude's Cycles [pdf] No, a token is not a word.

qsera 23 days ago [–]

I mean, it is some text.

astrange 22 days ago | [–]

How do you get from a piece of text smaller than a word to an entire coherent sentence?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact