a 20-min walkthrough of tokenisation from scratch. no libraries, no slides, just the byte pairs. this is the part of LLMs most people skip and it explains more weird behaviour than anything else.
posted 3d ago · 2.7M views3 of 11 clusters reached
posted 3d ago · 2.7M views3 of 11 clusters reached
Key insight
Born in AI Research; @gdb's repost (+2.1h) carried it into Tech Twitter, with 1 more cluster following. 2% landed outside the watch list; 3 of 11 watched clusters reached.
Where the views landed2.7M views · bubble area = views contributed · tint = share of cluster reached