4 points | by redcodenl 5 hours ago ago
2 comments
I've made a visual walk through the machinery inside a large language model: from raw text, to tokens, to vectors, to attention, to the next token.
If you have any comments/questions/remarks/improvements, let me know!
Very cool, well-put-together walkthrough, thanks!
I've made a visual walk through the machinery inside a large language model: from raw text, to tokens, to vectors, to attention, to the next token.
If you have any comments/questions/remarks/improvements, let me know!
Very cool, well-put-together walkthrough, thanks!