How LLMs See Images, Audio, and More

Just like how "Hello world!" becomes discrete tokens for text processing, a photograph gets chopped into image patches, and a song becomes a sequence of audio codes.

blog.bytebytego.com

ByteByteGo

Technology