GitHub - crashtheuniverse/chatgbc: A language model on a Game Boy Color - pure SM83 assembly

Summary

ChatGBC is a 512 KB Game Boy Color ROM containing a 374K-parameter language model written in SM83 assembly, where you type a prompt on an on-screen keyboard and watch a story print one character at a time. A second cartridge, Rei, holds a conversational model that asks your name, keeps it across power-off via battery save, and wanders off to a beach or garden if you leave her idle for twenty seconds.

• 374K parameters, ternary weights, no multiply or floating point
• 0.46 s per token, 1.8 s to first token
• Rei remembers your name and saves the conversation