Bit-exact MicroGPT inference in pure SQLite SQL—not text-to-SQL. Integer-only Q16.48 transformer math and deterministic sampling, with no UDFs or extensions. https://t.co/EqDB57HSsa
A few LLM experiments I’ve been doing as a hobby over the past few months.
They started with int-llm, an experiment in running LLM compute with fixed-point integer arithmetic, and gradually grew into four related projects.
The attached video is from int-llm-viz, an interactive visualization of the integer GPT and inference path.
#LLM #MachineLearning #AI #TinyLlama
Thread 👇
Bit-exact MicroGPT inference and training in pure PostScript—integer-only Q16.48 arithmetic with canonical wide and uniform-F12 MGW checkpoints.
https://t.co/M1YsHHu4MW