https://brianhengen.us/tags/tinystories/Recent content in TinyStories on Brian HengenHugoen-usSun, 05 Jul 2026 16:05:57 -0400https://brianhengen.us/posts/glassbox-watching-a-tiny-llm-learn/Sun, 05 Jul 2026 12:00:00 -0500https://brianhengen.us/posts/glassbox-watching-a-tiny-llm-learn/<figure><img src="https://brianhengen.us/posts/glassbox-watching-a-tiny-llm-learn/glassbox-explore.png" alt="The Glassbox explore view showing an attention heatmap, attention entropy charts, and a next-word probability table"><figcaption> <p>The Glassbox explore view - attention patterns and next-word probabilities at any point in training</p> </figcaption> </figure> <h2 id="who-this-is-for">Who this is for</h2> <p>Let me be upfront - if you are an AI researcher, someone who has built their own LLMs, done a bunch of fine tuning, investigated specialized models, this post is not for you. I will not go deep into LLM creation, tuning, etc.</p>