Thoughts, experiments, and lessons learned.
Okay. So we all know what a context window is and what prompting is but I tried diving really deep into the foundation of how all our favourite models actually work. A very human attempt to understand "Attention Is All You Need"
I built a product chatbot using Gemma 4. A user lands on a vitamins page, asks "do you have vegan friendly options," and the model checks the available product data and answers. From there they can add to cart. Simple concept. The whole inference layer costs nothing. That last part is the story.
On 10 April 2026, Government Gazette No. 54477 opened the country's Draft National AI Policy for public comment. I sent one in. Here's a short read of what the policy says, and the two things I told the department they need to grapple with more honestly.
There is an old vampire myth: they cannot enter your home unless you invite them in. In January 2026, millions of developers have officially opened the door... We have moved from a 'letterbox' relationship—where AI was a consultant in a clean room—to a world where we give it the keys to the terminal. The velocity is intoxicating, but the 'blast radius' of a mistake has never been larger.
The AI hype is real, but so is the failure rate. If you want to be part of the 6% of companies actually seeing returns, you need to stop chasing the magic and start fixing the mechanics. Here is the strategy guide.
To be completely honest with you, learning new things - no matter how much you want to - is hard!
Howdy strangers, I haven't written anything in a while. promise I am still here but I have been learning loads and doing a ton of work on the site itself! Currently just testing the automated blog notification - so if you got this - great! - it works....if not, well not so great. So maybe let this serve as a notice that we are back in business (though we never left)
Today I had the privilege of addressing the IT Society of the University of the Western Cape on a topic that matters to every single one of us: how to position yourself in the coming AI age.
I never knew how to code. I mean, I learned basic HTML in high school and could probably whip up a clunky-looking website. It would work, but it wouldn’t be pretty. Back then, I just didn't have the desire—or the attention span—to dive any deeper.