I'm continuing to focus on RL prediction steps 1/2 of the Alberta Plan. In my first experiment, I showed that IDBD diverges almost immediately on the real honeypot data I'm collecting and testing with. Given enough time Autostep fared much better but …
My strategy for learning the foundations and contributing to the Alberta Plan for AI Research is to begin at Step 1 and work my way through the plan, learning and reading the associated literature as I go. This should give me a solid …
I continue to be impressed with the JAX library as I learn how to use it. In my last post I mentioned switching from PyTorch to JAX for the alberta-framework. I had seen about a 2.78x speedup just …
Research is rarely a straight line. For me, the path began thirty years ago when I first graduated with a Computer Science degree. Now, at age 50 and serving as a CISO in the healthcare sector, I'm …
As I officially begin my D.Eng, I've been eager to start producing something. My method of learning has always been to understand things "under the hood". I don't feel I fully understand concepts until I can learn them from the …
I've completed the University of Alberta Reinforcement Learning Specialization which involved reading most of the Reinforcement Learning: An Introduction. In my original and updated RL learning roadmaps I was striving to actually start implementing something. I did get a start on some Pytorch implementations of basic algorithms but ended up …
I'm a month into my initial Reinforcement Learning Roadmap and a couple things have changed. First of all I've been accepted to University of Michigan Dearborn to begin a Doctor of Engineering degree in January 2026. Second my learnings from the first four weeks have convinced me that I need …