In my Security-Gym post I described the environment I built to generate realistic cybersecurity log streams for RL experiments. The next conditions I wanted to test were to see if a continual learning agent can actually detect attacks in this data running as a …
Over the past several months I've been running streaming RL experiments on real attack data extracted from a Cowrie SSH honeypot. The RL agent performance on the Cowrie data is promising and I wanted to continue testing different algorithms. However I …
I'm continuing to focus on RL prediction steps 1/2 of the Alberta Plan. In my first experiment, I showed that IDBD diverges almost immediately on the real honeypot data I'm collecting and testing with. Given enough time Autostep fared much better but …
My strategy for learning the foundations and contributing to the Alberta Plan for AI Research is to begin at Step 1 and work my way through the plan, learning and reading the associated literature as I go. This should give me a solid …
Research is rarely a straight line. For me, the path began thirty years ago when I first graduated with a Computer Science degree. Now, at age 50 and serving as a CISO in the healthcare sector, I'm …
As I officially begin my D.Eng, I've been eager to start producing something. My method of learning has always been to understand things "under the hood". I don't feel I fully understand concepts until I can learn them from the …
I've completed the University of Alberta Reinforcement Learning Specialization which involved reading most of the Reinforcement Learning: An Introduction. In my original and updated RL learning roadmaps I was striving to actually start implementing something. I did get a start on some Pytorch implementations of basic algorithms but ended up …
I'm a month into my initial Reinforcement Learning Roadmap and a couple things have changed. First of all I've been accepted to University of Michigan Dearborn to begin a Doctor of Engineering degree in January 2026. Second my learnings from the first four weeks have convinced me that I need …
My journey into understanding machine learning began with a 12 week learning syllabus that chatGPT prepared for me. That lead me to the Coursera Deep Learning Specialization which I just completed. The quality of Coursera specialization was excellent and I have a good understanding of the foundations of deep learning …
I heard the term "Full-Breadth Developers" on a episode of Changelog this morning. While I agree with everything Justin says in his post I have a, perhaps controversial take on new terms that are popping up for developers these days. Software developers today are just what they were when I …