40 Years of Programming I wanted to write a little history of how/why I learned to code and articulate my love of computing and engineering that my children could read. That's the inspiration for this posting. When I was a teenager movies like WarGames (note the title for my …
DISCLAIMER: This article reflects my personal experiences as a patient within the Ontario healthcare system and my expertise as a computer scientist and doctoral engineering student. The views expressed are mine alone and do not represent the positions of my employer, London Health Sciences...
rlsecd: A Streaming RL Security Daemon In my Security-Gym post I described the environment I built to generate realistic cybersecurity log streams for RL experiments. The next conditions I wanted to test were to see if a continual learning agent can actually detect attacks in this data running as a …
Security-Gym: A Streaming RL Benchmark from Real Attack Data Over the past several months I've been running streaming RL experiments on real attack data extracted from a Cowrie SSH honeypot. The RL agent performance on the Cowrie data is promising and I wanted to continue testing different...
Validating Streaming Deep RL on Attack Traffic I'm continuing to focus on RL prediction steps 1/2 of the Alberta Plan. In my first experiment, I showed that IDBD diverges almost immediately on the real honeypot data I'm collecting and testing with. Given enough time Autostep fared much better but …
Testing Real-World Data on IDBD and Autostep My strategy for learning the foundations and contributing to the Alberta Plan for AI Research is to begin at Step 1 and work my way through the plan, learning and reading the associated literature as I go. This should give me a solid …
30x Speedup with vmap: Why JAX is Built for RL Research I continue to be impressed with the JAX library as I learn how to use it. In my last post I mentioned switching from PyTorch to JAX for the alberta-framework. I had seen about a 2.78x speedup just …
Thirty Years Later: My Non-Traditional Path to a Doctor of Engineering in AI Research is rarely a straight line. For me, the path began thirty years ago when I first graduated with a Computer Science degree. Now, at age 50 and serving as a CISO in the healthcare sector, I'm …
Replicating the Foundations: Sutton 1992 and the Alberta Plan As I officially begin my D.Eng, I've been eager to start producing something. My method of learning has always been to understand things "under the hood". I don't feel I fully understand concepts until I can learn them from the …
Keith Lawson is CISO at London Health Sciences Centre with 25+ years in cybersecurity and systems engineering. Currently pursuing a Doctor of Engineering at the University of Michigan researching reinforcement learning.