DISCLAIMER: This article reflects my personal experiences as a patient within the Ontario healthcare system and my expertise as a computer scientist and doctoral engineering student. The views expressed are mine alone and do not represent the positions of my employer, London Health Sciences...
Validating Streaming Deep RL on Attack Traffic I'm continuing to focus on RL prediction steps 1/2 of the Alberta Plan. In my first experiment, I showed that IDBD diverges almost immediately on the real honeypot data I'm collecting and testing with. Given enough time Autostep fared much better but …
Testing Real-World Data on IDBD and Autostep My strategy for learning the foundations and contributing to the Alberta Plan for AI Research is to begin at Step 1 and work my way through the plan, learning and reading the associated literature as I go. This should give me a solid …
30x Speedup with vmap: Why JAX is Built for RL Research I continue to be impressed with the JAX library as I learn how to use it. In my last post I mentioned switching from PyTorch to JAX for the alberta-framework. I had seen about a 2.78x speedup just …
Thirty Years Later: My Non-Traditional Path to a Doctor of Engineering in AI Research is rarely a straight line. For me, the path began thirty years ago when I first graduated with a Computer Science degree. Now, at age 50 and serving as a CISO in the healthcare sector, I'm …
Replicating the Foundations: Sutton 1992 and the Alberta Plan As I officially begin my D.Eng, I've been eager to start producing something. My method of learning has always been to understand things "under the hood". I don't feel I fully understand concepts until I can learn them from the …
Keith Lawson is CISO at London Health Sciences Centre with 25+ years in cybersecurity and systems engineering. Currently pursuing a Doctor of Engineering at the University of Michigan researching reinforcement learning.
This is my first annual review. Credit to Will Larson's practice of doing this as my inspiration for doing the same. Thanks Will! This year started out with being declined on my application to University of Michigan which led me to explore a whole bunch of different things from continuing …
"If a person gave away your body to some passerby, you'd be furious. Yet you hand over your mind to anyone who comes along, so they may abuse you, leaving it disturbed and troubled—have you no shame in that?" — Epictetus, Enchiridion, 28 The Oxford Word of the Year for …
I've completed the University of Alberta Reinforcement Learning Specialization which involved reading most of the Reinforcement Learning: An Introduction. In my original and updated RL learning roadmaps I was striving to actually start implementing something. I did get a start on some Pytorch...