Not to steal @DEVLINCC 's thunder, as I think this is super clean, but you might be interested to see my sliding dropout version that’s documented here. It’s in the same vein as Sean’s UBM style solution.
3 Likes