Revin: What really grinds my gears
A review of Revin - Reversible Instance Normalization used in time series forecasting
LTSF-Linear: Embarrassingly simple time series forecasting models
A review of the 2022 Paper Are Transformers Effective for Time Series Forecasting that introduced DLinear and NLinear models
Super-convergence: Supercharge your Neural Networks
A look at 1Cycle scheduling, one of my favourite techniques at improving model performance and practical guidance on how to use it
A fistful of MASE: Deconstructing DeepAR
A deep dive into the GluonTS DeepAR neural network model architecture for time series forecasting and an ablation study of the covariates.
Teacher Forcing: A look at what it is and the alternatives
Review of teacher forcing, free running, scheduled-sampling, professor forcing and attention forcing for training auto-regresssive neural networks
Human-level control through deep reinforcement learning
Recreating the experiments from the classic 2015 Deepmind Paper by Mnih et al.: Human-level control through deep reinforcement learning
Revisiting Playing Atari with Deep Reinforcement Learning
Recreating the experiments from the classic DQN Deepmind paper by Mnih et al.: Playing Atari with Deep Reinforcement Learning