NeurIPS 2021: Cockpit: A Practical Debugging Tool for Training Deep Neural Networks

-------------------------------------------------------------------------------- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks Frank Schneider, Felix Dangel, and Philipp Hennig Advances in Neural Information Processing Systems (NeurIPS) 2021 -------------------------------------------------------------------------------- ► Paper: ► Cockpit Code: ► Try it: pip install cockpit-for-pytorch When engineers train deep learning models, they are very much “flying blind”. Commonly used methods for real-time training diagnostics, such as monitoring the train/test loss, are limited. Assessing a network’s training process solely through these performance indicators is akin to debugging software without access to internal states through a debugger. To address this, we present Cockpit, a collection of instruments that enable a closer look into the inner workings of a learning machine, and a more informative and meaningful status re