I recently had the pleasure to give a talk about neural networks and information theory at the Lunchtime Lectures organized by the Centre for Information Modelling (ZIM) of University of Graz. While most of the material I presented is either already common knowledge or based on work done by others, the last part of the presentation contains material from our own research. If you are interested in learning more about information-ordered cumulative ablation analyses and what they can do for neural network understanding, check out our paper on arXiv.
The slides of my talk can (as always) be accessed
by clicking on the image below.