introducing activation atlases

"Modern neural networks are often criticized as being a “black box.” Despite their success at a variety of problems, we have a limited understanding of how they make decisions internally. Activation atlases are a new way to see some of what goes on inside that box.

Activation atlases build on feature visualization, a technique for studying what the hidden layers of neural networks can represent. Early work in feature visualization primarily focused on individual neurons. By collecting hundreds of thousands of examples of neurons interacting and visualizing those, activation atlases move from individual neurons to visualizing the space those neurons jointly represent."

Check out the blog here:

https://blog.openai.com/introducing-activation-atlases/

And demo to play with here:

https://distill.pub/2019/activation-atlas/app.html

#lucheng

#dl可视化