Deep image reconstruction: Natural images

Reconstruction of visual images from human brain activity measured by fMRI To reconstruct visual images, we first decoded (translated) measured brain activity patterns into deep neural network (DNN) features, then fed those decoded features to a reconstruction algorithm. Our reconstruction algorithm starts from a given initial image and iteratively optimizes the pixel values so that the DNN features of the current image become similar to those decoded from brain activity. Left: Presented images. Right: Reconstructed images. The iterative optimization process is shown. References: Shen, G, Horikawa, T, Majima, K, Kamitani, Y, Deep image reconstruction from Human Brain Activity. bioRxiv (2017); CCN (2017) ()