5,710
edits
Changes
→Techniques
This project focuses on the idea of the brain as a filter—feeding specifically chosen audio-visual material to test subjects and imaging their resultant cortical activity. Nishimoto et. al (2011) demonstrated the reconstruction of natural video imagery from functional imaging. van Gerven et. al (2013) have shown reconstruction of letter imagery from functional imaging. Pasley et. al reconstructed speech from the human auditory cortext (2012). Additionally, work has been done on retrieving face imagery from subjects (IBM Patent, 2005), predicting activity associated with noun meaning (Mitchell et. al 2008), and identifying object categories (Siminova et. al) or other kinds of semantic content.
Artwork implementing any of the reconstruction schemes would require trained subjects, volitionally participating. The goal of a session would be just post real time reconstruction of the imagery or and sound fed to subjects. These could be seen live, as an audio-visual performance, or replayed at a later date. Each audio-visual stimulus would produce one set of imaging data, determining the output reconstruction.
== reconstructing natural video ==