Difference between revisions of "Solipsist Development"

Revision as of 10:43, 12 April 2011

Proposal

Ultimately, I decided it would be good to use this project to begin to explore the project I intend to work on next quarter. I have been working with voice recognition technologies and Mel Bochner's text 'Serial Art, Systems, Solipsism', developing a device for performance and exchange between human and computer. The device consists of a microphone, Speech To Text system, and receipt printer. The system transcribes (and validates) whatever it hears only in terms of the words it knows. As is characteristic of voice recognition, face recognition, and other types of "machine perception, this truly is a solipsistic system ('denying the existence of anything outside the confines of it's own mind'). The challenge for me next term is to develop the sound component of this piece as performance/installation.

So, for this project the samples I used were recordings of myself reciting the text of the Bochner text as I (or another) would when interacting with the installation. The composition is broken into two types of material--actual words recited, and the pauses, gaps, and inhalations of breath between those words. My desire with the piece was to emphasize these pre- and non-verbal utterances (the physical mechanics of breath and voice) while erasing, obfuscating or overwriting the spoken text. While I think I produced some interesting material in the recordings of the silences (especially the first section of the piece) I am dissatisfied with what I accomplished my use of the spoken-word part of the text. What I would like to accomplish is a kind of redaction (similar to redacted text in classified documets) where knowledge some subterranean or obscured content is still clear, but it is impossible to decipher or extract. More on that later I suppose... Well, enough of this, it's time to listen to your pieces!

Equipment

• Hardware:
  • receipt printer
  • microphone
  • motu box.
  • mac mini.
  • desk*
  • desk lamp*
  • sound-proof commercial glazing (windows)*
• Software:
  • see Code section below.

*I do not have these items yet.

Open Questions

• Where else do we do this sort of projection and anthropomorphism? (projecting psychology or attributing intention to non-intelligent systems)

Timeline

Week 1 - 2

Introduction to course and project development.

Week 3 - Proposal - 4/12

1. Write this.
2. Meet with Juan.
3. Find desk and desk lamp for "me vs. the computer" staging of microphone/speech recognition system.

Week 4

Work time.

Week 5 - Milestone 1 - 4/26

Working model of each of two tracks:

1. Participant speaking to computer.
2. Computer/printer speaking to itself (feedback loop). Interpreting printer sounds as speech. Or transforming them into spech.

Week 6

Realize that the best approach will combine elements of each of the two tracks above.

Week 7 - Milestone 2 - 5/10

• Experiments with the characterization of the system:
  • Software agent? agency. towards what goals?
  • Interruptions.
  • Unexpected responses.
  • Basic state modeling (emotional states, psychological states).
  • Basic drive modeling (for novelty, entertainment, activity, rest, conversation on certain topics).
• Attention to possible choices of text.

I imagine these two go hand in hand--that the choice of particular texts will lend much of the character to the piece.

Week 8

Have others experience the system, try it out.

Week 9 - Milestone 3 - 5/24

Near-final form, near-final realization.

Viewer interaction tests.

Week 10

Final changes, improvements, last minute blitz.

Presentation - 6/7

Progress

Week 2

get system running again

Week 3

• got system running again.
• met with Juan.

Code

• CMU Sphinx-4 Automatic Speech Recognition (ASR) library - http://sourceforge.net/projects/cmusphinx/files/
• Sphinx-4 wrapper for processing: http://svn.roberttwomey.com/processing/libraries/sphinx/
• Example code for Grammar-based recognition: http://svn.roberttwomey.com/processing/sphinxBochner/
• Example code for Statistical Language Model (SLM) based recognition: http://svn.roberttwomey.com/processing/sphinxSLMTest/

References

• Mel Bochner. "Serial Art, Systems, Solipsism."
• Natalie Jeremijenko.
  • "If Things Can Talk, What Do They Say? If We Can Talk To Things, What Do We Say?" http://www.electronicbookreview.com/thread/firstperson/voicechip
  • "Dialogue With A Monologuq: Voice Chips and the Products of Abstract Speech". http://www.topologicalmedialab.net/xinwei/classes/readings/Jeremijenko/VoiceChips.pdf
• Kelly Dobson - Machine Therapy:
  • "explorations of what we interact with when we interact with machines... much more than the machine itself... our sense of self, agency in the interpersonal and political world, and our shared psychological, emotional, cultural, and perceptual approaches to the world." (from abstract http://dspace.mit.edu/handle/1721.1/44329)
  • Blendie. sing to the blender to make it run. http://web.media.mit.edu/~monster/blendie/
  • Machine Therapy sessions. http://web.media.mit.edu/~monster/machinetherapy/
  • Machine Therapy. PhD Dissertation. 2007. http://dspace.mit.edu/handle/1721.1/44329
• William Gibson. "Count Zero". The idea of the "loa", voodoo gods / fragments of AIs set loose at the end of Neuromancer.
• Frances White. Valdrada. 1990. [1]
• Redaction Paintings. Jenny Holzer. 2007. [2]
• White Room #4 / Wittgenstein & my Brother Frank. 2005 William Pope.L.
  • http://www.artnet.com/artwork/424168501/white-room-4--wittgenstein-and-my-brother-frank.html
  • http://www.terminartors.com/artworkprofile/Pope_L._William-White_Room_4_Wittgenstein_my_Brother_Frank
  • http://www.rovetv.net/wp3-index.html