UNTREF Speech Workshop

From Robert-Depot
Revision as of 09:15, 21 September 2013 by Rtwomey (talk | contribs) (Programming with Speech Recognition)

Jump to: navigation, search

<<< back to Wiki Home

Introduction

saussure.gif

Talking To Machines

A short workshop introducing speech recognition and speech synthesis techniques for the creation of interactive artwork. We use pre-compiled open-source tools (CMU Sphinx ASR, Festival TTS, Processing, Python) and focus on the demonstrable strengths and unexpected limitations of speech technologies as vehicles for creating meaning.

Saturday Sept 21, 2-6pm Centro Cultural de Borges UNTREF.


Background Reading:

Automatic Speech Recognition

ear.gif

  • Talking to Machines.

Engines

Installing CMU Sphinx

  • Download from sourceforge: http://cmusphinx.sourceforge.net/wiki/download/
  • If using windows, you need the sphinxbase-0.8-win32.zip and pocketsphinx-0.8-win32.zip files. I already downloaded these for you. They are in the untref_speech folder.

Using sphinx

  • open a terminal. Windows, Run->Cmd.
  • change to the pocketsphinx directory.
    • cd Desktop\untref_speech\pocketsphinx-0.8-win32\bin\Release
  • run the pocketsphinx command to recognize english:
    • pocketsphinx_continuous.exe -hmm ..\..\model\hmm\en_US\hub4wsj_sc_8k -dict ..\..\model\lm\en_US\cmu07a.dic -lm ..\..\model\lm\en_US\hub4.5000.DMP
  • recognize spanish:
    • pocketsphinx_continuous.exe -hmm ..\..\model\hmm\es_MX\hub4_spanish_itesm.cd_cont_2500 -dict ..\..\model\lm\es_MX\h4.dict -lm ..\..\model\lm\es_MX\H4.arpa.Z.DMP
    • this should transcribe live from the microphone.

Language Models

Acoustic models versus language models.

Grammars versus Satistical Language Models.

Available language models. English, Mandarin, French, Spanish, German, Dutch and more: http://sourceforge.net/projects/cmusphinx/files/Acoustic%20and%20Language%20Models/


Training your own Models

grammer is trivial.

slm, can use online tools. or try the sphinxtrain packages.

Programming with Speech Recognition

Processing. Sphinx4, the java interface.

Python or c++, command line, android. pocketsphinx.

Hands-on with Processing

  • Requires STT library.
  • Download the file, unzip it, and copy it to processing libraries. I also put it on the thumbdrive.
  • Processing example: File:google_listen.zip
  • Try switching the recognition language.

Text To Speech Synthesis

voder-2.png

Engines

Test them online

Installing Festival


Hands-on With Processing

  • For Google TTS no library is required. You don't have to install anything. You just need an internet connection to talk to google.

Example 1. Speech

File:google_speak.zip

Example 2. Daisy Bell

  • Daisy Bell - http://www.youtube.com/watch?v=41U78QP8nBk
    • "Daisy Bell" was composed by Harry Dacre in 1892. In 1961, the IBM 7094 became the first computer to sing, singing the song Daisy Bell. Vocals were programmed by John Kelly and Carol Lockbaum and the accompaniment was programmed by Max Mathews.
  • Processing Daisy Bell example using Google Text To Speech. Requires an internet connection:

Voices

Making a Voice

  • Portraiture
  • Robert Voice

Activity: Feedback Loop

saussure.gif

Construct a conversation with the machine.

Processing Sketch

File:Listen speak.zip