Difference between revisions of "UNTREF Speech Workshop"

From Robert-Depot
Jump to: navigation, search
(Installation)
(Hands-on with Processing)
Line 30: Line 30:
  
 
==Hands-on with Processing==
 
==Hands-on with Processing==
*Requires STT library. http://stt.getflourish.com/
+
*Download and install the STT library. http://dl.dropbox.com/u/974773/_keepalive/stt.zip
*Download the library file, unzip it, and copy it to the Processing\libraries folder. I also put it on the thumbdrive.
+
*Download the library file, unzip it, and copy it to the ''Processing\libraries'' folder.
 
*Processing example:  
 
*Processing example:  
 
**[[:File:google_listen.zip]]
 
**[[:File:google_listen.zip]]

Revision as of 10:22, 21 September 2013

<<< back to Wiki Home

Introduction

saussure.gif

Talking To Machines

A short workshop introducing speech recognition and speech synthesis techniques for the creation of interactive artwork. We use pre-compiled open-source tools (CMU Sphinx ASR, Festival TTS, Processing, Python) and focus on the demonstrable strengths and unexpected limitations of speech technologies as vehicles for creating meaning.

Saturday Sept 21, 2-6pm Centro Cultural de Borges UNTREF.


Background Reading:

Automatic Speech Recognition

ear.gif

  • Talking to Machines.

Engines

Hands-on with Processing

Hands-on with Sphinx

Installation

  • Download from sourceforge: http://cmusphinx.sourceforge.net/wiki/download/
  • If using windows, you need the sphinxbase-0.8-win32.zip and pocketsphinx-0.8-win32.zip files. I already downloaded these for you. They are in the untref_speech folder.

Usage

  • open a terminal. Windows, Run->Cmd.
  • change to the pocketsphinx directory.
    • cd Desktop\untref_speech\pocketsphinx-0.8-win32\bin\Release
  • ENGLISH: run the pocketsphinx command to recognize english:
    • pocketsphinx_continuous.exe -hmm ..\..\model\hmm\en_US\hub4wsj_sc_8k -dict ..\..\model\lm\en_US\cmu07a.dic -lm ..\..\model\lm\en_US\hub4.5000.DMP
  • SPANISH: recognize spanish:
    • pocketsphinx_continuous.exe -hmm ..\..\model\hmm\es_MX\hub4_spanish_itesm.cd_cont_2500 -dict ..\..\model\lm\es_MX\h4.dict -lm ..\..\model\lm\es_MX\H4.arpa.Z.DMP
    • this should transcribe live from the microphone.

Language Models

Training your own Models

  • grammer is trivial.
  • slm, can use online tools. or try the sphinxtrain packages.
  • the online tool http://www.speech.cs.cmu.edu/tools/lmtool-new.html
    • upload a plain-text file of sentences. it will produce a language model from these!
    • download the results.
    • I can talk you through using the resultant model.

Programming with Speech Recognition

Processing. Sphinx4, the java interface.

Python or c++, command line, android. pocketsphinx.


Text To Speech Synthesis

voder-2.png

Engines

Test them online

Hands-on With Processing

  • For Google TTS no library is required. You don't have to install anything. You just need an internet connection to talk to google.

Example 1. Speech

File:google_speak.zip

Example 2. Daisy Bell

  • Daisy Bell - http://www.youtube.com/watch?v=41U78QP8nBk
    • "Daisy Bell" was composed by Harry Dacre in 1892. In 1961, the IBM 7094 became the first computer to sing, singing the song Daisy Bell. Vocals were programmed by John Kelly and Carol Lockbaum and the accompaniment was programmed by Max Mathews.
  • Processing Daisy Bell example using Google Text To Speech. Requires an internet connection:

Hands-on with Festival

Installation

Usage

  • run the terminal. Start Menu, Run -> Cmd.
  • switch to the festival directory:
    • cd C:\festival
  • start festival:
    • festival
  • to say something:
    • (SayText "this is what I am going to say")
  • to render speech to sound file:
  • to switch voices:
  • to exit festival:
    • (exit)
  • Festival is written in Scheme, a variant of LISP.

Voices

Making a Voice

  • Portraiture
  • Robert Voice

Activity: Feedback Loop

saussure.gif

Construct a conversation with the machine.

Processing Sketch

File:Listen speak.zip