Difference between revisions of "UNTREF Speech Workshop"
| Line 5: | Line 5: | ||
A short 1-2 day workshop introducing speech recognition and speech synthesis techniques for the creation of interactive artwork. We use pre-compiled open-source tools (CMU Sphinx ASR and Festival TTS), and focus on the specifics of language model construction and creative deployment of the technologies as vehicles for creating meaning. | A short 1-2 day workshop introducing speech recognition and speech synthesis techniques for the creation of interactive artwork. We use pre-compiled open-source tools (CMU Sphinx ASR and Festival TTS), and focus on the specifics of language model construction and creative deployment of the technologies as vehicles for creating meaning. | ||
| − | Background: | + | Background Reading: |
*''If Things Can Talk, What Do They Say? If We Can Talk to Things, What Do We Say?'' Natalie Jeremijenko. 2005-03-05 [http://www.electronicbookreview.com/thread/firstperson/voicechip] | *''If Things Can Talk, What Do They Say? If We Can Talk to Things, What Do We Say?'' Natalie Jeremijenko. 2005-03-05 [http://www.electronicbookreview.com/thread/firstperson/voicechip] | ||
**also see the responses by Simon Penny, Lucy Suchmann, and Natalie linked from that page. | **also see the responses by Simon Penny, Lucy Suchmann, and Natalie linked from that page. | ||
*''Dialogue with a Monologue: Voice Chips and the Products of Abstract Speech.'' [http://topologicalmedialab.net/xinwei/classes/readings/Jeremijenko/VoiceChips.pdf] | *''Dialogue with a Monologue: Voice Chips and the Products of Abstract Speech.'' [http://topologicalmedialab.net/xinwei/classes/readings/Jeremijenko/VoiceChips.pdf] | ||
| − | ='''Speech Recognition'''= | + | ='''Automatic Speech Recognition'''= |
==Introduction== | ==Introduction== | ||
*pocketsphinx on win32 - http://www.aiaioo.com/cms/index.php?id=28 | *pocketsphinx on win32 - http://www.aiaioo.com/cms/index.php?id=28 | ||
| Line 42: | Line 42: | ||
Python or c++, command line, android. '''pocketsphinx'''. | Python or c++, command line, android. '''pocketsphinx'''. | ||
| − | ='''Speech Synthesis'''= | + | ='''Text To Speech Synthesis'''= |
==Introduction== | ==Introduction== | ||
FestVox. CMU Speech group. | FestVox. CMU Speech group. | ||
Revision as of 09:36, 18 September 2013
Contents
Introduction: Speaking with Machines
A short 1-2 day workshop introducing speech recognition and speech synthesis techniques for the creation of interactive artwork. We use pre-compiled open-source tools (CMU Sphinx ASR and Festival TTS), and focus on the specifics of language model construction and creative deployment of the technologies as vehicles for creating meaning.
Background Reading:
- If Things Can Talk, What Do They Say? If We Can Talk to Things, What Do We Say? Natalie Jeremijenko. 2005-03-05 [1]
- also see the responses by Simon Penny, Lucy Suchmann, and Natalie linked from that page.
- Dialogue with a Monologue: Voice Chips and the Products of Abstract Speech. [2]
Automatic Speech Recognition
Introduction
- pocketsphinx on win32 - http://www.aiaioo.com/cms/index.php?id=28
Installing CMU Sphinx
http://cmusphinx.sourceforge.net/wiki/download/
Language Models
Acoustic models versus language models.
Grammars versus Satistical Language Models.
Available language models. English, Mandarin, French, Spanish, German, Dutch and more: http://sourceforge.net/projects/cmusphinx/files/Acoustic%20and%20Language%20Models/
Using sphinx
- open a terminal. Windows, Run->Cmd.
- change to the pocketsphinx directory.
cd Desktop\untref_speech\pocketsphinx-0.8-win32\bin\Release
- run the pocketsphinx command to recognize english:
pocketsphinx_continuous.exe -hmm ..\..\model\hmm\en_US\hub4wsj_sc_8k -dict ..\..\model\lm\en_US\cmu07a.dic -lm ..\..\model\lm\en_US\hub4.5000.DMP
- recognize spanish:
pocketsphinx_continuous.exe -hmm ..\..\model\hmm\es_MX\hub4_spanish_itesm.cd_cont_2500 -dict ..\..\model\lm\es_MX\h4.dict -lm ..\..\model\lm\es_MX\H4.arpa.Z.DMP- this should transcribe live from the microphone.
Training your own Models
grammer is trivial.
slm, can use online tools. or try the sphinxtrain packages.
Programming with Speech Recognition
Processing. Sphinx4, the java interface.
Python or c++, command line, android. pocketsphinx.
Text To Speech Synthesis
Introduction
FestVox. CMU Speech group.
Festival from University of Edinburgh.
Installation
Test It
- http://www.cstr.ed.ac.uk/projects/festival/onlinedemo.html
- Spanish (UVIGO Spanish Male)
- American English
- Others...
