speech-enabled.net framework application for cims murat semerci Çağdaş kayra akman 15.06.2004
TRANSCRIPT
![Page 1: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/1.jpg)
Speech-Enabled .NET Framework Application for CIMS
Murat Semerci
Çağdaş Kayra Akman
15.06.2004
![Page 2: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/2.jpg)
Project Goal
Development of speech-enabled voice-only version of Electrical and Electronic Engineering Department’s Course
Information Management System (CIMS) which is accessed via telephone network.
![Page 3: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/3.jpg)
Development Environment
• Microsoft Speech Application SDK Beta 4
• Microsoft Visual Studio .NET 2003 Enterprise Architect
• Microsoft SQL Server 2000
• Windows 2000 Professional Edition SP 4 (Intel Pentium III 800 MHz, 256 MB RAM)
![Page 4: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/4.jpg)
Overview
SERVER CLIENT
SR Engine
TTS Engine
SQL Server
Prompts Database
USER
![Page 5: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/5.jpg)
Basic Dialog Flow
User Name
Password
Intelligent Mode ?
Course Code Course Code/Course Name and Menu
YESNO
Menu
AnotherQuery ?
YES
END
START
![Page 6: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/6.jpg)
Error Handling
• No Recognition: no speech detected or recognized phrase not covered by grammar
• Invalid Input: recognized input does not match with user’s data (UserName, Password Course ID, Menu)
• No Database Connection
![Page 7: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/7.jpg)
SALT
• Speech Application Language Tags: extension of HTML and XML to support speech-enabled web applications
• Generated by Speech Application SDK
• Manipulated directly or via C# codebehind pages
• Supports client-side scripts to handle recognition or TTS events or prompts
![Page 8: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/8.jpg)
Grammars
• XML codes complying to W3C’s SRGS (Speech Recognition Grammar Specification)
• Used by SR engine on the client side.
• Results returned to server using W3C’s SML (Semantic Mark-up Language)
![Page 9: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/9.jpg)
Grammars
![Page 10: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/10.jpg)
Grammars<rule id="UserName" scope="public"> <one-of>
<item><?MS_Grammar_Editor GroupWrap?>
<one-of><item>
<?MS_Grammar_Editor GroupWrap?><ruleref uri="Library.grxml#Digit7" type="application/srgs+xml"/>
</item><item>
<?MS_Grammar_Editor GroupWrap?><ruleref uri="Library.grxml#Digit10" type="application/srgs+xml"/>
</item></one-of><tag>$.Username = $.Username ? $.Username : {}; $.Username._value = $$._value</tag>
</item><item>
<?MS_Grammar_Editor GroupWrap?><ruleref uri="Library.grxml#Cancel" type="application/srgs+xml"/><tag>$.Cancel = $.Cancel ? $.Cancel : {}; $.Cancel._value = $$._value</tag>
</item></one-of>
</rule>
![Page 11: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/11.jpg)
QA Controls
• Interact with Prompts Database, TTS Engine, SR Engine
• Prerecorded vs. TTS prompts
• Prompts generated by combining recorded prompts or parts of recorded prompts
• 4 different timeouts for recognition timing: Initial, Babble, End Silence, Max
![Page 12: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/12.jpg)
DATABASE
• A collection of interrelated data
• DB Models– Entity - Relationship Model– Relational Model – Network Models– etc.
![Page 13: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/13.jpg)
CIMS
• A Relational DB using MS SQL Server 2000
• Entities →Relations→Tables– Users– Courses– etc.
![Page 14: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/14.jpg)
SQL
• String Query Language– Update, Insert, Delete etc.
• Operations on CIMS– Make Announcements– Give Assignments– etc.
![Page 15: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/15.jpg)
Voice-Only CIMS
• Connect to CIMS Database
• Query the necessary tables– Ex : SELECT ID, Code FROM COURSES
WHERE Enabled='1‘
• Update the tables– Ex: UPDATE USERS SET LAST_ACCESS =
GETDATE() WHERE USERNAME = ‘9902959'
![Page 16: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/16.jpg)
Regular Expressions
• Text Processing and String Manipulations – Pattern Matching– String Splitting – Substring Replacement.
• Regex Class by C#.NET
![Page 17: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/17.jpg)
Regex-CIMS
• Free Labeling– Ex: hw#3, Homework 3, Spice hw 3 …
• Using prerecorded prompts– homework 3– Regex.Replace(name,@"(?<preamble>\w*\s*)
(H|h)\w*(W|w)([^09]*(?<no>\d*)).*","${preamble}"+"homework "+"${no}")
![Page 18: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/18.jpg)
Conlusion
• An IVR system, operating side-by-side with online version of CIMS developed
• Opportunity to gain knowledge about emerging technologies
• Satisfaction of developing a working system with zero initial knowledge
![Page 19: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/19.jpg)
What to do next?
• Windows Server 2003
• Microsoft Speech Server (MSS) (released in May 2004)
• Telephone card
• Deployment onto MSS
![Page 20: Speech-Enabled.NET Framework Application for CIMS Murat Semerci Çağdaş Kayra Akman 15.06.2004](https://reader036.vdocuments.net/reader036/viewer/2022072015/56649ed15503460f94be05a0/html5/thumbnails/20.jpg)
Thanks for listening
Murat Semerci
Çağdaş Kayra Akman