Multimodal Interaction with W3c Standards: Toward Natural User Interfaces to Everything

ISBN-13: 9783319428147 / Angielski / Twarda / 2016 / 422 str.

Deborah Dahl

Opis

This book presents new standards for multimodal interaction published by the W3C and other standards bodies in straightforward and accessible language, while also illustrating the standards in operation through case studies and chapters on innovative implementations. The book illustrates how, as smart technology becomes ubiquitous, and appears in more and more different shapes and sizes, vendor-specific approaches to multimodal interaction become impractical, motivating the need for standards. This book covers standards for voice, emotion, natural language understanding, dialog, and multimodal architectures. The book describes the standards in a practical manner, making them accessible to developers, students, and researchers.

• Comprehensive resource that explains the W3C standards for multimodal interaction clear and straightforward way;
  
• Includes case studies of the use of the standards on a wide variety of devices, including mobile devices, tablets, wearables and robots, in applications such as assisted living, language learning, and health care;
  
• Features illustrative examples of implementations that use the standards, to help spark innovative ideas for future applications.

Recenzje

"This 341-page book provides relatively comprehensive coverage of programming language concepts, a core topic in the ACM model computer science curriculum and a required topic for ABET accreditation of a computer science program. As such the book is appropriately aimed at senior students in an undergraduate curriculum." (Michael Oudshoorn, Computing Reviews, February, 2018)

Spis treści

Part I Standards.- 1 Introduction to the Multimodal Architecture.- 2 The role and importance of speech standards.- 3 Extensible Multimodal Annotation for Intelligent Interactive Systems.- 4 Emotion Markup Language.- 5 Introduction to SCXML.- 6 Dialogue Acts.- 7 Six-Layered Model for Multi-Modal Interaction Systems.- 8 WebRTC handling media on the web.- Part II Implementations.- 9 Developing portable context-aware multimodal applications for connected devices using W3C multimodal architecture.- 10 SCXML on Resource Constrained Devices.- 11 A Standard Portal for Intelligent Services.- 12 Assembling the jigsaw How multiple W3C standards are synergistically combined in the HALEF multimodal dialog system.- Part III Applications.- 13 Applications in Ambient Assisted Living.- 14 Applications in Ambient Assisted Living.- Part IV Future Directions.- 15 Finding and integrating components into dynamic systems.- 16 Laborda Multimodal Interactivity in Foreign Language Testing.- 17 Multi-device applications using the multimodal architecture.- 18 Multimodal Interaction Description Language based on data modeling.- 19 Multimodal Fusion and Fission within the W3C MMI Architectural Pattern.

O autorze

Dr. Deborah Dahl has over 20 years of experience in speech and natural language technologies, including working on research, defense, and commercial systems. She is also active in speech and multimodal standards activities in the World Wide Web Consortium, serving as Chair of the Multimodal Interaction Working Group and Co-Chair of the Hypertext Coordination Group. She is an editor of the EMMA (Extensible MultiModal Annotation specification). Dr. Dahl received the prestigious "Speech Luminary" award from Speech Technology Magazine, in 2012 and 2014.