Multimedia Interaction and Intelligent User Interfaces: Principles, Methods and Applications

ISBN-13: 9781447125907 / Angielski / Miękka / 2012 / 302 str.

Ling Shao; Caifeng Shan; Jiebo Luo

Opis

With the development of silicon technologies, consumer electronics (CE) devices (such as personal computers, HDTV, mobile phones, digital cameras and game consoles) have become ubiquitous in daily life. These devices can provide multimedia sources for entertainment, communication, and so on. To interact with this equipment, consumers currently rely on devices such as remote controls, keyboards or control panels, which are often inconvenient, ambiguous and non-interactive. The question of how to design user interfaces for CE products that enable natural, intuitive and fun interaction is one of the main challenges the CE industry is facing. Many companies and institutes are working on advanced user interfaces. User interface technologies has been studied in various disciplines for decades. Considering that modern CE products are usually supplied with both microphones and cameras, the challenge to employ both audio and visual information in interactive multimedia has recently received much attention in both academia and industry. Yet interactive multimedia is still an under-explored field. Many challenges exist when moving to multimodal interaction, for example: how to annotate and search huge amounts of data acquired by using multiple sensors, especially in the unconstrained end-user environments; how to effectively extract and select representative multimedia features for human behavior recognition; and how to select the fusion strategy of multimodal data for a given application. To address these challenges, existing approaches must be adapted or new solutions suitable for multimedia interaction must be found. This book brings together high-quality and up-to-date research advances in the areas of multimedia interaction, user interfaces, and applications of consumer electronics.

Spis treści

Retrieving Human Actions Using Spatio-temporal Features and Relevance Feedback Rui Jin and Ling Shao Computationally Efficient Clustering of Audio-Visual Meeting Data Hayley Hung, Gerald Friedland, and Chuohao Yeo Cognitive-aware Modality Allocation in Intelligent Multimodal Information Presentation Yujia Cao, Mariët Theune and Anton Nijholt Natural Human-Computer Interaction Gianpaolo D'Amico, Alberto Del Bimbo, Farizio Dini, Lea Landucci, and Nicola Torpei Gesture Control for Consumer Electronics Caifeng Shan Empirical Study of a Complete System for Real-time Face Pose Estimation Tommaso Gritti Evolution-based Virtual Content Insertion with Visually Virtual Interactions in Videos Chia-Hu Chang and Ja-Ling Wu Physical Activity Recognition on Mobile Phones: Challenges, Methods and Applications Jun Yang, Hong Lu, Zhigang Liu and Péter Pál Boda Gestures in an Intelligent User Interface Wim Fikkert, Paul van der Vet and Anton Nijholt Video Summary Quality Evaluation based on 4C Assessment and User Interaction Tongwei Ren, Yan Liu and Gangshan Wu Multimedia Experience on Web-Connected CE Devices Dan Tretter, Jerry Liu, Xuemei Zhang, Yuli Gao, Brian Atkins, Hui Chao, Jun Xiao, Peng Wu, and Qian Lin

Blurb

Consumer electronics (CE) devices, providing multimedia entertainment and enabling communication, have become ubiquitous in daily life. An important challenge for the modern CE industry is the design of user interfaces for CE products that enable natural interactions that are convenient, intuitive and fun. As many CE products are supplied with microphones and cameras, the exploitation of both audio and visual information for interactive multimedia is a growing field of research.

Collecting together contributions from an international selection of experts, including leading researchers in industry, this unique text presents the latest advances in applications of multimedia interaction and user interfaces for consumer electronics. Covering issues of both multimedia content analysis and human-machine interaction, the book examines a wide range of techniques from computer vision, machine learning, audio and speech processing, communications, artificial intelligence and media technology.

Topics and features:

• Introduces novel computationally efficient algorithms to extract semantically meaningful audio-visual events
• Investigates modality allocation in intelligent multimodal presentation systems, taking into account the cognitive impacts of modality on human information processing
• Provides an overview on gesture control technologies for CE
• Presents systems for natural human-computer interaction, virtual content insertion, and human action retrieval
• Examines techniques for 3D face pose estimation, physical activity recognition, and video summary quality evaluation
• Describes features that characterize the new generation of CE and examines how web services can be integrated for improved user experience

This book is an essential resource for researchers and practitioners from both academia and industry working in areas of multimedia analysis, human-computer interaction and interactive user interfaces. Graduate students studying computer vision, pattern recognition and multimedia will also find it a beneficial and a useful reference.

Dr. Ling Shao is a Senior Lecturer in the Department of Electronic and Electrical Engineering at the University of Sheffield, UK. Dr. Caifeng Shan is a Senior Scientist with Philips Research, Eindhoven, The Netherlands. Dr. Jiebo Luo is a Senior Principal Scientist with Kodak Research Laboratories in Rochester, NY, USA. Dr. Minoru Etoh is Managing Director of the Service & Solution Development Department of NTT DOCOMO, Yokosuka, Japan.