Multimodal Technologies for Perception of Humans: International Evaluation Workshops Clear 2007 and Rt 2007, Baltimore, MD, Usa, May 8-11, 2007, Revis

ISBN-13: 9783540685845 / Angielski / Miękka / 2008 / 580 str.

Rainer Stiefelhagen

Opis

ThesecondannualClassi?cationofEventsActivitiesandRelationships(CLEAR) and the 2007 Rich Transcription (RT) evaluations took place during the winter and earlyspring of 2007.This wasa co-locationof complementaryevaluation - forts;CLEARfor theevaluationofhuman activities, events, andrelationshipsin multiple multimodal data domains (e.g., meetings, surveillance, etc.); RT for the evaluation of speech transcription-relatedtechnologies from meeting roomaudio collections.Throughthesecollaborativespeech-andvideo-basedevaluationtasks, wehopetoprovideresourcesthathelpthespeechandvisionresearchcommunities establisha basefor fostering moremultimedia researche?orts inthe future. CLEAR targets the evaluation of systems for the perception of people, their identities, activities, interactions, and relationships in human-to-human int- action and related scenarios in various multimodal data domains (meetings, surveillance, etc.). RT targets the evaluation of meeting domain speech te- nologies including: speech-to-text transcription, "who-spoke-when" speaker - arization, and speaker attributed speech-to-text. As part of the evaluation, two workshops were held, during May 8-9, 2007 for CLEAR, and May 10-11, 2007 for RT, in Baltimore, Maryland, where the participating systems were presented and the evaluation results were discussed in detail. Both CLEAR and RT were open to any institution interested in participating and drew over 50 participants for their individual workshops. The book is broken down into two sections: CLEAR and RT. Each gives an overview of the data, evaluation protocol, the individual evaluation tasks, and the participants' results. This is followed by the papers that describe details of the algorithms that were scored. Thoughyoumaybedrawntotheproceedingsfromaspeci?cworkshopwe- courageyouto exploreallthe workpresentedin this publication.Therearec- plementary aspects between the research evaluated in CLEAR and RT, which we hope will stimulate new ideas for multimedia-based research, as well as new multimedia evaluation.

Spis treści

CLEAR 2007.- The CLEAR 2007 Evaluation.- The AIT 3D Audio / Visual Person Tracker for CLEAR 2007.- A Person Tracking System for CHIL Meetings.- An Appearance-Based Particle Filter for Visual Tracking in Smart Rooms.- Multi-level Particle Filter Fusion of Features and Cues for Audio-Visual Person Tracking.- Multispeaker Localization and Tracking in Intelligent Environments.- Multi-person Tracking Strategies Based on Voxel Analysis.- TUT Acoustic Source Tracking System 2007.- The AIT 2D Face Detection and Tracking System for CLEAR 2007.- PittPatt Face Detection and Tracking for the CLEAR 2007 Evaluation.- Tsinghua Face Detection and Tracking for CLEAR 2007 Evaluation.- The AIT Outdoor Tracker for Vehicles and Pedestrians in CLEAR2007.- Objective Evaluation of Pedestrian and Vehicle Tracking on the CLEAR Surveillance Dataset.- Person and Vehicle Tracking in Surveillance Video.- UMD_VDT, an Integration of Detection and Tracking Methods for Multiple Human Tracking.- CLEAR’07 Evaluation of USC Human Tracking System for Surveillance Videos.- Speed Performance Improvement of Vehicle Blob Tracking System.- Vehicle and Person Tracking in Aerial Videos.- Person Tracking in UAV Video.- The AIT Multimodal Person Identification System for CLEAR 2007.- Acoustic Speaker Identification: The LIMSI CLEAR’07 System.- MIT Lincoln Laboratory Multimodal Person Identification System in the CLEAR 2007 Evaluation.- Multichannel and Multimodality Person Identification.- ISL Person Identification Systems in the CLEAR 2007 Evaluations.- Robust Speaker Identification for Meetings: UPC CLEAR’07 Meeting Room Evaluation System.- Probabilistic Head Pose Tracking Evaluation in Single and Multiple Camera Setups.- Joint Bayesian Tracking of Head Location and Pose from Low-Resolution Video.- Learning a Person-Independent Representation for Precise 3D Pose Estimation.- Head Pose Estimation in Single- and Multi-view Environments - Results on the CLEAR’07 Benchmarks.- Head Orientation Estimation Using Particle Filtering in Multiview Scenarios.- The Acoustic Event Detector of AIT.- An HMM Based System for Acoustic Event Detection.- HMM-Based Acoustic Event Detection with AdaBoost Feature Selection.- Acoustic Event Detection: SVM-Based System and Evaluation Setup in CLEAR’07.- TUT Acoustic Event Detection System 2007.- RT 2007.- The Rich Transcription 2007 Meeting Recognition Evaluation.- The CHIL RT07 Evaluation Data.- Shared Linguistic Resources for the Meeting Domain.- The 2007 AMI(DA) System for Meeting Transcription.- The IBM Rich Transcription 2007 Speech-to-Text Systems for Lecture Meetings.- The LIMSI RT07 Lecture Transcription System.- The SRI-ICSI Spring 2007 Meeting and Lecture Recognition System.- The ISL RT-07 Speech-to-Text System.- Progress in the AMIDA Speaker Diarization System for Meeting Data.- Speaker Diarization Using Direction of Arrival Estimate and Acoustic Feature Information: The I2R-NTU Submission for the NIST RT 2007 Evaluation.- The IBM RT07 Evaluation Systems for Speaker Diarization on Lecture Meetings.- The ICSI RT07s Speaker Diarization System.- The LIA RT’07 Speaker Diarization System.- Multi-stage Speaker Diarization for Conference and Lecture Meetings.- Speaker Diarization for Conference Room: The UPC RT07s Evaluation System.

Blurb

This book constitutes the thoroughly refereed joint post-workshop proceedings of two co-located events: the Second International Workshop on Classification of Events, Activities and Relationships, CLEAR 2007, and the 5th Rich Transcription 2007 Meeting Recognition evaluation, RT 2007, held in succession in Baltimore, MD, USA, in May 2007.

The workshops had complementary evaluation efforts; CLEAR for the evaluation of human activities, events, and relationships in multiple multimodal data domains; and RT for the evaluation of speech transcription-related technologies from meeting room audio collections. The 35 revised full papers presented from CLEAR 2007 cover 3D person tracking, 2D face detection and tracking, person and vehicle tracking on surveillance data, vehicle and person tracking aerial videos, person identification, head pose estimation, and acoustic event detection. The 15 revised full papers presented from RT 2007 are organized in topical sections on speech-to-text, and speaker diarization.