Multimodal Interactive Pattern Recognition and Applications

Many real-world applications of pattern recognition (PR) systems require human post-processing to correct the errors committed by machines. This can create bottlenecks in recognition systems, yielding high operational costs. This important text/reference proposes a radically different approach to this problem, in which users of a system are involved during the recognition process. This can help to avoid later errors and reduce the costs associated with post-processing. The book also examines a range of advanced multimodal interactions between the machine and the users, including handwriting, speech and gestures. **Topics and features:** * Presents a thorough introduction to the fundamental concepts and general PR approaches for multimodal interaction modelling and search (or inference) * Provides numerous examples and a helpful Glossary * Includes work carried out in the context of the Spanish research program __Multimodal Interaction in Pattern Recognition and Computer Vision__ (MIPRCV), which involves more than 100 highly-qualified researchers from ten research institutions * Discusses approaches for computer-assisted transcription of handwritten and spoken documents * Examines systems for computer-assisted language translation, interactive text generation and parsing, relevance-based image retrieval, and interactive document layout analysis * Reviews several full working prototypes of multimodal interactive PR applications, including live demonstrations that can be publicly accessed through the Internet Addressing the emerging field of interactive and multimodal systems in a fresh, unified and integrated way, this unique book is highly recommended reading for graduate students, academic and industrial researchers, lecturers, and practitioners working in the field of pattern recognition. **Dr. Alejandro Héctor Toselli** is an Associate Professor at the Department of Computer Systems and Computation of the Polytechnic University of Valencia, Spain. **Dr. Enrique Vidal** and **Dr. Francisco Casacuberta** both hold the title of Full Professor at the same institution. This book presents a different approach to pattern recognition (PR) systems, in which users of a system are involved during the recognition process. This can help to avoid later errors and reduce the costs associated with post-processing. The book also examines a range of advanced multimodal interactions between the machine and the users, including handwriting, speech and gestures. Features: presents an introduction to the fundamental concepts and general PR approaches for multimodal interaction modeling and search (or inference); provides numerous examples and a helpful Glossary; discusses approaches for computer-assisted transcription of handwritten and spoken documents; examines systems for computer-assisted language translation, interactive text generation and parsing, relevance-based image retrieval, and interactive document layout analysis; reviews several full working prototypes of multimodal interactive PR applications, including live demonstrations that can be publicly accessed on the Internet. Front Matter....Pages I-XVI General Framework....Pages 1-45 Computer Assisted Transcription: General Framework....Pages 47-59 Computer Assisted Transcription of Text Images....Pages 61-98 Computer Assisted Transcription of Speech Signals....Pages 99-117 Active Interaction and Learning in Handwritten Text Transcription....Pages 119-133 Interactive Machine Translation....Pages 135-152 Multi-Modality for Interactive Machine Translation....Pages 153-168 Incremental and Adaptive Learning for Interactive Machine Translation....Pages 169-177 Interactive Parsing....Pages 179-193 Interactive Text Generation....Pages 195-207 Interactive Image Retrieval....Pages 209-226 Prototypes and Demonstrators....Pages 227-266 Back Matter....Pages 267-274