Mobile phones have evolved into powerful image and video processing devices equipped with high-resolution cameras, color displays, and hardware-accelerated graphics. These additional features allow to use multimodal queries for searching information on the go. This paper describes a multimodal image search system exploits multimodal and multi-touch functionalities of smart phones. The system allows to search similar images from the web by using an existing image query in user's hand or speech query that give a picture description in the user’s mind.
Keywords
Multimodal search, mobile visual search, interactive search, content based information retrieval, Mobile device