Integration of Pattern Information and Natural Language Information for Image Analysis and Retrieval

Yasuhiko Watanabe and Makoto Nagao

Cooperative use of pattern information and natural language information is quite effective for sophisticated and flexible information processing. Therefore, it is important to investigate the integration of these kinds of information (especially in multimedia). For this purpose, we propose method for image analysis by using the natural language information extracted from the explanation text of image data. First, we describe the method of extraction of color information from the explanation text. Then, we describe how this color information is used for the extraction of objects from the image data. We report experimental results to show the effectiveness of our method. Also, we report an experimental multimedia database system for pictorial book of flora which we developed by using the results of the experiment.

This page is copyrighted by AAAI. All rights reserved. Your use of this site constitutes acceptance of all of AAAI's terms and conditions and privacy policy.