Image Holistic Scene Understanding Based on Image Intrinsic Characteristics and Conditional Random Fields

Abstract

Image holistic scene understanding based on image intrinsic characteristics and conditional random fields is proposed. The model integrates image scene classification, image semantic segmentation and object detection. 1) For the scene classification, we use method of PHOW feature extraction plus KPCA dimensional reduction to obtain feature information for each image. 2) For object detection section, saliency detection and segmentation characteristics of the image object detection is useful. We propose the method by integrating image segmentation information got by the method proposed in literature [1]. 3) For the semantic segmentation: (1) For the unary potentials, we incorporating HOG, RGB color histogram and LBP features by the methods proposed in literature [2]; (2) The image manifold structural features can better reflect the importance between hyper-pixel regions and eventually boost accuracy. Therefore, we add the higher-order potential item to reflect inherent manifold image feature of each super pixel region. The experiments testify that model performance has raised on all three sub-tasks.