Fusing Generic Objectness and Visual Saliency for Salient Object Detection

Kai-Yueh Chang
Tyng-Luh Liu
Hwann-Tzong Chen
Shang-Hong Lai


International Conference on Computer Vision (ICCV) 2011

Source code

This source code contains:

  1. Segmentation code
  2. P. Felzenszwalb and D. Huttenlocher. Efficient Graph-Based Image Segmentation, IJCV 2004.

    I wrap the function for Matlab.

  3. Generic object detector
  4. B. Alexe, T. Deselaers and V. Ferrari. What is an object?, CVPR 2010.

  5. Bottom-up saliency detector
  6. S. Goferman, L. Zelnik Manor and A. Tal. Context-Aware Saliency Detection, CVPR 2010.

  7. Our fusion code
  8. K.-Y. Chang, T.-L. Liu, H.-T. Chen and S.-H. Lai. Fusing Generic Objectness and Visual Saliency for Salient Object Detection, ICCV 2011.

  9. Three test images from the dataset in
  10. T. Judd, K. Ehinger, F. Durand, and A. Torralba. Learning to predict where humans look, ICCV 2009.

The mex files are built under the VC6 (32-bit) and the Visual Studio 2010 (64-bit) environments. You may need to rebuild them if you use any other version of Visual Studio or other OS.

To get a quick overview:
>> SVO_setup;
>> demo;

Requirement

CVX optimization toolbox

MSRA dataset

We treat the scores ([1], [1]\Saliency, Ours-Obj, and Ours-Sal-Obj) as the weights of windows and use the expected windows to evaluate the precision, recall and F-measure according to the description in [2].

PrecisionRecallF-measure (F-0.5)
[1]0.750.810.75
[1]\Saliency0.750.810.74
Ours-Obj0.780.780.77
Ours-Sal-Obj0.810.770.78

PASCAL VOC 2007

We apply non maximum suppression (intersection-over-union>0.7) to each setting ([1], [1]\Saliency, Ours-Obj, and Ours-Sal-Obj) first and then evaluate the mAP value according to VOC criteria.

mAP
[1]0.260
[1]\Saliency0.236
Ours-Obj0.279

Download

  1. Paper (2.5MB)
  2. Matlab code available upon email request (liutyng@iis.sinica.edu.tw)

Bibtex

@InProceedings{Chang11,
  author    = {Kai-Yueh Chang and Tyng-Luh Liu and Hwann-Tzong Chen and Shang-Hong Lai},
  title     = {Fusing Generic Objectness and Visual Saliency for Salient Object Detection},
  booktitle = {IEEE International Conference on Computer Vision (ICCV)},
  year      = {2011}
}

Reference

[1] B. Alexe, T. Deselaers and V. Ferrari. What is an object? CVPR 2010.
[2] T. Liu, J. Sun, N. Zheng, X. Tang, and H. Shum. Learning to detect a salient object. CVPR 2007.