Segmentation over detection via optimal sparse reconstructions Journal Article

Author(s): Xia, Wei; Domokos, Csaba; Xiong, Junjun; Cheong, Loongfah; Yan, Shuicheng
Article Title: Segmentation over detection via optimal sparse reconstructions
Affiliation IST Austria
Abstract: This paper addresses the problem of semantic segmentation, where the possible class labels are from a predefined set. We exploit top-down guidance, i.e., the coarse localization of the objects and their class labels provided by object detectors. For each detected bounding box, figure-ground segmentation is performed and the final result is achieved by merging the figure-ground segmentations. The main idea of the proposed approach, which is presented in our preliminary work, is to reformulate the figure-ground segmentation problem as sparse reconstruction pursuing the object mask in a nonparametric manner. The latent segmentation mask should be coherent subject to sparse error caused by intra-category diversity; thus, the object mask is inferred by making use of sparse representations over the training set. To handle local spatial deformations, local patch-level masks are also considered and inferred by sparse representations over the spatially nearby patches. The sparse reconstruction coefficients and the latent mask are alternately optimized by applying the Lasso algorithm and the accelerated proximal gradient method. The proposed formulation results in a convex optimization problem; thus, the global optimal solution is achieved. In this paper, we provide theoretical analysis of the convergence and optimality. We also give an extended numerical analysis of the proposed algorithm and a comprehensive comparison with the related semantic segmentation methods on the challenging PASCAL visual object class object segmentation datasets and the Weizmann horse dataset. The experimental results demonstrate that the proposed algorithm achieves a competitive performance when compared with the state of the arts.
Keywords: Accelerated Proximal Gradient method; Lasso optimization; Semantic segmentation; Sparse reconstruction
Journal Title: IEEE Transactions on Circuits and Systems for Video Technology
Volume: 25
Issue 8
ISSN: 1051-8215
Publisher: IEEE  
Date Published: 2015-08-01
Start Page: 1295
End Page: 1308
Sponsor: This work was supported by the Singapore National Resear ch Foundation within the International Research Centre through the Singapor e Funding Initiative and administered by the IDM Programme Office.
DOI: 10.1109/TCSVT.2014.2379972
Open access: no
IST Austria Authors
Related IST Austria Work