Nothing Special   »   [go: up one dir, main page]

skip to main content
10.5555/3061053.3061094guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

Robust iterative quantization for efficient lp-norm similarity search

Published: 09 July 2016 Publication History

Abstract

Iterative Quantization (ITQ) is one of the most successful hashing based nearest-neighbor search methods for large-scale information retrieval in the past a few years due to its simplicity and superior performance. However, the performance of this algorithm degrades significantly when dealing with noisy data. Additionally, it can barely facilitate a wide range of applications as the distortion measurement only limits to l 2 norm . In this paper, we propose an ITQ+ algorithm, aiming to enhance both robustness and generalization of the original ITQ algorithm. Specifically, a l p,q -norm loss function is proposed to conduct the l p -norm similarity search, rather than a l 2 norm search. Despite the fact that changing the loss function to l p,q -norm makes our algorithm more robust and generic, it brings us a challenge that minimizes the obtained orthogonality constrained l p,q -norm function , which is non-smooth and non-convex. To solve this problem, we propose a novel and efficient optimization scheme. Extensive experiments on benchmark datasets demonstrate that ITQ+ is overwhelmingly better than the original ITQ algorithm, especially when searching similarity in noisy data.

References

[1]
N. S. Altman. An introduction to kernel and nearest-neighbor nonparametric regression. The American Statistician , 46(3):91-110, 1992.
[2]
Alexandr Andoni and Piotr Indyk. Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. In FOCS'06 , 2006.
[3]
G. Cheng, J. Han, L. Guo, Z. Liu, S. Bu, and J. Ren. Effective and efficient midlevel visual elements-oriented land-use classification using VHR remote sensing images. IEEE TGRS , 2015.
[4]
George W. Furnas, Scott C. Deerwester, Susan T. Dumais, Thomas K. Landauer, Richard A. Harshman, Lynn A. Streeter, and Karen E. Lochbaum. Information retrieval using a singular value decomposition model of latent semantic structure. In SIGIR , 1988.
[5]
Tiezheng Ge, Kaiming He, Qifa Ke, and Jian Sun. Optimized product quantization. TPAMI , 2014.
[6]
Aristides Gionis, Piotr Indyk, and Rajeev Motwani. Similarity search in high dimensions via hashing. In VLDB , 1999.
[7]
D. Goldfarb, Z. Wen, and W Yin. A curvilinear search method for the p-harmonic flow on spheres. SIAM J. Imaging Sci , 2(1):84-109, 2009.
[8]
Yunchao Gong, Svetlana Lazebnik, Albert Gordo, and Florent Perronnin. Iterative quantization: A procrustean approach to learning binary codes for large-scale image retrieval. TPAMI , 2013.
[9]
Kaiming He, Fang Wen, and Jian Sun. K-means hashing: an affinity-preserving quantization method for learning binary compact codes. In CVPR , 2013.
[10]
Jin Huang, Feiping Nie, Heng Huang, and Chris H. Q. Ding. Robust manifold nonnegative matrix factorization. TKDD , 8(3):11, 2013.
[11]
Herve Jegou, Matthijs Douze, Cordelia Schmid, and Patrick Pérez. Aggregating local descriptors into a compact image representation. In CVPR , 2010.
[12]
Hervé Jégou, Matthijs Douze, and Cordelia Schmid. Product quantization for nearest neighbor search. TPAMI , 33(1):117-128, 2011.
[13]
Wenhao Jiang, Feiping Nie, and Heng Huang. Robust dictionary learning with capped l1-norm. In IJCAI , pages 3590-3596, 2015.
[14]
Weihao Kong andWu-Jun Li. Isotropic hashing. In NIPS , 2012.
[15]
David G Lowe. Distinctive image features from scale-invariant keypoints. IJCV , 60(2):91-110, 2004.
[16]
A. Oliva and T. Torralba. Modeling the shape of the scene: a holistic representation of the spatial envelope. IJCV , 42:145-175, 2001.
[17]
Qihe Pan, Deguang Kong, Chris H. Q. Ding, and Bin Luo. Robust non-negative dictionary learning. In AAAI , pages 2027-2033, 2014.
[18]
Uday Pratap Singh and Sanjeev Jain. Content based image retrieval using euclidean and manhattan metrics. Journal of Math. Sciences: Advances and Appl. , 4(1):217-226, 2010.
[19]
L.A. Vese and S.J. Osher. Numerical methods for p-harmonic flows and applications to image processing. SIAM J. Numer. Anal , 2002.
[20]
H. Wang, F. Nie, W. Cai, and H. Huang. Semi-supervised robust dictionary learning via efficient l-norms minimization. In ICCV , 2013.
[21]
Jingdong Wang, Heng Tao Shen, Jingkuan Song, and Jianqiu Ji. Hashing for similarity search: A survey. CoRR , abs/1408.2927, 2014.
[22]
Zaiwen Wen and Wotao Yin. A feasible method for optimization with orthogonality constraints. Math. Program. , 142(1-2):397-434, 2013.
[23]
John Wright, Arvind Ganesh, Shankar Rao, YiGang Peng, and Yi Ma. Robust principal component analysis: Exact recovery of corrupted low-rank matrices via convex optimization. In NIPS , 2009.
[24]
Bin Xu, Jiajun Bu, Yue Lin, Chun Chen, Xiaofei He, and Deng Cai. Harmonious hashing. In IJCAI , 2013.
[25]
Dell Zhang, Jun Wang, Deng Cai, and Jinsong Lu. Self-taught hashing for fast similarity search. In SIGIR , 2010.
[26]
Ting Zhang, Chao Du, and Jingdong Wang. Composite quantization for approximate nearest neighbor search. In ICML , pages 838-846, 2014.

Cited By

View all
  1. Robust iterative quantization for efficient lp-norm similarity search

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Guide Proceedings
    IJCAI'16: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence
    July 2016
    4277 pages
    ISBN:9781577357704

    Sponsors

    • Sony: Sony Corporation
    • Arizona State University: Arizona State University
    • Microsoft: Microsoft
    • Facebook: Facebook
    • AI Journal: AI Journal

    Publisher

    AAAI Press

    Publication History

    Published: 09 July 2016

    Qualifiers

    • Article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 04 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2019)Image noise reduction based on adaptive thresholding and clusteringMultimedia Tools and Applications10.1007/s11042-018-6955-878:11(15545-15573)Online publication date: 31-Jul-2019
    • (2018)Large-scale vocabularies with local graph diffusion and mode seekingImage Communication10.1016/j.image.2018.01.00463:C(1-8)Online publication date: 1-Apr-2018
    • (2018)Elastic preserving projections based on L1-norm maximizationMultimedia Tools and Applications10.1007/s11042-018-5608-277:16(21671-21691)Online publication date: 1-Aug-2018
    • (2017)TUCHProceedings of the 26th International Joint Conference on Artificial Intelligence10.5555/3172077.3172380(3511-3517)Online publication date: 19-Aug-2017
    • (2017)Unsupervised deep video hashing with balanced rotationProceedings of the 26th International Joint Conference on Artificial Intelligence10.5555/3172077.3172318(3076-3082)Online publication date: 19-Aug-2017
    • (2017)SitNetProceedings of the 26th International Joint Conference on Artificial Intelligence10.5555/3172077.3172133(1767-1773)Online publication date: 19-Aug-2017
    • (2017)Actor identification via mining representative actionsNeurocomputing10.1016/j.neucom.2017.03.020244:C(1-9)Online publication date: 28-Jun-2017
    • (2016)SimHProceedings of the International Conference on Internet Multimedia Computing and Service10.1145/3007669.3007678(217-222)Online publication date: 19-Aug-2016

    View Options

    View options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media