article

Fusion feature for LSH-based image retrieval in a cloud datacenter

Authors:

Haifeng SunAuthors Info & Claims

Multimedia Tools and Applications, Volume 75, Issue 23

Pages 15405 - 15427

https://doi.org/10.1007/s11042-015-2892-y

Published: 01 December 2016 Publication History

Abstract

Since the emergence of cloud datacenters provides an enormous amount of resources easily accessible to people, it is challenging to provide an efficient search framework in such a distributed environment. However, traditional search techniques only allow users to search images over exact-match keywords through a centralized index. These methods are insufficient to meet requirements of content based image retrieval (CBIR) and more powerful search frameworks are needed. In this paper, we present LFFIR, a multi-feature image retrieval framework for content similar search in the distributed situation. The key idea is to effectively incorporate image retrieval based on multi-feature into the peer-to-peer (P2P) paradigm. LFFIR fuses the multiple features in order to capture the overall image characteristics. And then it constructs the distributed indexes for the fusion feature through exploiting the property of locality sensitive hashing (LSH). We implement a prototype system to evaluate the system performance with two image datasets. Comprehensive performance evaluations demonstration that our approach brings major performance and accuracy gains compared to the advanced distributed image retrieval framework.

References

[1]

Androutsos P, Androutsos D, Venetsanopoulos AN (2006) A distributed fault-tolerant MPEG-7 retrieval scheme based on small world theory. IEEE Trans Multimed 8(2):278---288

Digital Library

[2]

Batko M, Falchi F, Lucchese C et al (2010) Building a web-scale image similarity search system{J}. Multimed Tools Appl 47(3):599---629

Digital Library

[3]

Bawa M, Manku G, Raghavan P (2003) SETS: search enhanced by topic segmentation. Proceedings of the 26th Annual International ACM SIGIR Conference (SIGIR'03), Toronto, Canada, 306---313

Digital Library

[4]

Chen J, Hu C, Su C (2008) Scalable retrieval and mining with optimal peer-to-peer configuration. IEEE Trans Multimed 10(2):209---220

Digital Library

[5]

Crespo A, Garcia-Molina H (2002) Routing indices for peer-to-peer systems. Proceedings of the 22nd IEEE International Conference on Distributed Computing Systems (ICDCS'02), Vienna, Austria, 23---32

Digital Library

[6]

Datar M, Immorlica N, Indyk P, Mirrokni VS (2004) Locality-sensitive hashing scheme based on p-stable distributions. Proceedings of the 20th Annual Symposium on Computational Geometry (SoCG'04), New York, USA, 253---262

Digital Library

[7]

Datta R, Joshi D, Li J, Wang JZ (2008) Image retrieval: ideas, influences, and trends of the new age. ACM Comput Surv 40(2), Article 5

Digital Library

[8]

Dikaiakos MD, Katsaros D, Mehra P, Pallis G, Vakali A (2009) Cloud computing: distributed internet computing for IT and scientific research. IEEE Internet Comput 13(5):10---13

Digital Library

[9]

Eisenhardt M, Muller W, Henrich A, Blank D, Allali SE (2006) Clustering-based source selection for efficient image retrieval in peer-to-peer networks. Proceedings of the 8th IEEE International Symposium on Multimedia (ISM '06), Washington DC, USA, 823---830

Digital Library

[10]

Falchi F, Gennaro C, Zezula P (2005) A content-addressable network for similarity search in metric spaces. Proceedings of the 6th International Workshop on Databases, Information Systems and Peer-to-Peer Computing (DBISP2P'05), Toronto, Canada, 79---92

Digital Library

[11]

Forestiero A, Leonardi E, Mastroianni C, Meo M (2010) Self-chord: a bio-inspired P2P framework for self-organizing distributed systems. IEEE/ACM Trans Netw 18(5):1651---1664

Digital Library

[12]

Gaeta R, Sereno M (2011) Generalized probabilistic flooding in unstructured peer-to-peer networks. IEEE Trans Parallel Distrib Syst 22(12):2055---2062

Digital Library

[13]

Gnutella (2000) Gnutella website. http://www.Gnutella.com

[14]

Guo C, Lu G, Li D et al (2009) BCube: a high performance, server-centric network architecture for modular data centers{J}. ACM SIGCOMM Comput Commun Rev 39(4):63---74

Digital Library

[15]

Haghani P, Michel S, Aberer K (2009) Distributed similarity search in high dimensions using locality sensitive hashing. Proceedings of the 12th International Conference on Extending Database Technology (EDBT'09), Saint Petersburg, Russia, 744---755

Digital Library

[16]

Indyk P, Motwani R (1998) Approximate nearest neighbors: towards removing the curse of dimensionality. Proceedings of the 13th ACM Symposium on Theory of computing (STOC'98), Dallas, Texas, 604---613

Digital Library

[17]

Jagadish HV, Ooi BC, Vu QH (2005) BATON: a balanced tree structure for peer-to-peer networks. Proceedings of the 31st international conference on Very large data bases (VLDB'05), Trondheim, Norway, 661---672

Digital Library

[18]

Kalnis P, Ng WS, Ooi BC, Tan K (2004) Answering similarity queries in peer-to-peer networks. Inf Syst 31(1):57---72

Digital Library

[19]

King I, Ng CH, Sia KC (2004) Distributed content-based visual information retrieval system on peer-to-peer networks. ACM Trans Inf Syst 22(3):477---501

Digital Library

[20]

Li F, Fergus R, Perona P (2007) Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. Comput Vis Image Underst 106(1):59---70

Digital Library

[21]

Liao J, Wang J, Wu B, Wu W (2012) Toward a multi-plane framework of NGSON: a required guideline to achieve pervasive services and efficient resource utilization. IEEE Commun Mag 50(1):90---97

[22]

Liao J, Yang D, Li T, Wang J, Qi Q, Zhu X (2014) A scalable approach for content based image retrieval in cloud datacenter. Inf Syst Front 16(1):129---141

Digital Library

[23]

Liu G, Zhang L, Hon Y, Li Z, Yang J (2010) Image retrieval based on multi-texton histogram. Pattern Recogn 43(7):2380---2389

Digital Library

[24]

Lv Q, Cao P, Cohen E, Li K, Shenker S (2002) Search and replication in unstructured peer-to-peer networks. Proceedings of the 16th ACM Annual International Conference on Supercomputing (ICS'02), New York, USA, 84---95

Digital Library

[25]

Novak D, Zezula P (2006) M-Chord: a scalable distributed similarity search structure. Proceedings of the First International Conference on Scalable Information System (INFOSCALE' 06), Hong Kong, China, Article 19

Digital Library

[26]

Peng C, Kim M, Zhang Z, Lei H (2012) VDN: virtual machine image distribution network for cloud data centers. IEEE International Conference on Computer Communications (INFOCOM'12), Orlando, Florida, 181---189

[27]

Peng C, Ksim M, Zhang Z, Lei H (2012) VDN: virtual machine image distribution network for cloud data centers. IEEE International Conference on Computer Communications (INFOCOM'12), Orlando, Florida, 181---189

[28]

Ratnasamy S, Francis P, Handley M, Karp R, Shenker S (2001) Scalable content-addressable networks. The 2001 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM'01), San Diego, USA, 161---172

Digital Library

[29]

Sahin OD, Gulbeden A, Emekci F, Agrawal D, Abbadi AE (2005) PRISM: indexing multi-dimensional data in p2p networks using reference vectors. Proceedings of the 13rd Annual ACM International Conference on Multimedia, ACM Multimedia (MM'05), Singapore, 946---955

Digital Library

[30]

Snoek C,Worring M, Smeulders AWM (2005) Early versus late fusion in semantic video analysis. Proceedings of the 13rd Annual ACM International Conference on Multimedia, ACM Multimedia (MM'05), Singapore, 399---402

Digital Library

[31]

Sripanidkulchai K, Maggs BM, Zhang H (2003) Efficient content location using interest-based locality in peer-to-peer systems. Proceedings of the 22nd Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM'03), San Francisco

[32]

Stoica I, Morris R, Karger D, Kaashoek MF, Balakrishnan H (2001) Chord: a scalable peer-to-peer lookup service for internet applications. The 2001 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM'01), San Diego, USA, 149---160

Digital Library

[33]

Tang C, Xu Z, Dwarkadas S (2003) Peer-to-peer information retrieval using self-organizing semantic overlay networks. The 2003 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM'03), Karlsruhe, Germany, 175---186

Digital Library

[34]

Tian X, Jiao L, Liu X, Zhang X (2014) Feature integration of EODH and Color-SIFT: application to image retrieval based on codebook. Signal Process Image Commun 29(4):530---545

[35]

Urdaneta G, Pierre G, Steen MV (2011) A survey of DHT security techniques{J}. ACM Comput Surv (CSUR) 43(2):8

Digital Library

[36]

Vlachou A, Doulkeridis C, Kotidis Y (2012) Metric-based similarity search in unstructured peer-to-peer systems. Trans Large Scale Data Knowl Centered Syst 5:28---48

Digital Library

[37]

Wang X, Zhang B, Yang H (2014) Content-based image retrieval by integrating color and texture features. Multimed Tools Appl 68(3):545---569

Digital Library

[38]

Yang Z, Zhao BY, Xing Y et al (2010) AmazingStore: available, low-cost online storage service using cloudlets. Proceedings of the 9th International Workshops on Peer-to-Peer Systems (IPTPS'10), San Jose, USA, 1---5

Digital Library

[39]

Zhang X, Shou L, Tan K, Chen G (2010) iDISQUE: tuning high-dimensional similarity queries in DHT networks. Proceedings of the 15th International Conference on Database Systems for Advanced Applications (DASFAA'10), Tsukuba, Japan, 19---33

Digital Library

[40]

Zhu Y, Hu Y (2007) Efficient semantic search on DHT overlays. J Parallel Distrib Comput 67(5):604---616

Digital Library

Cited By

Wu JShen LLiu L(2019)LSH-based distributed similarity indexing with load balancing in high-dimensional spaceThe Journal of Supercomputing10.1007/s11227-019-03047-676:1(636-665)Online publication date: 30-Oct-2019
https://dl.acm.org/doi/10.1007/s11227-019-03047-6
Cai ZLee IChu SHuang X(2019)SimSimJournal of Grid Computing10.1007/s10723-019-09475-117:1(79-95)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1007/s10723-019-09475-1
Qi QWang JCao YWang JSun HLiao J(2018)Cluster-PSO Based Resource Orchestration for Multi-task Applications in Vehicular CloudWireless Personal Communications: An International Journal10.1007/s11277-017-5046-x102:3(2133-2155)Online publication date: 1-Oct-2018
https://dl.acm.org/doi/10.1007/s11277-017-5046-x

Fusion feature for LSH-based image retrieval in a cloud datacenter
1. Information systems
  1. Information retrieval

Recommendations

A scalable approach for content based image retrieval in cloud datacenter

The emergence of cloud datacenters enhances the capability of online data storage. Since massive data is stored in datacenters, it is necessary to effectively locate and access interest data in such a distributed system. However, traditional search ...
Dynamic Multi-probe LSH: An I/O Efficient Index Structure for Approximate Nearest Neighbor Search
DEXA 2013: Proceedings of the 24th International Conference on Database and Expert Systems Applications - Volume 8055

Locality-Sensitive Hashing LSH is widely used to solve approximate nearest neighbor search problems in high-dimensional spaces. The basic idea is to map the "nearby" objects into a same hash bucket with high probability. A significant drawback is that ...
Two-stage content based image retrieval using sparse representation and feature fusion
Abstract
With the advent of large-scale databases in the last two decades, content based image retrieval (CBIR) has been widely investigated. Studies show that the performance of the CBIR system is mainly affected by the image descriptors and the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Multimedia Tools and Applications

Multimedia Tools and Applications Volume 75, Issue 23

December 2016

1525 pages

ISSN:1380-7501

Issue’s Table of Contents

Copyright © Copyright © 2016 Springer Science+Business Media New York.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 December 2016

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wu JShen LLiu L(2019)LSH-based distributed similarity indexing with load balancing in high-dimensional spaceThe Journal of Supercomputing10.1007/s11227-019-03047-676:1(636-665)Online publication date: 30-Oct-2019
https://dl.acm.org/doi/10.1007/s11227-019-03047-6
Cai ZLee IChu SHuang X(2019)SimSimJournal of Grid Computing10.1007/s10723-019-09475-117:1(79-95)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1007/s10723-019-09475-1
Qi QWang JCao YWang JSun HLiao J(2018)Cluster-PSO Based Resource Orchestration for Multi-task Applications in Vehicular CloudWireless Personal Communications: An International Journal10.1007/s11277-017-5046-x102:3(2133-2155)Online publication date: 1-Oct-2018
https://dl.acm.org/doi/10.1007/s11277-017-5046-x

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents