Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-articleOctober 2024
Dr. CLIP: CLIP-Driven Universal Framework for Zero-Shot Sketch Image Retrieval
MM '24: Proceedings of the 32nd ACM International Conference on MultimediaPages 9554–9562https://doi.org/10.1145/3664647.3680702The field of Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) is undergoing a paradigm shift, transitioning from specialized models designed for individual tasks to more general retrieval models capable of managing various specialized scenarios. Inspired ...
- short-paperJune 2024
Conversational Image Search: A Sketch-based Approach
ICMR '24: Proceedings of the 2024 International Conference on Multimedia RetrievalPages 1265–1269https://doi.org/10.1145/3652583.3657594Conversational image search has emerged as a progressive step beyond traditional keyword-based methodologies, which addresses challenges in human-computer interaction during the information retrieval process. This paper introduces a demonstration called ...
- research-articleDecember 2023
Enhancing Video Retrieval with Robust CLIP-Based Multimodal System
- Minh-Dung Le-Quynh,
- Anh-Tuan Nguyen,
- Anh-Tuan Quang-Hoang,
- Van-Huy Dinh,
- Tien-Huy Nguyen,
- Hoang-Bach Ngo,
- Minh-Hung An
SOICT '23: Proceedings of the 12th International Symposium on Information and Communication TechnologyPages 972–979https://doi.org/10.1145/3628797.3629011In the rapidly evolving landscape of multimedia data, the need for efficient content-based video retrieval has become increasingly vital. To tackle this challenge, we introduce an interactive video retrieval system designed to retrieve data from vast ...
- research-articleJanuary 2024
Adapting Hierarchical Transformer for Scene-Level Sketch-Based Image Retrieval
MMAsia '23: Proceedings of the 5th ACM International Conference on Multimedia in AsiaArticle No.: 24, Pages 1–7https://doi.org/10.1145/3595916.3626394Sketch-based image retrieval (SBIR) is an essential application of sketches. Research on object-level SBIR is relatively mature, but the study of more complex scene-level SBIR is still in its early stages. In order to advance this research, we ...
- ArticleOctober 2023
LogoNet: A Fine-Grained Network for Instance-Level Logo Sketch Retrieval
AbstractSketch-based image retrieval, which aims to use sketches as queries to retrieve images containing the same query instance, receives increasing attention in recent years. Although dramatic progress has been made in sketch retrieval, few efforts are ...
-
- research-articleMarch 2023
Cross-Modal Relation and Sketch Prototype Learning for Zero-Shot Sketch-Based Image Retrieval
CSAI '22: Proceedings of the 2022 6th International Conference on Computer Science and Artificial IntelligencePages 121–128https://doi.org/10.1145/3577530.3577550Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) is an innovative cross-modal task that utilizes a sketch to retrieve corresponding images in the zero-shot learning scene. At present, most algorithms treat ZS-SBIR as a typical image classification ...
- research-articleOctober 2022
Prototype-based Selective Knowledge Distillation for Zero-Shot Sketch Based Image Retrieval
MM '22: Proceedings of the 30th ACM International Conference on MultimediaPages 601–609https://doi.org/10.1145/3503161.3548382Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) is an emerging research task that aims to retrieve data of new classes across sketches and images. It is challenging due to the heterogeneous distributions and the inconsistent semantics across seen and ...
- research-articleOctober 2022
Multi-Level Region Matching for Fine-Grained Sketch-Based Image Retrieval
MM '22: Proceedings of the 30th ACM International Conference on MultimediaPages 462–470https://doi.org/10.1145/3503161.3548147Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) is to use free-hand sketches as queries to perform instance-level retrieval in an image gallery. Existing works usually leverage only high-level information and perform matching in a single region. ...
- research-articleOctober 2022
PSDoodle: fast app screen search via partial screen doodle
MOBILESoft '22: Proceedings of the 9th IEEE/ACM International Conference on Mobile Software Engineering and SystemsPages 89–99https://doi.org/10.1145/3524613.3527816Searching through existing repositories for a specific mobile app screen design is currently either slow or tedious. Such searches are either limited to basic keyword searches (Google Image Search) or require as input a complete query screen image (...
- research-articleOctober 2022
PSDoodle: searching for app screens via interactive sketching
MOBILESoft '22: Proceedings of the 9th IEEE/ACM International Conference on Mobile Software Engineering and SystemsPages 84–88https://doi.org/10.1145/3524613.3527807Keyword-based mobile screen search does not account for screen content and fails to operate as a universal tool for all levels of users. Visual searching (e.g., image, sketch) is structured and easy to adopt. Current visual search approaches count on a ...
- research-articleOctober 2021
Relationship-Preserving Knowledge Distillation for Zero-Shot Sketch Based Image Retrieval
MM '21: Proceedings of the 29th ACM International Conference on MultimediaPages 5473–5481https://doi.org/10.1145/3474085.3475676Zero-shot sketch-based image retrieval is challenging for the modal gap between distributions of sketches and images and the inconsistency of label spaces during training and testing. Previous methods mitigate the modal gap by projecting sketches and ...
- research-articleOctober 2021
Domain-Aware SE Network for Sketch-based Image Retrieval with Multiplicative Euclidean Margin Softmax
MM '21: Proceedings of the 29th ACM International Conference on MultimediaPages 3418–3426https://doi.org/10.1145/3474085.3475499This paper proposes a novel approach for Sketch-Based Image Retrieval (SBIR), for which the key is to bridge the gap between sketches and photos in terms of the data representation. Inspired by channel-wise attention explored in recent years, we present ...
- demonstrationOctober 2017
Sketch-based Image Retrieval using Generative Adversarial Networks
MM '17: Proceedings of the 25th ACM international conference on MultimediaPages 1267–1268https://doi.org/10.1145/3123266.3127939For sketch-based image retrieval (SBIR), we propose a generative adversarial network trained on a large number of sketches and their corresponding real images. To imitate human search process, we attempt to match candidate images with theimaginary image ...
- research-articleJuly 2017
SmartSketcher: sketch-based image retrieval with dynamic semantic re-ranking
SBIM '17: Proceedings of the Symposium on Sketch-Based Interfaces and ModelingArticle No.: 1, Pages 1–12https://doi.org/10.1145/3092907.3092910We present a sketch-based image retrieval system, designed to answer arbitrary queries that may go beyond searching for predefined object or scene categories. While sketching is fast and intuitive to formulate visual queries, pure sketch-based image ...
- research-articleJune 2017
Quadruplet Networks for Sketch-Based Image Retrieval
ICMR '17: Proceedings of the 2017 ACM on International Conference on Multimedia RetrievalPages 184–191https://doi.org/10.1145/3078971.3078985Freehand sketches are a simple and powerful tool for communication. They are easily recognized across cultures and suitable for various applications. In this paper, we use deep convolutional neural networks (ConvNets) to address sketch-based image ...
- research-articleNovember 2016
A multi-level sketch-based interface for decorative pattern exploration
SA '16: SIGGRAPH ASIA 2016 Technical BriefsArticle No.: 26, Pages 1–4https://doi.org/10.1145/3005358.3005362Despite the extensive usage of decorative patterns in art and design, there is a lack of intuitive ways to find a certain type of patterns. In this paper, we present a multi-level sketch-based interface that incorporates low-level geometrical features ...
- research-articleOctober 2016
Academic Coupled Dictionary Learning for Sketch-based Image Retrieval
MM '16: Proceedings of the 24th ACM international conference on MultimediaPages 1326–1335https://doi.org/10.1145/2964284.2964329In the last few years, the query-by-visual-example paradigm gained popularity, specially for content based retrieval systems. As sketches represent a natural way of expressing a synthetic query, recent research efforts focused on developing algorithmic ...
- research-articleJuly 2016
The sketchy database: learning to retrieve badly drawn bunnies
ACM Transactions on Graphics (TOG), Volume 35, Issue 4Article No.: 119, Pages 1–12https://doi.org/10.1145/2897824.2925954We present the Sketchy database, the first large-scale collection of sketch-photo pairs. We ask crowd workers to sketch particular photographic objects sampled from 125 categories and acquire 75,471 sketches of 12,500 objects. The Sketchy database gives ...
- research-articleJune 2015
IdeaPanel: A Large Scale Interactive Sketch-based Image Search System
ICMR '15: Proceedings of the 5th ACM on International Conference on Multimedia RetrievalPages 667–668https://doi.org/10.1145/2671188.2749410In this work, we introduce the IdeaPanel system, an interactive sketch-based image search engine with millions of images. IdeaPanel enables users to sketch the target image in their minds and also supports tagging to describe their intentions. After a ...
- short-paperJune 2015
Sketch-based Image Retrieval via Shape Words
ICMR '15: Proceedings of the 5th ACM on International Conference on Multimedia RetrievalPages 571–574https://doi.org/10.1145/2671188.2749360The explosive growth of touch screens has provided a good platform for sketch-based image retrieval. However, most previous works focused on low level descriptors of shapes and sketches. In this paper, we try to step forward and propose to leverage ...