short-paper

AliMe MKG: A Multi-modal Knowledge Graph for Live-streaming E-commerce

Authors:

Fu Sun,

Ji ZhangAuthors Info & Claims

CIKM '21: Proceedings of the 30th ACM International Conference on Information & Knowledge Management

Pages 4808 - 4812

https://doi.org/10.1145/3459637.3481983

Published: 30 October 2021 Publication History

Get Access

Abstract

Live streaming is becoming an increasingly popular trend of sales in E-commerce. The core of live-streaming sales is to encourage customers to purchase in an online broadcasting room. To enable customers to better understand a product without jumping out, we propose AliMe MKG, a multi-modal knowledge graph that aims at providing a cognitive profile for products, through which customers are able to seek information about and understand a product. Based on the MKG, we build an online live assistant that highlights product search, product exhibition and question answering, allowing customers to skim over item list, view item details, and ask item-related questions. Our system has been launched online in the Taobao app, and currently serves hundreds of thousands of customers per day.

Supplementary Material

MP4 File (CIKM21-de3101.mp4)

Presentation video - AliMe MKG

Download
74.35 MB

References

[1]

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).

Google Scholar

[2]

Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020).

Google Scholar

[3]

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27-30, 2016. IEEE Computer Society, 770--778. https://doi.org/10.1109/CVPR.2016.90

Crossref

Google Scholar

[4]

Zhicheng Huang, Zhaoyang Zeng, Bei Liu, Dongmei Fu, and Jianlong Fu. 2020. Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers. CoRR, Vol. abs/2004.00849 (2020). arxiv: 2004.00849 https://arxiv.org/abs/2004.00849

Google Scholar

[5]

Feng-Lin Li, Hehong Chen, Guohai Xu, Tian Qiu, Feng Ji, Ji Zhang, and Haiqing Chen. 2020 a. AliMe KG: Domain Knowledge Graph Construction and Application in E-commerce. CoRR, Vol. abs/2009.11684 (2020). arxiv: 2009.11684 https://arxiv.org/abs/2009.11684

Digital Library

Google Scholar

[6]

Xiaonan Li, Hang Yan, Xipeng Qiu, and Xuanjing Huang. 2020 b. FLAT: Chinese NER Using Flat-Lattice Transformer. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online, July 5-10, 2020, Dan Jurafsky, Joyce Chai, Natalie Schluter, and Joel R. Tetreault (Eds.). Association for Computational Linguistics, 6836--6842. https://doi.org/10.18653/v1/2020.acl-main.611

Crossref

Google Scholar

[7]

Siqi Sun, Yen-Chun Chen, Linjie Li, Shuohang Wang, Yuwei Fang, and Jingjing Liu. 2021. LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 982--997.

Crossref

Google Scholar

[8]

Wei Wang, Bin Bi, Ming Yan, Chen Wu, Jiangnan Xia, Zuyi Bao, Liwei Peng, and Luo Si. 2020. StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net. https://openreview.net/forum?id=BJgQ4lSFPH

Google Scholar

Cited By

View all

Su TSheng JWang SZhang XXu HLiu TCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)IBMEA: Exploring Variational Information Bottleneck for Multi-modal Entity AlignmentProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680954(4436-4445)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3680954
Liang WMeo PTang YZhu J(2024)A Survey of Multi-modal Knowledge Graphs: Technologies and TrendsACM Computing Surveys10.1145/365657956:11(1-41)Online publication date: 28-Jun-2024
https://dl.acm.org/doi/10.1145/3656579
Xu SWang JWang XShou WNgo T(2024)Defect modelling and correlation mapping for bridge inspectionEngineering, Construction and Architectural Management10.1108/ECAM-10-2023-1013Online publication date: 16-Apr-2024
https://doi.org/10.1108/ECAM-10-2023-1013
Show More Cited By

Index Terms

AliMe MKG: A Multi-modal Knowledge Graph for Live-streaming E-commerce
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Matching
    2. Natural language processing
      1. Information extraction
2. Information systems
  1. Data management systems
    1. Database design and models
      1. Graph-based database models

Recommendations

AliMe Avatar: Multi-modal Content Production and Presentation for Live-streaming E-commerce
SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

We present AliMe Avatar, a Vtuber designed for live-streaming sales in the E-commerce field. To support the emerging live shopping mode, the core of our digitial avatar is to enable customers to understand products and encourage customers to purchase in ...
The Influence of Product Information Display on Purchase Intention
ICEBI '21: Proceedings of the 2021 5th International Conference on E-Business and Internet

E-commerce has grown rapidly due to the impact of the Covid-19. After combing theoretical studies, it was found that some scholars have verified the effects of the product information display on consumers' purchase intention. The mainly product ...
Impact of Live Streamer Characteristics and Customer Response on Live-streaming Performance: Empirical Evidence from e-Commerce Platform
Abstract
As an emerging form of marketing, live streaming has a positive effect on the ability of e-Commerce platforms to attract traffic and increase sales. It has become another important competitive area in the industry. Based on an alternative learning ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CIKM '21: Proceedings of the 30th ACM International Conference on Information & Knowledge Management

October 2021

4966 pages

ISBN:9781450384469

DOI:10.1145/3459637

General Chairs:
Gianluca Demartini
The University of Queensland, Australia
,
Guido Zuccon
The University of Queensland, Australia
,
Program Chairs:
J. Shane Culpepper
RMIT University, Australia
,
Zi Huang
The University of Queensland, Australia
,
Hanghang Tong
University of Illinois at Urbana-Champaign, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 October 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

CIKM '21

Sponsor:

CIKM '21: The 30th ACM International Conference on Information and Knowledge Management

November 1 - 5, 2021

Queensland, Virtual Event, Australia

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
412
Total Downloads

Downloads (Last 12 months)49
Downloads (Last 6 weeks)5

Reflects downloads up to 22 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Su TSheng JWang SZhang XXu HLiu TCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)IBMEA: Exploring Variational Information Bottleneck for Multi-modal Entity AlignmentProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680954(4436-4445)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3680954
Liang WMeo PTang YZhu J(2024)A Survey of Multi-modal Knowledge Graphs: Technologies and TrendsACM Computing Surveys10.1145/365657956:11(1-41)Online publication date: 28-Jun-2024
https://dl.acm.org/doi/10.1145/3656579
Xu SWang JWang XShou WNgo T(2024)Defect modelling and correlation mapping for bridge inspectionEngineering, Construction and Architectural Management10.1108/ECAM-10-2023-1013Online publication date: 16-Apr-2024
https://doi.org/10.1108/ECAM-10-2023-1013
Li QLi JWu JPeng XJi CPeng HWang LYu P(2024)Triplet-aware graph neural networks for factorized multi-modal knowledge graph entity alignmentNeural Networks10.1016/j.neunet.2024.106479179:COnline publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1016/j.neunet.2024.106479
Chen YGe XYang SHu LLi JZhang J(2023)A Survey on Multimodal Knowledge Graphs: Construction, Completion and ApplicationsMathematics10.3390/math1108181511:8(1815)Online publication date: 11-Apr-2023
https://doi.org/10.3390/math11081815
Li QGuo SLuo YJi CWang LSheng JLi J(2023)Attribute-Consistent Knowledge Graph Representation Learning for Multi-Modal Entity AlignmentProceedings of the ACM Web Conference 202310.1145/3543507.3583328(2499-2508)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3543507.3583328
Deng SWang CLi ZZhang NDai ZChen HXiong FYan MChen QChen MChen JPan JHooi BChen H(2023)Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graph2023 IEEE 39th International Conference on Data Engineering (ICDE)10.1109/ICDE55515.2023.00229(2988-3002)Online publication date: Apr-2023
https://doi.org/10.1109/ICDE55515.2023.00229
Zhang PGao SShen YYang SSun L(2023)SG-RC: SG-CIM Grid Knowledge Graph Relationship Complementation Model Based on Entropy Uncertainty and Semantic Recognition2023 IEEE 9th Intl Conference on Big Data Security on Cloud (BigDataSecurity), IEEE Intl Conference on High Performance and Smart Computing, (HPSC) and IEEE Intl Conference on Intelligent Data and Security (IDS)10.1109/BigDataSecurity-HPSC-IDS58521.2023.00040(181-186)Online publication date: May-2023
https://doi.org/10.1109/BigDataSecurity-HPSC-IDS58521.2023.00040
Wang NYilahun HHamdulla AQiu Z(2023)How to Define a Multi-modal Knowledge Graph?Computer Applications10.1007/978-981-99-8764-1_7(78-95)Online publication date: 14-Dec-2023
https://doi.org/10.1007/978-981-99-8764-1_7
Zhu XLi ZWang XJiang XSun PWang XXiao YYuan N(2022)Multi-Modal Knowledge Graph Construction and Application: A SurveyIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2022.3224228(1-20)Online publication date: 2022
https://doi.org/10.1109/TKDE.2022.3224228

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

Supplementary Material

References

Cited By

Index Terms

Recommendations

AliMe Avatar: Multi-modal Content Production and Presentation for Live-streaming E-commerce

The Influence of Product Information Display on Purchase Intention

Impact of Live Streamer Characteristics and Customer Response on Live-streaming Performance: Empirical Evidence from e-Commerce Platform

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations