VideoDiscovery: An Automatic Short-Video Generation System for E-commerce Live-streaming

We demonstrate an end-to-end intelligent system of short-video generation for live-streaming, namely "VideoDiscovery'', which aims to automatically produce batches of high-value short-videos by discovering and organizing highlight content for commodity delivery. Traditionally, production of high-value short-videos for live-streaming is cost-expensive and time-consuming, which also demands experienced editing skills. To this end, we construct this system with three modules: 1)Semantic segment structuring first decodes live-streaming into a series of semantic candidates including commodity, Q&A, action, multi-modal, etc. 2)Hierarchical search engine performs automatically searches for semantically matching candidate shots from scripts. 3)Script-aware shot assembly is formulated combination problem over a graph of shots, considering temporal constraints and candidate idioms. Specifically, given an input live-streaming, the recommended video results illustrate diverse visual-semantic content, and follow script guidelines. Currently, our system has been launched online for Taobao stores, which enables to generate appealing videos in minutes for advertising and recommendation. The entry of our system is available at https://discovery.aliyun.com/index.