KR20030094584A - System and method for video based interactive interface - Google Patents

Abstract

PURPOSE: A system and a method of a moving image based interactive interface are provided to enable a user to see a moving image with more fun and diverse effects, and to enable an information provider to get diverse feedback of the user while playing the moving image by realizing an interaction between the moving image and the user. CONSTITUTION: A user system(103) is a PC, a PDA(Personal Digital Assistant), a cellular phone, and a TV equipped with a set-top box. The user system includes a play tool playing the moving image, an interaction processing tool processing the interaction with the user by synchronizing with the moving image, and a value added information providing tool offering the value added information to the user as a result of the interaction. A server system offering the information includes a moving image server(100) offering the moving image, a web server(101) operating a web page related to the moving image, and a server(102) storing an interaction command.

Description

Video based interactive interface system and method thereof {SYSTEM AND METHOD FOR VIDEO BASED INTERACTIVE INTERFACE}

The present invention relates to a method for implementing an interactive interface synchronized in time and space with a video played on a computer. Existing video playback is simply operated by unilaterally playing the video requested by the user via wired or wireless. For example, if a user selects a desired video in an internet broadcast, the video is transmitted to the user and played back in the same manner as the streaming of the internet. Users can only play, stop, and pause the video, and they can't have time-based or spatially interactive interactions based on the video being played, so there is no way for an information provider to get user feedback while playing a video. In addition, there is a structural problem that the user can not only see the one-way video playback from the information provider.

As described above, the information provider unilaterally transmits the video content to the user, the information provider is difficult to obtain the user's feedback during the video playback, the user is difficult to obtain additional information about the video immediately . For example, it is difficult for an information provider to implement a system by linking a user's taste analysis, such as a survey about a video, directly to the video. There is the inconvenience of looking for information. Therefore, in order to solve this structural problem, in the present invention, a tool tip, a video, and a web, which can explain in detail the agent and the video content, which are the cyber characters synchronized with the video for the user interface, to the video played based on the Internet web browser. The purpose of this is to provide various information processing methods such as scripts, HTML, etc. between the browsers, and to provide additional information and interaction with the users.In addition to providing one-sided information in the existing video playback system, users and videos To implement a highly functional content providing system that can be interactively interacted with each other.

1 is a system configuration diagram

2 is a structural diagram of an interaction command

3 is an operation flowchart of an interaction command

<Description of the symbols for the main parts of the drawings>

100: video server 101: web server

102: interactive command server 103: user system

200: event occurrence time of the interaction command

201: types of interactive commands 202: effects of interactive commands

301: Random frames in the video

302: Examine the effect or additional information present in the frame

According to one aspect of the video-based interactive interface system and method for achieving the above object, the execution system used by the user is a device similar to a TV equipped with a PC, PDA, mobile phone, set-top box, and the video Reproducing means capable of reproducing; Interaction processing means for processing the interaction with the user synchronized with the reproduced video, and additional information providing means for providing additional information to the user as a result of the interaction processing.

The server system that provides the information includes a video server that provides a video according to a user's request, a web server that operates web pages such as e-commerce, internet advertising, and surveys related to the video. Server is included. These servers can be installed on a single system, distributed across multiple systems, and are connected via wired or wireless Internet between servers and user-run systems.

In order to show various effects to a user while playing a video through an interactive interface, there is a need for a method of describing effects generated by linking various events to be generated to a video according to the time of occurrence. Such events and effects are described as interactive commands, and it is also possible to describe interactive commands in Jscript, VBScript, JavaScript, and the like, which are frequently used for web page control.

In the interaction processing means and the additional information providing means, the interactive command generated by the content producer is downloaded from the server, processed in synchronization with the video, and the additional information is provided according to the interaction with the user.

The user can see the additional effect of responding to the user's interaction according to the interaction command while watching the video being played, and the interaction can be linked to additional web services such as e-commerce, internet advertisement, and survey.

The possible interactions between the video and the user can be various tools depending on the user platform used, as listed in Table 1.

User interaction tool according to the type of video playback system Video playback system Interaction tools Computer systems Mouse, Keyboard, Touch Screen, Joystick, User Voice Input Personal mobile terminal Stylus pen, function button on the terminal, user voice input cellphone User voice input, buttons on the phone television Television remote control

Using the interaction tools described in Table 1, the user can watch the video and raise events for the interaction. Table 2 shows an event occurrence time at a specific time or a specific area of the video.

When the event is fired by the user's interaction tool Interaction Means and Tools When the event occurred Play video After a certain time has passed since the video was played Pointing device (mouse, touch screen, stylus pen) When a pointing device enters a specific area When clicking a specific area with the pointing device When double-clicking a specific area with the pointing device keyboard When entering text with the keyboard Joystick When moving the joystick lever When pressing the joystick button User voice input When speaking voice Function buttons installed on the personal mobile device Press the function button attached to the personal mobile device Buttons on your phone Press the button on your phone Television remote control Press the button on the television remote control

Effects generated in association with the video being played are expressed in various effects described in Table 3, and these effects are performed according to the interaction command by the events generated by Table 2.

Effects of interactions that occur in conjunction with video Behavior control such as position movement, state change, animation, speaking of agent which is cyber character in user system Display tooltip box for user interface in user system The shape or color of the pointing cursor changes Characters or graphics appear superimposed on the video at specific points in the video Display specific areas of the video while tracking text or pictures Change the appearance of the video being played The video's playback status changes to pause, play, or stop Some changes in the web page where the video is played Display a new web page by changing the URL of the web page Execute independent scripts written in Jscript, JavaScript, VBScript or scripts in web pages Overlapping the video shows the content of the webpage

Hereinafter, an embodiment of a video-based interactive interface system and method according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a view schematically showing a video-based interactive interface system according to the present invention. As shown in FIG. 1, the video is stored in the video server 100, the web content associated with the video is stored in the web server 101, and the interaction describing the interaction with the user and the effect of the interaction. Action commands are stored in a server 102 that stores interaction commands. These servers can be integrated into a single computer system or distributed as shown. In the user system 103, while viewing a video in a web page, an effect that is additionally displayed on the video or web page according to user interaction such as a mouse click can be seen.

Figure 2 shows the structure of the interactive command used in the video-based interactive interface system according to the present invention. As shown in FIG. 2, one interactive command is composed of three parts: the time at which the interactive command starts, the type of user interaction, and the effect to be displayed when the user interacts. It consists of the above. At the time 200 at which the interactive command starts, the time at which the interactive command operates is recorded, and the interactive command becomes valid during this time. The event occurrence type 201 of user interaction describes the type of time at which an event by interaction occurs, as described in Table 2 above. The effect 202 to be shown when the user interacts may be described as shown in Table 3 above as an effect to be shown when the user interaction is operated.

3 shows an operation sequence of an interaction command used in the video-based interactive interface system according to the present invention. As shown in FIG. 3, the interaction command is examined for every frame of the video to output the effect of the interaction command.

As shown in FIG. 3, when one frame of the video becomes an input 301, the interactive command is examined to determine whether there is an interactive command that may appear without user interaction in the current video frame (302). . If there is a suitable command, the additional effect corresponding to the interactive command is performed (303). The next step is to check whether there is an interactive command according to the user's interaction in the current video frame (304), and if a suitable interaction corresponding to the interactive command has occurred (305), the addition corresponding to the interactive command Perform the effect (306). After checking the interaction command with respect to one video frame, one video frame is output to the screen, and all of the performed additional effects are output to the screen (307).

Unlike the existing system that simply plays a video through the Internet and shows it to the user, the present invention enables various forms of interaction between the playback of the video and the user so that the information provider acquires various feedbacks of the user while playing the video. At the same time, users can watch videos with more fun and a variety of effects, enabling high value-added video-based multimedia directly linked to video-based value-added services in applications such as e-commerce, customer care, internet surveys, and Internet advertising. Services and web services are possible.

Claims (2)

In the system that provides the video service based on the wired / wireless internet Authoring interactive commands for interacting with the user in the video, Sending an interactive command with the video, Process user interactions while playing a video to express additional effects, Video-based interactive interface system and method comprising the step of receiving the feedback information of the user while playing the video and transmitting to the server The method of claim 1 In the step of expressing the additional effects according to the user's interaction while playing the video, controlling the operations such as the position movement, state change, animation, and speech of the agent, which is a cyber character in the user system, Displaying a tooltip box for the user interface in the user system, Changing the shape or color of the pointing cursor, Displaying text or graphics overlaid on the video at a specific point in the video, Marking specific areas with text or pictures for each frame of your video, Changing the appearance of the screen of the video being played, Changing the playback state of a video to pause, play, or stop, Changing some of the content in the web page where the video is playing, Displaying a new web page by changing the URL of the web page, Executing the script in an independent script or web page written in Jscript, JavaScript, VBScript, Displaying the video overlaid on top of the web page, Video-based interactive interface system and method comprising the step of performing a script defined by the user