JP7292737B2 - Moving image display device, moving image display method and program - Google Patents

Description

The present invention relates to a moving image display device, a moving image display method, and a program.

2. Description of the Related Art A moving image reproduction control system is used that performs control related to moving image reproduction by operating a moving image display unit (see Patent Document 1).

JP 2019-179385 A

However, in the system described in Patent Literature 1, competition between playback control and interaction occurs when making moving images interactive.

SUMMARY OF THE INVENTION The present invention has been made in view of such a background, and an object of the present invention is to provide a technique for viewing interactive moving images.

The main invention of the present invention for solving the above problems is a moving image display device, comprising: a display unit for displaying a moving image; a moving image reproducing unit for reproducing a moving image transmitted from a server on the display unit;
The present invention is characterized by comprising an action processing section that executes different actions according to operation modes in response to an operation on the display section, and an input control that switches the operation modes.

Other problems disclosed by the present application and solutions thereof will be clarified by the section of the embodiment of the invention and the drawings.

According to the present invention, interactive moving images can be viewed.

1 is a diagram showing an overall configuration example of a moving image display system according to an embodiment of the present invention; FIG. 2 is a diagram showing a software configuration example of the moving image display device 1. FIG. 3 is a diagram showing a software configuration example of the server 2; FIG. 4A and 4B are diagrams for explaining the operation of the moving image display device 1 of the present embodiment; FIG. FIG. 3 is a diagram showing an example of a screen 10 displaying moving images. FIG. 10 is a diagram showing an example of a screen 10 when a moving image 111 is being reproduced; FIG. 10 is a diagram illustrating a case where a tag is selected during playback of a moving image; FIG. FIG. 10 is a diagram illustrating a case where a controller is displayed during video playback; 3 is a diagram showing a hardware configuration example of a computer that implements the video display device and the server 2; FIG.

<Overview of the invention>
The contents of the embodiments of the present invention are listed and explained. The present invention has, for example, the following configurations.
[Item 1]
a display for displaying moving images;
a moving image reproducing unit that reproduces a moving image transmitted from a server on the display unit;
an action processing unit that executes different actions according to operation modes in response to an operation on the display unit;
an input control for switching between the operating modes;
A moving image display device comprising:
[Item 2]
The moving image display device according to item 1,
The action processing unit
In the first operation mode, an image different from the moving image is displayed on the display unit,
In the second operation mode, performing an operation related to playback of the moving image;
A moving image display device characterized by:
[Item 3]
The moving image display device according to item 2,
The moving image reproducing unit receives the first and second moving images from the server,
In the first operation mode, the action processing unit switches between the first or second moving image and causes the display unit to output the moving image in response to the operation;
A moving image display device characterized by:
[Item 4]
The moving image display device according to item 2,
In the first operation mode, the action processing unit displays information about the moving image according to a position where the operation is performed on the display unit;
A moving image display device characterized by:
[Item 5]
the computer
displaying on the screen a display for displaying a moving image and an input control for switching between operating modes;
a step of playing a moving image transmitted from a server on the display unit;
performing different actions depending on the operating mode in response to an operation on the display;
A video display method that performs
[Item 6]
to the computer,
displaying on the screen a display for displaying a moving image and an input control for switching between operating modes;
a step of playing a moving image transmitted from a server on the display unit;
performing different actions depending on the operating mode in response to an operation on the display;
program to run the

<System Overview>
FIG. 1 is a diagram showing an example of the overall configuration of a moving image display system according to one embodiment of the present invention. The moving image display system of this embodiment includes a moving image display device 1 . The moving image display device 1 is communicably connected to the server 2 via the communication network 3 . The communication network 3 is, for example, the Internet, and is constructed by a public telephone line network, a mobile telephone line network, a wireless communication path, Ethernet (registered trademark), or the like.

The moving image display system of this embodiment displays a moving image distributed from a server 2 on a moving image display device 1 . In the moving image display device 1 of this embodiment, when viewing a moving image, the user:
It is possible to perform operations related to video playback (hereinafter referred to as playback operations, including operations for playing, stopping, fast-forwarding, rewinding, changing the playback position (seek), etc.). related information (hereinafter referred to as related information) operation (hereinafter referred to as tag operation), and videos downloaded in sync with the displayed video (first video) (second
video) (hereinafter referred to as a switching operation).

The server 2 is a computer that distributes moving images. The server 2 may be a general-purpose computer such as a workstation or personal computer, or may be logically implemented by cloud computing.

The moving image display device 1 is a computer of a viewer (user) who views moving images distributed by the server 2, and is, for example, a smart phone, a tablet computer, a personal computer, or the like. The moving image display device 1 receives and displays moving images distributed from the server 2, and accepts various operations by the viewer.

<Moving image display device 1>
FIG. 2 is a diagram showing a software configuration example of the video display device 1. As shown in FIG. The moving image display device 1 includes a screen display unit 111 , a moving image reproducing unit 112 and an action processing unit 113 .

The screen display unit 111 creates a screen for displaying moving images (moving image display screen). The moving image display screen includes a moving image display portion, controls for playback operations, and controls for at least one of tag operations and switching operations. Controls are input components such as buttons, switches, sliders, dials, radio buttons, check boxes, pull-downs, list boxes, and the like.

The moving image reproduction unit 112 creates moving images distributed by the server 2 . The moving picture reproducing unit 112 can sequentially download moving picture data from the server 2, decode chunks of the downloaded moving picture data to generate a moving picture, and display the generated moving picture in the moving picture display part of the moving picture display screen. .

The action processing unit 113 performs various actions according to the operation on the moving image display unit. Actions include playback processing according to playback operations (play, stop, fast forward, rewind, change playback position (seek), etc.), display of related information according to tag operations, and video playback according to switching operations. This includes switching between moving images to be displayed on the display unit. In this embodiment, the action processing unit 113 changes the action to be performed according to the action mode.

<Server 2>
FIG. 3 is a diagram showing a software configuration example of the server 2. As shown in FIG. The server 2 includes a video distribution unit 21
1, includes a related information transmission unit 212 , a moving image storage unit 231 , and a related information storage unit 232 .

The moving image storage unit 231 stores moving images. The moving image storage unit 231 stores a moving image ID for specifying a moving image.
And it is possible to store moving image data for reproducing the moving image in association with the user ID that identifies the user. The user ID is information for identifying the user who registered the moving image data. The moving image data can be data encoded in any format such as MPEG, FLY, or QuickTime. The file ID can be, for example, the file name. The video storage unit 231 can also store control information for each video. The control information can specify, for example, an action to be taken when the video is clicked or tapped. Control information can contain information necessary for an action. For example, if the action is to display related information, the tag information including the related information ID that specifies the related information to be displayed when the position on the video image where the tag is to be placed and the tag information is specified is included in the control information. can be included in A plurality of tag information can also be included in the control information. Also, for example, if the action is to switch videos, it is possible to include a video ID that specifies the video to be switched.

The related information storage unit 232 stores related information. Related information storage unit 232 stores related information I
D, and stores the video ID and related information. Related information can be, for example, information related to products or services shown in the video. The related information may be, for example, text data, text formatted by HTML or rich text, image data, or a URL for accessing the content.
L may be used.

The moving image distribution unit 211 distributes moving images. For example, the moving image distribution unit 211 can read out the moving image corresponding to the moving image ID included in the request from the moving image storage unit 231 and respond. The moving image distribution unit 211 may present a list of moving images prior to the request. The moving image distribution unit 211 can transmit moving images by, for example, a streaming method. Note that the moving image distribution unit 211 can distribute moving images by a general method. The moving picture distribution unit 211 also transmits control information corresponding to the moving picture together with the moving picture or prior to distributing the moving picture.

The related information transmission unit 212 transmits related information. The moving image distribution unit 211 can transmit related information in response to a request.

<Action>
FIG. 4 is a diagram for explaining the operation of the moving image display device 1 of this embodiment.

The moving image display device 1 sets the operation mode to "control mode" and starts processing (S300).
The screen display unit 111 creates a screen for displaying a moving image (S301). FIG. 5 is a diagram showing an example of a screen 10 displaying moving images. The screen 10 is provided with a moving image display section 11 .
A moving image 111 is reproduced on the display unit 11 . When the screen 10 is first created, it is in a control mode for performing a moving image reproduction operation.

The moving image reproduction unit 112 starts receiving moving images (S302). The moving image reproducing unit 112 can, for example, transmit a request designating a moving image ID indicating a moving image to be reproduced to the server 2 and sequentially receive moving image data transmitted from the server 2 .

When an operation is performed on the screen 10 (this embodiment assumes a selection operation by clicking, tapping, etc.) (S303: YES), the action processing unit 113 executes an action corresponding to the operation mode. .

When the operation mode is the "control mode" (S304: control mode), the action processing unit 113 can perform various controls on the moving image 111 (S305).

The action processing unit 113 controls, for example, setting the parameters of the moving image 111, setting the position of the tag on the moving image 111, setting the action when the tag is selected,
It is possible to play or stop the moving image 111, designate a switching moving image, and the like. As shown in FIG. 5, the display unit 11 initially displays a mark 131 indicating that the reproduction of the moving image 111 can be started. In this state, when an arbitrary location on the display unit 11 is selected, the action processing unit 113 reproduces the received moving image. Note that on the screen 10 , the seek bar 132 is also superimposed on the moving image 111 and displayed on the display unit 11 . The seek bar 132 can be used to designate the playback position of the moving image 111 . bar 13
21 indicates a reproduced time range. The seek bar 132 may display the portion of the video 111 that has been downloaded from the server 1 . When the playback time is designated using the seek bar 132 , the action processing unit 113 can perform control to change the playback position of the moving image 111 .

When the control by the action processing unit 113 is to reproduce the moving image (S306), the screen display unit 111 hides the controller (S307) and sets the operation mode to "reproduction mode" (S308).

When the operation mode is "reproduction mode" (S304: reproduction mode), when a tag on the moving image is selected (S309: YES), the action processing unit 113 can display related information on the display unit 11. (S310). FIG. 6 is a diagram showing an example of the screen 10 when the moving image 111 is being reproduced. When a tag is set during playback of the moving image 111 , the screen display unit 111 (or moving image playback unit 112 ) can superimpose a tag icon 133 indicating the tag on the moving image 111 . The screen 10 also has a button 14 for switching to the control mode. When the tag icon 133 is pressed during playback of the video 111,
The action processing unit 113 can display related information according to the tag. For example, the action processing unit 113 transmits a request in which the related information ID included in the control information is set to the server 2, receives related information responded from the server 2 in response to the request,
Relevant information received can be displayed. Here, the action processing unit 113 can cause the motion reproducing unit 112 to stop the moving image. When the control information includes a plurality of pieces of tag information, the action processing section 113 can select the related information ID included in the tag information corresponding to the position of the pressed tag icon 133 . FIG. 7 is a diagram illustrating a case where a tag is selected during playback of a moving image. When the tag icon 133 superimposed on the video 111 on the display unit 11 on the screen 10 is selected by the user's finger 12 or the like, the related information 112 is displayed on the display unit 11 . In the example of FIG. 7, a tag is placed on the baby in the baby scene, and when this tag is selected, it is possible to display related information about the diaper worn by the baby. For example, the action processing unit 113 transmits a request in which the related information ID included in the control information is set to the server 2, receives related information responded from the server 2 in response to the request, and converts the received related information into can be displayed. Here, the action processing unit 113 can cause the motion reproducing unit 112 to stop the moving image.

When the operation mode is "reproduction mode" (S304: reproduction mode), the operation on the display unit 11 from the user is not the selection of a tag (S309: NO), but the selection of the button 14 instructing the controller display is accepted. If so (S311: YES), the action processing unit 113 displays a controller for controlling the moving image 111 (S312), and sets the operation mode to "control mode" (S313). FIG. 8 is a diagram for explaining a case where the control controller is displayed during video playback. In the example of FIG.
When button 14 is selected by, for example, tapping screen 10 with finger 12 while 11 is being displayed, control mode is entered, and action processing unit 113 can stop moving image 111. A mark 134 indicating that it is possible is displayed, and a seek bar 132 is displayed. The process returns to step S302, and in this control mode, the user can stop the moving image 111 by selecting the mark 134, or change the playback position by operating the seek bar 132. FIG.

When the operation mode is the "reproduction mode" (S304: reproduction mode), the operation on the display unit 11 from the user is not the selection of a tag (S309: NO), and the selection of the button 14 instructing the controller display is accepted. If within (S311: NO), moving image 11
1 is continued (S314), the process returns to step S302, and the process corresponding to the operation is performed.

As described above, it is possible to change the control during reproduction of moving images according to the operation mode. Today, it is common to tap (or click) the video 111 itself in the user interface or user experience (UI/UX) for the display unit 11 of the video 111 to play or stop the video. , tags, etc., where user interaction with the video 111 is set, control actions related to the playback of the video 111 and actions related to the interaction are mixed. According to the moving image display system of the embodiment, it is possible to control moving images as intended by the user.

<Hardware>
FIG. 9 is a diagram showing a hardware configuration example of a computer that implements the moving image display device and the server 2. As shown in FIG. The computer includes a CPU 01 , memory 102 , storage device 103 , communication interface 104 , input device 105 and output device 106 . The storage device 103 is, for example, a hard disk drive, solid state drive, flash memory, etc., which stores various data and programs. The communication interface 104 connects to the communication network 3
For example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to the public telephone network, a wireless communication device for wireless communication, and a USB for serial communication ( Universal Serial Bus) connector, RS232C connector, and the like. The input device 105 is, for example, a keyboard, mouse, touch panel, button, microphone, etc. for inputting data. The output device 106 is, for example, a display, printer, speaker, or the like that outputs data. The screen display unit 111, the video playback unit 112, and the action processing unit 113 provided in the video display device 1, and the video distribution unit 211 and the related information transmission unit 212 provided in the server 2 are stored in the storage device 103 by the CPU 101. The server 2 is realized by reading the program into the memory 102 and executing it.
The moving image storage unit 231 and the related information storage unit 232 provided in the memory 102 and the storage device 10
3 can be implemented as part of the storage area provided by .

Although the present embodiment has been described above, the above-described embodiment is intended to facilitate understanding of the present invention, and is not intended to limit and interpret the present invention. The present invention can be modified and improved without departing from its spirit, and the present invention also includes equivalents thereof.

For example, in the present embodiment, the moving image display device 1 and the server 2 are one computer, but the functional units and/or storage units may be distributed among a plurality of computers.

In addition, in the present embodiment, the moving image is provided from the server 2 by streaming, but the present invention is not limited to this. A moving image stored in the moving image display device 1 may be reproduced.

In the present embodiment, pressing the button 14 on the screen 10 is used as a trigger to shift to the control mode. Any event that can be acquired on the screen 10, such as a pattern due to movement of a mouse or a touched finger on the unit 11, a key input from a keyboard, or the like, may be used as a trigger.

Further, in the present embodiment, it is assumed that tags are arranged on the display section 11 of the screen 10 and an action is performed according to the selection of the tags. Alternatively, a plurality of moving images may be received in parallel, and the moving images displayed on the display unit 11 may be switched according to the user's operation (for example, touching or clicking the display unit 11 for a short period of time less than several seconds). good. In this case, a plurality of moving images can be periodically synchronized.

Further, in the present embodiment, the tag is superimposed on the video 111 as the tag icon 133, but the position (or area) of the tag is set without displaying the tag icon 133, and the position (or area) of the tag is set. An action may be executed by using an operation such as a click or a tap as a trigger. Also, by setting the transparency to the tag icon 133,
The moving image 111 may be transparently displayed.

1 moving image display device 2 server 3 communication network 10 screen 11 display unit 14 button 111 screen display unit 112 moving image reproducing unit 113 action processing unit 211 moving image distribution unit 212 related information transmission unit 231 moving image storage unit 232 related information storage unit

Claims (3)

a display unit, which is an area in the screen for displaying moving images;
A button for switching an operation mode provided on the screen ; and
A control controller used for operations related to reproduction of the moving image, which is hidden in the first operation mode and superimposed on the display unit in the second operation mode;
a user interface having
a moving image reproducing unit that reproduces one of the first and second moving images transmitted from the server on the display unit;
an action processing unit ;
with
The action processing unit
In the first operation mode, information about the moving image is displayed according to the position of the display unit pressed down on the display unit, or the moving image and the moving image are displayed on the display unit in response to pressing of the display unit. shows a different image and
A motion picture display device, wherein in the second operation mode, an operation related to reproduction of the motion picture is performed in response to pressing of the controller. the computer
a display unit that is an area in a screen for displaying a moving image, a button that is provided on the screen for switching operation modes, and a display unit that is hidden in the first operation mode and on the display unit in the second operation mode a step of displaying on a screen a user interface having a control controller used for operations related to reproduction of the moving image, superimposed on the screen;
playing back one of the first and second moving images transmitted from the server on the display unit;
In the first operation mode, information about the moving image is displayed according to the position of the display unit pressed down on the display unit, or the moving image and the moving image are displayed on the display unit in response to pressing of the display unit. displaying a different image ; and
a step of performing an operation related to reproduction of the moving image in response to pressing of the controller in the second operation mode;
A video display method that performs to the computer,
a display unit that is an area in a screen for displaying a moving image, a button that is provided on the screen for switching operation modes, and a display unit that is hidden in the first operation mode and on the display unit in the second operation mode a step of displaying on a screen a user interface having a control controller used for operations related to reproduction of the moving image, superimposed on the screen;
playing back one of the first and second moving images transmitted from the server on the display unit;
In the first operation mode, information about the moving image is displayed according to the position of the display unit pressed down on the display unit, or the moving image and the moving image are displayed on the display unit in response to pressing of the display unit. displaying a different image; and
a step of performing an operation related to reproduction of the moving image in response to pressing of the controller in the second operation mode;
program to run the

Images