JP2005244605A - Streaming content distribution control system, program and recording medium storing the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To synchronize a content reproduction position between user terminals when a streaming content (video, voice and the like) is distributed to a plurality of the user terminals. <P>SOLUTION: A system is provided with: an audience managing part 32 having a function for managing a user; a reproduction position estimating part 33 receiving and managing reproduction position information on the streaming content from the user terminal 10 and estimating the content reproduction position in the user terminal at every user terminal 1; a reproduction position managing part 34 calculating time deviation of the content reproduction position among a plurality of the user terminals 10 viewing and listening the same content by using information from the audience managing part 32 and the reproduction position estimating part 33; and a reproduction position control indicating part 36 indicating control of the content reproduction position in the respective user terminals 10 to the user terminals 10 by using information from the audience managing part 32 and the reproduction position managing part 34. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a technology for distributing streaming content such as video and audio via a network using a server, and in particular, is used to control server client type and P2P (peer-to-peer) type streaming content distribution. The present invention also relates to a streaming content distribution control system that ensures that any streaming content is viewed at the same playback position among users at the same time by managing and controlling the streaming content playback position on each user terminal.

  With the spread of the Internet, streaming content distribution that distributes streaming content such as video and audio to each user's terminal via a network using the Internet protocol (IP) such as the Internet is actively performed. It has become. In the following description, “viewing” includes not only viewing a video with sound but also viewing a video without sound or listening to only sound.

  FIG. 7 shows a conventional system configuration when a streaming content distribution service is provided on the Internet.

  User terminals 10-1 and 10-2 are connected to the Internet 20 via, for example, an ISP (Internet Service Provider) or the like. The Internet 20 is configured by interconnecting a plurality of networks using a router or the like that is a network connection device. By using the Internet protocol, it is possible to perform communication between nodes connected to the Internet 20. It is. Further, a web server 50 is connected to the Internet 20 directly or indirectly through a router device, a switch device or the like. Similarly, a streaming server 40 for performing streaming distribution is connected to the Internet 20 directly or indirectly through a router device, a switch device, or the like. Although only a single web server 90 and a single streaming server 40 are shown in the figure, in reality, both the web server and the streaming server are distributed throughout the world. The streaming content in each streaming server is identified by a URL (Uniform Resource Locator) that is a character string for uniquely identifying a resource. The web server 50 generates and provides a user with a web page including a program guide showing contents that can be provided by each streaming server and links to the contents.

  The operation for streaming delivery will be described on the premise of such a network configuration. In the following description, when it is not necessary to distinguish between the user terminals 10-1 and 10-2, these are indicated by the user terminal 10.

  First, a user can specify a resource by acquiring a metafile including a URL for identifying a resource of streaming content to be viewed from the web server 50 or the like. The user transmits the request (request) message for the streaming content to the streaming server 40 by designating the acquired URL using the streaming content playback application operating on the user terminal 10. For example, RTSP (Real Time Streaming Protocol), which is a multimedia presentation control protocol, or HTTP (Hyper Text Transfer Protocol (Hyper Text), which is a protocol for transferring hypertext data, is used for the transmission of a request message. Transfer Protocol)) is used. The request message reaches the corresponding streaming server 40 that provides the streaming content via the Internet 20.

  The streaming server 40 communicates with the user terminal 10 in response to a request message from the user, performs a negotiation process for determining a transfer protocol and a distribution band used for the streaming distribution, and actually performs the streaming distribution. Start. When receiving data by streaming delivery, the streaming content playback application operating on the user terminal 10 performs streaming on the received data after performing a preset amount of buffering processing on the user terminal 10. Start playing content. Even after the reproduction of streaming content is started, the user terminal 10 and the streaming server 40 communicate with each other regarding the streaming distribution status and reception status, and the streaming server 40 uses the result obtained by the communication for retransmission control and distribution bit rate control. , Maintain viewing quality. In the user terminal 10, if the buffering capacity is insufficient due to the deterioration of the network condition while viewing the streaming content, the streaming of the streaming content is temporarily stopped and the buffering is performed until the buffering capacity exceeds a certain amount again. By reproducing the streaming content after processing, the quality of the reproduced video is prevented from being deteriorated.

  Here, in the conventional streaming distribution control system, the above-described metafile is created using a language capable of describing presentations regarding different media such as a plurality of streaming contents and image files. An example of such a language is SMIL (Synchronized Multimedia Integration Language). Then, by describing the playback timing of a plurality of streaming contents and media in the metafile and controlling the streaming contents and media to be displayed according to the timing in the streaming content playback application on the user terminal, between different media Synchronization is realized.

  However, in the conventional streaming distribution control system, when viewing the streaming content, a plurality of content playback timings are described in advance in a description language such as SMIL, and the streaming content playback application on the user terminal determines the content content according to the timing. Although synchronization between different media is realized by controlling the display etc., when multiple users think about it, video paused by rebuffering processing of streaming content playback application due to network quality degradation etc. As a result, it is not always possible for individual users to reproduce the content to be reproduced within the expected time, and the same reproduction position cannot be guaranteed between users. In realizing a service that allows multiple users to discuss while viewing the same streaming content, if the streaming content playback position shifts between users, the premise of the discussion is the user The discussion will not proceed normally due to differences between the two. Therefore, when distributing the same streaming content to a plurality of users, it is an important issue to realize synchronized playback control between users.

  An object of the present invention is to provide a streaming content distribution control system capable of dynamically managing and controlling the reproduction position of viewing content for each user in streaming content distribution and realizing streaming content synchronous reproduction control between users. Is to provide. Specifically, an object of the present invention is to estimate a playback position at an arbitrary time using information regarding viewing content and playback position periodically reported from a user terminal, and a user viewing the same content It is an object of the present invention to provide a streaming content distribution control system capable of managing a difference in content reproduction position (for example, a viewing scene shift) between terminals and dynamically controlling the synchronization.

  A streaming content distribution control system according to the present invention is a streaming content distribution control system that controls streaming content distribution to a user terminal via a network, and that manages a plurality of users who view the same streaming content. A management unit, and a reproduction position estimation unit that receives and manages the reproduction position information of the streaming content in the user terminal from each user terminal, and estimates the content reproduction position in the user terminal for each user terminal; Using the information from the viewer management unit and the playback position estimation unit, a time shift of content playback positions between a plurality of user terminals viewing the same streaming content is calculated, and playback is managed in time series Information from the location manager, viewer manager and playback location manager A playback position control instruction unit that instructs control of the content playback position at each user terminal to at least one or more user terminals attempting to view or viewing the same streaming content; Have

  In this streaming content distribution control system, it is preferable that a distribution management server connected to the network is provided, and a viewer management unit, a reproduction position estimation unit, a reproduction position management unit, and a reproduction position control instruction unit are provided in the distribution management server. In addition, the distribution management server is further notified to the at least one user terminal of the deviation of the content reproduction position between the user terminals by using information from the viewer management unit and the reproduction position management unit. A reproduction position notification unit can be provided. The user terminal includes at least one of streaming content reproduction means for reproducing the streaming content, reproduction position information indicating the reproduction position of the reproduced streaming content, information indicating the state of the streaming content reproduction means, and information indicating the time. A reproduction position measurement unit that periodically reports one or more to the reproduction position estimation unit, and a reproduction position control unit that controls the content reproduction position in the streaming content reproduction unit according to an instruction from the reproduction position control instruction unit It is preferable.

  In the present invention, regarding the problem that it is difficult for a plurality of users to reproduce the same content in synchronization in streaming content distribution, the state of the streaming content reproduction application (streaming content reproduction means) operating on the user terminal And by acquiring and managing the transition of the content reproduction position a plurality of times, it is possible to estimate and control the deviation of the content reproduction position between user terminals at an arbitrary time. This realizes synchronized playback of streaming content among a plurality of user terminals. In particular, in the above-described streaming content distribution control system, the reproduction position measurement unit periodically measures the transition of the content reproduction position and reports to the distribution management server at each user terminal that views the streaming content, so that the distribution management server Identifies the user terminal and manages a plurality of users viewing the same content. In addition, by managing the periodic reports from each user terminal in time series, it is possible to estimate the content playback position at an arbitrary time, and the content playback position of an arbitrary user terminal can be determined using the estimation. By controlling, it is possible to simultaneously play streaming content between a plurality of user terminals.

  In the present invention, the viewer management unit includes user identification information including one or more of an IP address of a user terminal, a user terminal name, HTTP cookie information, and an identification ID of a streaming content reproduction means, Using an identifier consisting of one or more information of a metafile acquired by the user, streaming content viewed on the user terminal, viewing start time, and URL of the web page accessed by the user terminal The user terminal and the streaming content being viewed can be identified, and the user terminals viewing the same streaming content can be identified and managed as the same group. With such a configuration, it becomes possible to realize grouping according to various policies such as for each streaming content for viewing each user terminal and for each viewing time.

  In the present invention, the playback position information includes at least one of a content playback position of streaming content played on the user terminal, and a playback delay indicating a difference between the elapsed time from the streaming viewing request time and the content playback position. More than one can be used. In the present invention, in the playback position measurement unit operating on each user terminal, the content playback position of the streaming content playback means is periodically acquired and the transition is measured or compared with the transition of time in the user terminal. Thus, the playback status of the streaming content playback means can be grasped in time series. Then, by reporting such playback position information to the playback position estimation unit, it is possible to grasp the playback status in a plurality of user terminals in real time. Although it is possible to improve the accuracy and real-time performance of reproduction position estimation by shortening the collection interval of content reproduction positions, the processing load increases depending on the reporting interval, which affects scalability. Therefore, when the content playback position is acquired by the playback position measurement unit, the state of the streaming content playback unit is simultaneously acquired and reported, and used for estimating the content playback position at an arbitrary time in the playback position estimation unit, It is possible to improve the estimation accuracy without increasing the processing load.

  In the present invention, it is possible to estimate the content playback position at an arbitrary time by collecting and managing the playback position information periodically reported from each user terminal. By grasping the transition of past playback position information, it is possible to estimate the content playback position at an arbitrary time from the tendency, and playback position management by considering the state of the playback application rather than increasing the number of collections It is possible to estimate the content reproduction position with less error. In addition, by enabling estimation at an arbitrary time, even when the content playback position reporting interval differs for each user terminal, the deviation between users at the content playback position at an arbitrary time is calculated. It becomes possible to do.

  In the present invention, by managing the viewer information and the playback status of each user terminal in real time, the streaming content playback position shift between a plurality of user terminals viewing the same streaming content can be reduced. It is possible to detect. Identifying a plurality of user terminals viewing the same content from the management information of the viewer management unit, and periodically obtaining and comparing the content playback position at the current time from the playback position estimation unit for the user terminal Thus, it is possible to grasp the transition of the deviation of the content reproduction position between the user terminals.

  In the present invention, for example, a control method of control at the start of viewing or control after start of viewing can be selected in order to correct the deviation of the content playback position between the user terminals and ensure synchronized playback. The user terminal can be notified based on the technique.

  Viewing start control is to ensure that the same streaming content has the same viewing start time among multiple user terminals. In this control, each use required for negotiation processing and buffering processing at the start of viewing is performed. The deviation of the content reproduction position depending on the connection environment of the user terminal and application settings is corrected. Specifically, by periodically acquiring the status of the streaming content playback means in each user terminal, the streaming content viewing start processing is grasped, and when the playback start is enabled, the streaming content playback means is set. The state is paused and the state is notified to the reproduction position control instruction unit via the reproduction position estimation unit. Playback position control instruction unit, all users in the same group can start playback, or all users after a certain time has passed since the first user started playback Notify the terminal of playback start instruction. As a result, simultaneous playback between a plurality of user terminals can be started.

  The control after the start of viewing is intended to eliminate the shift when the playback position shifts between the user terminals after the start of viewing the content. In this control, each user terminal after the start of viewing is controlled. It is possible to dynamically correct the shift of the content playback position depending on the change of the network status and the connection environment. Specifically, the content playback position can be controlled when the maximum content playback position deviation between user terminals exceeds a threshold or periodically, in which case the playback position management unit By periodically monitoring the information, it is possible to grasp the reproduction position deviation. When control is performed in response to a request from the user, the playback position information in the same group in the playback position management unit is notified to the user via the playback position notification unit, and the user determines the deviation of the playback position. Then, the control request may be made. For the control of the content playback position of each user terminal, a reference user terminal is selected, and for the user terminal whose content playback position is advanced from the reference user terminal, the streaming content for the preceding seconds Pause playback. In addition, for a user terminal whose content playback position is delayed, the user terminal is fast-forwarded as much as the playback of the streaming content is delayed, or reconnected to the streaming server for playback from the designated content playback position. In this way, simultaneous playback between a plurality of user terminals is possible. When reconnecting to a streaming server, it is possible to estimate the time required for reconnection by using the time required for connecting the user terminal held by the playback position estimation unit as the connection time. Thus, it is possible to improve the control accuracy of the content playback position.

  By using the present invention, for example, in an IP network (a network using IP such as the Internet), a configuration of a server for distributing streaming content, a multimedia control protocol and a transfer protocol used for streaming distribution, and each user terminal Regardless of the difference in streaming content playback application, it is possible to calculate the deviation of content playback position at any time between users by estimating and managing the content playback position of each user. It is possible to synchronize between the user terminals with respect to the playback position or automatically from the request. Therefore, according to the present invention, in a streaming content distribution service via an IP network or the like, the content reproduction position on the user terminal is estimated and controlled in real time without depending on a protocol related to streaming distribution. By doing so, it is possible to perform simultaneous playback control between users who view the same content. Therefore, the present invention can be applied as a control technique in a service in which synchronization between users is important, such as a communication service in which a video chat is performed while viewing streaming content, and the synchronization between users is important. I can expect.

  Next, a preferred embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 shows a configuration of a streaming content distribution control system according to the first embodiment of this invention.

  In this streaming content distribution control system, user terminals 10-1 and 10-2 are connected to the Internet 20 and a streaming server 40 is connected to the Internet 20, as shown in FIG. . The Internet 20 is configured by interconnecting one or more networks using IP (Internet Protocol). As the streaming server 40, the same server as that used in the conventional system shown in FIG. 7 can be used. Furthermore, in the streaming content distribution control system of the present embodiment, the distribution management server 30 for managing the streaming content viewer and managing the reproduction position of the streaming content at each user terminal and performing the reproduction position control is directly Alternatively, it is indirectly connected to the Internet 20 using a router device or a switch device. The distribution management server 30 also has a function as a web server for the program guide in the conventional distribution control system shown in FIG. 7, and grasps where each streaming content is stored (which streaming server is stored). In addition, the corresponding metafile is held. The distribution management server 30 has a web page describing the viewing start time and the viewing streaming content for each arbitrary group viewing the same streaming content.

  Hereinafter, details of the user terminal 10 and the distribution management server 30 in the present embodiment will be described.

  As shown in FIG. 2, the user terminal 10 is generally constituted by a computer such as a personal computer, and an operating system which is a base layer software for operating the user terminal 10 as the computer. A system (OS) 11, which operates on the operating system 11, plays streaming content received from the streaming server 40 via the Internet 20, and plays back reproduced audio and video with a speaker (not shown) attached to the user terminal 10. ) And a streaming content playback application 12 that is output from each display device, and a playback position measurement unit 13 and a playback position control unit 14 that operate on the operation system 11.

  The reproduction position measurement unit 13 periodically reports information related to the reproduction position of streaming content on the user terminal 10 to the distribution management server 30. Specifically, the reproduction position measurement unit 13 reproduces information on the user terminal 10. Information related to the content playback position indicating the playback frame number of the streaming content being streamed, information related to the status of the streaming content playback application such as during playback, pause, and buffering of the content, and information indicating the time when the information was acquired A function to periodically report to the distribution management server 30 at least one of them.

  The playback position control unit 14 has a function of controlling the content playback position in the streaming content playback application 12 based on an instruction from the distribution management server 30.

  As shown in FIG. 3, the distribution management server 30 is generally constituted by a computer such as a server computer, and is a base layer software for operating the distribution management server 30 as a computer. An operating system (OS) 31, a viewer management unit 32 that operates on the operating system 11, a playback position estimation unit 33, a playback position management unit 34, a playback position notification unit 35, and a playback position control instruction unit 36 are provided. .

  The viewer management unit 32 has a function of managing a plurality of users who view the same content. In this embodiment, the viewer management uses the IP address of the user terminal 10 and the URL of the web page accessed by the user as identifiers. Note that the form of the viewer management is not limited to this, and the viewer management unit 32 uses the IP address of the user terminal 10, the user terminal name, and cookie (cockie) information associated with the transmission / reception of information by HTTP. , One or more user identification information of the identification ID of the streaming content playback application 12, the metafile acquired by the user, the streaming content being viewed, the viewing start time, and the URL of the web page being accessed by the user It is possible to determine the user and the content being viewed using the identifier composed of one or more pieces of information, and to identify and manage a plurality of users who are viewing the same streaming content as the same group .

  The reproduction position estimation unit 33 receives and manages information indicating the content reproduction position from each user terminal 10 at an interval designed in advance, and based on the information, the reproduction position estimation unit 33 at any time at each user terminal 10 It has a function of estimating the content playback position. The reproduction position estimation unit 33 manages reproduction position information periodically reported from the reproduction position measurement unit 13 of the user terminal 10 for each user terminal in time series, and responds to a request from the reproduction position management unit 34. Therefore, the content playback position at any time on any user terminal is taken into account the transition of the past playback position, or the status of the streaming content playback application on that user terminal reported at the time closest to that arbitrary time. It may have a function of calculating and reporting to the reproduction position management unit 34.

  The playback position management unit 34 uses the information from the viewer management unit 32 and the playback position estimation unit 33 to calculate a temporal shift in content playback position among a plurality of user terminals that are viewing the same streaming content. And has a function of managing in time series. Note that the playback position management unit 34 selects an arbitrary from the current streaming content playback position of each user terminal that is periodically acquired from the playback position estimation unit 33 according to the viewer information acquired from the viewer management unit 32. It may have a function of calculating the distribution of the time lag of the reproduction position between the user terminals at the time and managing the change of the time lag of the reproduction position in time series for the same group.

  The playback position notifying unit 35 uses information from the viewer management unit 32 and the playback position management unit 34 to periodically view at least one user terminal that is watching or watching the same streaming content. In particular, it has a function of notifying the deviation of the content reproduction position between these user terminals. As will be described later, when only the viewing start control is performed as the synchronization control between the user terminals, the reproduction position notification unit 35 may not be provided.

  The playback position control instructing unit 36 uses the information from the playback position management unit 34 and the playback position notification unit 35 to relate all the streaming content playback in a plurality of user terminals viewing the same streaming content. Has a function of instructing content playback position control. The timing at which the playback position control instruction unit 36 instructs content playback position control is one or more timings at the start of viewing the content and / or during the viewing of the content. In the following description, performing synchronization control between user terminals at the start of content viewing is referred to as viewing start control, and performing synchronization control between user terminals at one or more timings during content viewing. This is called post-start control.

  The distribution management server 30 uses information regarding the playback position of the streaming content indicated by the streaming content playback application 12 on the user terminal 10 as the playback position information, and the status of the streaming content playback application 12 (contents content). Whether playback is being performed, playback is paused, or content is being buffered) and time information of the operating system 12 of the user terminal 10 is received together with the playback position information.

  Next, the operation of the streaming content distribution control system in this embodiment will be described. Here, regarding the synchronous control between the user terminals 10, a case where only the above-described viewing start control is used will be described.

  On the user terminal 10, processing proceeds according to the flowchart shown in FIG. FIG. 4 shows operations until the streaming content is played back on the user terminal 10.

  Generally, when receiving content distribution by a streaming content distribution service, a user connects to a server that provides a web page including a link to a metafile to each streaming content via the user terminal 10. Then, the location of the actual streaming content is known from the server, and the metafile is acquired. Typical examples of such web pages include program guides and links. In the case of this embodiment, the distribution management server 30 corresponds to the server here.

  By acquiring the metafile, the user selects a streaming content playback application 12 for playing the corresponding streaming content on the user terminal 10, passes the metafile to the application 12 as an argument, and the application 12 Start up. The started streaming content playback application 12 requests streaming content delivery to the streaming server 40 via the Internet 20 in accordance with the description of the metafile passed as an argument. At this time, negotiation processing such as selection of a transfer protocol used for content distribution and a content distribution bit rate is performed between the user terminal 10 and the streaming server 40, and then distribution of streaming content is started from the streaming server 40. . The streaming content playback application 12 of the user terminal 10 buffers the distributed content based on a preset buffer capacity, and then starts playback of the content on the user terminal 10. In the streaming delivery control system of this embodiment, in such a general streaming delivery process flow, the user sends a request for a web page to be a program guide to the delivery management server 30 via the user terminal 10. By doing so, the process of streaming distribution of content is started.

  Specifically, the distribution management server 30 prepares and publishes a program guide for each arbitrary group that simultaneously views streaming content. When the program table of such a group is accessed from the user terminal 10 in step 1001, in the distribution management server 30, the viewer management unit 32 makes the URL of the program table and the user terminal 10 of the request source. The user terminal 10 and the group to which the user terminal 10 participates are determined from the IP address of the user, and it is determined that the group is preparing to start playback, that is, that the group is active. Notify the management unit 34.

The web page showing the program guide for each group provided by the distribution management server 30 specifies the URL of the metafile for the content to be played next and the time to start playback. In the user terminal 10 that has accessed the correct program guide, the playback position control unit 14 stops the processing for a certain time in step 1002 and then acquires a metafile at the time when the playback start time is reached. To start the connection process (step 1003). At the same time, the reproduction position measurement unit 13 of the user terminal 10, in step 1004, and obtains the state at the time T _o0 and streaming content playback application 12 that the operating system 11 is clocking, in step 1005, the streaming content state The timer T _t1 that is the maximum measurement interval when no transition occurs is started.

Here, after the processing is stopped for a certain time (step 1006), the playback position measurement unit 13 checks the state of the streaming content playback application 12 again in step 1007. If it is determined that there is no change from the last state in the application 12 checks the timer T _t1 in step 1008, the timer is enabled (T _t1> 0), i.e. if not timed out, the process in step 1006 Will return. On the other hand, if the timer is invalid (T _t1 ≦ 0, timed out) in step 1008, the process proceeds to step 1009. Similarly, when it is determined in step 1007 that the state of the application 12 has changed, the process proceeds to step 1009. In step 1009, the playback position measurement unit 13 reports the elapsed time from T _t0 and the state of the streaming content playback application 12 to the playback position estimation unit 33 of the distribution management server 30.

Next, the playback position measurement unit 13 of the user terminal 10 confirms whether or not the buffering of the streaming content to be played back has ended in Step 1010. If the buffering has not ended, the process proceeds to Step 1005. Return. On the other hand, if the buffering is finished in step 1010, the playback position control unit 14 temporarily stops the processing of the streaming content playback application 12 in step 1011 and acquires the current time _To1 from the operating system 11. . Thereafter, in step 1012, the playback position measurement unit 13 determines the time (= T _o1 −T _o0 ) required from when the streaming content playback application 12 issues a connection request to the start of playback, and the state of the content playback application 12 Is reported to the reproduction position estimation unit 33 of the distribution management server 40. Thereafter, the playback position control unit 13 temporarily stops the process (step 1013), and confirms in step 1014 whether there is a playback start instruction from the playback position control instruction unit 36 of the distribution management server 40. If there is a playback start instruction, the playback position control unit 13 starts playback of content by the streaming content playback application 12 in step 1015. If there is no reproduction start instruction in step 1014, the process returns to step 1013.

  The processing in the distribution management server 30 identifies and manages the user terminals 10 that simultaneously view the same content regarding the streaming content reproduction on the plurality of user terminals 10 as a group, and reports the reproduction position from each user terminal 10. The purpose is to manage and synchronize the reproduction start of streaming contents of all user terminals 10 of the group.

  In the distribution management server 30, first, the viewer management unit 32 determines which user terminal 10 belongs to which group by accessing the web page representing the program guide for each group from the user terminal 10. As a response to the access to the web page, the playback start time control unit 14 of the user terminal 10 is notified of the connection start time of the streaming content described in the program guide. In addition, the viewer management unit 32 notifies the user who has accessed the program guide as active to the reproduction position management unit 34, and the reproduction position management unit 34 recognizes all the active user terminals 10 in the same group. The latest information on the reproduction position information is collected from the reproduction position estimation unit 33 at predetermined intervals.

  The reproduction position estimation unit 33 receives and manages a report of reproduction position information from each user terminal 10, and acquires time information from the operating system 31 of the distribution management server 30 when receiving the report. Therefore, the playback position management unit 34 can check the reception time of the playback position information and determine that a user terminal that has not transmitted playback position information for a certain length of time is not an active user terminal. It is. In the example described here, the control at the start of viewing is used as the synchronization control between the user terminals 10, and therefore, the playback position management unit 34 performs all active regarding the playback position information collected from the playback position estimation unit 33. Confirm that the streaming content is ready to be played back on the user terminal 10 or that a certain time has passed since the connection to the streaming content from each user terminal 10 is started. The position control instruction unit 36 is instructed to start reproduction. The playback position control instruction unit 36 notifies the playback position control unit 14 of those active user terminals 10 of the start of playback of streaming content all at once. Thereby, in each of the plurality of user terminals 10, the playback position control unit 14 controls the streaming content playback application 12 to start playback of the streaming content.

  In this way, in the present embodiment, it is possible to realize the start of reproduction synchronized between a plurality of user terminals 10 for the same streaming content.

  In the above description, in the user terminal 10, the playback position measurement unit 13 and the playback position control unit 14 are configured separately from each other, but can be logically combined into one configuration. is there. Similarly, in the distribution management server 30, the viewer management unit 32, the playback position estimation unit 33, the playback position management unit 34, and the playback position control instruction unit 36 are configured separately from each other. Some or all of them can be logically determined in one configuration.

  Next, a second embodiment of the present invention will be described. In the first embodiment described above, the viewing start time control is used as the synchronization control of the user terminal related to the reproduction of the streaming content. However, when only the viewing start time control is used, a plurality of user terminals 10 are used. Can simultaneously start viewing the same streaming content, but the network environment of each user terminal 10 is different, and each user after the start of viewing due to packet loss, rebuffering, etc. due to network quality deterioration When the transition of the content playback position on the terminal 10 is not constant, the content playback position shift between the user terminals 10 gradually increases. Therefore, in the second embodiment, the control at the start of viewing and the control after the start of viewing are used together, and the deviation of the playback position among the plurality of user terminals 10 is detected and managed even after the start of viewing the streaming content. When the maximum reproduction position deviation representing the relative deviation of the reproduction positions between user terminals exceeds a preset threshold value, synchronization control is performed to reduce the reproduction position deviation. Specifically, the streaming content playback is paused for a certain period for each user terminal 10 so that the user terminals 10 in the same group view the same playback position.

  The streaming content distribution control system of the second embodiment is the same as the system of the first embodiment shown in FIGS. 1 to 3 as the system configuration, and the playback position measurement unit 13 of the user terminal 10. The operation in FIG. 4 and the operation in the distribution management server 30 are different from those in the first embodiment. The operation of this embodiment will be described below.

  The reproduction position measurement unit 13 and the reproduction position control unit 14 of the user terminal 10 operate according to the flowcharts shown in FIGS. In the present embodiment, the operation until the reproduction of streaming content is started is the same as that in the first embodiment as shown in FIG. FIG. 5 shows the operation of the playback position measurement unit 13 after starting playback of streaming content.

As shown in FIG. 5, the measurement of the playback position after the start of playback of the streaming content is started when the playback of the streaming content on the user terminal 10 is started (step 1015). In step 1016, and acquires the time T _o2 and reproducing position P ₀ of the operating system 11 at this time. Since playback has just started at this point, P ₀ = 0 is acquired. Next, in step 1017, variables i and n for managing the transition of acquisition time are initialized as i = 2 and n = 0, respectively, and in step 1018, the processing is stopped for a certain time. Thereafter, in step 1019, a timer T _t2 representing a measurement deadline for not delaying the reporting interval to the distribution management server 30 for a predetermined period or longer is started, and in step 1020, the processing is stopped for a predetermined time.

Next, in step 1021, the state of the streaming content playback application 12 is confirmed. If there is no change, the process proceeds to step 1022, and it is confirmed whether or not the expiration date of the timer T _t2 has expired. If the timer T _t2 is valid (T _t2 > 0), the process returns to step 1020. On the other hand, if it is determined in step 1021 that the state of the streaming playback application 12 has changed, or if the expiration date of the timer T _t2 has expired in step 1022, the process proceeds to step 1023 to set the variables i and n respectively. In step 1024, the time T _on (n is a variable) is acquired from the operating system 11, and the playback position P _i (i is a variable) is acquired from the streaming content playback application 12. Thereafter, in step 1025, T _on , _Pi and the status of the streaming playback application 12 are reported to the streaming distribution management server 30 as playback position information. Here, it is confirmed from the state of the streaming playback application 12 whether or not the playback of the streaming content has been completed (step 1026). If it has been completed, the processing at the playback position measurement unit 13 is completed and has not ended. In this case, the process returns to step 1019.

  On the other hand, the distribution management server 30 operates according to the flowchart shown in FIG.

First, after the reproduction of the same streaming content is started at a plurality of user terminals 10 in the same group, the reproduction position management unit 34 determines that in the same group based on the information from the viewer management unit 32 in step 2001. The user terminal 10 that is viewing the streaming content, that is, the active user terminal 10 is confirmed. If there is no active user terminal 10 here, the distribution control process for the streaming content ends. On the other hand, if there is an active user terminal 10 in step 2001, the playback position management unit 34 sends an inquiry about the current playback position of the user terminal 10 to the playback position estimation unit 33 in step 2002. In step 2003, the reproduction position estimation unit 33 estimates the current reproduction position in each user terminal 10 from the reproduction position information reported from the user terminal 10 so far, and determines the reproduction position of the content. The deviation D is estimated. As a specific estimation method, the playback position estimation unit 33 periodically reports a recent report (T _on , P _i ) _on the playback position information of each user terminal 10 and a previous report (T _on−1 , P _i-1 ) and the transition thereof, and the deviation D of the content reproduction position in each user terminal 10 is expressed as D = Σ {(P _i −P _i-1 ) − (T _{o (i + 1)} −T _{o (i)} )} (i = 1, 2, 3,..., N)
Asking. If the status of the streaming content playback application in the recent report indicates suspension (buffering, pause, etc.), the elapsed time from the time of the recent report to the estimated time By adding to D, the estimation error can be reduced. In addition, when calculating the deviation of the reproduction position in the reproduction position estimation unit 33, the user management unit 32 is notified of a user terminal that has not been reported for a certain period of time or a user terminal that has been reported to have been reproduced. Is reported as an inactive user terminal.

  The playback position management unit 34 acquires the content playback position shift D in each user terminal 10 estimated by the procedure as described here, and compares the size between the user terminals 10 in step 2004. . As a result of this comparison, if the relative value of the deviation of the content reproduction position between the user terminals 10 is less than a preset threshold value, no special control is performed on each user terminal 10, and step The process proceeds to 2005, and the processing of the reproduction position management unit 34 itself is stopped for a certain period. Thereafter, the process returns to step 2001. On the other hand, as a result of the comparison in step 2004, if the relative value of the deviation of the content reproduction position between the user terminals is equal to or greater than the threshold value, in step 2006, the reproduction position management unit 34 indicates that the deviation D of the content reproduction position is A shift in the relative content playback position of each of the other user terminals 10 is calculated with reference to the maximum user terminal 10, and the shift is set as a pause time for each user terminal 10. In step 2007, A control instruction is given to each user terminal 10 through the reproduction position control instruction unit 36, and then the process proceeds to step 2005.

  As the distribution management server 30 operates in this manner, the reproduction position control unit 14 on the user terminal 10 follows the instruction from the reproduction position control instruction unit 36 of the distribution management server 30 to stream the content for a specified time. Control is performed so that the deviations D of the content reproduction positions of all user terminals 10 are equalized by temporarily stopping the reproduction in the reproduction application 12. As a result, synchronized playback between a plurality of user terminals can be realized during playback of the same streaming content.

  In the present embodiment, when the playback position control is executed, the user terminal having the largest content playback position shift D is used as a reference, that is, the user whose playback is most delayed among the user terminals belonging to the same group. With the streaming content playback application 12 on the other user terminal 10 based on the terminal, synchronization between the user terminals 10 is realized by temporarily stopping playback, but conversely, the content playback position shift D A method of controlling the content reproduction position of other user terminals 10 with the user terminal 10 having the smallest value as a reference is also conceivable. In this case, the streaming content playback application 12 on the other user terminal 10 corrects the relative shift of the content playback position and reconnects to the streaming server 40 to view the streaming content from the appropriate content playback position. There is a need. Therefore, in this case, unlike the case of the temporary stop, the reproduction position management unit 34 of the distribution management server 30 requires reconnection control in consideration of the reconnection processing time. Therefore, the playback position management unit 34 estimates the reconnection time using the processing time S required when starting the streaming content viewing of each user terminal 10 managed by the playback position estimation unit 33, and determines the relative content playback position. A value obtained by adding S to the deviation is notified to the reproduction position control unit 14 on the user terminal 10 via the reproduction position control instruction unit 36. The playback position control unit 14 requests the streaming delivery server 40 to transmit the streaming content from the playback position obtained by adding this value to the current content playback position, so that the user terminal 10 can perform reconnection processing between the user terminals 10. It is possible to prevent an increase in content reproduction position deviation.

  Furthermore, in the present embodiment, it is possible to correct the deviation of the reproduction position at each user terminal based on a request from the user terminal side. In that case, the reproduction position information in the same group in the reproduction position management unit is notified to the user via the reproduction position notification unit. On the user terminal side, it is possible to use it as a trigger for control by judging the deviation of the notified reproduction position and making a control request.

  The streaming content distribution control system according to the preferred embodiment of the present invention has been described above. However, the user terminal 10 and the distribution management server 30 in the above-described streaming content distribution control system both have computer programs for realizing them. It can also be realized by reading it into a computer such as a personal computer (PC) or a server computer and executing the program. A program for realizing a user terminal or a distribution management server is read into a computer by a recording medium such as a CD-ROM or via a network.

  Computers that function as user terminals and distribution management servers generally have a CPU (Central Processing Unit), a hard disk device for storing programs and data, a main memory, and input devices such as a keyboard and a mouse. , A display device such as a CRT or a liquid crystal display, a reading device that reads a recording medium such as a CD-ROM, and a communication interface for connecting directly or indirectly to the Internet 20 or the like. The hard disk device, main memory, input device, display device, reading device, and communication interface are all connected to the CPU. These computers mount a recording medium storing a program for realizing a user terminal in a reading device and store the program in a hard disk device, or download such a program via a network and download the hard disk device. The CPU executes a program stored in the hard disk device and functions as a user terminal. Similarly, such a computer loads a recording medium storing a program for realizing a distribution management server into a reading device and stores the program in a hard disk device, or downloads such a program via a network. When the CPU executes the program stored in the hard disk device and stored in the hard disk device, it functions as a distribution management server.

It is a figure which shows arrangement | positioning of the streaming delivery control system of the 1st Embodiment of this invention. It is a block diagram which shows the structure of a user terminal. It is a block diagram which shows the structure of a delivery management server. It is a flowchart which shows the process in a user terminal. It is a flowchart which shows the process in the reproduction | regeneration position measurement part of a user terminal. It is a flowchart which shows the process in a delivery management server. It is a figure which shows the conventional streaming content delivery system.

Explanation of symbols

10, 10-1, 10-2 User terminal 20 Internet 30 Distribution management server 40 Streaming server 11, 31 Operating system 12 Streaming content playback application 13 Playback position measurement unit 14 Playback position control unit 32 Viewer management unit 33 Playback position estimation unit 34 Playback position management unit 35 Playback position notification unit 36 Playback position control instruction unit 50 Web server

Claims (13)

A streaming content distribution control system that controls streaming content distribution to a user terminal via a network,
A viewer management unit for managing a plurality of users who view the same streaming content;
Receiving and managing the playback position information of the streaming content in the user terminal from each user terminal, and a playback position estimation unit for estimating the content playback position in the user terminal for each user terminal;
Using information from the viewer management unit and the playback position estimation unit, a time lag in content playback position between a plurality of user terminals that are viewing the same streaming content is calculated in time series. A playback position management unit to manage,
Using the information from the viewer management unit and the playback position management unit, each user terminal with respect to at least one user terminal that intends to view or watch the same streaming content A playback position control instruction unit for instructing control of the content playback position at
A streaming content distribution control system.   2. The distribution management server connected to the network, wherein the viewer management unit, the reproduction position estimation unit, the reproduction position management unit, and the reproduction position control instruction unit are provided in the distribution management server. The streaming content distribution control system described in 1.   The distribution management server is further notified of a shift in content playback position between user terminals to at least one of the user terminals using information from the viewer management unit and the playback position management unit. The streaming content distribution control system according to claim 2, further comprising a reproduction position notification unit that performs the reproduction content notification. The user terminal is
Streaming content playback means for playing back the streaming content;
At least one or more of playback position information indicating the playback position of the streaming content to be played back, information indicating the state of the streaming content playback means, and information indicating time is periodically reported to the playback position estimation unit. A playback position measurement unit;
In accordance with an instruction from the playback position control unit, a playback position control unit that controls a content playback position in the streaming content playback unit;
The streaming content delivery control system according to any one of claims 1 to 3, further comprising:   The viewer management unit includes user identification information including at least one of an IP address of the user terminal, a user terminal name, HTTP cookie information, and an identification ID of the streaming content reproduction means, and the usage An identifier consisting of one or more information of a metafile acquired by the user, streaming content viewed on the user terminal, viewing start time, and URL of the web page accessed by the user terminal. The streaming content distribution control system according to claim 4, wherein the user terminal and the streaming content being viewed are identified, and the user terminals viewing the same streaming content are identified and managed as the same group.   The reproduction position estimation unit manages the reproduction position information periodically reported from the reproduction position measurement unit in time series for each user terminal, and is designated according to a request from the reproduction position management unit. The content playback position at an arbitrary time of the user terminal is calculated in consideration of the transition of the previous playback position or the state of the streaming content playback means reported at the time closest to the arbitrary time, and the playback position management The streaming content distribution control system according to claim 4, which is reported to a department.   The playback position management unit, based on the viewer information acquired from the viewer management unit, can be set to an arbitrary time from the current playback position of the streaming content of each user terminal periodically acquired from the playback position estimation unit. 5. The distribution of the time lag of the reproduction position between the user terminals in FIG. 5 is calculated, and the transition of the time lag of the reproduction position is managed in time series for each same group. The streaming content distribution control system described.   The playback position control instructing unit analyzes a state transition before starting playback of the streaming content playback means on a plurality of user terminals, and all user terminals viewing simultaneously can play back the same streaming content. The streaming content distribution control system according to claim 4, wherein the playback start control instruction is simultaneously given to each user terminal and the playback start time is controlled by the fact that a certain grace period has elapsed.   The reproduction position control instructing unit is a control request from the user when the maximum deviation of the content reproduction position between the user terminals managed by the reproduction position management unit exceeds a specific threshold. Or, periodically, the control method is determined so that the user terminals of the same group view the same content playback position at least one of the triggers, and the playback position control unit of each user terminal is notified. The streaming content distribution control system according to claim 4. Computer
Viewer management means having a function of managing a plurality of users who view the same streaming content;
Receiving position estimation means for receiving and managing the reproduction position information of the streaming content in the user terminal from each user terminal and estimating the content reproduction position in the user terminal for each user terminal;
Using the information from the viewer management means and the playback position estimation means, a time lag in content playback position between a plurality of user terminals that are viewing the same streaming content is calculated in time series. Playback position management means to manage,
Using the information from the viewer management means and the playback position management means, each user terminal is connected to at least one user terminal that is trying to view or watch the same streaming content. Reproduction position control instruction means for instructing control of the content reproduction position at
Program to function as.   A computer is further used to notify at least one user terminal of a shift in content playback position between user terminals using information from the viewer management unit and the playback position management unit. The program according to claim 10, which functions as position notification means. Computer
Streaming content playback means for playing back streaming content;
A reproduction position for periodically reporting at least one of reproduction position information representing the reproduction position of the streaming content to be reproduced, information representing the state of the streaming content reproduction means, and information representing the time to the distribution management server Measuring means,
A reproduction position control means for controlling a content reproduction position in the streaming content reproduction means in accordance with an instruction from the distribution management server;
Program to function as.   A computer-readable recording medium that stores the program according to any one of claims 10 to 12.

Images