JP6008378B2 - Terminal device, display device, terminal device linkage system, terminal device linkage method, and program - Google Patents

Description

  The present invention relates to technology for displaying content information displayed on a display device in conjunction with a terminal device.

  When viewing a movie or the like on a display device such as a TV, some people may want to watch the subtitles in English while others want to dubb into another language such as Japanese. is there. In this way, when watching the same movie at the same time, there are cases where individual requests differ, such as wanting to watch a movie with a different type of sound or the like.

However, conventional displays cannot satisfy these demands at the same time. For example, in a general television, there is one screen for displaying video, and a selected one of a plurality of types of audio is output. Therefore, in order to view a video with captions inserted or other types of audio, it is necessary to prepare a display device and audio output device outside.
In this regard, for example, Patent Document 1 discloses a parent and child that can allow a user to view characters in the vicinity of a user while allowing a user to view a video on a large screen arranged at a position distant from the user. A cooperative display system has been proposed.

Japanese Patent Laid-Open No. 11-243512

However, in the parent-child cooperative display system disclosed in Patent Document 1, it is necessary to prepare a dedicated device.
An object of the present invention is to provide a system for viewing content by linking a display device that displays content and a terminal device such as a mobile phone.

  One aspect of the terminal device according to the present invention is a terminal device that can communicate with a display device that displays content including audio and video, a transmission / reception unit that transmits / receives information to / from the display device, and the display of the content. An input unit that receives setting information that is information specifying elements to be output in conjunction with each other, a storage area that stores setting information received by the input unit, and the setting information after the setting information is transmitted to the display device An interlock control unit that controls to receive from the display device control data for outputting the element specified in the display in conjunction with the display of the content, and the control data in conjunction with the display of the content. And an output control unit that outputs the element.

  One aspect of the display device according to the present invention is a display device that displays content including audio and video, a transmission / reception unit that transmits / receives information to / from an arbitrary terminal device, and the content received from the terminal device. A storage area for storing setting information, which is information for designating an element output by the terminal device in conjunction with display, and an element designated in the setting information for outputting in conjunction with display of the content An interlock control unit that generates control data and transmits the control data to the terminal device via the transmission / reception unit.

  One aspect of the terminal device interlocking system according to the present invention is a terminal device interlocking system for viewing content by interlocking a terminal device with a display device that displays content including audio and video, and the terminal device Stores a transmission / reception unit that transmits / receives information to / from the display device, an input unit that receives setting information that is information specifying an element to be output in conjunction with display of the content, and setting information received by the input unit After transmitting the storage area and the setting information to the display device, control is performed so as to receive from the display device control data for outputting the element specified in the setting information in conjunction with the display of the content. And an output control unit that outputs the element using the control data in conjunction with the display of the content. The display device generates the control data by using a transmission / reception unit that transmits / receives information to / from the terminal device, a storage area that stores the setting information received from the terminal device, and the control information. An interlock control unit that transmits data to the terminal device via the transmission / reception unit.

  One aspect of the terminal device interlocking method according to the present invention is a terminal device interlocking method in which a terminal device interlocks a display device that displays content including audio and video, and the output is performed in conjunction with the display of the content. Receiving setting information, which is information for designating an element to be stored, storing the received setting information in a storage area, transmitting the setting information to the display device, and displaying the element specified in the setting information as the display of the content Control data to be output in conjunction with the display is received from the display device, and the element is output using the control data in conjunction with display of the content.

  One aspect of the terminal device interlocking method according to the present invention is a terminal device interlocking method in which a display device that displays content including audio and video is interlocked with an arbitrary terminal device, and is interlocked with the display of the content. The terminal device receives the setting information, which is information specifying an element output from the terminal device, stores the received setting information in a storage area, and displays the element specified in the setting information as the content display Control data to be output in conjunction with the control data is generated, and the generated control data is transmitted to the terminal device.

  One aspect of the terminal device linking method according to the present invention is a terminal device linking method for viewing content by linking a display device that displays content including audio and video and the terminal device, the terminal device Accepts setting information, which is information specifying an element to be output in conjunction with the display of the content, stores the received setting information in a storage area, transmits the setting information to the display device, and stores the setting information in the setting information. Control data for outputting the designated element in conjunction with the display of the content is received from the display device, and the element is output using the control data in conjunction with the display of the content. The display device receives the setting information from the terminal device, stores the setting information in a storage area, generates the control data using the setting information, and transmits the generated control data to the terminal device. Send.

  One aspect of the program according to the present invention is a program that causes a terminal device to operate in conjunction with a display device that displays content including audio and video, and outputs to a computer in conjunction with the display of the content. A process for receiving setting information, which is information for specifying an element, a process for storing the received setting information in a storage area, a process for transmitting the setting information to the display device, and an element specified in the setting information. A process of receiving control data for output in conjunction with display of the content from the display device, and a process of outputting the element using the control data in conjunction with display of the content. Let it run.

  One aspect of the terminal device interlocking method according to the present invention is a program for causing a display device that displays content including audio and video to operate in cooperation with an arbitrary terminal device. A process of receiving setting information, which is information specifying an element output by the terminal device, in conjunction with the terminal device, a process of storing the setting information in a storage area, and an element specified in the setting information Is generated in a manner linked to the display of the content, and a process of generating the control data to be transmitted to the terminal device is executed.

  According to the present invention, it is possible to provide a system for viewing content by linking a display device that displays content and a terminal device such as a mobile phone.

It is a block diagram which shows the principal part of the structural example of the display apparatus which concerns on Embodiment 1 of this invention. It is a block diagram which shows the principal part of the structural example of the terminal device which concerns on Embodiment 1 of this invention. 3 is a flowchart illustrating an operation example of the display device (television) of Embodiment 1. 3 is a flowchart illustrating an operation example of the terminal device (mobile phone) according to the first exemplary embodiment. It is a figure explaining the flow of information when a display apparatus operate | moves. It is a figure explaining operation | movement when a terminal device receives setting information from a user. It is a figure which shows an example of the display screen when a user inputs setting information. It is a figure which shows an example of setting information. It is a figure explaining operation | movement when a terminal device outputs each element using control data. It is a figure which shows the specific example of the interlocking vibration data contained in control data. It is a figure which shows the specific example of the interlocking lighting data contained in control data. It is a figure which shows the specific example which outputs a caption and a different type audio | voice with a terminal device. It is a figure which shows the specific example which outputs the audio | voice of a different type with a display apparatus and a terminal device. It is a figure which shows the specific example which outputs an audio | voice with a display apparatus, and a caption with a terminal device. It is a figure which shows the specific example which vibrates a terminal device. It is a figure which shows the specific example which makes a terminal device light.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. For clarity of explanation, the following description and drawings are omitted and simplified as appropriate. In the drawings, components having the same configuration or function and corresponding parts are denoted by the same reference numerals and description thereof is omitted.

  The present invention provides a system (terminal device linkage system) that links a display device that can view content information and a terminal device. The terminal device linkage system of the present invention can be applied to a system including a display device (for example, a television) that displays content including audio and video and a terminal device having a communication function such as a portable terminal. . First, an outline of the function of each device will be described.

The terminal device has the following functions.
A function to send and receive information to and from the display device.
An input function that accepts setting information.
A function that stores setting information received by the input function.
A function of transmitting setting information to the display device.
A function for receiving control data from the display device in accordance with the transmitted setting information.
Function to output set elements according to control data.

Further, the display device has the following functions.
A function to send / receive information to / from a terminal device.
A function of receiving setting information from a terminal device and storing it in a storage area.
A function that generates control data using setting information and transmits it to the terminal device.

Here, “setting information” is information for designating elements to be output in conjunction with content display.
The “elements” output by the terminal device include, for example, what type of audio (Japanese, English, etc.) is output, whether audio is not output, what type of subtitles is displayed, or subtitles are not displayed, There is presence / absence of vibration of own device, presence / absence of lighting of own device. Information regarding the setting of each element is, for example, audio information, caption information, vibration information, and lighting information. The setting information includes at least one of these pieces of information. Further, the elements are not limited to these, and other elements may be used as long as the terminal device can output in conjunction with the display of the content.
“Control data” (also referred to as “interlocking control data”) is data for outputting elements specified in the setting information in conjunction with display of content. Among the control data, when referring to the control data for each element, it may be called linked audio data, linked subtitle data, linked vibration data, and linked lighting data. The control data includes at least one of these data.

  In the following embodiments, a case where a television is used as a display device and a mobile phone is used as a terminal device will be described as an example. Provided is an interlocking system between a television and a cellular phone that reproduces the audio of the television or displays the caption in a cellular phone.

Embodiment 1
FIG. 1 is a block diagram illustrating a main part of a configuration example of a display device according to Embodiment 1 of the present invention. Here, the main part of the component configuration of the television 100 as a display device (video / audio output device) is shown. Here, a display control unit 101, an audio output unit 102, a program reproduction unit 103, a control unit (interlocking control unit) 104, a storage area 105, and a transmission / reception unit 106 are shown.

The display control unit 101 performs control to display video information on the screen.
The audio output unit 102 performs control to output audio information.
The program playback unit 103 is a part that controls playback of content including broadcasted programs, and provides content information to be played back to the display control unit 101, audio output unit 102, and control unit 104.
The control unit 104 performs various processes and controls.
The storage area 105 is an area for storing information, for example, setting information (described later) received from a mobile phone. The storage area 105 is composed of, for example, a readable / writable RAM (random access memory).

The transmission / reception unit 106 transmits / receives data to / from the mobile phone. The communication method is a wireless communication system such as Bluetooth (registered trademark) or Wi-Fi (registered trademark) provided in a mobile phone, and any other communication method may be used as long as it is compatible with a television. The transmission / reception unit 106 includes a transmission unit 107 and a reception unit 108.
The television used in the present embodiment has the above-described configuration, but may be realized by adding a mobile phone link system unit 110 to a general television. The mobile phone link system unit 110 is a function realized by a part of the function of the program playback unit 103, a function of the control unit 104, the storage area 105, and the transmission / reception unit 106.

  FIG. 2 is a block diagram illustrating a main part of a configuration example of the terminal device according to the first embodiment of the present invention. In FIG. 2, as a terminal device, a main part of a component configuration of the mobile phone 200 that realizes a function according to the present invention is shown, and a configuration such as a communication function provided in the mobile phone is omitted. Here, a display control unit 201, a sound output unit 202, a vibration control unit 203, a lighting control unit 204, a control unit (interlocking control unit) 205, a storage area 206, an input unit 207, and a transmission / reception unit 208 are shown.

The display control unit 201 performs control to display video information on the screen.
The audio output unit 202 performs control to output audio.
The vibration control unit 203 performs vibration control such as vibration of a mobile phone.
The lighting control unit 204 performs lighting control of illumination such as an LED (light-emitting diode) and an organic EL (electroluminescence) mounted on the mobile phone.
The control unit 205 performs various processes and controls.
The storage area 206 is an area for storing information, and stores, for example, setting information input from the input unit 207 and control data received from the television. The storage area 206 is composed of, for example, a RAM.

The input unit 207 is an input circuit that receives an input from the user via a key, a touch panel, or the like.
The transmission / reception unit 208 is a part that transmits and receives data to and from the television 100. The communication method is a wireless communication method provided in a mobile phone such as Bluetooth (registered trademark) or Wi-Fi (registered trademark), and any other communication method may be used as long as the wireless communication method is compatible with a television. The transmission / reception unit 208 includes a transmission unit 209 and a reception unit 210.
In the mobile phone 200, the display control unit 201, the audio output unit 202, the vibration control unit 203, and the lighting control unit 204 that output control data in conjunction with content display may be referred to as an output control unit 2211.

Next, the operation of the terminal device linkage system will be described with reference to the drawings.
FIG. 3 is a flowchart illustrating an operation example of the television according to the first embodiment. FIG. 4 is a flowchart illustrating an operation example of the mobile phone according to the first embodiment.
First, the operation of the television 100 will be described. FIG. 5 is a diagram for explaining the flow of information when the television operates. When the television 100 and the mobile phone 2 are linked (step S11: Y), the control unit 104 uses the transmission / reception unit 106 to search for the mobile phone 200 linked to the television 100 (step S12). As to how to search for the mobile phone 200 to be linked, a, for example, it is only necessary to confirm that the link is possible by exchanging predetermined initial information by mutual transmission / reception units. When the mobile phone 200 is found (step S13: Y), the receiving unit 108 receives the setting information 402 from the mobile phone 200 (step S14). The received setting information 402 is stored in the storage area 105 (step S15). The control unit 104 generates control data 302 using this setting information and content information (step S16). The control data 302 will be described later. The control unit 104 transmits the generated control data to the mobile phone 200 via the transmission unit 107 (step S17). Thereafter, the television 100 reproduces the content from the content information 301 (step S18).

Next, the operation of the mobile phone 200 will be described. FIG. 6 is a diagram for explaining a flow of information when the mobile phone receives setting information by a user operation. When the mobile phone 200 is linked to the television 100 (step S21: Y), the input unit 207 receives information (setting information) on how the mobile phone 200 and the television 100 are linked by the user operation 401 ( In step S22, the input setting information is stored in the storage area 206 (step S23). The display screen of the mobile phone 200 at that time is set by key input or touch panel input on a screen as shown in FIG. 7, for example.
Thereafter, the control unit 205 uses the transmission / reception unit 208 to search for the television 100 linked to the mobile phone 200 (step S24). When the television 100 is found (step S25: Y), the control unit 205 transmits the setting information 402 stored in the storage area 206 to the television 100 via the transmission unit 209.

When the setting information 402 is transmitted to the television 100, the control data 302 is generated and transmitted from the television 100, and is received by the receiving unit 210 of the mobile phone 200 (step S27).
The received control data 302 is stored in the storage area 206, and the control unit 205 uses the stored control data 302 to match the content displayed on the television 100, the display control unit 201, the audio output unit 202, and the vibration control unit. 203, the lighting control unit 204 is controlled (step S28).

  Setting information 402 transmitted from the mobile phone 200 is stored in the storage area 105 of the television 100. FIG. 8 shows an example of setting information 402 a stored in the storage area 105. In the setting information 402a, information on subtitles, audio, vibration, and lighting is stored for each mobile phone 200 to be linked with an ID for identifying the mobile phone 200. In FIG. 8, as the audio information, an audio type to be output (Japanese, English, etc.), or no audio output (OFF) is designated. As subtitle information, the type of subtitles to be displayed or whether to display subtitles is designated. As vibration information, the presence / absence (ON / OFF) of vibration of the own device is designated. As lighting information, the presence / absence (ON / OFF) of lighting of the screen of the own apparatus is designated.

  FIG. 9 shows a flow of information when mobile phone 200 outputs each element of voice, caption, vibration, and lighting according to control data 302. Control data 302 received from the television 100 is stored in the storage area 206. The control unit 205 analyzes the stored control data 302 and passes the control data 302 to the corresponding output control unit. The display control unit 201 outputs linked subtitle data. The audio output unit 202 outputs linked audio data. The vibration control unit 203 vibrates its own device according to the interlocking vibration data. The lighting control unit 204 lights the LED according to the interlocking vibration data.

The control data 302 generated by the television 100 includes subtitles and audio data, and data indicating the timing for causing vibration and the timing for lighting. The interlocked subtitle data included in the control data 302 is subtitle data displayed by the mobile phone 200 in conjunction with the display of content, and the interlocked audio data is audio data output by the mobile phone 200 in conjunction with the display of content. It is. Also, vibration and lighting control data is stored in the form shown in FIGS. 10 and 11, for example. FIG. 10 shows an example of the interlocking vibration data 302a included in the control data 302, and FIG. 11 shows an example of the interlocking lighting data 302b. The control data 302 is output in synchronization with the content displayed on the television 100, so that each element is output corresponding to the display content of the content. For example, when the display start timing of the content is notified from the television to the mobile phone, the display of the content and the output of the control data element can be synchronized.
If you have other methods, please add them.

There is a method of automatically generating these data from the content information, and it is also possible for a person to give them manually. In the case of generating from content information, for example, it is conceivable that vibration or lighting data is given by utilizing the fact that the change in luminance is large in a lightning scene.
In the above description, the case where the TV 100 and the mobile phone 200 are linked one to one has been described. However, a plurality of mobile phones 200 can be linked to one TV 100.
When this interlocking setting is performed and the program is reproduced, control data for audio, subtitles, vibration, and LED lighting required by the mobile phone 200 is transmitted from the television 100 by wireless communication. The mobile phone 200 receives the control data, and the mobile phone 200 performs processing using the control data.

  FIGS. 12 to 16 show specific examples of viewing content when the terminal device linkage system is applied. FIG. 12 shows a specific example in which subtitles and different types of audio are output by the terminal device. FIG. 13 is a diagram illustrating a specific example of outputting different types of sound between the display device and the terminal device. FIG. 14 shows a specific example in which audio is output from the display device and captions are output from the terminal device. FIG. 15 shows a specific example of vibrating the terminal device. FIG. 16 shows a specific example of lighting the terminal device.

When watching the program in FIG. 12, the television 1 outputs video on the screen and English audio from the speaker, the mobile phone 2-1 outputs Japanese subtitles on the screen, and the other mobile phone 2-2 uses the speaker. (Or earphones, etc.) can output Japanese audio and enjoy the program in the style you want to watch. Information is transmitted and received between the television 1 and the mobile phones 2-1 and 2-2 by wireless communication 3.
In another example, as shown in FIG. 13, it is possible to output Japanese voice from the television 1 and English voice from the mobile phone 2. As shown in FIG. 14, English sound is displayed from the television 1, Japanese subtitles are displayed on the mobile phone 2, or the mobile phone 2 is vibrated in conjunction with the state of the television 1 as shown in FIG. Function), and the LED of the mobile phone 2 can be turned on in conjunction with the state of the television 1 as shown in FIG.

  As described above, according to the present embodiment, the content can be viewed by linking the display device that displays the content and the terminal device. Thereby, it is possible to view content information such as a movie in a form desired by the user. For example, when viewing content from a display device by a plurality of people, it is possible to view the content in a desired style by using a mobile phone possessed by an individual.

Embodiment 2
In the first embodiment, the case where a mobile phone is used as the terminal device has been described. However, a mobile game device having a wireless function can be used instead of the mobile phone.
When listening only to audio, a music playback device such as a DAP (Digital Audio Player) having a wireless function may be used instead of a mobile phone.
Furthermore, the present invention may be applied to 3D programs. For example, when watching 3D programs on TV with multiple people, there may be people who do not want to see 3D video because they get drunk with 3D. In that case, it is possible to view 2D video on a mobile phone. is there. In addition, when the television does not support 3D video, it is possible to view 3D video on a mobile phone that supports 3D video by transmitting video data as control data to the mobile phone.
Further, the display measure is not limited to the television, and any device capable of displaying (reproducing) content may be used.

Other Embodiments In each of the above embodiments, a mobile phone or the like as a terminal device has been described using a device including a display mechanism, an audio output mechanism, a vibration mechanism, and a lighting mechanism. It is also possible to apply the present invention to a terminal device including a unit. In addition, the present invention can be applied even when some of these functions are used. For example, the vibration mechanism may not be used.

  In each of the above embodiments, the case where the display device and the terminal device communicate using wireless communication has been described. However, the present invention can also be applied to the case of wired communication.

Furthermore, each process of the terminal device linkage method described in each of the above embodiments can be realized by a program that causes a computer to execute each means. The program is loaded into a memory in the computer and is executed under the control of a CPU (Central Processing Unit).
The program installed in the terminal device causes the computer to execute at least the following processing. A process of receiving setting information, which is information for designating an element (at least one of audio output, subtitle display, own device vibration, and own device lighting) that is output in conjunction with content display. Processing for storing the received setting information in the storage area. Processing to send setting information to the display device. Processing for receiving control data from the display device after transmitting the setting information to the display device. A process of outputting elements according to control data in conjunction with content display.

  The program installed in the display device causes the computer to execute at least the following processing. Processing for receiving setting information from the terminal device. Processing for storing setting information in a storage area. A process for generating control data based on the stored setting information. Processing to transmit the generated control data to the terminal device.

  In the above example, the program can be stored and supplied to a computer using various types of non-transitory computer readable media. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / W, semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory) are included. A computer may be provided by a transitory computer readable medium Examples of temporary computer readable media include electrical signals, optical signals, and electromagnetic waves. Supplied program to computer via wired communication path such as fiber or wireless communication path it can.

  In addition, this invention is not limited to embodiment shown above. Within the scope of the present invention, it is possible to change, add, or convert each element of the above-described embodiment to a content that can be easily considered by those skilled in the art.

  A part or all of the above-described embodiment can be described as in the following supplementary notes, but is not limited thereto.

Appendix 1
A terminal device capable of communicating with a display device that displays content including audio and video,
A transmission / reception unit for transmitting / receiving information to / from the display device;
An input unit that receives setting information that is information for designating an element to be output in conjunction with the display of the content;
A storage area for storing the setting information received by the input unit;
After transmitting the setting information to the display device, an interlock control unit that controls to receive control data for outputting the element specified in the setting information in conjunction with the display of the content from the display device When,
A terminal device comprising: an output control unit that outputs the element using the control data in conjunction with display of the content.

Appendix 2
The output control unit
An audio output unit for outputting the audio;
The setting information includes audio information for designating which type of audio to be output among different types of audio,
The terminal device according to claim 1, wherein the control data includes interlocking sound data output from the sound output unit in conjunction with display of the content.

Appendix 3
The output control unit further includes:
A display control unit for displaying the video;
The setting information includes subtitle information that specifies whether to display subtitles,
The terminal device according to claim 2, wherein the control data includes interlocking subtitle data to be displayed on the display control unit in conjunction with display of the content.

Appendix 4
The output control unit further includes:
It has a vibration control unit that vibrates its own device,
The setting information includes vibration information that specifies vibration of the device itself,
The terminal device according to appendix 2 or 3, wherein the control data includes interlocking vibration data for designating a timing for vibrating the own device in conjunction with the display of the content.

Appendix 5
The output control unit further includes:
It has a lighting control unit that turns on its own device,
The setting information includes lighting information for designating lighting of the own device,
The terminal device according to any one of appendices 2 to 4, wherein the control data includes interlocking lighting data that specifies a timing for lighting the own device in conjunction with display of the content.

Appendix 6
A display device for displaying content including audio and video,
A transmission / reception unit for transmitting / receiving information to / from any terminal device;
A storage area for storing setting information, which is information specifying an element output from the terminal device in conjunction with display of the content received from the terminal device;
An interlock control unit that generates control data for outputting the element specified in the setting information in conjunction with display of the content, and transmits the control data to the terminal device via the transmission / reception unit; A display device comprising:

Appendix 7
The setting information includes audio information for designating which type of audio to be output among different types of audio,
The display device according to claim 6, wherein the interlock control unit generates control data including interlocking audio data output by the terminal device in conjunction with display of the content.

Appendix 8
The setting information includes subtitle information that specifies whether to display subtitles,
The display device according to appendix 6 or 7, wherein the interlock control unit generates control data including interlocking subtitle data that the terminal device displays in conjunction with display of the content.

Appendix 9
The setting information includes vibration information specifying that the terminal device is vibrated,
The supplementary control unit generates control data including interlocking vibration data that specifies a timing at which the terminal device vibrates in conjunction with the display of the content. Display device.

Appendix 10
The setting information includes lighting information that specifies lighting of the terminal device,
Any one of Supplementary notes 6 to 9, wherein the interlock control unit generates control data including interlocking lighting data that specifies a timing at which the terminal device lights the screen in conjunction with display of the content. The display device according to item.

Appendix 11
A display device that displays content including audio and video, and a terminal device interlocking system that views the content in conjunction with a terminal device,
The terminal device
A transmission / reception unit for transmitting / receiving information to / from the display device;
An input unit that receives setting information that is information for designating an element to be output in conjunction with the display of the content;
A storage area for storing the setting information received by the input unit;
After transmitting the setting information to the display device, an interlock control unit that controls to receive control data for outputting the element specified in the setting information in conjunction with the display of the content from the display device When,
An output control unit that outputs the element using the control data in conjunction with the display of the content;
The display device
A transmission / reception unit for transmitting / receiving information to / from the terminal device;
A storage area for storing the setting information received from the terminal device;
A terminal device linkage system comprising: a linkage control unit that generates the control data using the setting information and transmits the control data to the terminal device via the transmission / reception unit.

Appendix 12
The terminal device is a terminal device interlocking method in which a display device that displays content including audio and video is interlocked,
Accepts setting information which is information for designating an element to be output in conjunction with the display of the content;
Storing the received setting information in a storage area;
Sending the setting information to the display device;
Receiving the control data for outputting the element specified in the setting information in conjunction with the display of the content from the display device;
A terminal device interlocking method for outputting the element using the control data in conjunction with display of the content.

Appendix 13
A display device that displays content including audio and video is a terminal device interlocking method that interlocks with an arbitrary terminal device,
In conjunction with the display of the content, the terminal device receives from the terminal device setting information that is information for designating elements output by the terminal device,
Store the received setting information in the storage area,
Generating control data for outputting the element specified in the setting information in conjunction with the display of the content;
A terminal device linkage method for transmitting generated control data to the terminal device.

Appendix 14
A terminal device linkage method for viewing content by linking a display device that displays content including audio and video and a terminal device,
The terminal device
Accepts setting information which is information for designating an element to be output in conjunction with the display of the content;
Store the received setting information in the storage area,
Sending the setting information to the display device;
Receiving the control data for outputting the element specified in the setting information in conjunction with the display of the content from the display device;
In conjunction with the display of the content, the element is output using the control data,
The display device
Receiving the setting information from the terminal device;
Storing the setting information in a storage area;
Using the setting information, generating the control data,
A terminal device interlocking method of transmitting generated control data to the terminal device.

Appendix 15
A program for operating a terminal device in conjunction with a display device that displays content including audio and video,
On the computer,
Processing for receiving setting information, which is information for designating an element to be output in conjunction with display of the content;
A process of storing the received setting information in a storage area;
Processing for transmitting the setting information to the display device;
A process of receiving, from the display device, control data for outputting the element specified in the setting information in conjunction with display of the content;
A program for executing the process of outputting the element using the control data in conjunction with display of the content.

Appendix 16
A display device that displays content including audio and video is a program that operates any terminal device in conjunction with each other,
On the computer,
A process of receiving setting information from the terminal device, which is information specifying an element output by the terminal device in conjunction with the display of the content;
A process of storing the setting information in a storage area;
A process of generating control data for outputting the element specified in the setting information in conjunction with the display of the content;
And a process for transmitting the generated control data to the terminal device.

1, 100 TV 2, 2-1, 2-2, 200 Mobile phone 101, 201 Display control unit 102, 202 Audio output unit 103 Program playback unit 104, 205 Control unit (interlocking control unit)
105, 206 Storage area 106, 208 Transmitter / receiver 107, 209 Transmitter 108, 210 Receiver 110 Mobile phone link system unit 203 Vibration controller 204 Lighting controller 207 Input unit

Claims (10)

A terminal device capable of communicating with a display device that displays content including video,
A transmission / reception unit for transmitting / receiving information to / from the display device;
An input unit that receives setting information that is information for designating elements to be output only by the terminal device in conjunction with the display of the content;
After transmitting the setting information to the display device, control data for outputting the element specified in the setting information only by the terminal device in conjunction with the display of the content, the video of the content An interlocking control unit that controls to receive control data generated by the display device from the display device using information indicating ;
A terminal device comprising: an output control unit that outputs the element using the control data in conjunction with display of the content. The output control unit further includes:
It has a vibration control unit that vibrates its own device,
The setting information includes vibration information that specifies vibration of the device itself,
The terminal device according to claim 1, wherein the control data includes linked vibration data that specifies a timing for vibrating the own apparatus in conjunction with the display of the content. The output control unit further includes:
It has a lighting control unit that turns on its own device,
The setting information includes lighting information for designating lighting of the own device,
3. The terminal device according to claim 1, wherein the control data includes interlocking lighting data that specifies a timing for lighting the own device in conjunction with display of the content. A display device for displaying content including video,
A transmission / reception unit for transmitting / receiving information to / from any terminal device;
A storage area for storing setting information received from the terminal device, the setting information being information specifying an element to be output only by the terminal device in conjunction with the display of the content;
Control data for outputting the element specified in the setting information only by the terminal device in conjunction with display of the content is generated using information indicating the video of the content, and the generated control data a display device and a synchronous control unit for transmitting to the terminal apparatus via the transmitting and receiving unit. A terminal device linkage system for viewing content by linking a display device that displays content including video and a terminal device,
The terminal device
A transmission / reception unit for transmitting / receiving information to / from the display device;
An input unit that receives setting information that is information for designating elements to be output only by the terminal device in conjunction with the display of the content;
After transmitting the setting information to the display device, control data for outputting the element specified in the setting information only by the terminal device in conjunction with the display of the content, the video of the content An interlocking control unit that controls to receive control data generated by the display device from the display device using information indicating ;
An output control unit that outputs the element using the control data in conjunction with the display of the content;
The display device
A transmission / reception unit for transmitting / receiving information to / from the terminal device;
A storage area for storing the setting information received from the terminal device;
A terminal device interlocking system comprising: an interlock control unit that transmits the control data to the terminal device via the transmission / reception unit using the setting information. There is a terminal device interlocking method in which a terminal device interlocks a display device that displays content including video,
Accepting setting information which is information specifying an element to be output only by the terminal device in conjunction with the display of the content;
Sending the setting information to the display device;
Control data for outputting the element specified in the setting information only by the terminal device in conjunction with display of the content, and generated by the display device using information indicating the video of the content Receiving control data from the display device;
A terminal device interlocking method for outputting the element using the control data in conjunction with display of the content. A display device that displays content including video is a terminal device interlocking method that interlocks with an arbitrary terminal device,
In conjunction with the display of the content, setting information that is information specifying an element to be output only by the terminal device is received from the terminal device,
Store the received setting information in the storage area,
Control data for outputting the element specified in the setting information only by the terminal device in conjunction with display of the content is generated using information indicating the video of the content, and the generated control data the terminal device link method to be transmitted to the terminal device. A program for operating a terminal device in conjunction with a display device that displays content including video,
On the computer,
Processing for receiving setting information that is information for designating elements to be output only by the terminal device in conjunction with display of the content;
Processing for transmitting the setting information to the display device;
Control data for outputting the element specified in the setting information only by the terminal device in conjunction with display of the content, and generated by the display device using information indicating the video of the content Processing for receiving control data from the display device;
A program for executing the process of outputting the element using the control data in conjunction with display of the content. A display device that displays content including video is a program that operates any terminal device in conjunction with each other,
On the computer,
A process of receiving setting information, which is information specifying an element to be output only by the terminal device in conjunction with the display of the content, from the terminal device;
A process of storing the setting information in a storage area;
Control data for outputting the element specified in the setting information only by the terminal device in conjunction with display of the content is generated using information indicating the video of the content, and the generated control data And a process for transmitting to the terminal device. A terminal device linkage method for viewing content by linking a display device that displays content including video and a terminal device,
The terminal device
Accepting setting information which is information specifying an element to be output only by the terminal device in conjunction with the display of the content;
Sending the setting information to the display device;
Control data for outputting the element specified in the setting information only by the terminal device in conjunction with display of the content, and generated by the display device using information indicating the video of the content Receiving control data from the display device;
In conjunction with the display of the content, the element is output using the control data,
The display device
Receiving the setting information from the terminal device;
Storing the setting information in a storage area;
A terminal device linkage method, wherein the control data is transmitted to the terminal device using the setting information.

Images