JP2012163853A - Display device, information service system, information service method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display subtitle information more properly.SOLUTION: A display device with a display unit includes detection means for detecting a position of the display device and display control means for displaying subtitle information at a display position in the display unit, identified according to the position detected by the detection means.

Description

  The present invention relates to a display device, an information providing system, an information providing method, and a program.

There are cases where movies produced in foreign countries are screened in movie theaters and are shown in foreign languages and Japanese subtitles are projected, and cases where Japanese subtitles are dubbed and not shown. Such a device makes it possible to deal with various audiences. However, for example, in the former case, some problems remain.
For example, in order to support subtitles in two languages, when performing on the same screen (venue), perform twice at different times, or set a screen for each language if you want to perform at the same time There is a need to. In other words, a time zone and a venue must be secured for each language. In addition, for example, even if Japanese subtitles are screened, subtitles are created according to a certain age group, and depending on the wording and usage of kanji, expressions that are difficult to understand may be mixed into younger generations.
In recent years, a technique for displaying subtitles on an HMD (Head Mounted Display) worn by a spectator using virtual reality has been disclosed (for example, see Patent Document 1). In this technique, subtitles are displayed on the HMD, so that a plurality of spectators who are viewing the same screen can view subtitles in their favorite languages.

Japanese Patent Laid-Open No. 2001-069024

  However, the technique described in Patent Document 1 has a problem in that captions displayed on the HMD are fixed and displayed near predetermined coordinates in the HMD.

  The present invention has been made in view of such problems, and an object thereof is to display subtitle information more appropriately.

  Therefore, a display device according to the present invention is a display device having a display unit, the detection unit detecting a position of the display device, and the display unit specified according to the position detected by the detection unit Display control means for displaying subtitle information at the display position.

  According to the present invention, caption information can be displayed more appropriately.

It is a figure which shows an example of HMD. It is a figure which shows an example of AR provision system. It is a figure which shows an example of the hardware constitutions of HMD. It is a figure which shows an example of the hardware constitutions of a projector. It is a figure which shows an example of a function structure of HMD and a projector. It is a figure which shows an example of the data structure of caption data. It is a figure which shows an example of the sequence of an information provision system. It is a figure which shows an example of the flowchart which concerns on a data delivery process. It is a figure which shows an example of the flowchart which concerns on a display control process. It is a figure which shows an example of the display mode of HMD. It is a figure which shows an example of the display mode of HMD. It is a figure which shows an example of the data structure of subtitle information. It is a figure which shows an example of the flowchart which concerns on a data delivery process. It is a figure which shows an example of the data structure of subtitle information. It is a figure which shows an example of the data structure of a management table. It is a figure which shows an example of the flowchart which concerns on a data delivery process. It is a figure which shows an example of the flowchart which concerns on a display control process. It is a figure which shows an example of the display timing of a caption. It is a figure which shows an example of the display mode of HMD. It is a figure which shows an example of the display mode of HMD.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1 is a diagram illustrating an example of an HMD (HMD 100) according to the present embodiment. The HMD 100 is an example of a display device (computer) and includes a display 10.
In this embodiment, the user views the movie by wearing the HMD 100 on the head and viewing the screen 900 on which the image is displayed via the display 10.
At this time, caption information (an example of AR data) corresponding to the scene is displayed on the display 10 so as to be located outside the screen 900.
In the present embodiment, AR data (computer graphics image or the like) is displayed on the display 10 at a position that matches the real space, thereby providing the user with an expanded reality (AR).

FIG. 2 is a diagram illustrating an example of an AR providing system (information providing system). The information providing system includes an HMD 100 and a projector 200. The HMD 100 and the projector 200 are configured to be capable of wireless communication with each other.
The HMD 100 includes a control function 120 that controls various types of control in the HMD 100, and a language designation function 130 that accepts designation of a subtitle language.
The projector 200 is an example of an information providing device (computer), and includes a projection function 210 that reads a film 220 and displays an image on the screen 900, and a control function 230 that controls various controls in the projector 200 using various data 240. Have.

For example, the control function 230 of the projector 200 transmits a series of caption data (caption information) to the HMD 100 when the projection function 210 reads the caption data in accordance with the reading of the film 220. The details of the caption data will be described with reference to FIG.
On the other hand, the control function 120 of the HMD 100 captures a real space in real time via the photographing device 15 provided in the HMD 100. Further, the control function 120 identifies the screen 900 (outer shape) by recognizing the markers (910, 920, 930, 940) provided on the screen 900 from the image of the photographing device 15, and the outside of the screen 900 in the display 10. Displays subtitle information.
Details of the control function 120, the language designation function 130, and the control function 230 will be described with reference to FIG.

FIG. 3A is a diagram illustrating an example of a hardware configuration of the HMD 100. The HMD 100 includes a display 10, a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an HD (Hard Disk) 14, a photographing device 15, an input device 16, and an interface device 17. Have.
The display 10 is an example of a display unit, and is a transmissive liquid crystal display or the like. The display 10 is configured to display AR data and to be able to visually recognize a real space through the display 10. The CPU 11 reads the program from the ROM 12, the HD 14, etc. as necessary, and executes the program. By executing the program, functions in the HMD 100 and processing according to a flowchart described later are realized.

The ROM 12 stores a program that is read first when the power of the HMD 100 is turned on. The RAM 13 functions as a main memory of the HMD 100. The HD 14 stores numerical data calculated by the CPU 11 in addition to the program.
Note that the HMD 100 may acquire various types of information stored in a storage unit such as the RAM 13 and the HD 14 from a medium such as a CD-ROM or USB, or may download the information via a network or the like.
The imaging device 15 captures a real space. The input device 16 includes operation buttons and the like, and inputs various information in response to operation of the operation buttons (user operation). The interface device 17 communicates with an external device (such as the projector 200), transmits a device ID, language data, and the like, which will be described later, and receives subtitle information and the like. Data received by the interface device 17 is stored in a storage unit such as the RAM 13 or the HD 14.

FIG. 3B is a diagram illustrating an example of a hardware configuration of the projector 200. The projector 200 includes a CPU (Central Processing Unit) 21, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23, an HD (Hard Disk) 24, an input device 25, an output device 26, a recording medium drive device 27, and An interface device 28 is included.
CPU21 reads a program from ROM22, HD24 etc. as needed, and executes a program. By executing the program, functions in the projector 200 and processing according to a flowchart described later are realized.

The ROM 22 stores a program that is read first when the projector 200 is powered on. The RAM 23 functions as a main memory for the projector 200. The HD 24 stores numerical data calculated by the CPU 21 in addition to the program.
The projector 200 may acquire various types of information stored in the storage unit such as the RAM 23 and the HD 24 from a medium such as a CD-ROM or USB, or may download the information via a network or the like.

The input device 25 includes an input device such as a button, and inputs various information to the projector 200 in response to an operation of the input device by the user. Note that the input device 25 may be configured to input various information to the projector 200 through operation of a device for performing remote control, operation of a keyboard or mouse connected to the information processing device, or the like. Good. The output device 26 displays various information on the screen 900.
The recording medium drive device 27 reads a recording medium 29 such as a film set in the recording medium drive device 27 and reads various recorded information. The interface device 28 communicates with an external device (such as the HMD 100), transmits subtitle information and the like, and receives a device ID, language data, and the like described later. Data received by the interface device 28 is stored in a storage unit such as the RAM 23 or the HD 24.

FIG. 4 is a diagram illustrating an example of functional configurations of the HMD 100 and the projector 200. The HMD 100 includes a display control unit 31, a communication unit 32, and an input unit 33.
The display control unit 31 controls display on the display 10 via the CPU 11, the imaging device 15, and the like. For example, the display control unit 31 adjusts the position, size, range, brightness, etc. of the caption information and displays it on the display 10.
The communication unit 32 controls communication performed via the interface device 17. For example, the communication unit 32 transmits a later-described device ID, language data, and the like to the projector 200 and receives subtitle information and the like from the projector 200.
The input unit 33 manages information input in response to operation of the operation buttons. For example, the input unit 33 receives designation of one language from a plurality of types of languages in response to operation of the operation button, and notifies the communication unit 32 of language data that is an example of identification information that can identify the designated language. To do. The designated language data is stored in a storage unit such as the RAM 13.

On the other hand, the projector 200 includes a data management unit 41 and a communication unit 42.
The data management unit 41 manages various data in the projector 200 via the CPU 21, the recording medium drive device 27, and the like. For example, the data management unit 41, when a plurality of types of caption data provided corresponding to a plurality of types of languages are read from the film, a series of caption data (caption information) corresponding to the language data received from the HMD 100 To the communication unit 42.
The communication unit 42 controls communication performed via the interface device 28. For example, the communication unit 32 transmits caption information to the HMD 100 and receives a device ID, language data, and the like described later from the HMD 100.

FIG. 5 is a diagram illustrating an example of the data structure of caption data.
In the present embodiment, the caption data is information indicating “0” or “1”, and is provided in the caption track of the film. More specifically, the film is provided with a video track, an audio track (“sound track” in a broad sense), and a subtitle track. The video track, the audio track, and the subtitle track are simultaneously recorded by the recording medium drive device 27. Is read. Note that video information is recorded on the video track, and audio information is recorded on the audio track.
In other words, caption data is provided in advance on the film so as to be synchronized with the video information and the audio information (so that they can be synchronized), and the projector 200 displays the caption information in synchronization with the video information and the audio information. The subtitle data is read out as follows.

For example, when subtitle data of the subtitle is recorded at a point before the point on the film where the video information corresponding to the subtitle is recorded, and a series of subtitle data is read by the projector 200 until the video information is projected. A series of caption data is transmitted as caption information to the HMD 100, and the caption information is displayed by the HMD 100. With the above-described configuration, synchronization of video, audio, and subtitles is realized.
The subtitle track is provided with a plurality of types of subtitle data corresponding to a plurality of types of languages. Note that the projector 200 simultaneously reads out all types of caption data together with video information and audio information.

FIG. 6 is a diagram illustrating an example of a sequence of the information providing system.
In SQ300, the HMD 100 performs language designation processing. More specifically, in response to the operation of the input device 16, the input unit 33 of the HMD 100 accepts designation of one language from a plurality of types of languages, and specifies language data that can identify the accepted language. .
In SQ310, the communication unit 32 of the HMD 100 transmits a device ID that can identify the HMD 100 and the specified language data to the projector 200. The device ID may be a manufacturing number at the time of shipment of the HMD 100 or may be a value set in advance by an administrator.

In SQ320, the data management unit 41 of the projector 200 performs data distribution processing. For example, the data management unit 41 stores the device ID and language data received via the communication unit 42 in association with each other in the HD 24, and in response to reading of the film, subtitle information in the language requested by the HMD 100 is transmitted to the communication unit. 42 to transmit. Details of the data distribution process will be described with reference to FIG.
In SQ330, the communication unit 42 of the projector 200 transmits the caption information to the HMD 100. Here, in FIG. 6, the process of SQ330 is performed in the data distribution process, but for convenience, it is illustrated as being performed after the data distribution process. The same applies to SQ350, SQ370, and SQ380.

In SQ340, the display control unit 31 of the HMD 100 performs display control processing. For example, the display control unit 31 adjusts the subtitle information received via the communication unit 32 to suit various settings designated by the audience, the position and orientation of the HMD 100, and the brightness of the movie theater. Displayed on the display 10. Details of the display control process will be described with reference to FIG.
Subtitle information transmission processing and display control processing are performed until the data management unit 41 finishes reading the film through the recording medium drive device 27 (SQ350 to SQ390).

FIG. 7 is a diagram illustrating an example of a flowchart relating to data distribution processing.
First, the data management unit 41 reads a video track, an audio track, and a subtitle track via the recording medium drive device 27 (S400).
At this time, the data management unit 41 stores the caption data of the caption track in the RAM 23 for each language. For example, when subtitle data corresponding to Japanese, English, and Chinese is recorded in the audio track, the data management unit 41 stores Japanese subtitle data, English subtitle data, and Chinese subtitle data. It identifies and stores in RAM23.
If the data management unit 41 determines that a series of subtitle data has been obtained, the data management unit 41 performs the process of S410. An appropriate method can be adopted as a method for discriminating a series of caption data. For example, the data management unit 41 determines that the caption data provided between the start code and the end code provided in the caption track is a series of caption data. Further, for example, it is determined that the caption data for each specific code provided in the caption track is a series of caption data.

Next, the data management unit 41 uses the device ID received from each HMD via the communication unit 42 and the language data of the language requested from each HMD to display the caption information of the requested language for each HMD. Is transmitted via the communication unit 42 (S410).
For example, when the device ID is “100” indicating HMD100 and the language data is “JP” indicating Japanese, the device ID “100” and the language data “JP” correspond to the HD 24 as described above. Attached and memorized. That is, in the process of S410, the data management unit 41 sequentially reads the device ID and language data stored in the HD 24, and reads “100” and “JP” from the HD 24 via the communication unit 42. The Japanese subtitle information stored in the RAM 23 is transmitted to the HMD 100.

  Next, the data management unit 41 determines whether or not reading of the video track, the audio track, and the subtitle track by the recording medium drive device 27 is completed (S420). At this time, if the data management unit 41 determines that the processing has been completed, the processing ends. If the data management unit 41 determines that the processing has not been completed, the processing of S400 is performed.

FIG. 8 is a diagram illustrating an example of a flowchart relating to display control processing.
First, the display control unit 31 specifies the screen 900 based on the video of the photographing device 15 and calculates the position of the screen 900 on the display 10 (S500).
In the present embodiment, markers indicating the outer shape of the screen 900 are provided at the four corners of the screen 900, and the display control unit 31 identifies the screen 900 using the marker. Note that the method for specifying the screen 900 is not limited to the above-described configuration, and a known method such as pattern recognition may be employed.

Further, a configuration may be adopted in which the markers provided at the four corners of the screen 900 emit infrared rays, and the screen 900 is specified based on the markers detected by the infrared detection device. In this case, the infrared detecting device may be included in the photographing device 15 or may be provided instead of the photographing device 15. In addition, the infrared detection device is not limited to the passive sensor as described above, and the present embodiment can be realized by an active sensor.
In this way, by using a marker that emits infrared rays, the screen 900 can be specified without causing discomfort to the audience. Furthermore, the screen 900 can be accurately specified even in a dark place such as a movie theater. be able to. In other words, an infrared camera may be employed as the photographing device 15, and the same effect can be obtained in this case.

Next, the display control unit 31 displays subtitle information on the display 10. More specifically, the display control unit 31 displays subtitle information on the outside (outside area) of the screen 900 in the display 10 using the position calculated in S500. A conventionally used technique is applied to the position specifying calculation (S500). More specifically, the coordinate system in the photographing apparatus 15 is converted into the coordinate system in the display 10. As a result, a corresponding area of the screen 900 can be specified in the display 10 based on each marker position captured by the photographing device 15. The display control unit 31 displays subtitle information at a certain distance from the outer shape of the screen 900 in the display 10 in the outer region.
Whether to display on the top, bottom, left, or right of the screen 900 in the display 10 may be a configuration specified by the user, or may be a configuration determined in the widest region of the top, bottom, left, and right outer regions, The configuration may be determined according to the position, posture, etc. of the HMD 100, or these may be combined.

Here, when the configuration determined according to the position of the HMD 100 is adopted, the display control unit 31 is close to the screen 900 as shown in FIG. 9A when the HMD 100 is not positioned in front of the screen 900, for example. Display subtitle information on the side.
Further, for example, when a configuration determined according to the attitude of the HMD 100 is adopted, the display control unit 31 causes the user to slightly lower the screen 900 as shown in FIG. 9B when the HMD 100 is tilted. When viewed, that is, when the HMD 100 is not located in front of the screen 900, the display control unit 31 specifies the widest area of the upper, lower, left, and right outer areas and displays the caption information in the specified area.

According to the present embodiment, a caption such as a movie can be set in a language desired by the user, and further, the caption can be provided to the user without disturbing the video.
Note that the present embodiment is not limited to the above-described configuration. For example, the read caption data may be appropriately transmitted to the HMD 100, and a series of caption data may be used as the caption information in the HMD 100.

(Second Embodiment)
In the first embodiment, the caption data is recorded on the film, but in the present embodiment, caption information (a series of caption data) is stored in a storage unit such as the HD 24. In addition, about the same structure as 1st Embodiment, description is abbreviate | omitted suitably using the same code | symbol.

FIG. 10 is a diagram illustrating an example of a data structure of caption information.
The video information and the audio information are stored in the HD 24 and are timing IDs 51 (an example of marker information that serves as an index for synchronizing with video information at each timing when at least one of the video information and the audio information is read out). .) Is attached. On the other hand, for the caption information, the timing IDs (52 to 56) corresponding to the timing ID 51 of at least one of the video information and the audio information are associated with each other and stored in the HD 24.
Note that the video information and audio information may be recorded on a film.

Here, when video information and audio information are read, the attached timing ID is read first, and caption information corresponding to the read timing ID is read from the HD 24. Then, the timing ID and subtitle information read by the projector 200 are transmitted to the HMD 100, and the subtitle information is displayed by the HMD 100. This realizes synchronization of video, audio, and subtitles.
Further, the HD 24 similarly stores a plurality of types of subtitle information corresponding to a plurality of types of languages.
Note that the present embodiment is not limited to the above-described configuration. For example, video information, audio information, and subtitle information may be stored in a storage device connected via the interface device 28.

FIG. 11 is a diagram illustrating an example of a flowchart relating to data distribution processing.
First, the data management unit 41 reads the video track and the audio track via the recording medium drive device 27, and stores the timing ID in the RAM 23 when the timing ID is read (S600).
Next, the data management unit 41 determines whether or not the read information is a timing ID (S610). At this time, if the data management unit 41 determines that it is a timing ID, it performs the process of S620, and if it determines that it is not a timing ID, it performs the process of S600.

In S620, the data management unit 41 extracts caption information corresponding to the read timing ID from the HD 24. At this time, the data management unit 41 extracts all caption information corresponding to a plurality of types of languages.
Next, as in S410, the data management unit 41 uses the device ID received from each HMD and the language data of the language requested from each HMD to obtain the subtitle information of the requested language and its timing ID. It transmits to each HMD via the communication part 42 (S630). In addition, the data management part 41 transmits only timing ID, when the caption information corresponding to timing ID is not extracted.
Next, the data management unit 41 determines whether the reading of the video track and the audio track is completed (S640). At this time, if the data management unit 41 determines that the processing has been completed, the processing ends. If the data management unit 41 determines that the processing has not been completed, the processing of S600 is performed.
In the HMD 100, display control processing is performed, and caption information is displayed on the outside of the screen 900 in the display 10.

In the process of S630, the configuration in which the caption information and the corresponding timing ID are transmitted to each HMD is adopted, but the configuration is not limited to this configuration.
For example, when the projector 200 receives language data from the HMD 100, the projector 200 transmits all the caption information in the language of the language data and the associated timing ID to the HMD 100, and transmits the timing ID in the process of S630. It may be adopted.
Further, for example, when the HMD 100 receives the designation of the language, the HMD 100 acquires the subtitle information and the associated timing ID from the HD 24, and the projector 200 adopts a configuration in which the timing ID is transmitted in the process of S630. Good.
In these cases, the same process as the extraction process in S620 is performed in the display control process.
According to the present embodiment, since the subtitle information is not provided on the film, it is possible to more easily cope with the demand for additional language types. In addition, in this embodiment, there exists an effect of 1st Embodiment.

(Third embodiment)
In the present embodiment, object information (an example of AR data) stored in advance is displayed on the display 10 so as to be superimposed on an object (letter, newspaper, magazine, signboard, etc.) displayed on the screen 900. That is, in the present embodiment, caption information is stored in the HD 24 as in the second embodiment, and object information and the like related to video are stored in the HD 24. In addition, about the same structure as 1st Embodiment and 2nd Embodiment, description is abbreviate | omitted suitably using the same code | symbol.

FIG. 12 is a diagram illustrating an example of a data structure of caption information.
The video information and the audio information may be stored in the HD 24 or recorded on the film, but a timing ID 51 is assigned for each timing at which at least one of the video information and the audio information is read. On the other hand, the subtitle information is stored in the HD 24 in association with the timing IDs (52 to 56) corresponding to the timing ID 51.
In this embodiment, the timing ID (57, 58) corresponding to the timing ID 51 is associated with the object information (image data, free data, etc.) stored in the HD 24. The object information is information related to the object in the video. For example, in the case where Japanese designation is accepted by the HMD 100, in order to indicate a Japanese letter when a Chinese letter is projected as an object, the administrator uses a Japanese letter as object information. The image data is stored in advance in the HD 24 in association with the timing ID.

Here, when video information and audio information are read, the attached timing ID is read, and caption information and object information corresponding to the read timing ID are read. Then, the timing ID, subtitle information, and object information read by the projector 200 are transmitted to the HMD 100, and the subtitle information and the object information are displayed by the HMD 100. This realizes synchronization of video, audio, subtitles, and objects.
Further, the HD 24 similarly stores a plurality of types of subtitle information corresponding to a plurality of types of languages.
Note that the present embodiment is not limited to the above-described configuration. For example, video information, audio information, caption information, and object information may be stored in a storage device connected via the interface device 28.

FIG. 13 is a diagram illustrating an example of a data structure of a management table for managing caption information and the like.
The management table includes timing ID, language type, subtitle content, time adjustment for adjusting the time for displaying the subtitle, display position indicating the position for displaying the object, and information for size adjustment for adjusting the size of the object. Stored.
It is assumed that various information in the management table is set in advance by the administrator or the like before the start of the movie. In the present embodiment, a management table used in a database or the like is adopted for data management. However, it may be a table format file handled by an application capable of spreadsheet or the like, and may be separated by a comma. File.

  FIG. 14 is a diagram illustrating an example of a flowchart relating to data distribution processing. Note that the processing in S700, S710, S720, and S750 is basically the same as the processing in S600, S610, S620, and S640, and thus description thereof is omitted. However, in S720, the data management unit 41 also extracts the adjustment time information when the adjustment time information for the caption information is set.

In S730, the data management unit 41 extracts object information corresponding to the read timing ID from the HD 24. The data management unit 41 extracts all object information when there is object information corresponding to a plurality of types of languages.
Next, similarly to S410 and S630, the data management unit 41 extracts the caption information of the requested language based on the device ID received from each HMD and the language data of the language requested by each HMD. The object information and its timing ID are transmitted to each HMD via the communication unit 42. In addition, the data management part 41 transmits only timing ID, when the caption information and object information corresponding to timing ID are not extracted.

FIG. 15 is a diagram illustrating an example of a flowchart relating to display control processing. Note that the processing in S800 is basically the same as the processing in S500, and thus the description thereof is omitted.
In S810, the display control unit 31 performs the same processing as the processing in S510, and sets time adjustment information (value) in the timer when the time adjustment information is received together with the caption information.
Here, when receiving the timing ID, the display control unit 31 basically deletes the currently displayed subtitle information, and when receiving the next timing ID and subtitle information, a value is set in the timer. When the value has passed, the caption information is displayed. However, when the input unit 33 accepts the designation (extended display designation) for displaying the subtitles extended through the input device 16, the display control unit 31 has passed the value set in the timer. Later, the currently displayed subtitle information is deleted and the next subtitle information is displayed.

FIG. 16 shows an example of subtitle display timing. The upper row shows the subtitle display timing when the extended display designation is not accepted, and the lower row shows the subtitle display timing when the extended display designation is accepted.
Here, in this embodiment, as shown in the upper part of FIG. 16, basically, subtitles corresponding to the scene are displayed. More specifically, when the video is switched from the first scene (scene 1) to the second scene (scene 2) (when the timing ID of the second scene is received), the caption of the first scene is changed. Erased. However, elementary school students and the like read the subtitles slowly, so the subtitles in the first scene may be erased before reading the subtitles in the first scene.
Therefore, in this embodiment, when the extended display designation is accepted, as shown in the lower part of FIG. 16, even if the timing ID of the second scene is received and the second scene is started, Until the caption is displayed (until 10 seconds after receiving the timing ID of the second scene), the caption of the first scene is displayed. Note that the time for displaying a caption may be changed according to the length of the caption. In this case, the subtitle of the first scene and the subtitle of the second scene may be displayed simultaneously in the second scene.
In this way, the time for displaying the caption can be changed by accepting the extended display instruction, so that the audience can easily grasp the caption.

In S820, the display control unit 31 performs distortion processing. In the distortion processing, the display control unit 31 deforms the shape of the display object according to the distortion of the screen 900. Note that the process of deforming the shape can be realized by using a general method, and thus detailed description thereof is omitted.
Further, the display control unit 31 changes the size of the display object corresponding to the size of the screen 900 in the display 10 based on the size adjustment information transmitted together with the object information. In the present embodiment, the size adjustment information is a value (ratio) indicating the vertical length of the object when the vertical length of the screen 900 is 1.

In S830, the display control unit 31 displays the object information after the distortion processing on the display 10. More specifically, the display control unit 31 determines the display position on the display 10 based on the coordinate information of the display position transmitted together with the object information. In the present embodiment, the coordinate information is data in a coordinate system with the marker (marker 910) provided at the upper left of the screen 900 as the origin.
For example, when designation of Japanese subtitles is accepted by the HMD 100, when a Chinese letter 60 as shown in FIG. 17A is displayed on the screen 900, object information of a Japanese letter as shown in FIG. 17B. Is transmitted from the projector 200 and is aligned so that it is superimposed on the Chinese letter 60 on the screen 900, and the Japanese letter 65 is displayed on the display 10.

In S840, the display control unit 31 performs an option process. In the optional processing, when the display control unit 31 receives free data, the display control unit 31 performs processing according to the free data.
For example, the display control unit 31 performs a process (mosaic process) that covers or hides some or all of the video based on free data indicating a cruel scene, a scene that the child does not want to show.
According to this embodiment, subtitles can be provided according to the age of the audience. Further, according to the present embodiment, it is possible to more easily correspond to a designated language for a video object. In addition, in this embodiment, there also exists the effect of 1st Embodiment and the effect of 2nd Embodiment.

Further, the present embodiment is not limited to the above-described configuration.
For example, the display control unit 31 may perform a process related to displaying caption information (S810) and a process related to displaying object information (S820, S830) in parallel, or a process related to displaying object information. You may perform before the process which concerns on a display of subtitle information.
For example, the display control unit 31 may perform a process of adjusting the brightness of the object information in accordance with the brightness of a movie theater (venue). The brightness of the venue may be acquired from the video of the photographing device 15 or may be acquired by the detection device provided in the HMD 100 for detecting the brightness.

The HD 24 stores 3D object information. Therefore, when the movie is a 3D movie, the display control unit 31 displays 3D object information on the display 10 in accordance with the scene of the movie. Note that the display control unit 31 may display 3D object information on the display 10 in accordance with the scene of the movie even in the case of a 2D movie.
In addition, (stored in the HD24) to register the face photos of 360 ^o of the audience in advance, the projector 200, and sends it to the HMD100 reads the face photograph at a timing defined in advance, HMD100 is, display a face photo on the display 10 To do. For example, when a specific person appearing in a movie is projected, his / her face picture is superimposed on the face of the specific person and displayed on the display 10.

In the above-described embodiment, the example in which the video is recorded on the film has been described. However, even if the video, audio, and subtitles are all recorded as digital data, the embodiment can be similarly implemented.
In the above-described embodiment, the example in which the language data is transmitted from the HMD 100 to the projector 200 has been described. However, the language selection switch (an example of the input device 16) is provided in the HMD 100, and the projector 200 is wirelessly distributed over multiple channels. You may make it selectively receive the subtitle information (subtitle information channel) of the language according to the operation of the language selection switch by the user from the subtitle information. In this case, the language selection switch may be a physical switch or a software configuration switch. If it adds, this structure is employable also about 1st Embodiment and 2nd Embodiment.

(Other embodiments)
In the above-described embodiment, the description is applied to the movie theater screen 900. However, the present invention may be applied to a television set in a house.
The storage device connected via the recording medium 29, the HD 24, and the interface device 28 is an example of a storage medium.
If it adds, about the structure mentioned above, it can employ | adopt combining suitably.

According to the configuration described above, when subtitles are projected, it is possible to avoid a situation in which they overlap with a part of the video, and the subtitles overlap somewhere in the work and do not deteriorate the appearance.
In addition, subtitles are basically displayed in correspondence with dialogue, captions, etc., but depending on the work, there are some articles such as newspapers and magazines that are projected on the video. On the other hand, according to the above-described configuration, it is possible to solve the problem that a meaningful article portion is displayed while being displayed in the original language.
Thus, according to the configuration described above, caption information can be displayed more appropriately.

  The preferred embodiments of the present invention have been described in detail above, but the present invention is not limited to such specific embodiments, and various modifications can be made within the scope of the gist of the present invention described in the claims.・ Change is possible.

100 HMD
200 Projector

Claims (11)

A display device having a display unit,
Detecting means for detecting the position of the display device;
And a display control means for displaying subtitle information at a display position in the display unit specified according to the position detected by the detection means. The detection means further detects the attitude of the display device,
The display device according to claim 1, wherein the display control unit displays the subtitle information at a display position in the display unit specified according to the position and orientation detected by the detection unit. The detection means identifies a screen that displays information according to the position and orientation of the display device,
The display according to claim 2, wherein the display control unit determines a position outside the screen in the display unit as a display position in the display unit, and displays the caption information at the determined position. apparatus. Markers are provided at the four corners of the screen,
The display device according to claim 3, wherein the display control unit specifies the screen by using markers at the four corners. An information providing system that includes an information providing device that transmits caption information, a display device that includes a display unit, and a storage medium that stores caption information,
The information providing apparatus includes:
Acquisition means for acquiring subtitle information from the storage medium;
Transmission means for transmitting subtitle information acquired by the acquisition means to the display device,
The display device
Receiving means for receiving the caption information from the information providing device;
Detecting means for detecting the position of the display device;
An information providing system comprising: display control means for displaying the caption information at a display position in the display unit specified according to the position detected by the detection means. The storage medium further stores object information related to the object displayed on the screen,
The acquisition means further acquires object information from the storage medium,
The transmission means transmits the object information acquired by the acquisition means to the display device,
The receiving means receives the object information from the information providing apparatus;
The information providing system according to claim 5, wherein the display control unit displays the object information at a display position in the display unit specified according to the position detected by the detection unit. The storage medium stores a plurality of types of subtitle information corresponding to a plurality of types of languages,
The display device further includes notification means for notifying the information providing device of identification information indicating a language specified in response to a user operation,
The information providing system according to claim 5, wherein the transmission unit transmits subtitle information in a language corresponding to the identification information among the subtitle information acquired by the acquisition unit to the display device. The storage medium stores a plurality of types of subtitle information corresponding to a plurality of types of languages,
The acquisition means acquires the plurality of types of subtitle information from the storage medium,
The transmission means transmits the plurality of types of subtitle information acquired by the acquisition means to the display device,
The receiving means receives subtitle information in a language specified in response to a user operation among the plurality of types of subtitle information,
The display control means displays the subtitle information of the language received by the receiving means at a display position in the display unit specified according to the position detected by the detecting means. 6. The information providing system according to 6. An information providing method in a display device having a display unit,
A detection step of detecting a position of the display device;
A display control step of displaying subtitle information at a display position in the display unit specified according to the position detected in the detection step. An information providing method in an information providing system comprising: an information providing device that transmits caption information; a display device that includes a display unit; and a storage medium that stores caption information.
The information providing apparatus includes:
An acquisition step of acquiring subtitle information from the storage medium;
Transmitting the closed caption information acquired in the acquisition step to the display device,
The display device
A receiving step of receiving the caption information from the information providing device;
A detection step of detecting the position of the display device;
A display control step of displaying the subtitle information at a display position in the display unit specified according to the position detected in the detection step. A computer having a display unit,
Detecting means for detecting the position of the computer;
A program that functions as display control means for displaying subtitle information at a display position in the display unit specified according to the position detected by the detection means.

Images