JP3918197B2 - Transmitting device and receiving device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a transmission apparatus suitable for application to an ISDB broadcast system and the reception apparatus thereof. Specifically, as image information, not only image information constituting one screen but also image information capable of enlarging and displaying an image of a specific area is transmitted at the same time, so that a part of the image displayed on the screen can be arbitrarily selected. The display can be enlarged without any deterioration in image quality.
[0002]
[Prior art]
With the development of digital technology, an interactive integrated digital broadcasting system (referred to as an ISDB (Integrated Services Digital Broadcasting) system) in which various kinds of information including broadcast signals are digitized is being researched and developed in the broadcasting industry.
[0003]
More specifically, the ISDB system is used for not only current broadcast signals (standard television signals, high-definition signals), but also software and facsimile data, as well as multimedia information such as voice, text, graphics, and images. It is a broadcasting system in which each is digitized (encoded), integrated and multiplexed, and then subjected to modulation processing matching the transmission form to be transmitted and received.
[0004]
When various types of information including broadcast signals are integrated and multiplexed, in addition to these pieces of information, additional information used as control information on the receiving side can also be integrated and multiplexed at the same time. The integrated ISDB broadcast signal (digital signal) is transmitted using ground waves, satellite waves, optical cables, or the like.
[0005]
On the receiving terminal side, it is possible to receive the integrated ISDB broadcast signal, discriminate the target signal, display it on the monitor and enjoy it as a normal television broadcast. (Save) or transfer to another terminal. Further, if the received additional information is used, the received information can be used according to the user's preference, such as monitor control, recording control, and processing control on the monitored image. That is, an interactive broadcasting system can be constructed.
[0006]
[Problems to be solved by the invention]
Therefore, if this ISDB system is used, the service content for the user is improved and the more interactive broadcasting system can be constructed as the variety of additional information to be transmitted increases.
[0007]
Now, in the current broadcasting system, the received broadcast signal is simply received and demodulated and viewed on a TV monitor, and so on, so to speak, it is a passive and unilateral system, so the enjoyment of the user is limited. . For example, there is a case where it is desired to enlarge and view a part of an image being monitored on a television. This is because a partial composition may be more attractive than an entire composition.
[0008]
Such partial enlargement processing of partial and local images cannot be realized even with the current system. However, in order to perform this partial enlargement process, an area is specified, and the video information is enlarged and displayed by interpolation, so that not only the scale of the enlargement display processing apparatus increases, but also the object is limited. I hate it. In addition, although it is possible to perform an enlarged display process for a still image, not only a large amount of information has to be processed for a moving image, but the speed of the enlargement process is slow, which is not realistic. Furthermore, since an enlarged image is obtained by interpolation processing, its resolution also becomes a problem.
[0009]
Therefore, the present invention has been made to achieve such a problem, and not only image information constituting one screen but also image information capable of enlarging and displaying an image of a specific area as image information is simultaneously transmitted. By doing so, a part of the image displayed on the screen can be enlarged and displayed at an arbitrary timing regardless of the moving image or the still image without causing any deterioration in image quality.
[0010]
[Means for Solving the Problems]
In order to solve the above-described problem, in the transmission device of the present invention, a first encoding unit that encodes information of a main video material for displaying a predetermined screen size and generates first encoded information; Second encoding for generating second encoded information by encoding video information of the predetermined screen size corresponding to the enlarged display in order to enlarge and display a part of the main video material on the predetermined screen Means, at least multiplexing means for multiplexing the first encoded information and the second encoded information, and transmitting means for transmitting the encoded information multiplexed by the multiplexing means It is.
[0014]
Further, the receiving device selects at least a specific broadcast signal obtained by encoding and multiplexing information of a plurality of video materials, and at least the specific broadcast signal selected by the channel selection means. First encoded information obtained by encoding main video material information for displaying a predetermined screen size, and an image having the predetermined screen size for enlarging and displaying a part of the main video material on the predetermined screen Signal separation means for separating the encoded information into second encoded information, and information on the main video material for decoding the first encoded information and displaying the predetermined screen size. First decoding means for generating and decoding the second encoded information to generate video information of the predetermined screen size for enlarging and displaying a part of the main video material on the predetermined screen. 2 decoding means and at least the above Output video control means for outputting information generated by one decoding means and / or information generated by the second decoding means, and control means for controlling information output from the output video control means. Is.
[0018]
When the video screen is divided into n in advance and each divided area is designated, an image belonging to the designated area is enlarged and displayed. Therefore, on the transmitting side, in addition to the video information for one screen, video information for one screen corresponding to each of the n divided images is transmitted at the same time. Therefore, on the transmission side, video information corresponding to one screen is transmitted using (n + 1) channels. The divided area can be specified by moving the cursor.
[0019]
In this way, an enlarged image of the designated area can be displayed immediately, and there is no deterioration in resolution due to the enlarged display. The position of the designated cursor on the screen determines the coordinates of the cursor position, and the image of the channel including the coordinates is selected.
[0020]
In this embodiment, since an area to be enlarged is determined in advance, an arbitrary image cannot be enlarged and displayed. In order to realize this, for example, a pointing address (subject coordinates) is assigned in advance to a subject (single or plural) such as a main character. The value of this pointing address changes according to the movement of the subject. Sometimes it disappears from the screen. This is because it corresponds to each movement of the subject.
[0021]
This pointing address is associated with the subject identifier (keywords such as the name and actor name for characters). At the same time, image interpolation information for enlarging and displaying these subjects to the size of one screen is simultaneously transmitted. The user specifies a pointing address or an identifier. Searches for an image in which the specified pointing address or identifier matches the transmitted pointing address or identifier. If they match, the corresponding interpolation information is used to enlarge the size of the subject image for one screen. indicate. In this way, as long as the pointing address is present, the subject is always enlarged and displayed regardless of the position on the screen. Even if the image is enlarged and displayed due to the use of the image interpolation information, the resolution does not deteriorate so much.
[0022]
DETAILED DESCRIPTION OF THE INVENTION
Next, an embodiment of the present invention will be described in detail with reference to the drawings.
[0023]
FIG. 1 is a system diagram of a main part showing an embodiment of an ISDB transmitting apparatus 10 according to the present invention. In this example, the main information transmitted in an integrated manner is the same as that of a standard television signal. It is assumed that it is a broadcast signal of a multi-channel multiplex program that transmits a program using a plurality of channels. Additional information such as control information is added to each of them for multiplexing. Various kinds of additional information can be considered. For a standard television signal, a time code can be considered.
[0024]
Referring to FIG. 1, the video signal SVN of the standard television signal is supplied to the terminal 12a, and the audio signal SAN associated therewith is supplied to the terminal 12b. The encoding unit 14 performs appropriate encoding processing including compression and the like. Is given. In synchronization with this encoding process, the additional information generating means 16 operates to generate additional information such as control information. In this example, a time code is illustrated as additional information, and thus the time code generating unit 16 is configured. The encoded standard television signal and time code TC are supplied to the multiplexing unit 20 and multiplexed together with other information.
[0025]
Sources include broadcast signals for multi-channel multiplex programs that can be enlarged and displayed in addition to standard television signals. In the following description, two examples of the enlarged display method are given. One is a method of enlarging and displaying the video in the designated divided area by dividing the screen into n in advance and designating each divided area.
[0026]
In this case, the number of multiplexed channels used for the same program is (n + 1). For example, when the screen is divided into four as shown in FIG. 2, in addition to the video information (main video material) for one screen, four pieces of video information (divided video) for enlarging and displaying the information divided into four on one screen. This is because a material is required. FIG. 1 shows an embodiment for realizing the first method.
[0027]
Assuming these, there are five source sources as the video material, the main video material is supplied to the input terminals 24m and 26m for one channel, and the input terminals 24a to 24d and 26a to the remaining four channels. A corresponding divided video material is supplied to 26d. FIG. 2 shows an image based on the main image material, and FIG. 3 shows an enlarged image based on the image material displayed in the third divided area among the divided image materials.
[0028]
The video materials SM and S1 to S4 are composed of video signals SMV and S1V to S4V and audio signals SMA and S1A to S4A, respectively. The video materials S1 to S4 are subjected to the same encoding process as described above by the corresponding encoding units 22M and 22A to 22D.
[0029]
In synchronization with this encoding process, the additional information generating means 28M, 28A to 28D are activated to generate additional information suitable for the video material SM, S1 to S4. As additional information for the main video material SM, for example, the coordinate data of the middle point p of the divided area can be cited (see FIG. 2). The coordinate data p indicates a reference coordinate value. With respect to the divided video materials S1 to S4, the minimum and maximum coordinate data in each region can be listed as additional information.
[0030]
The encoded information and additional information obtained from each are multiplexed in the multiplexing unit 20 shown in FIG. In the multiplexing unit 20, for example, a process is performed in which each piece of encoded information is packetized and multiplexed for error correction is multiplexed in units of transmission frames to form a bit stream. The types of additional information and main information described above can be inserted into a header (packet header) when packetized or inserted into a non-video period (such as a blanking period).
[0031]
The multiplexed data is modulated by the transmission unit 34 into an ISDB broadcast signal having a transmission form suitable for transmission means (for example, a broadcasting satellite), and in this example, the data is multiplexed by an up-converter 36 and a transmission antenna (parabolic antenna) 38. Sent to the broadcasting satellite.
[0032]
FIG. 4 shows an example of the receiving apparatus 40 according to the present invention for receiving the ISDB broadcast signal as described above.
[0033]
The satellite wave received by the receiving antenna (parabolic antenna) 42 is down-converted to a 1 GHz band by the down converter 44 and then supplied to the ISDB tuner 46 for channel selection processing. Therefore, the ISDB broadcast signal of a specific channel including the character broadcast is selected by the channel selection signal SC from the terminal 48.
[0034]
The selected ISDB broadcast signal is supplied to the signal separation unit 50 and separated into original main information and additional information. For example, when a specific channel of a standard television signal is selected, the standard television signal and additional information (time code or the like) associated with the specific channel are separated.
[0035]
The separated main information is supplied to the decoding unit 52 and subjected to decoding processing. The decoding unit 52 includes at least (n + 1) decoding units 52A to 52N. As described above, when one program is constituted by 5-channel multiplexing, at least five decoding units 52A to 52E are used, and video materials SM and S1 to S4 of the corresponding channels are supplied and decoded. Processing is performed simultaneously.
[0036]
Since the decoding unit 52 is configured to be used in common for the main information, one of the predetermined decoding units 52, for example 52A, is selected when the multi-channel multiplex program is not used.
[0037]
Of the video material, the decoded video signal is supplied to an output video control unit 54 configured by a frame memory or the like. In the case of the embodiment of FIG. 1, the output video control unit 54 may have a simple switcher configuration. The additional information separated by the signal separation unit 50 is decoded by the dedicated decoding unit 56 and then supplied to the output video control unit 54 and the control unit 58, and the control from the control unit 58 is performed while referring to the obtained additional information. Based on the signal, the output video control unit 54 performs video output control processing, and the result is displayed on the television monitor 60. As an example of video output control will be described later, an audio signal (main audio signal or sub audio signal) corresponding to the image content being monitored is selected by the audio processing unit 62 for the audio signal decoded by the decoding unit 52 described above, This is emitted from the speaker 66 through the amplifier 64.
[0038]
The control unit 58 constituted by a microcomputer generates a control signal for changing the display mode and selecting the monitor contents by remote control from the commander 68. For example, as shown in FIG. 5, the commander 68 is provided with a channel selection numeric keypad (10 key) 72, a channel selection switch 74, and a volume switch 76 in addition to a power switch 70, and a display mode selection switch 78 for the monitor 60. Is provided. The cursor key 80 is a key for moving the cursor K (see FIG. 2) displayed on the screen, and is used for designating divided areas.
[0039]
In the above-described output video control unit 54, the following processing is performed under the control of the control unit 58. However, the processing example is merely an example and is not limited to the presentation example.
[0040]
When a standard television signal or the like is displayed, the screen is displayed as usual. When a multi-channel multiplex program capable of partial enlargement display is selected, one screen image as shown in FIG. 2 is displayed as usual. Although the coordinate reference point p and the dividing boundary line (shown by a chain line) passing therethrough are not displayed on this screen, they can be combined and displayed. If the division boundary line is shown, the designated position of the divided video becomes clear.
[0041]
The area to be enlarged is selected using the cursor K. When the cursor K is clicked in the third divided area as shown in FIG. 2, the position of the coordinate position (pointing address position) is searched with respect to the coordinate reference point p. When the position of the search result cursor K is determined, a channel selection signal is supplied to the output video control unit 54, and the video signal of the corresponding channel is selected. In the example of FIG. 2, the video signal (divided video material) of the third channel (CH3) is selected and supplied to the monitor 60. As a result, an image as shown in FIG. 3 in which the third divided area is enlarged is displayed on the monitor screen. Thereafter, the video of the third channel is continuously projected, but it is also possible to return to the original video (FIG. 2).
[0042]
Since the video signal transmitted through the third channel is originally composed of a video signal constituting one screen, the image quality is not deteriorated just because it is enlarged and displayed. In this way, an arbitrary divided image can be enlarged and displayed using the cursor K. Divided video can be selected by directly specifying a channel. A picture-in-picture (pinP) process in which the original screen is fitted to a part of the enlarged screen as shown in FIG. 6 is also possible.
[0043]
In the example shown in FIG. 2, the screen area is divided into n in advance, and the divided area is designated and enlarged and displayed, so the divided area is fixed. However, in practice, it is convenient if a part of the focused video is always tracked, and it can be enlarged and displayed to the size of one screen by designating it at any position on the screen. It is unclear where this noticed video is located on the screen, and the fact is that the position is constantly moving.
[0044]
Therefore, main subjects such as characters are determined in advance, and a pointing address indicating the position on the screen is given to them. For example, in the case of a video as shown in FIG. 7, parent and child X1, X2, mountain range X3, and UFOX4 are defined as main subjects, and the current position on the screen is given as a pointing address to these, and this is added information. And This pointing address usually changes from moment to moment. Further, an identifier of the subject (keyword such as parent and child, UFO) is added to the additional information together with the pointing address.
[0045]
At the same time, when the vicinity of the subject is selected, an image enlargement process such as interpolation is performed to enlarge and display it in the size of one screen. However, only the subject shown in FIG. An enlarged display is impossible. In view of this, for the subjects X1 to X4 designated in advance, video within a predetermined area (for example, for 1/4 screen) including the subject is transmitted as image interpolation information using multiple channels. Alternatively, it is transmitted as additional information.
[0046]
In the former example, image interpolation information (channel 1) of the subject X1 is given to the terminal 24a shown in FIG. At the same time, a dedicated audio signal can be given to the terminal 26a. Similarly, the image interpolation information (channel 2) of the subject X2 is given to the terminal 24b, the image interpolation information (channel 3) of the subject X3 is given to the terminal 24c, and the image interpolation information (channel 3) of the subject X4 is given to the terminal 24d. Channel 4) is provided. The image interpolation information is digitized and multiplexed together with the other main information as described above.
[0047]
Then, when the user moves the cursor K and designates the vicinity of UFOX 4 as shown in FIG. 7, the coordinate position is searched by the control unit 58 to search for a corresponding pointing address, and when a matching or approximate address is searched, A channel related to the subject X4 is automatically selected. As a result, an enlarged image subjected to the interpolation processing as shown in FIG. 8 is displayed.
[0048]
Instead of designating the pointing address for the subject with the cursor K, it is also possible to select an identifier (for example, UFO) for the subject. In this case, the pointing address to which the designated identifier belongs is analyzed and corresponding to the subject video signal. The image interpolation information signal to be selected is selected, and interpolation processing for enlarged display is performed.
[0049]
The selected subject X4 may have moved to the position shown in FIG. 9 at the next moment. Even in this case, an image centered on the subject X4 as shown in FIG. 10 is obtained on the enlarged screen. As described above, since the subject X4 is known in advance, automatic tracking is possible by using the identifier, and image interpolation information for the pointing address at the position shown in FIG. 9 is always supplied to the output video controller 54. Therefore, an enlarged video as shown in FIG. 10 can be generated from the image interpolation information and the subject X4 of the original video shown in FIG.
[0050]
Therefore, in this case, even if the specified specific subject is a moving image, it can be enlarged and displayed while automatically tracking the subject. Since image interpolation information is used, resolution does not deteriorate much. It is also possible to return from the enlarged display mode to the normal display mode (the original screen in FIG. 7).
[0051]
【The invention's effect】
As described above, in the transmission device and the reception device according to the present invention, as an aspect of the ISDB broadcast signal, a plurality of video materials that can be enlarged are transmitted together with additional information, and a specific area or a specific subject is received on the reception side. By designating, the image of the area can be enlarged and displayed.
[0052]
According to this, there is a feature that an image projected in a specific area or an area including a specific subject can be enlarged and displayed to the size of one screen. In this case, since the video is enlarged and displayed using the enlarged video information or the image interpolation information transmitted using the dedicated channel, even if the video is enlarged and displayed, the image quality does not deteriorate, so the resolution is good. You can enjoy a magnified image at.
[0053]
Thus, since a user-intentional broadcast can be selected, a kind of user participation type entertainment broadcast can be realized, and a television broadcast can be enjoyed from various aspects. Therefore, the present invention is very suitable when applied to an ISDB system for digital broadcasting.
[Brief description of the drawings]
FIG. 1 is a system diagram of a main part of an ISDB transmission apparatus.
FIG. 2 is a diagram illustrating a relationship between an original image and a designated area.
FIG. 3 is a diagram illustrating an enlarged display example of a designated area.
FIG. 4 is a system diagram of a main part showing an embodiment of an ISDB receiving apparatus.
FIG. 5 is a configuration diagram illustrating a specific example of a commander.
FIG. 6 is a diagram illustrating an example of picture-in-picture.
FIG. 7 is a diagram (part 1) illustrating a relationship between an original image and a designated subject when a pointing address is added;
FIG. 8 is a diagram illustrating an enlarged display example when a subject X4 is designated.
FIG. 9 is a diagram (part 2) illustrating a relationship between an original image and a designated subject when a pointing address is added;
FIG. 10 is a diagram showing an enlarged display example when a subject X4 at that time is designated.
[Explanation of symbols]
10 ISDB Transmitter 14, 22A-22D Encoding Unit 16 Time Code Generation Unit 20 Multiplexing Units 28A-28D Additional Information Generation Unit 46 ISDB Tuner 52, 56 Decoding Unit 54 Output Video Control Unit 60 Monitor

Claims (10)

First encoding means for encoding information of main video material for displaying a predetermined screen size to generate first encoded information;
Second encoding for generating second encoded information by encoding video information of the predetermined screen size corresponding to the enlarged display in order to enlarge and display a part of the main video material on the predetermined screen Means,
Multiplexing means for multiplexing at least the first encoded information and the second encoded information;
A transmission apparatus comprising: transmission means for transmitting the encoded information multiplexed by the multiplexing means. The second encoding means encodes video information of the predetermined screen size corresponding to the enlarged display in order to enlarge and display one of the divided video materials among the plurality of divided main video materials on the predetermined screen. And
The second encoding means is provided for each divided video material obtained by dividing the main video material,
2. The transmission apparatus according to claim 1, wherein the multiplexing means multiplexes at least the first encoded information and a plurality of the second encoded information. The first encoding means includes first additional information generating means for generating coordinate data indicating a midpoint of the division of the main video material as first additional information,
3. The transmission apparatus according to claim 2, wherein the multiplexing means multiplexes at least the first encoded information, the first additional information, and a plurality of the second encoded information. The second encoding means includes second additional information generating means for generating the maximum and minimum coordinate data of the divided video material as second additional information,
The multiplexing means multiplexes at least the first encoded information, the first additional information, the plurality of second encoded information, and the plurality of second additional information. Item 4. The transmission device according to Item 3. The multiplexing means is
Packetizing at least the first encoded information and the plurality of second encoded information;
Inserting the first and second additional information into each packet header in the packetized packet data;
5. The transmission apparatus according to claim 4, wherein the transmission apparatus multiplexes each transmission frame to form a bit stream. Channel selection means for selecting a specific broadcast signal obtained by encoding and multiplexing information of at least a plurality of video materials;
The specific broadcast signal selected by the channel selection means is encoded with first encoded information in which information of a main video material for displaying at least a predetermined screen size is encoded, and one of the main video material Signal separating means for separating the image information into the second encoded information obtained by encoding the video information of the predetermined screen size for enlarging the part on the predetermined screen;
First decoding means for decoding the first encoded information and generating main video material information for displaying the predetermined screen size;
Second decoding means for decoding the second encoded information and generating video information of the predetermined screen size for enlarging and displaying a part of the main video material on the predetermined screen;
Output video control means for outputting at least information generated by the first decoding means and / or information generated by the second decoding means;
And a control means for controlling information output from the output video control means. The second decoding means decodes the second encoded information in order to enlarge and display one divided video material among the plurality of main video materials divided on the predetermined screen, and displays the enlarged display on the enlarged display. Generate corresponding video information of the predetermined screen size ,
7. The receiving apparatus according to claim 6, wherein the second decoding unit is provided for each divided video material obtained by dividing the main video material. The control means identifies the divided video material in response to an input from the outside, and causes the output video control means to output information generated by the second decoding means corresponding to the identified divided video material. The receiving apparatus according to claim 7. The signal separation means separates first additional information that is coordinate data indicating a midpoint of division of the main video material from the specific broadcast signal,
The control means compares the position information in the predetermined screen based on the input from the outside with the coordinate data of the first additional information separated by the signal separation means, thereby obtaining the external information. 9. The receiving apparatus according to claim 8, wherein the divided video material corresponding to the position information based on the input is specified. The control means controls the output video control means so that the information generated by the first decoding means is reduced and then combined with the information generated by the second decoding means for output. The receiving device according to claim 9.

Images