JPH10243363A - Video reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it possible to change the dimensions of a sub-image and output the changed sub-image on a screen by superposing bit map data on a main image as sub-image based on a display address found out by a display control data decoder and setting up a display position. SOLUTION: Main video data are inputted to a main video data decoder 101 and sub-video data are inputted to a sub-video data decoder 102. The sub- video data inputted to the decoder 102 are inputted to a pixel data decoder 105 and the display control data decoder 106. An on-screen display part 108 sets up the display position of bit map data outputted from the decoder 105 based on a display address converted by the decoder 106 and outputs the display position to a video mixing part 103. The mixing part 103 superposes the sub- video data decoded by the decoder 102 to the main-video data decoded by the decoder 101 and outputs the superposed data to a display means such as a monitor.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video reproducing apparatus for decoding main video data and sub-video data, and superimposing the sub-video data on the main video data and outputting the resultant data.

[0002]

2. Description of the Related Art FIG. 7 is a block diagram showing a conventional video reproducing apparatus. In FIG. 7, main video data is input to a main video data decoder 701, and sub video data is input to a sub video data decoder 702. After being decoded, the main video data and the sub video data are mixed by the video mixing unit 703 and output to a monitor or the like.

Here, the main video data is video data such as a still image and a moving image, and the sub video data such as subtitles and characters is transmitted together with the main video data. Sub-picture data is
For example, it includes pixel data for forming and expressing a character as a set of pixels, and display control data for determining a display style (display color, mixture ratio, change of display color) or display position of the pixel data.

[0004] Of the sub-picture data, pixel data is input to a pixel data decoder 704 and display control data is input to a display control data decoder 705. The pixel data decoder 704 converts the pixel data into bitmap data, and the display control data decoder 705 obtains a display style, a display position, and the like of the pixel data from the display control data and outputs them to the on-screen setting unit 706. The bitmap data is a serially arranged data string, and the display control data rearranges the bitmap data into character information or the like. Here, the bitmap data represents, for example, an image by subdividing one screen in the X-axis direction and the Y-axis direction, and displaying the presence or absence of pixels in the image to be displayed in subdivided block units. is there.

[0005] An on-screen setting unit 706 determines the display color, display position, and the like of the bitmap data based on the output from the display control data decoder 705. And
The bitmap data is mixed with the main video from the main video data decoder 701 in the video mixing unit 703 and output to a monitor or the like.

FIG. 8 is a schematic diagram showing a display address of a sub-picture on a screen. In FIG. 8, the display start position and the display end position of the sub-picture are specified by coordinate display in which the top left of the screen is (0, 0), the pixel direction is the X axis, and the line direction is the Y axis. The display range of the sub-picture is determined by the start position and the display end position. That is,
The sub-picture is displayed on the screen according to the display address determined by the sender of the picture data.

For example, NTSC (National Television S)
In the case of the system committee, the display address indicates the address of the area of 720 × 478 shown in FIG. The sub-picture is
It is displayed at a position within a 720 × 478 area intended by the sender. For example, if the display start address is (X, Y) =
(5, 3), the display end address is (X, Y) = (71
6, 478), the sub-picture is displayed in the area surrounded by the oblique lines shown in FIG.

[0008]

However, since the display position of the sub-picture is determined by the display address intended by the sender, when the sub-picture and the main picture are displayed and viewed on a monitor or the like, they are displayed. Sometimes the size is too small to see. For example, in a movie or the like, the caption displayed on the screen may be too small to read. Also, if the size of the sub-picture is too large, the displayed subtitles may be too large to obstruct the movie picture.

An object of the present invention is to provide a video reproducing apparatus capable of receiving video data in which both main video data and sub-video data are transmitted, changing the size of the sub-video and outputting it on a screen. It is intended to be.

[0010]

According to the present invention, there is provided the present invention which encodes main video data obtained by encoding a main video and sub video and decodes sub video data provided with display control data and pixel data. In a video playback device that superimposes and outputs a sub-picture on a main picture, a display size setting unit that sets the display size and display position of the sub-picture, and decodes the display control data of the sub-picture data to A display control data decoder for obtaining a display address indicating a display size and a display position, and a display address conversion unit for converting the display address obtained by the display control data decoder based on the display size and the display position set by the display size setting unit. And decodes the pixel data of the sub-picture data and converts it into bitmap data, and based on the display address converted by the display address conversion unit. A pixel data decoder that deletes or interpolates the bitmap data, and a display position where the bitmap data converted by the pixel data decoder based on the display address obtained by the display control data decoder is superimposed on the main video as a sub video. And an on-screen setting unit for setting.

The present invention described in claim 2 is the same as the claim 1.
In the video playback device described in the above, the pixel data decoder comprises:
A display unit for detecting a background portion in which background pixels of the bitmap data are continuous for a predetermined period, the display address conversion unit includes:
A character string conversion unit that converts the bitmap data into a display address in which the bitmap data is rearranged into a plurality of columns in the background portion detected by the detection unit.

According to the present invention, the pixel data of the sub-picture data is decoded into bitmap data, the display address of the bitmap data is obtained from the display control data of the sub-picture data, and the display address and the display size set by the user are set. The obtained display address is converted according to the display address based on the bitmap data, and the bitmap data can be output by being superimposed on the main video based on the converted display address. Images can be output to any size and position.

[0013]

DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 is a schematic diagram showing a schematic configuration of one embodiment of a video reproducing apparatus according to the present invention. In FIG. 1, a video playback device includes a main video data decoder 10.
1, sub-picture data decoder 102, picture mixing section 103,
A display size setting unit 104 is provided. The sub-picture data decoder 102 includes a pixel data decoder 105, a display control data decoder 106, a display address converter 107,
An on-screen setting unit 108 is provided.

Here, the transmitted video data includes main video data which is video data such as still images and moving images, and sub video data such as characters. Sub-picture data is
For example, it includes pixel data for forming and expressing a character as a set of pixels, and display control data for determining a display style (display color, color mixture ratio, etc.) or a display position of the pixel data.

In FIG. 1, main video data and sub video data transmitted at the same time are separated into main video data and sub video data by a data separation unit (not shown). , And the sub-picture data is inputted to the sub-picture data decoder 102.

The main video data decoder 101 performs a decoding process on the input main video data and outputs the decoded data to the video mixing unit 103.

Of the sub-picture data inputted to the sub-picture data decoder 102, pixel data is inputted to a pixel data tegoder 105, and display control data is inputted to a display control data decoder 106. Pixel data decoder 10
5 converts the pixel data into bitmap data. In addition, a background pixel for performing a character string conversion process described later is detected. The display control data decoder 106 obtains a display style, a display position, and the like of the bitmap data from the display control data and outputs them to the on-screen setting unit 108.

The display address conversion unit 107 determines the display address of the display control data decoder 106 specified by the sender and the display size and display position of the sub-picture data set by the display size setting unit 104, after the deletion process described later. Alternatively, the display address of the bitmap data after the interpolation processing is calculated. The display address conversion unit 107 performs a deletion process or an interpolation process of the bitmap data in the pixel data decoder 105 based on the calculated display address.
Further, the display control data decoder 106 outputs the converted display address to the on-screen setting unit 108.

The on-screen display unit 108 sets the display position of the bitmap data from the pixel data decoder 105 based on the display address converted by the display control data decoder 106, and outputs it to the video mixing unit 103.

The video mixing section 103 superimposes the decoded main video data from the main video data decoder 101 and the sub video data from the sub video data decoder 102 and outputs the superimposed data to display means such as a monitor.

The processing operation of the sub-picture data decoder 102 when reducing or enlarging the sub-picture will be described. FIG. 2 is a flowchart showing the sub-picture data reduction or enlargement processing of the sub-picture data decoder in the picture reproducing apparatus of the present embodiment. FIG. 3 is a schematic diagram showing a case where the sub-picture is reduced in the picture reproducing apparatus of the present embodiment.
(A) shows the case of left justification, (b) shows the case of center, and (c) shows the case of right justification. Here, the display start address before reduction is (X, Y) = (Sx, Sy), the display end address is (X, Y) = (Ex, Ey), and the display start address after reduction is (Sx ′, Sy '), and the display end address is (E
x ', Ey').

The case of sub-picture reduction will be described. Of the sub-picture data separated by the system separation unit (not shown), pixel data is input to the pixel data decoder 105, and display control data is input to the display control data decoder 106.

The display control data decoder 106 decodes display control information such as a display position of pixel data from the display control data. The display address conversion unit 107 extracts display addresses (Sx, Sy) and (Ex, Ey) before reduction from the display control information from the display control data decoder 105. (S1)

Next, when the user sets the display size of the sub-picture with the display size setting unit 104, the display address conversion unit 107 compares the set display size with the display control information to reduce the size of the sub-picture. And whether to enlarge. For example, when the set display size i = １ ／, i <1
And performs a process of reducing the sub-picture. (S2)

When the user sets the display size after setting the display size, the display address conversion unit 107
It is determined at which position on the screen the reduced sub-picture is to be displayed. The display position of the sub-image is selected from, for example, left-justified, centered, and right-justified. (S3)

The display address conversion unit 107 calculates the display address of the reduced bitmap data from the display control data from the display control data decoder 106 and the display position set by the display size setting unit 104, and calculates the display control data. Output to the decoder 106. Display size setting unit 104
3A, when the left-justified display position is selected, the display start address is fixed, and the display end address is (Ex ′, Ey ′) = (Ex− (Ex−S
x) / 2, (Ey- (Ey-Sy) / 2). (S
4)

As shown in FIG. 3B, when the center display position is selected, the display start address is set to (Sx ',
Sy ′) = (Sx + (Ex−Sx) / 4, Sy + (Ey
−Sy) / 4), and the display end address is (Ex ′, E
y ′) = (Ex− (Ex−Sx) / 4, (Ey− (Ey
−Sy) / 4). (S5)

As shown in FIG. 3C, when a right-justified display position is selected, the display start address is set to (S
x ′, Sy ′) = (Sx + (Ex−Sx) / 2, Sy +
(Ey-Sy) / 2), and the display end address is fixed. (S6)

Next, the pixel data decoder 105 deletes the bitmap data of the pixel data decoder 105 based on the display control information from the display control data decoder 106, and generates a bitmap data of the set display size. Output to the on-screen setting unit 108.
The bitmap data deletion processing is performed by thinning out the pixel data of the bitmap data. In other words, in the case of a reduced value of 映像, an image in which data is decimated by ２ in the line direction and the pixel direction of the bitmap data. (S7)

The on-screen setting unit 108 controls the pixel data decoder 10 based on the display address of the reduced bitmap data from the display control data decoder 106.
5 is set on the screen and output to the video mixing unit 103. (S8)

Next, the case of enlarging a sub-picture will be described. FIG. 4 is a schematic diagram showing a case of enlarging a sub-picture in the picture reproducing apparatus of the present embodiment. (A) shows the case of left justification, (b) shows the case of center, and (c) shows the case of right justification. Of the sub-picture data separated by the system separation unit (not shown), the pixel data is input to the pixel data decoder 105, and the display control data is
Enter 6

The display control data decoder 106 decodes display control information such as a display position of pixel data from the display control data. The display address conversion unit 107 extracts display addresses (Sx, Sy) and (Ex, Ey) before enlargement from the display control information from the display control data decoder 106. (S1)

Next, when the user sets the display size of the sub-picture in the display size setting unit 104, the display address conversion unit 1
07 compares the set display size with the display control information to determine whether to reduce or enlarge the sub-picture. For example, when the designated display size i = 2, it is determined that i> 1, and processing for enlarging the sub-picture is performed. (S2)

When the user sets the display size after setting the display size, the display address conversion unit 107
It is determined at which position on the screen the enlarged sub-picture is to be displayed. The display position of the sub-image is selected from, for example, left-justified, centered, and right-justified. (S9)

The display address conversion unit 107 calculates the display address of the bitmap data after enlargement from the display control data from the display control data decoder 106 and the display position set by the display size setting unit 104, and calculates the display control data. Output to the decoder 106.

Then, when the sub-picture is enlarged from the set display size and display position, it is determined whether or not the sub-picture is within the display range (X = 0 to 720) of the screen in the X-axis direction on the screen. I do. (S10)

When the enlarged sub-picture is within the display range,
The display address of the X axis is (Sx ′, Sy ′) = (0, (Ex
−Sx) × 2). (S11)

When the X-axis direction does not fall within the display range, a character string conversion process described later is performed. The character string conversion process is a process of dividing the bitmap data by a predetermined length and rearranging the bitmap data into a plurality of columns. (S12)

When the sub-picture is enlarged from the set display size and display position, it is determined whether or not the sub-picture is within the display range (Y = 0 to 478) of the screen in the Y-axis direction on the screen. I do. (S13)

When the enlarged sub-picture is within the display range,
The display address of the Y axis is (Sy ′, Ey ′) = (480−
(Ey−Sy) × 2,480). (S14)

If the Y-axis direction does not fall within the display range, a display address is set in the maximum display area in the Y-axis direction. (S1
5)

Then, based on the display control information from the display control data decoder 106, the pixel data decoder 105 performs an interpolation process on the bitmap data so as to have the set display size, and outputs the result to the on-screen setting unit 108. . (S16)

In the interpolation processing for enlarging the sub-picture, the same data is used as interpolation data in both the line direction and the pixel direction of the bitmap data, and the sub-picture is enlarged by arranging it between data from the pixel data decoder. For example,
When the interpolation processing is performed on the bitmap data “A, B, C”, the bitmap data after interpolation is “A, A, B,
B, C, C ".

As another method for enlarging a sub-picture,
There is a method in which an average value of data in the adjacent pixel direction is used as interpolation data, and is arranged between data from a pixel data decoder to enlarge a sub-picture. For example, if the interpolation processing is performed on the bitmap data “A, B, C”, the bitmap data after interpolation is “A, (A + B) / 2, B,
(B + C) / 2, C ". According to this method, sub-pictures such as characters become smooth.

As another method for enlarging a sub-picture,
There is a method of enlarging a sub-picture by using an average value of data in the adjacent line directions before and after as the interpolation data and arranging it between data from the pixel data decoder. For example, when interpolating line data between bitmap data “A, B, C” for N lines and bitmap data “D, E, F” for M lines, the interpolated bitmap data for N lines is “A”. , (A + B) / 2, B, (B + C) / 2, C ", and the interpolated bitmap data of M lines is" D,
(D + E) / 2, E, (E + F) / 2, F ", and N
Interpolation line "(N + M) / 2" between line and M line
The bitmap data after interpolation is “(A + D) / 2,
{(A + B) + (D + E)} / 4, (D + E) / 2,
{(B + C) + (E + F)} / 4 ". This method also makes sub-pictures such as characters smooth.

Then, the on-screen setting unit 108
Based on the display address of the expanded bitmap data from the display control data decoder 106, the bitmap data from the pixel data decoder 105 is set on the screen and output to the video mixing unit 103. (S8)

The character string conversion processing will be described. FIG.
9 is a flowchart illustrating a character string conversion process in the video playback device of the present embodiment. FIG. 6 is a schematic diagram illustrating a case where the character string conversion process is performed in the video reproduction device of the present embodiment. (A) is before the character string conversion processing, and (b) is after the character string conversion processing. In the character string conversion processing, as shown in FIG. 6A, when the enlarged bitmap data does not fit on the screen, the bitmap data is divided by a predetermined length.
As shown in FIG. 6B, this is a process for rearranging and displaying the data in two columns.

The pixel data decoder 105 shown in FIG. 1 detects a portion where the character string of the sub-picture can be divided.
That is, the pixel data converted into the bitmap data does not exist in the space part (the part other than the character) between the character and the character, and therefore, the space between the character is the background pixel. Therefore, the pixel data decoder detects, as the background pixel, a portion where the background pixel continues for a predetermined period on the X axis of each line. (S17)

Next, at the detection point, the bitmap data is
The X-axis display area (a, b) in the case of division is calculated, and the enlarged X-axis display area (A, B) = (a × 2, b × 2) is calculated and compared. (S18)

When A> B, the enlarged display start address in the X-axis direction is (Sx ″, Ex ″) = (Sx, Sx + A). (S19)

If A <B, the enlarged display start address in the X-axis direction is (Sx ″, Ex ″) = (Sx, Sx +
B). (S20)

Next, the display address is converted with reference to the display position selected in advance. If the sub-video segment is 2
If there are more than three locations, the location where the difference between A and B is minimum is selected. (S21)

When the selected display position is left-justified, (Sx ′, Ex ′) = (0, Ex ″ −Sx ″). (S22)

When the selected display position is right-justified, (Sx ′, Ex ′) = (Sx ″ + (720−E)
x '') and 720). (S23)

When the selected display position is at the center, (Sx ′, Ex ′) = (240− (Ex ″ −S)
x ″) / 2, 240+ (Ex ″ −Sx ″) / 2). (S24)

As described above, the display size of the sub-picture can be arbitrarily reduced or enlarged in the picture reproducing apparatus. When the sub-picture is enlarged, the character string of the sub-picture can be divided and displayed in a plurality of rows, so that the sub-picture becomes easy to see and the sub-picture does not protrude from the screen.

[0057]

According to the present invention, the display size of a sub-picture can be arbitrarily changed in a video reproducing apparatus which receives video data in which a main picture and a sub-picture are transmitted together and outputs it to a monitor or the like. .

[Brief description of the drawings]

FIG. 1 is a schematic diagram showing a schematic configuration of a video reproducing apparatus according to an embodiment of the present invention.

FIG. 2 is a flowchart showing reduction and enlargement processing in the video reproduction device of the present invention.

FIG. 3 is a schematic diagram showing a case where a sub-picture is reduced in the picture reproducing apparatus of the embodiment. (A) is left-justified,
(B) is for the center case, and (c) is for the right-justified case.

FIG. 4 is a horizontal view showing a case where a sub-picture is enlarged in the picture reproducing apparatus of the embodiment. (A) is left-justified,
(B) is for the center case, and (c) is for the right-justified case.

FIG. 5 is a flowchart illustrating a character string conversion process in the video reproduction device of the present embodiment.

FIG. 6 is a schematic diagram illustrating a case where a character string conversion process is performed in the video playback device of the present embodiment. (A) is before the character string conversion processing, and (b) is after the character string conversion processing.

FIG. 7 is a horizontal view showing a schematic configuration of a conventional video reproducing apparatus.

FIG. 8 is a schematic diagram showing a display address of an image on a screen.

[Explanation of symbols]

 101 main video data decoder 102 sub video data decoder 103 video mixing unit 104 display size setting unit 105 pixel data decoder 106 display control data decoder 107 display address conversion unit 701 main video data decoder 702 sub video decoder 703 video mixing unit 704 pixel data decoder 705 display control data decoder 706 on-screen setting unit

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FI G09G 5/36 520 H04N 5/66 D G06F 15/66 450 H04N 5/445 H04N 7/13 Z 5/66 7/24

Claims (2)

[Claims] 1. A video which is obtained by encoding main video data obtained by encoding a main video and a sub-video, decoding sub-video data comprising display control data and pixel data, and superimposing the sub-video on the main video for output. A display size setting unit for setting a display size and a display position of the sub-picture, a display for decoding a display control data of the sub-picture data and obtaining a display address indicating a display size and a display position of the sub-picture, A control data decoder, a display address conversion unit that converts the display address obtained by the display control data decoder based on the display size and the display position set by the display size setting unit, and pixel data of the sub-picture data. The display address is decoded and converted into bitmap data, and the bitmap is converted based on the display address converted by the display address conversion unit. A pixel data decoder that deletes or interpolates the data, and superimposes the bitmap data converted by the pixel data decoder based on the display address obtained by the display control data decoder on the main video as the sub video. An image reproducing apparatus, comprising: an on-screen setting unit that sets a display position. 2. The video reproducing apparatus according to claim 1, wherein said pixel data decoder includes a detection unit for detecting a background portion in which background pixels of said bitmap data continue for a predetermined period, and said display address conversion unit includes: A video string conversion unit that converts the bitmap data into a display address obtained by rearranging the bitmap data into a plurality of columns in the background detected by the detection unit.