JP5075923B2 - Image processing apparatus and image processing method - Google Patents

Description

  The present invention relates to a technique for increasing the resolution of a video, and particularly to an image processing apparatus and an image processing method for increasing the resolution according to a video mode.

  In recent years, fusion of PCs (Personal Computers) and televisions has progressed, and various images (for example, soccer etc.) are displayed on a high-definition display of so-called HD (High Definition) size such as high-definition broadcasting that exceeds SD (Standard Definition) size. Of sports programs, movie programs such as anime and movies) are increasing.

  However, a video broadcast on an SD TV or a video recorded on a DVD has a low resolution, and when a user views a video of HD size (especially 1920 × 1080 so-called full HD size), The image needs to be converted to high resolution. In this regard, conventionally, image resolution has been increased by linear interpolation or cubic convolution interpolation of image pixel values, but there has been a problem that a sharp image cannot be obtained. .

  Therefore, in order to solve such a problem, the image is decompressed and at the same time, a pixel having a high frequency component is interpolated between pixels of the image generated by the decompression process to obtain a sharp high-resolution image. Research on super-resolution technology that can be performed is performed (for example, Patent Document 1 and Patent Document 2).

JP 2008-067110 A JP 2008-146190 A

According to the super-resolution technology, the sharpness of the image is increased, so that the user can enjoy a sharp image and a clear image.
However, when the image is sharpened by the super-resolution technique, there may be a problem that the block noise of the pixel becomes too conspicuous or the perspective between the background and the person appears unnatural.

  Conventionally, as a method for sharpening an image, there is a sharpness process that makes an image appear sharp by raising an edge of the image. However, the super-resolution technology is a technology that is completely different from the sharpness processing in that it newly generates high-frequency component pixels, and the sharpening processing is performed by the same method as the sharpening processing performed in the sharpness processing. There was a problem that it was difficult to adjust the degree.

  The present invention has been made in view of the above, and an object of the present invention is to provide an image processing apparatus and an image processing method that can provide an image that has been appropriately processed for image quality processing.

In order to solve the above-described problems and achieve the object, an image processing apparatus according to an embodiment receives a first resolution video signal, inserts pixels between the pixels with respect to the first resolution video signal, and Level in which image quality processing level indicating the ratio of high frequency component pixels among pixels inserted between pixels and video mode are stored in association with each other in high resolution processing for generating a video signal having a second resolution higher than the first resolution Storage means, video mode designating means for designating the video mode by user operation, video judging means for determining the image quality processing level in accordance with the designated video mode, and the first resolution video signal. On the other hand, image quality processing means for performing image quality processing at the determined image quality processing level, and the level storage means for viewing brighter than a predetermined video mode As is the case of the image mode to be higher than the video mode proportions of said predetermined pixel of the high-frequency components, in association with the video mode and the image quality processing level, it is characterized.

In the image processing apparatus of the embodiment, a first resolution video signal is input, and a second resolution video signal higher than the first resolution by inserting pixels between the pixels with respect to the first resolution video signal. In the high resolution processing for generating the image, the level storage means for storing the image quality processing level indicating the ratio of the high frequency component pixel in the pixels inserted between the pixels and the video mode in association with each other, and the video mode by the user operation A video mode designating unit for designating the image, a video judging unit for determining the image quality processing level according to the designated video mode, and an image quality process at the determined image quality processing level for the video signal of the first resolution. Image level processing means for performing the above-mentioned, and the level storage means is configured to display the high-level image when the video mode is for viewing in a darker condition than the predetermined video mode. The ratio of pixels of the wave components to lower than the predetermined video mode, in association with the video mode and the image quality processing level, and wherein the.

In the image processing apparatus of the embodiment, a first resolution video signal is input, and a second resolution video signal higher than the first resolution by inserting pixels between the pixels with respect to the first resolution video signal. In the high resolution processing for generating the image, the level storage means for storing the image quality processing level indicating the ratio of the high frequency component pixel in the pixels inserted between the pixels and the video mode in association with each other, and the video mode by the user operation A video mode designating unit for designating the image, a video judging unit for determining the image quality processing level according to the designated video mode, and an image quality process at the determined image quality processing level for the video signal of the first resolution. Image level processing means for performing image processing of the high-frequency component when the level storage means is a video mode more suitable for watching a movie than a predetermined video mode. The proportion of such lower than the predetermined video mode, in association with said video mode and the image quality processing level, and wherein the.

In the image processing method of the embodiment, a first resolution video signal is input, and a second resolution video signal higher than the first resolution by inserting pixels between the pixels with respect to the first resolution video signal. In the high-resolution processing for generating image data, the image processing apparatus includes level storage means for storing the image quality processing level indicating the ratio of high-frequency component pixels in the pixels inserted between the pixels and the video mode in association with each other. If the video mode is for viewing brighter than the video mode, the video mode is associated with the image quality processing level so that the ratio of the high-frequency component pixels is higher than the predetermined video mode. An image processing method performed by an image processing apparatus for storing the image, wherein the image mode designating unit includes a image mode designating step for designating the image mode; A video determination step of determining the image quality processing level according to the designated video mode, and an image quality processing means performs the image quality processing of the determined image quality processing level on the video signal of the first resolution. And an image quality processing step .

In the image processing method of the embodiment, a first resolution video signal is input, and a second resolution video signal higher than the first resolution by inserting pixels between the pixels with respect to the first resolution video signal. In the high-resolution processing for generating image data, the image processing apparatus includes level storage means for storing the image quality processing level indicating the ratio of high-frequency component pixels in the pixels inserted between the pixels and the video mode in association with each other. The video mode and the image quality processing level so that the ratio of pixels of the high-frequency component is lower than the predetermined video mode when the video mode is for viewing in a darker state than the video mode. The image processing method is performed by the image processing apparatus that stores the information in association with each other, and the video mode designating unit designates the video mode designated by the user operation. A specifying step; a video determining step in which the video determining unit determines the image quality processing level according to the specified video mode; and the image quality determining unit determines the image quality determined for the video signal having the first resolution. And an image quality processing step for performing image quality processing at a processing level .

  According to the present invention, since the image quality processing level is determined according to the video mode, it is possible to provide an image that has been appropriately subjected to image quality processing.

It is a block diagram which shows the structure of the image processing apparatus concerning this Embodiment. It is a block diagram which shows the structure of the main process part shown in FIG. It is a block diagram which shows the structure of the high resolution part shown in FIG. It is a figure which shows the example of the setting screen of the video mode displayed on a display part by operation of an operation part. It is a figure which shows the example which an EEPROM memory matches and memorize | stores a super-resolution parameter and a video mode value. It is a flowchart which shows the execution procedure of the super-resolution process concerning 1st Embodiment. It is a flowchart which shows the execution procedure of the super-resolution process concerning 2nd Embodiment.

(First embodiment)
Exemplary embodiments of an image processing apparatus and an image processing method according to the present invention are explained in detail below with reference to the accompanying drawings. FIG. 1 is a block diagram schematically showing a system of the image display apparatus 100 according to the present embodiment. As shown in the figure, the image display device 100 includes a video signal input unit 11, a main processing unit 12, a resolution increasing unit 13 corresponding to the image processing device, a moving image improvement processing unit 14, and a display processing unit. 15, a display unit 16, an audio processing unit 17, and an audio output unit 18.

  The video signal input unit 11 is a part to which a video signal to be displayed is input. The video signal input unit 11 is connected to a digital broadcast receiving unit 111, an IPTV (Internet Protocol TV) signal processing unit 112, and an IP network such as the Internet. An Internet signal processing unit 113 that receives data to be transmitted and an external input unit 114 that receives an analog signal input are provided. Here, the “video signal” is a concept including an audio signal in addition to an image signal composed of a still image or a moving image.

  The digital broadcast receiver 111 includes a digital antenna 1111 for receiving digital broadcasts such as BS, CS, and terrestrial waves, a digital tuner 1112 for selecting digital broadcasts, and demodulating the digital broadcasts as digital video signals. And a digital signal demodulating unit 1113 for outputting to the main processing unit 12.

  The IPTV signal processing unit 112 receives an IP broadcast transmitted via a dedicated IP network, and outputs it to the main processing unit 12 as a digital video signal.

  The Internet signal processing unit 113 receives data (still images and moving images) transmitted via an IP network such as the Internet and outputs the data to the main processing unit 12 as a digital video signal.

  The external input unit 114 includes an analog antenna 1141 for receiving an analog broadcast, an analog tuner 1142 for selecting the analog broadcast, and performs signal processing such as A / D conversion on the analog signal to obtain a digital video signal. An external input signal processing unit 1143 for outputting to the main processing unit 12. The external input signal processing unit 1143 has a terminal (not shown) for connecting to an external device such as a game machine, a PC (Personal Computer), a DVD (Digital Versatile Disk) player, and the like, via the input terminal. Signal processing is also performed on an analog signal input from an external device.

  FIG. 2 is a block diagram illustrating a functional configuration of the main processing unit 12. As illustrated in FIG. 2, the main processing unit 12 includes an operation reception unit 121, a video determination unit 122, a control unit 123, and a flash memory 19.

  As will be described later, the operation receiving unit 121 receives a signal indicating that the type of video mode designated (hereinafter referred to as a selection signal) is selected from the remote controller that is the operation unit 200, and responds to the received selection signal. The type of the selected video mode is output to the video determination unit 122 described later.

  Specifically, when the user presses a mode selection button or the like (not shown) for designating the video mode of the operation unit 200, the video mode is selected for a part of the display unit 16 as shown in FIG. Display the sub screen. When the user presses a selection key (not shown) such as an up / down key of the operation unit 200 to select various video modes such as “Azureka”, “Standard”, “Movie”, and “Memory”, the operation reception unit 121 The selection signal output at this time is received and output to the video determination unit 122. In this way, video mode designating means is provided for the user to designate a preferred video mode from among several video modes. In the present embodiment, the image modes other than “memory” are modes in which values of image quality adjustment items such as unicolor, backlight level, black level, color density, hue, and sharpness are determined by default. Yes, it is a mode in which the user can freely adjust the “memory” mode and each image quality adjustment item. As described above, the video mode is provided to provide a user with a favorite video according to a program to be viewed or a usage state of the television. Although not shown, there may be an Auto mode (a mode in which each adjustment item is automatically adjusted according to the viewing video or the use state of the television).

  As described later, the various video modes described above are associated with the level of super-resolution processing performed on the image signal separated from the video signal by the control unit 123, and the user can select these various video modes. By designating, super-resolution processing corresponding to the designated video mode is performed.

  Of the above-mentioned video modes, “Azayaka” is a mode that is selected when the user wants to enjoy watching bright and powerful video, and is a mode for performing super-resolution processing stronger than “Standard”. Means that. “Movie” is a mode that is selected when you want to enjoy watching a movie in a dark room like a movie theater. Means. The “memory” means that the user individually sets the level of super-resolution processing in addition to each adjustment item (for example, unicolor, backlight, black level, color density, hue, sharpness, etc.) from the operation unit 200 or the like. Mode (ie, manual mode), and a finer level of super resolution can be set. It should be noted that the setting value of the super resolution level that is “standard” may be arbitrarily set by the user from the operation unit 200, or may be fixed by default.

  The video determination unit 122 receives a selection signal indicating that the operation reception unit 121 has specified the video mode from the operation unit 200, outputs a video mode value indicating the type of the specified video mode to the control unit 123, and flashes. Write to memory 19. For example, when the video mode designated by the user is “Azayaka”, it is “1”, when it is “Standard”, it is “2”, when it is “Movie”, it is “3”, “Memory”. In this case, “4” is output to the control unit 123 described later and written to the flash memory 19.

  The control unit 123 separates the video signal into an image signal and an audio signal, outputs an image signal subjected to predetermined image processing to the high resolution unit 13, and outputs the audio signal to the audio processing unit 17.

  Here, the image processing performed by the control unit 123 includes scaling processing for converting the resolution of the input image signal into a predetermined resolution (for example, 1280 × 720).

  As described above, when the selection signal is received from the operation unit 200, the flash memory 19 stores the video mode value corresponding to the selection signal. The video mode value corresponding to the selection signal designated from the operation unit 200 is stored in advance in a memory (not shown) or the like.

  FIG. 3 is a block diagram showing a functional configuration of the resolution increasing unit 13 shown in FIG. As shown in FIG. 3, the high resolution unit 13 includes a preprocessing unit 131, a super resolution conversion processing unit 132, a post processing unit 133, and an EEPROM memory 20.

  The preprocessing unit 131 performs image processing (hereinafter referred to as preprocessing) such as interlace / progressive conversion processing and noise reduction processing for removing noise on the image signal input from the main processing unit 12. The completed video signal is output to the super-resolution conversion processing unit 132. Further, the preprocessing unit 131 outputs the video mode value received from the main processing unit 12 to the super-resolution conversion processing unit 132 described later. The signal related to the video mode value may be input from the main processing unit 12 to the super resolution processing unit 132 without passing through the preprocessing unit 131.

  Specifically, as the interlace / progressive conversion process, the preprocessing unit 131 detects the motion of the image in the input image signal and determines a still image and a moving image. Interpolation processing is performed, and when it is determined to be a moving image, interpolation processing for the moving image is performed.

  In addition, the pre-processing unit 131 performs noise reduction processing such as image contour correction in an image signal, reduction of image blur and glare, correction for suppressing excessive equalization (high frequency emphasis), and when the camera moves in the horizontal direction. Processes such as blurring improvement.

  The super-resolution conversion processing unit 132 performs image processing (hereinafter referred to as “super-resolution conversion processing”) for increasing the resolution of the low-resolution frame input from the pre-processing unit 131, thereby obtaining a high resolution of HD size. Frame of the moving image data (hereinafter referred to as “high resolution frame”) is generated and output to the post-processing unit 133.

  Here, the super-resolution conversion processing is a sharpening that restores a high-resolution image signal that is the second resolution by estimating the original pixel value from the low-resolution image signal that is the first resolution and increasing the number of pixels. Means processing. Here, the original pixel value is, for example, an image of the same subject as that obtained when a low-resolution (first resolution) image signal is obtained with a camera having the number of pixels of the high-resolution (second resolution) image signal. It refers to the value of each pixel of the image signal that is sometimes obtained.

  Also, “estimate and increase pixels” means to capture the image features and use the image features that are correlated to estimate the original pixel value from the surrounding (within the same frame or between frames) image This means increasing the number of pixels. For the super-resolution conversion processing, it is possible to use a publicly known / public technique disclosed in Japanese Unexamined Patent Application Publication No. 2007-310837, Japanese Unexamined Patent Application Publication No. 2008-98803, Japanese Unexamined Patent Application Publication No. 2000-188680, and the like. As a technique for the super-resolution conversion processing of the present embodiment, for example, a technique for restoring an image having a frequency component higher than the Nyquist frequency determined by the sampling period of the input image is used.

  For example, when using the super-resolution conversion process disclosed in Japanese Patent Application Laid-Open No. 2007-310837, the change pattern of the pixel value in the target image area including the target pixel in the frame for each of a plurality of medium resolution frames. Select a plurality of corresponding points corresponding to a plurality of target image areas closest to the reference frame from the reference frame, set the sample value of the luminance at the corresponding point to the pixel value of the target pixel corresponding to the corresponding point, and Calculating a pixel value of a high-resolution frame corresponding to the reference frame, which is a high-resolution frame having a number of pixels larger than the number of pixels of the reference frame, based on the size of the sample value and the arrangement of a plurality of corresponding points. Thus, the original pixel value is estimated from the low resolution image signal and the number of pixels is increased to restore the high resolution image signal.

  In addition, when using the super-resolution conversion process using self-congruent position search in the same frame image disclosed in Japanese Patent Application Laid-Open No. 2008-98803, the error of each pixel in the search area of the medium resolution frame is compared. The minimum first pixel position is calculated, and based on the first pixel position and the first error, the second pixel position around the first pixel, and the second error, The position where the error is minimized is calculated with decimal precision. Then, a decimal precision vector with this position as the end point and the target pixel as the start point is calculated, and an extrapolation vector of the decimal precision vector with the pixel on the screen not included in the search region as the end point is calculated using the decimal precision vector. calculate. Then, based on the decimal precision vector, the extrapolation vector, and the pixel value acquired from the image signal, the pixel value of the high-resolution image having a larger number of pixels than the number of pixels included in the image signal is calculated. By performing such processing, the super-resolution conversion processing unit 133 estimates the original pixel value from the low-resolution image signal and increases the number of pixels, thereby restoring the high-resolution image signal.

  Also, a super-resolution conversion process using mapping between a plurality of frame images disclosed in Japanese Patent Laid-Open No. 2000-188680 can be used.

  However, the method of the super resolution conversion processing in the super resolution conversion processing unit 132 is not limited to the above, and a high resolution image is obtained by estimating the original pixel value from the low resolution image signal and increasing the number of pixels. Any technique can be applied as long as the process restores the signal.

  When the pre-processing unit 131 receives an image signal after the noise reduction processing or the like is performed, the super-resolution conversion processing unit 132 performs super-resolution conversion processing according to the set video mode. Specifically, for example, the super-resolution conversion processing unit 132 acquires a super-resolution parameter corresponding to the video mode value from the EEPROM memory 20 described later.

  Then, the super resolution conversion processing unit 132 refers to the acquired video mode value and acquires a super resolution parameter corresponding to the video mode value.

  FIG. 5 is a diagram illustrating an example of parameters stored in the EEPROM memory 20. As shown in FIG. 5, the EEPROM memory 20 stores video mode values, video modes, and super-resolution parameters in association with each other.

  Here, the super resolution parameter is a numerical expression of the strength of the super resolution conversion process. For example, the number of high-frequency component pixels to be inserted between pixels and the ratio of high-frequency component pixels to the pixel to be inserted is high, that is, the larger the numerical value of the super-resolution parameter, the higher the sharpening gain and the stronger the super-resolution conversion processing. This can be appropriately set according to the super-resolution processing method. The super-resolution parameter shown in FIG. 5 indicates the ratio of high-frequency component pixels inserted between pixels with respect to the total number of pixels, where 100 is the case where super-resolution processing is performed on all pixels. As described above, by storing the index for performing the super-resolution processing in the parameter format, even if the specification change occurs in the super-resolution processing standard, it is possible to easily and quickly cope with the specification change. .

  The super-resolution conversion processing unit 132 performs the above-described super-resolution processing according to the acquired super-resolution parameter, and outputs the image signal subjected to the super-resolution processing to a post-processing unit 133 described later.

  Specifically, for example, when the video mode value received from the pre-processing unit 131 is “1” (bright), the super-resolution conversion processing unit 132 uses “1” as a super-resolution parameter as shown in FIG. 80 "is acquired, and the above-described super-resolution processing is performed according to the acquired parameters.

  Returning to FIG. 3, the post-processing unit 133 performs image correction processing (hereinafter referred to as post-processing) such as gamma correction and white balance adjustment on the image signal input from the super-resolution conversion processing unit 132, and a moving image. Output to the improvement processing unit 14. Next, returning to FIG. 1, the moving image improving unit 14 will be described.

  The moving image improvement processing unit 14 performs double speed processing on the image signal received from the post-processing unit 133. Specifically, by performing processing to convert the frame rate of a video signal transmitted at 60 fps (Frame Per Second) to 120 fps, video blurring in moving parts such as horizontal, vertical, diagonal directions and rotating subjects is reduced. In addition, noise is also effectively suppressed, and flowing telop and fast-moving sports scenes are clearly displayed. The frame rate converted image signal is output to the display processing unit 15.

  As a method of interpolation processing, interpolation is performed in accordance with a generally performed frame image interpolation method such as an interpolation generation processing method based on motion vector detection by a block matching method described in Japanese Patent Application Laid-Open No. 2008-35404. It is also possible to generate and interpolate frame images. Furthermore, the number of interpolated frame images can be arbitrarily determined.

  The display processing unit 15 includes a driver or the like for outputting an image signal to the display unit 16, and causes the display unit 16 to display the image signal received from the moving image improvement processing unit 14.

  The display unit 16 includes a display such as an LCD (Liquid Crystal Display), a plasma panel, and an SED (Surface-conduction Electron-emitter Display) panel, and displays an image signal controlled by the display processing unit 15.

  The operation unit 200 is configured by a remote operation device such as a remote controller, and transmits a selection signal to the main processing unit 12 when a user presses a mode selection button (not shown).

  Subsequently, an execution process performed in the above-described image display apparatus 100 will be described.

  FIG. 6 is a flowchart showing a processing procedure of super-resolution conversion processing when the user designates a video mode.

  As shown in the figure, the video determination unit 122 of the main processing unit 12 identifies the set video mode (step S601).

  Subsequently, the video determination unit 122 stores the video mode value corresponding to the set video mode in the flash memory (step S602). Note that the video mode value corresponding to the video mode may be stored in advance in a flash memory or the like.

  Thereafter, the video determination unit 122 transmits the video mode value to the resolution enhancement unit 13 (step S603).

  Upon receiving the video mode value from the video determination unit 122, the preprocessing unit 131 of the resolution increasing unit 13 performs image processing such as interlace / progressive conversion processing and noise reduction processing, and superimposes the image signal together with the video mode value. The data is output to the conversion processing unit 132 (step S604). A signal related to the video mode value may be input from the main processing unit 12 (video determination unit 122) to the super-resolution processing unit 132 without passing through the preprocessing unit 131.

  Upon receiving the video mode value and the image signal from the preprocessing unit 131, the super resolution conversion processing unit 132 acquires a super resolution parameter corresponding to the video mode value from the EEPROM 20 (step S605).

  Then, the super resolution conversion processing unit 132 performs super resolution processing at a super resolution level corresponding to the acquired super resolution parameter on the image signal (step S606). Thereafter, the super-resolution conversion processing unit 132 outputs the image signal subjected to the super-resolution processing to the post-processing unit 133, and the post-processing unit 133 performs correction processing such as gamma correction and white balance adjustment, and the moving image improvement processing unit 14 (step S607). Thereafter, the image signal is displayed on the display unit 16 via the display processing unit 15. When the moving image improvement processing unit 14 includes various correction processing functions as described above, the correction processing is not performed by the post-processing unit 133 but the correction processing is performed on the moving image improvement processing unit 14 side. It is also good.

  As described above, the video determination unit 122 of the main processing unit 12 performs the super-resolution conversion process according to the set video mode, so that it is possible to provide a video that is appropriately super-resolution processed according to the video mode.

In the first embodiment, when a video mode whose image quality has been adjusted is selected assuming that the user wants to enjoy viewing bright and powerful video, the super resolution parameter value is set high and super resolution processing is performed. If a video mode with image quality adjustment is selected, assuming that you want to enjoy watching the movie in a darkened room, like a movie theater, set a small value for the super resolution parameter. However, the super resolution processing is weakened. With such a configuration, it is easy for the user to recognize the effect of super-resolution with respect to a vivid video, and a clearer video can be enjoyed. In addition, in a video mode where a user wants to enjoy a calm video like a movie, the super-resolution processing is weakened. Therefore, noise enhancement due to the super-resolution can be reduced, and a more calm video can be enjoyed.
Since the video has human preference, it is possible to set parameter values opposite to those in the present embodiment. In other words, in the vivid mode referred to in the present embodiment, the super-resolution process may be weakened. As a result, noise enhancement or the like can be reduced for an image with a lot of noise components. In the movie mode referred to in this embodiment, the value of the super resolution parameter may be increased. As a result, when a high-resolution video signal is received, there is no or little noise enhancement defect, so that the user can enjoy a clearer video in the movie mode.

(Second Embodiment)
In the first embodiment described above, the user designates an arbitrary video mode from several video modes such as “Azakaya” and “Movie”, whereby the super-resolution parameter corresponding to the designated video mode. The super-resolution conversion process according to However, it may be difficult for the user to determine which video mode should be specified. Therefore, instead of the video mode, a code indicating the type of program included in the video signal (for example, “1” for a sports program, “2” for a variety program, “3” for a movie program, etc. Hereinafter, the case where the super-resolution conversion process is automatically performed according to the program genre code will be described.

  Since the components in the second embodiment are the same as the components in the first embodiment, description using a block diagram will be omitted, and description will be made according to the processing procedure shown in FIG.

  In addition to performing the same processing as in the first embodiment, the video determination unit 122 identifies a program genre code included in the video signal received by the video signal input unit 11 (step S701), and identifies the identified program genre code. The data is stored in the flash memory 19 (step S702).

  Thereafter, the video determination unit 122 transmits the identified program genre code to the high resolution unit (step S703), and performs pre-processing similar to that of the first embodiment (step S704).

  Then, when receiving the program genre code received from the preprocessing unit 131, the super resolution conversion processing unit 132 acquires the super resolution parameter corresponding to the program genre code from the EEPROM 20 (step S705).

  Then, the super-resolution conversion processing unit 132 performs super-resolution processing at a super-resolution level according to the super-resolution parameter, as in the first embodiment (steps S706 and S707).

  As described above, since the video determination unit 122 of the main processing unit 12 identifies the program genre code and performs the super-resolution conversion process according to the identified program genre code, it is difficult for the user to determine the video mode. However, it is possible to provide a video that has been appropriately super-resolution processed according to the genre of the program.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  For example, when the video mode is not specified (for example, in the case of a television or the like that does not particularly have a video mode specifying means), the video determination unit 122 automatically identifies the program genre code and performs the super-resolution conversion process. For example, the first embodiment and the processes in the first embodiment can be combined. Also, the super resolution processing parameters may be set by combining information of both the set video mode and the program genre. For example, when the video mode is “Vivid” and the program genre is “Sports”, and when the video mode is “Vivid” and the program genre is “Movies”, the parameters of the super-resolution processing are changed. It is also possible to configure.

  In this embodiment, an example in which the image processing apparatus of the present invention is applied to an image display apparatus 100 such as a digital TV having a display unit 16, a display processing unit 15, an audio output unit 18, and an audio processing unit 17 is given. As described above, the image processing apparatus of the present invention can be applied to, for example, a tuner, a set top box, or the like that does not include the display unit 16, the display processing unit 15, the audio output unit 18, and the audio processing unit 17. .

  As described above, the image processing apparatus and the image processing method according to the present invention are useful for increasing the resolution of a video signal, and are particularly suitable for a technique for performing super-resolution processing according to a video mode.

DESCRIPTION OF SYMBOLS 100 Image display apparatus 11 Video signal input part 12 Main processing part 13 High resolution part 14 Movie improvement processing part 15 Display processing part 16 Display part 17 Audio | voice processing part 18 Audio | voice output part 19 Flash memory 20 EEPROM memory 111 Digital broadcast receiving part 112 IPTV signal processing unit 113 Internet signal processing unit 114 External input unit 121 Operation receiving unit 122 Video determination unit 123 Control unit 131 Preprocessing unit 132 Super-resolution conversion processing unit 133 Post processing unit 200 Operation unit (remote controller)
1111 Digital antenna 1112 Digital tuner 1113 Digital signal demodulator 1141 Analog antenna 1142 Analog tuner 1143 External input signal processor

Claims (8)

The first resolution video signal is input,
A pixel of a high-frequency component in a pixel to be inserted between pixels in a high resolution processing for generating a second resolution video signal higher than the first resolution by inserting pixels between the pixels with respect to the first resolution video signal Level storage means for associating and storing an image quality processing level indicating a ratio of the image mode and a video mode;
Video mode designating means for designating the video mode by a user operation;
Video determining means for determining the image quality processing level according to the specified video mode ;
A quality processing means for performing relative to the first resolution of the video signal, the determined image quality processing of the image quality processing level,
With
The level storage means, in the video mode for viewing brighter than the predetermined video mode, the video mode and the video mode so that the ratio of the pixels of the high frequency component is higher than the predetermined video mode. Store the image quality processing level in association with each other.
An image processing apparatus. The first resolution video signal is input,
A pixel of a high-frequency component in a pixel to be inserted between pixels in a high resolution processing for generating a second resolution video signal higher than the first resolution by inserting pixels between the pixels with respect to the first resolution video signal Level storage means for associating and storing an image quality processing level indicating a ratio of the image mode and a video mode;
Video mode designating means for designating the video mode by a user operation;
Video determining means for determining the image quality processing level according to the specified video mode ;
A quality processing means for performing relative to the first resolution of the video signal, the determined image quality processing of the image quality processing level,
With
In the video mode for viewing in a situation where the level storage means is darker than the predetermined video mode, the level storage means is configured to reduce the ratio of the high-frequency component pixels to be lower than that in the predetermined video mode. Storing the mode and the image quality processing level in association with each other;
An image processing apparatus. Display means for displaying the video signal of the second resolution;
The image processing apparatus according to claim 1 or 2, further comprising a. The first resolution video signal is input,
A pixel of a high-frequency component in a pixel to be inserted between pixels in a high resolution processing for generating a second resolution video signal higher than the first resolution by inserting pixels between the pixels with respect to the first resolution video signal Level storage means for associating and storing an image quality processing level indicating a ratio of the image mode and a video mode;
Video mode designating means for designating the video mode by a user operation;
Video determining means for determining the image quality processing level according to the specified video mode ;
A quality processing means for performing relative to the first resolution of the video signal, the determined image quality processing of the image quality processing level,
With
The level storage means, when the video mode is more suitable for movie viewing than the predetermined video mode, the video mode and the video mode so that the ratio of the pixels of the high-frequency component is lower than the predetermined video mode. Store the image quality processing level in association with each other.
An image processing apparatus. The image processing apparatus according to claim 1, wherein the resolution enhancement process includes a super-resolution process. Pixels in a resolution enhancement process in which a first resolution video signal is input and a second resolution video signal higher than the first resolution is generated by inserting pixels between the pixels with respect to the first resolution video signal Level storage means for storing the image quality processing level indicating the ratio of high frequency component pixels in the pixels to be inserted and the video mode in association with each other, and the level storage means for viewing brighter than the predetermined video mode. In the case of the video mode, the image is performed by the image processing apparatus that stores the video mode and the image quality processing level in association with each other so that the ratio of the high-frequency component pixels is higher than the predetermined video mode. A processing method,
A video mode designating step for designating the video mode;
A video determining step, wherein the video determining means determines the image quality processing level according to the specified video mode ;
A quality processing step of performing image quality processing means to the first resolution of the video signal, the determined image quality processing of the image quality processing level,
An image processing method comprising: Pixels in a resolution enhancement process in which a first resolution video signal is input and a second resolution video signal higher than the first resolution is generated by inserting pixels between the pixels with respect to the first resolution video signal Level storage means for storing the image quality processing level indicating the ratio of high frequency component pixels in the pixels inserted between the image processing mode and the video mode in association with each other, and the level storage means for viewing in a darker state than the predetermined video mode. An image processing apparatus that stores the video mode and the image quality processing level in association with each other so that the ratio of the high-frequency component pixels is lower than that of the predetermined video mode. An image processing method to be performed,
A video mode designating step for designating the video mode by a user operation;
A video determining step, wherein the video determining means determines the image quality processing level according to the specified video mode ;
A quality processing step of performing image quality processing means to the first resolution of the video signal, the determined image quality processing of the image quality processing level,
An image processing method comprising: The image processing method according to claim 6, wherein the resolution enhancement process includes a super-resolution process.

Images