CN113438418A - Image processing method, device, equipment and computer readable storage medium - Google Patents
Image processing method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN113438418A CN113438418A CN202110713170.4A CN202110713170A CN113438418A CN 113438418 A CN113438418 A CN 113438418A CN 202110713170 A CN202110713170 A CN 202110713170A CN 113438418 A CN113438418 A CN 113438418A
- Authority
- CN
- China
- Prior art keywords
- image
- resolution
- processed
- processing
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 12
- 238000012545 processing Methods 0.000 claims abstract description 90
- 238000000034 method Methods 0.000 claims abstract description 45
- 230000009467 reduction Effects 0.000 claims abstract description 19
- 230000008569 process Effects 0.000 claims abstract description 15
- 238000012937 correction Methods 0.000 claims description 10
- 238000007906 compression Methods 0.000 claims description 9
- 230000006835 compression Effects 0.000 claims description 7
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 238000009877 rendering Methods 0.000 description 9
- 238000013144 data compression Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 7
- 238000004590 computer program Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 239000000047 product Substances 0.000 description 4
- 229920001621 AMOLED Polymers 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000013527 convolutional neural network Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 239000002096 quantum dot Substances 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/156—Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/436—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/65—Control of camera operation in relation to power supply
- H04N23/651—Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W52/00—Power management, e.g. Transmission Power Control [TPC] or power classes
- H04W52/02—Power saving arrangements
- H04W52/0209—Power saving arrangements in terminal devices
- H04W52/0261—Power saving arrangements in terminal devices managing power supply demand, e.g. depending on battery level
- H04W52/0267—Power saving arrangements in terminal devices managing power supply demand, e.g. depending on battery level by controlling user interface components
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The application discloses an image processing method, an image processing device, an image processing apparatus and a computer-readable storage medium, wherein the image processing method comprises the following steps: acquiring an image to be processed; performing resolution reduction processing on an image to be processed to obtain a first image; performing image drawing on the first image; and performing super-resolution processing on the drawn first image to obtain a second image, and displaying the second image. By means of the mode, power consumption in the image display process can be reduced.
Description
Technical Field
The present application relates to the field of image processing, and in particular, to an image processing method, an image processing apparatus, an image processing device, and a computer-readable storage medium.
Background
With the advent of the mobile internet era, electronic devices such as mobile phones and tablet computers have become indispensable social and entertainment tools in daily life of people. With the development of display technologies, the resolution of display screens is greatly improved, the resolution of early function machines is generally about 320 × 240, and now the resolution has reached 4K and 8K, and correspondingly, the resolution of display images is also improved, so that the power consumption in the image display process is also increased.
Disclosure of Invention
A first aspect of an embodiment of the present application provides an image processing method, including: acquiring an image to be processed; performing resolution reduction processing on an image to be processed to obtain a first image; performing image drawing on the first image; and performing super-resolution processing on the drawn first image to obtain a second image, and displaying the second image.
A second aspect of the embodiments of the present application provides an image processing apparatus, including: the acquisition module is used for acquiring an image to be processed; the resolution reducing module is used for reducing the resolution of the image to be processed to obtain a first image; the drawing module is used for drawing the first image; the super-resolution module is used for performing super-resolution processing on the drawn first image to obtain a second image; and the display module is used for displaying the second image.
A third aspect of the embodiments of the present application provides an electronic device, which includes a processor and a memory connected to the processor, where the memory is used to store program data, and the processor is used to execute the program data to implement the foregoing method.
A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, in which program data are stored, and when the program data are executed by a processor, the program data are used to implement the foregoing method.
The beneficial effect of this application is: different from the prior art, the method and the device have the advantages that the resolution reduction processing is carried out on the image to be processed to obtain the first image, then the image drawing is carried out on the first image, the super-resolution processing is carried out on the drawn first image to obtain the second image, and the second image is displayed. The power consumption of the super-resolution processing is much smaller than that of image drawing, so that the resolution of an image to be processed is reduced firstly, then the image drawing is carried out, and finally the resolution is improved to the effect of an original resolution data source through the super-resolution processing, so that the power consumption in the image display process can be reduced while the resolution of the displayed image is not reduced.
Drawings
In order to more clearly illustrate the technical solutions in the present application, the drawings required in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings described below are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive labor. Wherein:
FIG. 1 is a schematic flowchart of an embodiment of an image processing method provided in the present application;
FIG. 2 is a schematic flow chart diagram illustrating an image processing method according to another embodiment of the present disclosure;
FIG. 3 is a flowchart illustrating an embodiment of step S21 in FIG. 2;
FIG. 4 is a flowchart illustrating an embodiment of step S212 in FIG. 3;
FIG. 5 is a block diagram schematically illustrating an embodiment of an image processing apparatus provided in the present application;
FIG. 6 is a block diagram illustrating an exemplary configuration of an electronic device provided herein;
FIG. 7 is a block diagram illustrating the structure of one embodiment of a computer-readable storage medium provided herein.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first" and "second" in this application are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless explicitly specifically limited otherwise. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Currently, the resolution of many displayed images is not high due to the influence of network bandwidth or shooting conditions. Taking a mobile phone as an example, various display images with different resolutions may be encountered in the mobile phone, and because the display images are not matched with the resolution of the display screen, the current common practice is to directly stretch or shrink the display images to the resolution corresponding to the screen, or supplement a black picture around the display images, but both of the above two ways affect the display effect. In addition, the display image can be processed by the super-resolution technology to improve the resolution of the display image, so that the resolution of the display image is adaptive to the resolution of the display screen, and the display effect can be improved when the display image is displayed on the display screen. And for the high-resolution display image, because the resolution is equal to or higher than the screen resolution, the super-resolution technology processing is not needed, and the high-resolution display image can be directly output to a display screen for display after being drawn. However, since image drawing is performed at a pixel level, power consumption of a high-resolution image is high during image drawing, which increases power consumption during image display and thus increases power consumption of an electronic device.
In order to save power consumption in the image display process, embodiments of the present application provide an image processing method, an apparatus, a device, and a computer-readable storage medium, where the image to be processed is subjected to resolution reduction processing to obtain a first image, the first image is then subjected to image rendering, the rendered first image is subjected to super-resolution processing to obtain a second image, and the second image is displayed. The power consumption of the super-resolution processing is much smaller than that of image drawing, so that the resolution of an image to be processed is reduced firstly, then the image drawing is carried out, and finally the resolution is improved to the effect of an original resolution data source through the super-resolution processing, so that the power consumption in the image display process can be reduced while the resolution of the displayed image is not reduced.
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating an image processing method according to an embodiment of the present disclosure. The execution subject of the embodiment of the present application may be an electronic device with data processing capability, and specifically may be a personal computer, a mobile terminal, a personal digital assistant, a wearable electronic device, and the like.
The method may comprise the steps of:
step S11: and acquiring an image to be processed.
The image to be processed may be a frame of image in the video stream, or may be a single image. The image to be processed may be sent to the electronic device by other devices, or may be acquired by the electronic device through a camera.
In some embodiments, the electronic device may acquire an image through a camera based on the photographing instruction, and perform preprocessing on the image by using a preset processing policy to obtain an image to be processed. The preprocessing is to acquire a clear and reliable image, and the preset processing strategy may include, but is not limited to, any one of linear correction, noise reduction, dead pixel removal, interpolation, white balance, and the like. In other embodiments, the electronic device may also acquire a plurality of images through the camera based on the photographing instruction, respectively pre-process the plurality of images by using a preset processing strategy, and then select at least one of the plurality of images as an image to be processed.
In other embodiments, the electronic device may acquire raw image data including an image to be processed, and then perform decoding processing on the raw image data to obtain the image to be processed. The original image data can be video source data, and after the video source data is decoded, a plurality of images can be obtained from a decoding code stream, and the resolution of each image can be obtained. The resolution includes the amount of information stored in the image. The higher the resolution is, the clearer the corresponding image is, and the higher the quality is; lower resolution corresponds to a blurry image, with lower quality. In general, the resolution may correspond to the length and width of the image (both length and width being units of resolution). For example, an image with a resolution of 1080 x 1920 may be 1080 a long and 1920 a wide.
Further, after the resolution of each image is acquired, a plurality of images can be selected from the plurality of images as the images to be processed according to the resolution of each image, so that resolution reduction processing can be avoided for each image, but the power consumption of the electronic device can be reduced to a greater extent. For a detailed description of this section, reference is made to the following examples.
Step S12: and performing resolution reduction processing on the image to be processed to obtain a first image.
The purpose of the resolution reduction processing is to reduce the resolution of the image to be processed, that is, the resolution of the first image obtained after the image to be processed is subjected to the resolution reduction processing is smaller than the resolution of the image to be processed.
Image data can be compressed because of the redundancy present in the data. The redundancy of image data is mainly represented by: spatial redundancy due to correlation between adjacent pixels in the image; temporal redundancy caused by correlation between different frames in the image sequence; spectral redundancy due to the correlation of different color planes or spectral bands. The goal of data compression is to reduce the number of bits required to represent the data by removing these data redundancies. Image compression refers to a technique of losslessly or losslessly representing an original pixel matrix with a small number of bits, and is also called image encoding. The image compression can comprise lossy data compression and lossless data compression, the lossless data compression method comprises a run length coding method and an entropy coding method, and the lossy data compression method comprises chroma sampling, transform coding and fractal compression.
In this embodiment, the image data compression method used in the resolution reduction processing of the image to be processed is not limited, and may be one or a combination of more of the above image data compression methods.
Generally, the resolution of the first image is smaller than the resolution of the display screen of the image to be displayed, where the display screen may be a display screen of an electronic device, or may be a display screen of another device connected to the electronic device, such as a display, a notebook, a desktop computer, a mobile phone, and the like.
Step S13: and performing image drawing on the first image.
In particular, the electronic device may image render the first image via the processor. The processor may be a single processing chip, or may be a module formed by a plurality of components that execute processing or control functions, which is not limited in this embodiment. Examples of the Processor include a GPU (Graphics Processing Unit), a CPU (central Processing Unit), an ISP (Image Signal Processor), and a DSP (Digital Signal Processor).
In a particular embodiment, the electronic device may include a GPU, and the first image is image rendered by the GPU. It can be understood that, since the GPU is used for pixel-level rendering, if the resolution of an image to be rendered is higher, the GPU needs to use more threads for rendering, thereby increasing the power consumption of the GPU. Under the same resolution difference, the power consumption of general GPU drawing is 3 times or more than that of super-resolution processing. According to the embodiment, the high-resolution image is compressed to the low resolution, then the GPU is used for drawing, and then the super-resolution image is subjected to super-resolution processing to be super-divided back to the original high-resolution image quality, so that the power consumption of the GPU for drawing the image can be greatly saved, the power consumption of the GPU for drawing on the whole display link is the largest, and the power consumption of the electronic equipment is greatly saved.
In some embodiments, the electronic device may obtain a resolution of the first image, adjust a drawing resolution of a processor (e.g., GPU) based on the resolution of the first image, and then draw the first image based on the adjusted drawing resolution. It can be understood that, since the resolution of the image to be processed is reduced in the present embodiment, the resolution of the first image may be lower than the resolution of the display screen, and at this time, if the processor still uses a high drawing resolution to draw the first image, the power consumption of the processor may be wasted. Therefore, the drawing resolution of the processor can be adjusted according to the resolution of the first image so as to further reduce the power consumption of the processor, thereby reducing the power consumption in the image display process.
Specifically, the electronic device may determine a target drawing resolution matching the resolution of the first image from preset drawing resolutions according to a preset algorithm, and then adjust the drawing resolution of the processor to the target drawing resolution. The number of the preset drawing resolutions may be plural. In one embodiment, it may be determined whether a difference between a width of the preset drawing resolution and a width of a resolution of the first image is within a first preset range, and whether a difference between a height of the preset drawing resolution and a height of the resolution of the first image is within a second preset range, if so, the preset drawing resolution is marked as a target drawing resolution, otherwise, the preset drawing resolution is not marked and is continuously compared with a next preset drawing resolution until the comparison with all preset drawing resolutions is completed. If the target drawing resolution is not marked, the original drawing resolution may not be adjusted. The first preset range and the second preset range may be the same or different. The width of the target drawing resolution obtained in the above manner is larger than the width of the resolution of the first image and the height is larger than the height of the second resolution, that is, the target drawing resolution covers the resolution of the first image, so that the target drawing resolution can satisfy the requirement of drawing for the first image, and meanwhile, the drawing resolution can be limited in a proper range, thereby reducing the power consumption of the processor.
For example, if a preset drawing resolution is 700 × 500 and a resolution of a first image is 690 × 480, a difference between a width of the preset drawing resolution and a width of a resolution of the first image is 10, and the difference is within a first preset range [0, 10], and a difference between a height of the preset drawing resolution and a height of a resolution of the first image is 20, and the difference is also within a second preset range [0, 20], so that the preset drawing resolution 700 × 500 can be marked as a target drawing resolution.
In some embodiments, there may be a case where the target drawing resolution is multiple, and in this case, the electronic device may perform image drawing at any one of the multiple target drawing resolutions, or may further calculate a product of a difference between a width of the target drawing resolution and a width of the resolution of the first image and a difference between a height of the target drawing resolution and a height of the resolution of the first image, and select the mesh drawing resolution with the smallest product to perform image drawing. It is understood that the smallest product represents the smallest resolution, so that the target plot resolution with the smallest resolution among a plurality of target plot resolutions satisfying the condition can be selected, and the power consumption of the processor in the image plotting can be minimized by using the target plot resolution for image plotting.
Step S14: and performing super-resolution processing on the drawn first image to obtain a second image, and displaying the second image.
The purpose of Super-Resolution (SR) is to improve the Resolution of an image, that is, reconstruct a corresponding high-Resolution image from a low-Resolution image.
Specifically, the super-resolution model may be employed to perform super-resolution processing on the first image. The Super-Resolution model is, for example, a model such as a Super-Resolution Convolutional Neural Network (SRCNN), a Fast SRCN (fsrcn), an ESPCN (effective Sub-Pixel Convolutional Neural Network), a deep-Recursive Convolutional Neural Network (DRCN), or the like. It is understood that the resolution of the second image after the super-resolution processing is greater than that of the first image.
In some embodiments, the super-resolution processing may increase the resolution of the first image to the resolution of the display screen, or even to be greater than the resolution of the display screen, that is, the resolution of the second image may be approximately equal to or greater than the resolution of the display screen, so that the display screen may normally display the second image, thereby improving the display effect of the image to be displayed, and reducing power consumption during the image display process.
According to the scheme, the resolution of the image to be processed is reduced to obtain the first image, then the first image is drawn, the drawn first image is subjected to super-resolution processing to obtain the second image, and the power consumption of the super-resolution processing is much smaller than that of the image drawing, so that the resolution of the image to be processed is reduced firstly, then the image is drawn, and finally the resolution is improved to the effect of an original resolution data source through the super-resolution processing, so that the power consumption in the image display process can be reduced while the resolution of the displayed image is not reduced.
Referring to fig. 2 to 4, fig. 2 is a schematic flowchart of another embodiment of an image processing method provided in the present application, fig. 3 is a schematic flowchart of an embodiment of step S21 in fig. 2, and fig. 4 is a schematic flowchart of an embodiment of step S212 in fig. 3. The execution subject of the embodiment of the present application may be an electronic device having a data processing capability.
The method may comprise the steps of:
step 21: and acquiring an image to be processed.
In this embodiment, step S21 may specifically include steps S211 and S212:
step S211: raw image data containing an image to be processed is acquired.
The original image data may include a plurality of images, and the resolutions of the plurality of images may be the same or different. In this embodiment, the source of the original image data is not limited, and the original image data may be acquired by the electronic device through the camera, or may be sent by other devices or the server.
Step S212: and decoding the original image data to obtain an image to be processed.
Generally, an electronic device may include a codec module for encoding and decoding data such as images, videos, and the like. When the electronic device acquires original image data, the original image data can be sent to the encoding and decoding module, and the encoding and decoding module performs decoding processing on the original image data to obtain an image to be processed.
Step S212 may specifically include steps S2121-S2124:
step S2121: and carrying out decoding processing on the original image data to obtain at least two frames of images.
It is understood that the original image data in this embodiment includes at least two frames of images, so that after the original image data is decoded, at least two frames of images can be obtained.
Step S2122: the resolution of at least two frames of images is obtained.
Specifically, the resolution of at least two frames of images may be obtained from the decoded code stream of the original image data, or may be read from the image information of at least two frames of images; alternatively, the image editing program is called to read the image attribute information, which is not limited in this embodiment. In some embodiments, the electronic device may add a resolution identification module at the back end of the codec module (e.g., codec) for identifying the resolution of the image.
Take original image data as video source data as an example. Since the video source data is encoded according to a fixed encoding rule, such as H.264/AVC, HEVC/H.265, Ffmmpeg and the like, after the video source data is decoded, the required resolution can be quickly extracted from the decoded code stream. Taking h.264 code stream as an example, h.264 code stream takes 0x 000 x 000 x01 or 0x 000 x 000 x o1 as start code, and then determines whether it is SPS (sequence Parameter set) by detecting whether the last five bits of the first byte after the start code are 7(00111), and after SPS is obtained, the resolution of video source data can be analyzed. Two members of the SPS are pic width In mbs minus1 and pic height _ In map units minus _1, which respectively represent the width and height information of the image, and the actual resolution of the video source data, i.e. the resolution of at least two frames of images, can be obtained through calculation according to the two values.
Step S2123: and sequencing at least two frames of images according to the sequence of the resolution from large to small.
Step S2124: and selecting the previous preset number of frame images as images to be processed.
The preset number can be set according to actual needs, and can be 1, 2 or 10, for example. In some embodiments, the preset number may also be determined according to the number of images (i.e., at least two frames of images) included in the original image data, and specifically, according to the preset ratio, a preset number of images with a higher resolution may be selected from the decoded at least two frames of images as the images to be processed. For example, the preset ratio is 5:1, that is, one image needs to be selected from 5 images as an image to be processed, and if 30 images exist in the decoded original image data, 6 images with the resolution arranged in front from large to small need to be selected from 30 images. In other embodiments, the preset number may be a fixed value, such as 1, 2, 3, etc.
It is understood that, in some embodiments, at least two frames of images may be sorted in the order of the resolution from small to large, and then the next preset number of images may be selected as the images to be processed. According to the scheme, the decoded images are screened firstly, and the images with high resolution can be used as the images to be processed, so that the number of the images needing resolution reduction processing can be reduced, and the power consumption of the processor can be reduced to a large extent.
Step 22: and acquiring the resolution of the image to be processed.
The resolution of the image to be processed includes but is not limited to: the resolution of the image to be processed can be obtained from the decoding code stream of the original image data, and the image information of the image to be processed is read; alternatively, the image editing program is called to read the image attribute information, which is not limited in this embodiment.
Step 23: and judging whether the resolution of the image to be processed is greater than a preset resolution threshold value.
If not, step S24 is executed.
If yes, go to step S25.
In this embodiment, the preset resolution threshold may be set according to an actual situation. For example, the preset resolution threshold may be a resolution of a display screen of the electronic device. The resolution of the display screen of the mobile phone, which is common at present, includes: QHD (resolution 960 × 540), HD (resolution 1280 × 720), FHD (resolution 1920 × 1080), 2K (resolution 2560 × 1440), 4K (resolution 3840 × 2160).
In some specific embodiments, the preset resolution threshold is 1280 × 720, the resolution of the image a to be processed is 480 × 320, the resolution of the image B to be processed is 1920 × 1080, and it is seen that the resolution of the image a to be processed is smaller than the preset resolution threshold, the image to be processed may be directly subjected to image rendering without performing resolution reduction processing, and the resolution of the image B to be processed is larger than the preset resolution threshold, so that the resolution of the image B to be processed is reduced and then the image is rendered, thereby reducing power consumption in the image rendering process.
Step S24: and drawing the image to be processed, performing super-resolution processing on the drawn image to be processed to obtain a third image, and displaying the third image.
In this embodiment, an image to be processed (which may be referred to as a low-resolution image) of which the image to be processed is smaller than or equal to the preset resolution threshold is directly subjected to image rendering, so as to obtain a rendered image to be processed. Because the resolution of the drawn image to be processed is low, in order to enable the display screen to display normally, the drawn image to be processed can be further subjected to super-resolution processing to obtain a third image. And the resolution of the third image is greater than that of the drawn image to be processed, and is equal to or greater than that of the display screen. After the third image is obtained, the third image may be output to a display screen for display, or sent to a third device for display.
Step S25: and performing resolution reduction processing on the image to be processed to obtain a first image.
Specifically, the image to be processed may be subjected to an equal ratio compression process to obtain the first image. After the image is compressed by an equal ratio compression mode, the ratio of the resolution width to the height of the first image is the same as the ratio of the resolution width to the height of the image to be processed before compression. The geometric compression mode can reduce the distortion of the compressed image.
Step S26: and performing image drawing on the first image.
Step S27: and performing super-resolution processing on the drawn first image to obtain a second image.
It can be understood that the embodiments of the present application may be combined, and for the description of the above steps, reference may be made to corresponding positions in the foregoing embodiments, which are not described herein again.
In some embodiments, after step S27, the method may further include:
step S28: and performing correction processing on the second image by using the image to be processed.
The super-resolution module of the electronic device can acquire the image to be processed and correct the second image by using the image to be processed.
It can be understood that the image to be processed is an original image, information in the original image is relatively comprehensive, and part of information in the second image obtained after the super-resolution processing may have a deviation from information of a corresponding position in the original image, so that the second image can be corrected through the image to be processed, and the information having the deviation is corrected, so as to be better restored into the image to be processed. In some embodiments, it may be determined whether an information deviation between the second image and a corresponding position in the image to be processed is greater than a preset threshold, and if so, replacing information of the corresponding position in the second image with information of the image to be processed. The preset threshold may be set according to practical situations, and is not limited herein. If the information deviation is, for example, a color deviation, the second image may be color-corrected according to RGB data in the image to be processed, and the information deviation may be a luminance deviation.
For example, if the information deviation is a brightness deviation, the gray value of the corresponding position in the second image and the image to be processed may be obtained, and the difference value is calculated to obtain the brightness deviation, and if the brightness deviation is greater than a preset threshold (for example, 20), the gray value of the corresponding position in the second image is replaced by the gray value in the image to be processed.
Step S29: and displaying the second image after the correction processing, or sending the second image after the correction processing to a third device for displaying.
Electronic devices include display screens for displaying images, videos, and the like. The electronic device may transmit the second image after the correction processing to the display screen for display by the display screen, or the electronic device may establish a communication connection with a third device so that the second image after the correction processing may be transmitted to the third device for display.
In this embodiment, the display screen may include a display panel. The display panel may be a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a mini light-emitting diode (mini-light-emitting diode), a micro led, a quantum dot light-emitting diode (QLED), or the like. In some embodiments, the electronic device may include 1 or more display screens.
The third device is similar to the electronic device, and for the description of the third device, reference may be made to the description in the embodiment of the electronic device, which is not described herein again.
It can be understood that, after obtaining the second image, the electronic device may not perform the correction processing on the second image, and directly display the second image or directly send the second image to the third device for display, which may be specifically set according to an actual situation.
Referring to fig. 5, fig. 5 is a schematic block diagram illustrating a structure of an embodiment of an image processing apparatus according to the present disclosure.
In this embodiment, the image processing apparatus 500 may include an acquisition module 510, a resolution reduction module 520, a rendering module 530, a super-resolution module 540, and a display module 550.
The acquiring module 510 is configured to acquire an image to be processed, the resolution reducing module 520 is configured to perform resolution reducing processing on the image to be processed to obtain a first image, the drawing module 530 is configured to draw the first image, the super-resolution module 540 is configured to perform super-resolution processing on the drawn first image to obtain a second image, and the display module 550 is configured to display the second image.
In some embodiments, the resolution reduction module 520 may be further configured to perform an equal ratio compression process on the image to be processed to obtain the first image.
In some embodiments, the image processing apparatus 500 may further include a determination module (not shown). The obtaining module 510 may also be configured to obtain a resolution of the image to be processed. The judging module is used for judging whether the resolution of the image to be processed is greater than a preset resolution threshold value or not; if yes, executing the step of reducing the resolution of the image to be processed.
In some embodiments, the rendering module 530 is further configured to perform image rendering on the image to be processed when the resolution of the image to be processed is less than or equal to a preset resolution threshold, and perform super-resolution processing on the rendered third image to obtain a fourth image.
In some embodiments, the image processing apparatus 500 may further include a codec module (not shown). The obtaining module 510 may be further configured to obtain raw image data including an image to be processed; the encoding and decoding module can be used for decoding the original image data to obtain an image to be processed.
In some embodiments, the encoding and decoding module may perform decoding processing on the original image data to obtain at least two frames of images; acquiring the resolution of at least two frames of images; sequencing at least two frames of images according to the sequence of the resolution from large to small; and selecting a preset number of images in front as images to be processed.
In some embodiments, the image processing apparatus 500 may further include a modification module (not shown). The correction module is used for correcting the second image by using the image to be processed. The display module 550 is configured to display the second image after the modification processing, or send the second image after the modification processing to a third device for display.
According to the scheme, the resolution of the image to be processed is reduced to obtain the first image, then the first image is drawn, the drawn first image is subjected to super-resolution processing to obtain the second image, and the power consumption of the super-resolution processing is much smaller than that of the image drawing, so that the resolution of the image to be processed is reduced firstly, then the image is drawn, and finally the resolution is improved to the effect of an original resolution data source through the super-resolution processing, so that the power consumption in the image display process can be reduced while the resolution of the displayed image is not reduced.
Referring to fig. 6, fig. 6 is a schematic block diagram of a structure of an embodiment of an electronic device provided in the present application.
The electronic device 600 may comprise a processor 610 and a memory 620 connected to the processor 610, the memory 620 being adapted to store program data, the processor 610 being adapted to execute the program data to implement the steps of any of the method embodiments described above.
The electronic device 600 may be a television, a desktop computer, a laptop computer, a handheld computer, a wearable device, a head-mounted display, a reader device, a portable music player, a portable game console, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, and a cicada-phone, a Personal Digital Assistant (PDA), an Augmented Reality (AR), a Virtual Reality (VR) device.
In particular, the processor 610 is configured to control itself and the memory 620 to implement the steps of any of the method embodiments described above. Processor 610 may also be referred to as a CPU (Central Processing Unit). The processor 610 may be an integrated circuit chip having signal processing capabilities. The Processor 610 may also be a Graphics Processing Unit (GPU), a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. In addition, the processor 610 may be implemented collectively by a plurality of integrated circuit chips.
Referring to fig. 7, fig. 7 is a schematic block diagram illustrating a structure of an embodiment of a computer-readable storage medium provided in the present application.
The computer readable storage medium 700 stores program data 710, which program data 710, when executed by a processor, is adapted to carry out the steps of any of the above-described method embodiments.
The computer-readable storage medium 700 may be a medium that can store a computer program, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, or may be a server that stores the computer program, and the server can send the stored computer program to another device for running or can run the stored computer program by itself.
In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a module or a unit is merely a logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some interfaces, and may be in an electrical, mechanical or other form.
Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings, or which are directly or indirectly applied to other related technical fields, are intended to be included within the scope of the present application.
Claims (10)
1. An image processing method, comprising:
acquiring an image to be processed;
performing resolution reduction processing on the image to be processed to obtain a first image;
performing image drawing on the first image;
and performing super-resolution processing on the drawn first image to obtain a second image, and displaying the second image.
2. The method of claim 1,
the performing resolution reduction processing on the image to be processed to obtain a first image includes:
and performing geometric compression processing on the image to be processed to obtain a first image.
3. The method of claim 1,
before the performing resolution reduction processing on the image to be processed to obtain a first image, the method further includes:
acquiring the resolution of the image to be processed;
judging whether the resolution of the image to be processed is greater than a preset resolution threshold value or not;
and if so, executing the step of performing resolution reduction processing on the image to be processed.
4. The method of claim 3,
after judging whether the resolution of the image to be processed is greater than a preset resolution threshold, the method further comprises:
and if not, performing image drawing on the image to be processed, performing super-resolution processing on the drawn image to be processed to obtain a third image, and displaying the third image.
5. The method of claim 1,
the acquiring of the image to be processed includes:
acquiring original image data containing the image to be processed;
and decoding the original image data to obtain the image to be processed.
6. The method of claim 5,
the decoding processing of the original image data to obtain the image to be processed includes:
decoding the original image data to obtain at least two frames of images;
acquiring the resolution of at least two frames of images;
sequencing at least two frames of images according to the sequence of the resolution from large to small;
and selecting a preset number of frame images in front as the images to be processed.
7. The method of claim 1, further comprising:
correcting the second image by using the image to be processed;
the displaying the second image includes:
displaying the second image after the correction process, or
And sending the second image after the correction processing to a third device for displaying.
8. An image processing apparatus characterized by comprising:
the acquisition module is used for acquiring an image to be processed;
the resolution reducing module is used for carrying out resolution reducing processing on the image to be processed to obtain a first image;
the drawing module is used for drawing the first image;
the super-resolution module is used for performing super-resolution processing on the drawn first image to obtain a second image;
and the display module is used for displaying the second image.
9. An electronic device, comprising a processor and a memory coupled to the processor,
the memory is for storing program data, and the processor is for executing the program data to implement the method of any one of claims 1-8.
10. A computer-readable storage medium, in which program data are stored which, when being executed by a processor, are adapted to carry out the method according to any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110713170.4A CN113438418A (en) | 2021-06-25 | 2021-06-25 | Image processing method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110713170.4A CN113438418A (en) | 2021-06-25 | 2021-06-25 | Image processing method, device, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113438418A true CN113438418A (en) | 2021-09-24 |
Family
ID=77755300
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110713170.4A Pending CN113438418A (en) | 2021-06-25 | 2021-06-25 | Image processing method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113438418A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113885822A (en) * | 2021-10-15 | 2022-01-04 | Oppo广东移动通信有限公司 | Image data processing method and device, electronic equipment and storage medium |
| CN113986168A (en) * | 2021-10-14 | 2022-01-28 | 深圳Tcl新技术有限公司 | Image display method, device, equipment and readable storage medium |
| CN113993104A (en) * | 2021-10-26 | 2022-01-28 | 中汽创智科技有限公司 | Data transmission method, device, equipment and storage medium |
| WO2023206282A1 (en) * | 2022-04-28 | 2023-11-02 | 京东方科技集团股份有限公司 | Image display method and system, computer readable storage medium, and electronic device |
| WO2024055229A1 (en) * | 2022-09-15 | 2024-03-21 | 华为技术有限公司 | Image processing method, apparatus, and system, and intelligent device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130071044A1 (en) * | 2011-09-21 | 2013-03-21 | Fuji Xerox Co., Ltd. | Image processing apparatus, non-transitory computer readable medium, and image processing method |
| CN105807890A (en) * | 2016-03-04 | 2016-07-27 | 北京金山安全软件有限公司 | Information display method and device and electronic equipment |
| CN106919401A (en) * | 2017-03-10 | 2017-07-04 | 广东欧珀移动通信有限公司 | A kind of method of dynamic regulation resolution ratio, device and mobile terminal |
| CN107277419A (en) * | 2017-07-28 | 2017-10-20 | 京东方科技集团股份有限公司 | A kind of display device and its display methods |
| CN107357404A (en) * | 2016-05-10 | 2017-11-17 | 联发科技（新加坡）私人有限公司 | Method for displaying image and its electronic installation |
| CN108648259A (en) * | 2018-03-27 | 2018-10-12 | 广东欧珀移动通信有限公司 | image drawing method, device, storage medium and intelligent terminal |
| CN108710478A (en) * | 2018-03-27 | 2018-10-26 | 广东欧珀移动通信有限公司 | Control method, device, storage medium and the intelligent terminal of display screen |
| CN110471731A (en) * | 2019-08-09 | 2019-11-19 | 网易（杭州）网络有限公司 | Display interface method for drafting, device, electronic equipment and computer-readable medium |
| CN111179883A (en) * | 2020-01-03 | 2020-05-19 | 云谷（固安）科技有限公司 | Image display method and device, mobile terminal, computer equipment and storage medium |
-
2021
- 2021-06-25 CN CN202110713170.4A patent/CN113438418A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130071044A1 (en) * | 2011-09-21 | 2013-03-21 | Fuji Xerox Co., Ltd. | Image processing apparatus, non-transitory computer readable medium, and image processing method |
| CN105807890A (en) * | 2016-03-04 | 2016-07-27 | 北京金山安全软件有限公司 | Information display method and device and electronic equipment |
| CN107357404A (en) * | 2016-05-10 | 2017-11-17 | 联发科技（新加坡）私人有限公司 | Method for displaying image and its electronic installation |
| CN106919401A (en) * | 2017-03-10 | 2017-07-04 | 广东欧珀移动通信有限公司 | A kind of method of dynamic regulation resolution ratio, device and mobile terminal |
| CN107277419A (en) * | 2017-07-28 | 2017-10-20 | 京东方科技集团股份有限公司 | A kind of display device and its display methods |
| CN108648259A (en) * | 2018-03-27 | 2018-10-12 | 广东欧珀移动通信有限公司 | image drawing method, device, storage medium and intelligent terminal |
| CN108710478A (en) * | 2018-03-27 | 2018-10-26 | 广东欧珀移动通信有限公司 | Control method, device, storage medium and the intelligent terminal of display screen |
| CN110471731A (en) * | 2019-08-09 | 2019-11-19 | 网易（杭州）网络有限公司 | Display interface method for drafting, device, electronic equipment and computer-readable medium |
| CN111179883A (en) * | 2020-01-03 | 2020-05-19 | 云谷（固安）科技有限公司 | Image display method and device, mobile terminal, computer equipment and storage medium |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113986168A (en) * | 2021-10-14 | 2022-01-28 | 深圳Tcl新技术有限公司 | Image display method, device, equipment and readable storage medium |
| CN113885822A (en) * | 2021-10-15 | 2022-01-04 | Oppo广东移动通信有限公司 | Image data processing method and device, electronic equipment and storage medium |
| CN113993104A (en) * | 2021-10-26 | 2022-01-28 | 中汽创智科技有限公司 | Data transmission method, device, equipment and storage medium |
| CN113993104B (en) * | 2021-10-26 | 2023-12-26 | 中汽创智科技有限公司 | Data transmission method, device, equipment and storage medium |
| WO2023206282A1 (en) * | 2022-04-28 | 2023-11-02 | 京东方科技集团股份有限公司 | Image display method and system, computer readable storage medium, and electronic device |
| WO2024055229A1 (en) * | 2022-09-15 | 2024-03-21 | 华为技术有限公司 | Image processing method, apparatus, and system, and intelligent device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113438418A (en) | Image processing method, device, equipment and computer readable storage medium | |
| US12136186B2 (en) | Super resolution image processing method and apparatus | |
| CN110169068B (en) | DC coefficient sign coding scheme | |
| CN103281539A (en) | Method, device and terminal for image encoding and decoding processing | |
| US20150279055A1 (en) | Mipmap compression | |
| WO2012138568A1 (en) | System and method for encoding and decoding anti-aliased video data | |
| TW201904294A (en) | Digital content stream compression | |
| CN116863861B (en) | Image processing method and device based on non-explicit point judgment and readable storage medium | |
| US11805278B2 (en) | Image compression | |
| JP2008259071A (en) | Image compressing method, image compressing apparatus and program | |
| US20180048914A1 (en) | Image processing method and related apparatus | |
| CN111510643B (en) | System and method for splicing panoramic image and close-up image | |
| CN116862814B (en) | Image processing method, image processing apparatus, and computer-readable storage medium | |
| KR100935541B1 (en) | Method For Processing Of Imaging Signal And Signal Processor Perfoming The Same | |
| JP3695451B2 (en) | Image size changing method and apparatus | |
| CN114467298A (en) | Image signal conversion processing method and device and terminal equipment | |
| JP4888120B2 (en) | Method and apparatus for processing image data | |
| US20110242112A1 (en) | Display device and driving circuit thereof | |
| CN115767085A (en) | Data processing method and device | |
| JP2010213356A (en) | Method and system for processing image data | |
| US10034007B2 (en) | Non-subsampled encoding techniques | |
| CN115150624A (en) | Image compression method and circuit system | |
| CN115623217B (en) | Image preprocessing method, device and system | |
| Lebowsky | Optimizing color fidelity for display devices using contour phase predictive coding for text, graphics, and video content | |
| CN117173056B (en) | Image processing method, apparatus and readable storage medium for solving information loss |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |