CN113744125B

CN113744125B - Image processing method, storage medium and electronic device

Info

Publication number: CN113744125B
Application number: CN202010478260.5A
Authority: CN
Inventors: 朱文波; 方攀
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2020-05-29
Filing date: 2020-05-29
Publication date: 2024-07-26
Anticipated expiration: 2040-05-29
Also published as: CN113744125A

Abstract

The application discloses an image processing method, which is applied to electronic equipment, wherein the electronic equipment comprises a multimedia processing chip and an application processing chip, and the method comprises the following steps: acquiring first image data in a RAW format; acquiring image parameter information of the first image data by using the multimedia processing chip; transmitting image parameter information of the first image data to the application processing chip; acquiring second image data by using the application processing chip, wherein the second image data is non-RAW format image data obtained by converting the first image data; and the application processing chip performs image processing on the second image data according to the image parameter information of the first image data. The application can improve the imaging quality of the image.

Description

Image processing method, storage medium and electronic device

Technical Field

The present application relates to the field of image technology, and in particular, to an image processing method, a storage medium, and an electronic device.

Background

With the development of technology, the imaging capability of electronic devices is becoming more and more powerful. On this basis, users often take various images using electronic devices, such as users may take photographs or record videos using electronic devices. Accordingly, the electronic apparatus needs to frequently process various image data. However, in the related art, the imaging quality of an image is still poor when the electronic device processes image data.

Disclosure of Invention

The embodiment of the application provides an image processing method, a storage medium and electronic equipment, which can improve the imaging quality of an image.

In a first aspect, an embodiment of the present application provides an image processing method, applied to an electronic device, where the electronic device includes a multimedia processing chip and an application processing chip, the method includes:

acquiring first image data in a RAW format;

Acquiring image parameter information of the first image data by using the multimedia processing chip;

Transmitting image parameter information of the first image data to the application processing chip;

Acquiring second image data by using the application processing chip, wherein the second image data is non-RAW format image data obtained by converting the first image data;

and the application processing chip performs image processing on the second image data according to the image parameter information of the first image data.

In a second aspect, an embodiment of the present application provides an image processing method, applied to an electronic device, where the image processing method includes:

acquiring first image data in a RAW format;

Converting the first image data in the RAW format into second image data in a non-RAW format;

Performing preset processing on the image corresponding to the first image data to obtain a first processing result, and performing the preset processing on the image corresponding to the second image data to obtain a second processing result;

comparing the first processing result with the second processing result to obtain a correction parameter of the second processing result relative to the first processing result;

When the image data in the non-RAW format is acquired and the preset processing is needed, the preset processing is carried out on the image corresponding to the acquired image data in the non-RAW format according to the correction parameters.

In a third aspect, an embodiment of the present application provides a storage medium having stored thereon a computer program which, when executed on a computer, causes the computer to execute the flow in the image processing method provided in the first aspect or the second aspect of the embodiment of the present application.

In a fourth aspect, an embodiment of the present application further provides an electronic device, including a multimedia processing chip and an application processing chip, where the multimedia processing chip is connected to the application processing chip;

The multimedia processing chip is used for: acquiring first image data in a RAW format; acquiring image parameter information of the first image data; transmitting image parameter information of the first image data to the application processing chip;

The application processing chip is used for: acquiring second image data, wherein the second image data is non-RAW format image data obtained by converting the first image data; and carrying out image processing on the second image data according to the image parameter information of the first image data.

In a fifth aspect, an embodiment of the present application provides an electronic device, including a multimedia processing chip and an application processing chip, where the multimedia processing chip is connected to the application processing chip;

The multimedia processing chip is used for: acquiring first image data in a RAW format; converting the first image data in the RAW format into second image data in a non-RAW format;

The application processing chip is used for: performing preset processing on the first image data to obtain a first processing result, and performing the preset processing on the second image data to obtain a second processing result; comparing the first processing result with the second processing result to obtain a correction parameter of the second processing result relative to the first processing result; when the image data in the non-RAW format is acquired and the preset processing is needed, the acquired image data in the non-RAW format is subjected to the preset processing according to the correction parameters.

In the embodiment of the application, the electronic equipment can acquire the first image data in the RAW format and extract the image parameter information from the first image data by utilizing the multimedia processing chip. Thereafter, the electronic device may transmit the image parameter information extracted from the first image data to the application processing chip. The application processing chip may acquire second image data in a non-RAW format converted from the first image data, and perform image processing on the second image data according to image parameter information extracted from the first image data. That is, the electronic device can perform image processing on image data in a non-RAW format based on more accurate image parameter information extracted from the image data in the RAW format. Therefore, compared with the mode of directly carrying out image processing on the image data in the non-RAW format based on the image parameter information extracted from the image data in the non-RAW format, the embodiment of the application can improve the accuracy of the image processing, thereby improving the imaging quality of the image.

Drawings

The technical solution of the present application and its advantageous effects will be made apparent by the following detailed description of the specific embodiments of the present application with reference to the accompanying drawings.

Fig. 1 is a schematic diagram of a first structure of an electronic device according to an embodiment of the present application.

Fig. 2 is a schematic diagram of a second structure of an electronic device according to an embodiment of the present application.

Fig. 3 is a schematic diagram of a third structure of an electronic device according to an embodiment of the present application.

Fig. 4 is a schematic flow chart of a first image processing method according to an embodiment of the present application.

Fig. 5 is a second flowchart of an image processing method according to an embodiment of the present application.

Fig. 6 is a schematic view of a scenario of an image processing method according to an embodiment of the present application.

Fig. 7 is a third flowchart of an image processing method according to an embodiment of the present application.

Fig. 8 is a fourth flowchart of an image processing method according to an embodiment of the present application.

Fig. 9 is a schematic diagram of a first configuration of an image processing apparatus according to an embodiment of the present application.

Fig. 10 is a schematic diagram of a second structure of an image processing apparatus according to an embodiment of the present application.

Fig. 11 is a schematic diagram of a fourth structure of an electronic device according to an embodiment of the present application.

Detailed Description

Referring to the drawings, wherein like reference numerals refer to like elements throughout, the principles of the present application are illustrated in a suitable computing environment. The following description is based on illustrative embodiments of the application and should not be taken as limiting other embodiments of the application not described in detail herein.

Referring to fig. 1, fig. 1 is a schematic diagram of a first structure of an electronic device according to an embodiment of the application.

The electronic device 20 may include a camera 600, a multimedia processing chip 200, and an application processing chip 400. Camera 600 may include one or more cameras. The camera 600 may be electrically connected to the multimedia processing chip 200, and the multimedia processing chip 200 and the application processing chip 400 may be electrically connected. Wherein an electrical connection is understood to mean that two components are connected by signal lines, such as wires, or that the two components are soldered directly together.

It is understood that the camera 600 includes a lens and an image sensor, and the camera 600 is electrically connected to the multimedia processing chip through the image sensor thereof. The camera 600 may collect an image through a lens by an image sensor to obtain image data, such as image data in a RAW format.

The camera in the electronic device 20 may be at least one of a macro camera, a normal black and white camera, and TFO (Time of flight) cameras.

After the multimedia processing chip 200 receives the image data acquired from the camera 600, the multimedia processing chip 200 may perform a first process (or referred to as preprocessing) on the image data. After the image data is processed by the multimedia processing chip 200, the processed image data may be transmitted to the application processing chip 400, and after the application processing chip 400 receives the data processed by the multimedia processing chip 200, a second process (or referred to as post-process) is performed on the image data by using the image signal processor 420 and/or the application process 410 in the processing chip 400, so as to obtain a processed image.

Referring to fig. 2, fig. 2 is a schematic diagram of a second structure of an electronic device according to an embodiment of the application. The electronic device 20 may also include a display screen 800, and the display screen 800 may be electrically connected to the application processing chip 400. The display 800 may display a picture. For example, the display screen 800 may receive image data output from the application processing chip and display the image data as a preview image, a video recording image, a video playing image, a photograph, or the like.

It should be noted that, although not shown in fig. 1 and 2, the electronic device 20 defined in the embodiment of the present application may further include other devices, such as a battery, a speaker, a receiver, and the like.

Referring to fig. 3, fig. 3 is a schematic diagram of a third structure of an electronic device according to an embodiment of the application.

The multimedia processing chip 200 may perform a first process on image data acquired therefrom, such as RAW image data, to improve image quality. In some embodiments, the multimedia processing chip 200 may include an image signal Processor (IMAGE SIGNAR Processor, ISP) 210 and a neural network Processor (Neural-network Processing Unit, NPU) 220.

The image signal processor 210 may perform image processing on the image data, for example, statistical processing of the image data to count reference data, and then transmit the reference data to the application processing chip 400. The benchmark data may include 3A (AF stats, AWB stats, AE stats) data. It should be noted that the reference data may also include other data such as phase focusing data.

The neural network processor 220 processes the image data with high efficiency, and the improvement of the image quality is obvious. The neural network processor 220 may process completion in the data stream according to a preset time. The preset time is, for example, 30 fps=33 ms (milliseconds). Or the time preset for the neural network processor 220 to process one frame of image is 33ms, so that the neural network processor 220 can realize real-time transmission of data on the basis of rapidly processing the image data.

The neural network processor 220 may process the image data using various algorithms based on deep machine learning, thereby improving the image quality of the image data.

In addition, the multimedia processing chip 200 may also include components such as a digital signal Processor (DIGITAL SIGNAR Processor, DSP). Wherein the digital signal processor is not shown.

In previewing images or recording video, it is often necessary to transmit image data in real time. In order to ensure the processing rate of the image data by the multimedia processing chip 200, the image signal processor 210 can perform optimization processing on the image data, such as dead pixel compensation, black level correction, linearization processing, and the like, so as to speed up the algorithm processing rate of the image data by the neural network processor 220, thereby reducing the algorithm processing time of the image data by the neural network processor 220, ensuring real-time transmission of the image data, and avoiding the problems of blocking, and the like.

The optimization processing performed on the image data by the image signal processor 210 is not limited to the dead point compensation, the black level correction, and the linearization processing, and may include a Crop (loop) processing, a shrink (Bayerscaler) processing, and the like.

It will be appreciated that, after the image signal processor 210 performs optimization such as dead point compensation, black level correction and linearization on the image data, the image signal processor 420 applying the processing chip 400 does not need to perform optimization on the multiple paths of image data. That is, the image signal processor 420 and the image signal processor 210 of the application processing chip 400 may perform a differentiation process on the image data. The image signal processor 420 of the application processing chip 400 may perform 3A processing, fusion processing, etc. on the image data processed by the multimedia processing chip 200.

The neural network processor 220 and the image signal processor 210 may be connected through a system bus 230. The image signal processor 210 and the camera 600 may be connected through a first interface 21, and the first interface 21 may have multiple paths, each of which may transmit one path of image data. The image signal processor 210 is connected to the second interface 22, and the second interface 22 has multiple paths, each of which can transmit one path of image data. The second interface 22 is connected to the third interface 401, and the third interface 401 also has multiple paths, each of which can receive one path of image data.

The first interface 21, the second interface 22, and the third interface 401 may be mobile industry processor interfaces (Mobile Industry Processor Interface, MIPI).

The image data collected by the camera 600 in the embodiment of the present application may be transmitted to the multimedia processing chip 200 through the first interface 21, the multimedia processing chip 200 processes the image data, the image data processed by the multimedia processing chip 200 may be transmitted to the third interface 401 through the second interface 22, and the image signal processor 420 of the application processing chip 400 may further process the multiple paths of image data received via the third interface 401 and the system bus 430.

It should be noted that, the multimedia processing chip 200 and the application processing chip 400 may also use other interface connections, such as a high-speed interconnect bus interface (PERIPHERAL COMPONENT INTERCONNECT EXPRESS, PCIE) or/and a low-speed interconnect bus interface, where PCIE may also be referred to as a high-speed peripheral component interconnect interface, and an external device interconnect bus interface is an interface of a high-speed serial computer expansion bus standard.

The multimedia processing chip 200 may include a memory to store image data collected by the camera 600, image data processed by the image signal processor 210, image data processed by the neural network processor 220, and other data. The movement of image data may be implemented by integrating one or more memory access controllers, such as a direct memory access controller (Direct Memory Access, DMA), within the multimedia processing chip 200.

The application processing chip 400 may include a memory to store image data and other data processed by the multimedia processing chip 200. One or more memory access controllers, such as a direct memory access controller, may be integrated within the application processing chip 400 to effect the movement of image data.

It can be understood that the multimedia processing chip 200 of the electronic device 20 provided by the embodiment of the application is a chip dedicated to processing image data in the electronic device 20. The multimedia processing chip 200 can integrate different modules and improve the computing power according to actual needs, so that the processing capacity of the multimedia processing chip on image data can be increased, and the processing rate of the multimedia processing chip on the image data can be accelerated. Further, the power consumption of the image signal processor 420 in the application processing chip 400 can be greatly reduced, and the processing capability of the electronic device 20 on the image data can be greatly improved.

It is understood that the execution subject of the embodiment of the present application may be an electronic device such as a smart phone or a tablet computer.

Referring to fig. 4, fig. 4 is a schematic flow chart of a first image processing method according to an embodiment of the present application, where the image processing method may be applied to an electronic device, and the electronic device may include a multimedia processing chip and an application processing chip.

The image processing method provided by the embodiment of the application comprises the following steps:

11. First image data in a RAW format is acquired.

For example, in the related art, the electronic device generally performs image processing based on image data in YUV format, that is, the electronic device may extract image parameters required for image processing from the image data in YUV format, and perform image processing according to the image parameters. YUV is a color coding method that allows for reduced bandwidth of chroma in view of human perceptibility when encoding video or light. Where "Y" represents brightness (Luminance), i.e., gray scale values, and "U" and "V" represent chromaticity (Chrominance), which are used to describe image color and saturation for specifying the color of the pixel. But the image data in YUV format has undergone some image compression processing compared to the image data in RAW format. Therefore, the imaging quality of an image obtained by the electronic device performing image processing based on the image data in YUV format is poor.

In the embodiment of the present application, for example, the electronic device may first acquire image data in the RAW format, that is, the first image data. For example, in the embodiment of the present application, the first image data in the RAW format may be acquired by the multimedia processing chip.

The RAW format image data refers to RAW data of the CMOS or CCD image sensor for converting the collected light source signal into a digital signal. Thus, the RAW format is an unprocessed, also uncompressed format, and may be visually referred to as a "digital negative".

12. And acquiring the image parameter information of the first image data by utilizing the multimedia processing chip.

For example, after acquiring the first image data in the RAW format, the electronic device may acquire the image parameter information of the first image data using the multimedia processing chip.

In the embodiment of the application, the image parameter information of the image data may be some parameters such as brightness information, auto-focus information, auto-exposure information, auto-white balance information, depth information, lens shading correction information, and the like of the image.

It will be appreciated that since the first image data is image data in RAW format, and the image data in RAW format is image data that has not been processed and compressed, the accuracy of the image parameter information extracted from the first image data is relatively high compared to the image parameter information extracted from image data in non-RAW format.

13. And transmitting the image parameter information of the first image data to the application processing chip.

For example, after acquiring the image parameter information of the first image data, the electronic device may transmit the image parameter information of the first image data to the application processing chip. For example, the electronic device may control the multimedia processing chip to transmit the image parameter information of the first image data to the application processing chip.

14. And acquiring second image data by using the application processing chip, wherein the second image data is the image data in a non-RAW format obtained by converting the first image data.

For example, the application processing chip may acquire second image data, which may be image data of a non-RAW format converted from the first image data of the RAW format. For example, the second image data may be YUV format image data converted from the first image data in RAW format. In some implementations, the YUV format may include formats such as YUV444, YUV422, YUV420, YV12, NV21, and the like.

Of course, in other embodiments, the non-RAW format may include other image formats besides YUV format, such as JPEG format, etc., which is not limited in detail by the embodiment of the present application.

15. And the application processing chip performs image processing on the second image data according to the image parameter information of the first image data.

For example, after receiving the image parameter information of the first image data and the second image data in the non-RAW format, the electronic device may control the application processing chip to perform image processing on the second image data according to the image parameter information of the first image data.

For example, after receiving the image parameter information of the first image data, the application processing chip may process the second image data in YUV format using the image parameter information of the first image data.

In the embodiment of the present application, for example, the multimedia processing chip may acquire image data in a RAW format from the image sensor and extract depth information from the image data in the RAW format, and then the multimedia processing chip may convert the image data in the RAW format into image data in a YUV format and transmit the depth information extracted from the image data in the RAW format and the image data in the format-converted YUV format to the application processing chip. The application processing chip can perform image processing, such as background blurring processing, on the image data in the YUV format according to the depth information extracted from the image data in the RAW format.

It can be understood that in the embodiment of the present application, the electronic device may acquire the first image data in the RAW format, and extract the image parameter information from the first image data by using the multimedia processing chip. Thereafter, the electronic device may transmit the image parameter information extracted from the first image data to the application processing chip. The application processing chip may acquire second image data in a non-RAW format converted from the first image data, and perform image processing on the second image data according to image parameter information extracted from the first image data. That is, the electronic device can perform image processing on image data in a non-RAW format based on more accurate image parameter information extracted from the image data in the RAW format. Therefore, compared with the mode of directly carrying out image processing on the image data in the non-RAW format based on the image parameter information extracted from the image data in the non-RAW format, the embodiment of the application can improve the accuracy of the image processing, thereby improving the imaging quality of the image.

Referring to fig. 5, fig. 5 is a schematic flow chart of a second image processing method according to an embodiment of the application. The image processing flow may be applied to an electronic device, which may include a multimedia processing chip and an application processing chip.

21. The current shooting mode is determined.

22. A target image processing algorithm corresponding to the current photographing mode is determined.

23. And determining target parameters required for executing the target image processing algorithm.

For example, 21, 22, 23 may include:

For example, the electronic device may first determine a current shooting mode and determine a target image processing algorithm corresponding to the current shooting mode. The electronic device may then determine the target parameters required to execute the target image processing algorithm.

For example, electronic devices currently use a high dynamic range (HIGH DYNAMIC RANGE, HDR) capture mode, i.e., images captured by the electronic device have the effect of a high dynamic range. Based on this, the electronic device can determine an HDR processing algorithm corresponding to the HDR photographing mode as a target image processing algorithm. The electronic device may then determine the image processing parameters required to perform the HDR processing algorithm as target parameters. For example, parameters required to perform the HDR processing algorithm may include at least exposure, etc. Then, the electronic device may determine the exposure degree or the like as the target parameter.

As another example, the photographing mode currently used by the electronic device is a background blurring photographing mode, and the image processing algorithm corresponding to the background blurring photographing mode is a background blurring algorithm, then the electronic device may determine the background blurring algorithm as the target image processing algorithm. The parameters required to perform the background blurring algorithm include at least the depth information of the image. Then, the electronic device may determine the adoption number of the depth information and the like as the target parameter.

In the embodiment of the present application, the above-described flows 21 to 23 may be executed by an application processing chip. That is, the electronic device may determine a current photographing mode, a target image processing algorithm corresponding to the current photographing mode, and target parameters required to execute the target image processing algorithm using the application processing chip.

Of course, in other embodiments, the above-described flows 21 to 23 may be performed by a multimedia processing chip. That is, the electronic device may determine a current photographing mode, a target image processing algorithm corresponding to the current photographing mode, and target parameters required to perform the target image processing algorithm using the multimedia processing chip.

24. First image data in a RAW format is acquired.

For example, the electronic device may also acquire image data in RAW format, i.e., first image data. For example, in the embodiment of the present application, the first image data in the RAW format may be acquired by the multimedia processing chip.

In one embodiment, the multimedia processing chip may be connected to an image sensor of the electronic device, so that the multimedia processing chip may obtain image data in RAW format from the image sensor.

25. And extracting image parameter information corresponding to the target parameter from the first image data by utilizing the multimedia processing chip.

For example, after determining the target parameters required for executing the target image processing algorithm and acquiring the first image data in the RAW format, the electronic device may use the multimedia processing chip to extract the image parameter information corresponding to the target parameters from the first image data.

For example, the target parameter is depth information of the image, and the electronic device may extract the depth information of the first image data using the multimedia processing chip. That is, the electronic device may extract depth information of the first image data in the RAW format using the multimedia processing chip.

26. The first image data in the RAW format is converted into second image data in a non-RAW format.

For example, after extracting image parameter information corresponding to a target parameter from the first image data using the multimedia processing chip, the electronic device may convert the first image data in the RAW format into the second image data in a non-RAW format. For example, the electronic device may convert the first image data in RAW format to second image data in YUV format.

For example, the electronic device may convert the first image data in the RAW format into the second image data in the non-RAW format using the multimedia processing chip.

In other embodiments, the electronic device may also transmit the first image data in the RAW format to the application processing chip, so that the application processing chip converts the first image data in the RAW format into the second image data in the non-RAW format.

27. The image parameter information of the first image data and the second image data are transmitted to the application processing chip.

For example, after acquiring the image parameter information of the first image data and the second image data, the electronic device may transmit the image parameter information of the first image data and the second image data to the application processing chip.

For example, the multimedia processing chip may transmit depth information acquired from the first image data in the RAW format and the second image data in the YUV format to the application processing chip.

28. And the application processing chip performs image processing on the second image data according to the image parameter information of the first image data.

For example, after receiving the image parameter information of the first image data and the second image data, the electronic device may perform image processing on the second image data according to the image parameter information of the first image data using the application processing chip.

For example, the application processing chip may perform background blurring processing on the second image data in YUV format according to the depth information extracted from the first image data in RAW format.

It can be appreciated that in the embodiment of the present application, the electronic device may perform image processing on the image data in the non-RAW format according to the more accurate image parameter information extracted from the image data in the RAW format. Therefore, compared with the mode of directly carrying out image processing on the image data in the non-RAW format based on the image parameter information extracted from the image data in the non-RAW format, the embodiment of the application can improve the accuracy of the image processing, thereby improving the imaging quality of the image.

In one embodiment, the process of transmitting the image parameter information of the first image data and the second image data to the application processing chip in the above 27 may include:

and the multimedia processing chip is used for carrying out data packaging processing on the image parameter information of the first image data and the second image data and then transmitting the data to the application processing chip.

Then, the process of performing image processing on the second image data by the application processing chip according to the image parameter information of the first image data in the above-mentioned 28 may include: unpacking the received data by an application processing chip to obtain image parameter information of the first image data and the second image data; and performing image processing on the second image data according to the image parameter information of the first image data.

For example, the multimedia processing chip may compress and pack the image parameter information of the first image data and the second image data to process the data into a data packet, and then transmit the data packet to the application processing chip. Then, the application processing chip may perform decompression and unpacking processing on the received data packet, so as to obtain image parameter information of the first image data and the second image data, and then, the application processing chip may perform image processing on the second image data according to the image parameter information of the first image data.

It can be appreciated that in the embodiment of the present application, the efficiency of data transmission between the multimedia processing chip and the application processing chip can be improved by using the processing mode of data packing and data unpacking.

Referring to fig. 6 to fig. 7, fig. 6 is a schematic view of a scenario of an image processing method according to an embodiment of the application. Fig. 7 is a third flowchart of an image processing method according to an embodiment of the present application.

In an embodiment of the application, the electronic device may include an image sensor, a multimedia processing chip, and an application processing chip. Wherein the multimedia processing chip may be connected to the image sensor, and the multimedia processing chip may also be connected to the application processing chip.

For example, as shown in fig. 6, when the user opens the camera application and selects the background blurring shooting mode and presses the shooting button, the electronic device may collect image data about the current shooting scene through the image sensor, and the image sensor may output the image data in a RAW format, for example, as first image data. The image sensor may transmit the first image data to the multimedia processing chip.

And when the user presses the photographing button, the application processing chip can determine the currently used photographing model, for example, the application processing chip determines that the currently used background blurring photographing mode. Then, the application processing chip may determine a background blurring algorithm corresponding to the background blurring shooting mode as a target image processing algorithm, and determine target parameters for performing image depth information required for the background blurring algorithm.

Then, the application processing chip may transmit information in which the image depth information is determined as the target parameter to the multimedia processing chip.

After receiving the image depth information as the target parameter, the multimedia processing chip may extract the image depth information from the first image data in the RAW format. Then, the multimedia processing chip may convert the first image data in the RAW format into the second image data in the YUV format. After that, the multimedia processing chip may package the image depth information extracted from the first image data and the second image data in YUV format into a data packet, and transmit the data packet to the application processing chip.

After receiving the data packet, the application processing chip may unpack the data packet, so as to obtain the image depth information extracted from the first image data and the second image data in YUV format. Then, the application processing chip can perform background blurring processing on the second image data in the YUV format according to the image depth information extracted from the first image data.

Referring to fig. 8, fig. 8 is a fourth flowchart of an image processing method according to an embodiment of the application. The image processing method provided by the embodiment of the application comprises the following steps:

31. First image data in a RAW format is acquired.

For example, the electronic device may first acquire the first image data in the RAW format.

32. The first image data in the RAW format is converted into second image data in a non-RAW format.

For example, after acquiring the first image data in the RAW format, the electronic device may convert the first image data in the RAW format into the second image data in the non-RAW format.

For example, the electronic device may convert the first image data in RAW format to second image data in YUV format.

33. And carrying out preset processing on the image corresponding to the first image data to obtain a first processing result, and carrying out the preset processing on the image corresponding to the second image data to obtain a second processing result.

For example, after obtaining the first image data in the RAW format and the second image data in the non-RAW format, the electronic device may perform a preset process on the image corresponding to the first image data in the RAW format, thereby obtaining a first processing result, and perform the preset process on the image corresponding to the second image data in the non-RAW format, thereby obtaining a second processing result. That is, the electronic device may perform the same preset processing on the images corresponding to the first image data and the second image data, so as to obtain respective image processing results.

In some embodiments, the preset process may be various image processes, for example, the preset process may be a background blurring process or an HDR process or an image brightening process, and so on.

34. And comparing the first processing result with the second processing result to obtain a correction parameter of the second processing result relative to the first processing result.

For example, after obtaining the first processing result and the second processing result, the electronic device may compare the first processing result and the second processing result, thereby obtaining a correction parameter of the second processing result relative to the first processing result.

For example, the preset process is a background blurring process. Then, the electronic device performs background blurring processing on the image corresponding to the first image data, so as to obtain a first processing result, and the electronic device may perform background blurring processing on the image corresponding to the second image data, so as to obtain a second processing result. Then, the electronic device may compare the first processing result with the second processing result, thereby obtaining a correction parameter of the second processing result relative to the first processing result. For example, by comparing the degree of blurring corresponding to the second processing result detected by the electronic device to be weaker than the degree of blurring corresponding to the first processing result by 2%, the electronic device may determine the 2% as a correction parameter of the second processing result with respect to the first processing result, that is, when the electronic device performs background blurring on the image in the non-RAW format, the degree of blurring needs to be increased by 2% on the original basis.

35. When the image data of the non-RAW format is acquired and the preset processing is needed, the preset processing is carried out on the image corresponding to the acquired image data of the non-RAW format according to the correction parameters.

For example, after obtaining the correction parameter of the second processing result relative to the first processing result, when the image data of the non-RAW format is obtained and the preset processing needs to be performed on the image of the non-RAW format, the electronic device may perform the preset processing on the obtained image of the non-RAW format according to the correction parameter. For example, when it is acquired

It can be understood that in the embodiment of the present application, the electronic device may obtain, by comparing the first processing result and the second processing result, a correction parameter of the image in the non-RAW format relative to the image in the RAW format when the electronic device performs the preset processing on the image, and perform the preset processing on the image in the non-RAW format according to the correction parameter when the electronic device performs the subsequent image processing. The embodiment of the application can improve the imaging quality of the image because the embodiment of the application corrects the image in the non-RAW format when carrying out the preset processing.

In some embodiments, the image processing method provided in this embodiment may be applied to an electronic device, which may include a multimedia processing chip and an application processing chip.

Then, the electronic device may acquire the first image data in the RAW format using the multimedia processing chip, and convert the first image data in the RAW format into the second image data in the non-RAW format. The electronic equipment can perform preset processing on the first image data by using the application processing chip to obtain a first processing result, and perform the preset processing on the second image data to obtain a second processing result; and comparing the first processing result with the second processing result to obtain a correction parameter of the second processing result relative to the first processing result.

Then, when the image data in the non-RAW format is acquired and the preset processing is required, the application processing chip performs the preset processing on the acquired image data in the non-RAW format according to the correction parameters.

In one embodiment, the electronic device may perform the steps 31 to 34 at regular intervals or at regular frames, so as to obtain the latest correction parameters. Then, after obtaining the latest correction parameters, when the image data in the non-RAW format is obtained and needs to be subjected to the preset processing, the electronic device may perform the preset processing on the image corresponding to the obtained image data in the non-RAW format according to the correction parameters.

Referring to fig. 9, fig. 9 is a schematic diagram of a first structure of an image processing apparatus according to an embodiment of the application. The image processing apparatus may be applied to an electronic device including a multimedia processing chip and an application processing chip. The image processing apparatus 100 may include: the first acquisition module 101, the second acquisition module 102, the transmission module 103, the third acquisition module 104, and the processing module 105.

A first acquisition module 101, configured to acquire first image data in a RAW format.

A second obtaining module 102, configured to obtain image parameter information of the first image data by using the multimedia processing chip.

A transmission module 103, configured to transmit the image parameter information of the first image data to the application processing chip.

And a third obtaining module 104, configured to obtain second image data by using the application processing chip, where the second image data is non-RAW format image data obtained by converting the first image data.

And a processing module 105, configured to perform image processing on the second image data according to the image parameter information of the first image data by using the application processing chip.

In one embodiment, the first acquisition module 101 may be further configured to: determining a current shooting mode; determining a target image processing algorithm corresponding to the current shooting mode; and determining target parameters required for executing the target image processing algorithm.

Then, the second acquisition module 102 may be configured to: and extracting image parameter information corresponding to the target parameter from the first image data by using the multimedia processing chip.

In one embodiment, the first obtaining module 101 may be configured to: and determining a current shooting mode, a target image processing algorithm corresponding to the current shooting mode and target parameters required for executing the target image processing algorithm by using the application processing chip.

In one embodiment, the transmission module 103 may also be configured to: and converting the first image data in the RAW format into second image data in a non-RAW format by using the multimedia processing chip, and transmitting the second image data to the application processing chip.

In one embodiment, the transmission module 103 may be configured to: and the multimedia processing chip is used for carrying out data packaging processing on the image parameter information of the first image data and the second image data and then transmitting the data to the application processing chip.

Then, the processing module 105 may be configured to: unpacking the received data by the application processing chip to obtain the image parameter information of the first image data and the second image data; and carrying out image processing on the second image data according to the image parameter information of the first image data.

Referring to fig. 10, fig. 10 is a schematic diagram of a second structure of an image processing apparatus according to an embodiment of the application. The image processing apparatus 900 may include: a fourth acquisition module 901, a conversion module 902, a comparison module 903, and an execution module 904.

A fourth acquiring module 901, configured to acquire first image data in a RAW format.

A conversion module 902, configured to convert the first image data in the RAW format into second image data in a non-RAW format.

The comparison module 903 is configured to perform a preset process on an image corresponding to the first image data to obtain a first processing result, and perform the preset process on an image corresponding to the second image data to obtain a second processing result; comparing the first processing result with the second processing result to obtain a correction parameter of the second processing result relative to the first processing result;

and an execution module 904, configured to, when the image data in the non-RAW format is acquired and the preset processing is required, perform the preset processing on the image corresponding to the acquired image data in the non-RAW format according to the correction parameter.

In one embodiment, the electronic device includes a multimedia processing chip and an application processing chip.

Acquiring first image data in a RAW format by using the multimedia processing chip, and converting the first image data in the RAW format into second image data in a non-RAW format;

The application processing chip is utilized to perform preset processing on the first image data to obtain a first processing result, and the second image data is subjected to preset processing to obtain a second processing result; comparing the first processing result with the second processing result to obtain a correction parameter of the second processing result relative to the first processing result;

the execution module 904 is configured to, when the image data in the non-RAW format is acquired and the preset processing is required, perform the preset processing on the acquired image data in the non-RAW format by using the application processing chip according to the correction parameter.

An embodiment of the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed on a computer, causes the computer to execute a flow in an image processing method as provided in the present embodiment.

The embodiment of the application also provides electronic equipment, which can be a mobile terminal such as a tablet personal computer or a smart phone.

Referring to fig. 11, fig. 11 is a schematic diagram of a fourth structure of an electronic device according to an embodiment of the application.

The electronic device 20 may include a camera 600, a multimedia processing chip 200, an application processing chip 400, a display screen 800, a battery 300, a microphone 500, a speaker 700, and the like. It will be appreciated by those skilled in the art that the electronic device structure shown in fig. 7 is not limiting of the electronic device and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.

The battery 300 may be used to provide power support for various components of the electronic device, thereby ensuring normal operation of the various components.

Microphone 500 may be used to collect sound signals in the surrounding environment.

The speaker 700 may be used to play sound signals and the like.

In this embodiment, the electronic device may execute the following procedure:

acquiring first image data in a RAW format;

In one embodiment, the electronic device may further perform: determining a current shooting mode; determining a target image processing algorithm corresponding to the current shooting mode; and determining target parameters required for executing the target image processing algorithm.

Then, when the electronic device executes the acquiring of the image parameter information of the first image data using the multimedia processing chip, it may execute: and extracting image parameter information corresponding to the target parameter from the first image data by using the multimedia processing chip.

In one embodiment, the electronic device may determine a current photographing mode, a target image processing algorithm corresponding to the current photographing mode, and target parameters required to execute the target image processing algorithm using the application processing chip.

In one embodiment, the electronic device may further perform: and converting the first image data in the RAW format into second image data in a non-RAW format by using the multimedia processing chip, and transmitting the second image data to the application processing chip.

In one embodiment, when the electronic device performs the transfer of the image parameter information of the first image data and the second image data to the application processing chip, the method may include: and the multimedia processing chip is used for carrying out data packaging processing on the image parameter information of the first image data and the second image data and then transmitting the data to the application processing chip.

Then, when the electronic device performs the image processing on the second image data according to the image parameter information of the first image data by the application processing chip, it may perform: unpacking the received data by the application processing chip to obtain the image parameter information of the first image data and the second image data; and carrying out image processing on the second image data according to the image parameter information of the first image data.

Or the electronic device may perform:

acquiring first image data in a RAW format;

In one embodiment, the electronic device may acquire first image data in a RAW format using the multimedia processing chip, and convert the first image data in the RAW format into second image data in a non-RAW format; the application processing chip is utilized to perform preset processing on the first image data to obtain a first processing result, and the second image data is subjected to preset processing to obtain a second processing result; and comparing the first processing result with the second processing result to obtain a correction parameter of the second processing result relative to the first processing result. And when the image data in the non-RAW format is acquired and the preset processing is needed, the application processing chip performs the preset processing on the acquired image data in the non-RAW format according to the correction parameters.

In the foregoing embodiments, the descriptions of the embodiments are focused on, and the portions of an embodiment that are not described in detail in the foregoing embodiments may be referred to the detailed description of the image processing method, which is not repeated herein.

The image processing device provided by the embodiment of the present application belongs to the same concept as the image processing method in the above embodiment, and any method provided in the image processing method embodiment may be run on the image processing device, and the specific implementation process of the method is detailed in the image processing method embodiment, which is not described herein.

It should be noted that, for the image processing method according to the embodiment of the present application, it will be understood by those skilled in the art that all or part of the flow of implementing the image processing method according to the embodiment of the present application may be implemented by controlling related hardware through a computer program, where the computer program may be stored in a computer readable storage medium, such as a memory, and executed by at least one processor, and the execution may include the flow of the embodiment of the image processing method as described in the embodiment of the present application. The storage medium may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a random access Memory (RAM, random Access Memory), or the like.

For the image processing device according to the embodiment of the present application, each functional module may be integrated in one processing chip, or each module may exist alone physically, or two or more modules may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules. The integrated module, if implemented as a software functional module and sold or used as a stand-alone product, may also be stored on a computer readable storage medium such as read-only memory, magnetic or optical disk, etc.

The foregoing describes in detail an image processing method, apparatus, storage medium and electronic device provided in the embodiments of the present application, and specific examples are applied to illustrate the principles and embodiments of the present application, where the foregoing examples are only used to help understand the method and core idea of the present application; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, the present description should not be construed as limiting the present application.

Claims

1. An image processing method applied to an electronic device, wherein the electronic device comprises a multimedia processing chip and an application processing chip, the method comprising:

acquiring first image data in a RAW format acquired by a camera;

2. The image processing method according to claim 1, characterized in that the method further comprises:

Determining a current shooting mode;

determining a target image processing algorithm corresponding to the current shooting mode;

determining target parameters required by executing the target image processing algorithm;

The acquiring, by using the multimedia processing chip, the image parameter information of the first image data includes: and extracting image parameter information corresponding to the target parameter from the first image data by using the multimedia processing chip.

3. The image processing method according to claim 2, wherein a current photographing mode, a target image processing algorithm corresponding to the current photographing mode, and target parameters required for executing the target image processing algorithm are determined using the application processing chip.

4. The image processing method according to claim 1, characterized in that the method further comprises:

and converting the first image data in the RAW format into second image data in a non-RAW format by using the multimedia processing chip, and transmitting the second image data to the application processing chip.

5. The image processing method according to claim 4, wherein transmitting the image parameter information of the first image data and the second image data to the application processing chip includes: the multimedia processing chip is used for carrying out data packaging processing on the image parameter information of the first image data and the second image data and then transmitting the data to the application processing chip;

The image processing of the second image data by the application processing chip according to the image parameter information of the first image data includes: unpacking the received data by the application processing chip to obtain the image parameter information of the first image data and the second image data; and carrying out image processing on the second image data according to the image parameter information of the first image data.

6. An image processing method applied to an electronic device, the image processing method comprising:

acquiring first image data in a RAW format;

7. The image processing method according to claim 6, wherein the image processing method is applied to an electronic device including a multimedia processing chip and an application processing chip;

When the image data in the non-RAW format is acquired and the preset processing is required, the application processing chip performs the preset processing on the acquired image data in the non-RAW format according to the correction parameters.

8. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when executed on a computer, causes the computer to perform the method of any one of claims 1 to 5 or causes the computer to perform the method of any one of claims 6 to 7.

9. The electronic equipment is characterized by comprising a multimedia processing chip and an application processing chip, wherein the multimedia processing chip is connected with the application processing chip;

the multimedia processing chip is used for: acquiring first image data in a RAW format acquired by a camera; acquiring image parameter information of the first image data; transmitting image parameter information of the first image data to the application processing chip;

10. The electronic equipment is characterized by comprising a multimedia processing chip and an application processing chip, wherein the multimedia processing chip is connected with the application processing chip;