CN113781949B

CN113781949B - Image display method, display driving chip, display screen module and terminal

Info

Publication number: CN113781949B
Application number: CN202111130179.9A
Authority: CN
Inventors: 高延凯; 王月文; 蔡辉跃
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2021-09-26
Filing date: 2021-09-26
Publication date: 2023-10-27
Anticipated expiration: 2041-09-26
Also published as: WO2023046164A1; CN113781949A

Abstract

The embodiment of the application discloses an image display method, a display driving chip, a display screen module and a terminal. The method comprises the following steps: the display driving chip receives the nth frame of image data sent by the application processor, wherein n is a positive integer; in response to the historical display rate of the application processor meeting the display delay condition, the display driving chip performs display delay operation on the nth frame of image data, wherein the display delay operation is used for delaying the display of the nth frame of image; in response to completion of the display delay operation, the display drive chip controls the display screen to display the nth frame image based on the nth frame image data. In the embodiment of the application, the display delay condition is set to avoid the problem of flicker and jitter of the picture caused by the refresh frequency jump of the display driving chip due to the fluctuation of the output frame rate of the application processor, thereby being beneficial to improving the stability of the refresh frequency of the display driving chip in the image display process and achieving the effect of improving the image display quality.

Description

Image display method, display driving chip, display screen module and terminal

Technical Field

The embodiment of the application relates to the technical field of display, in particular to an image display method, a display driving chip, a display screen module and a terminal.

Background

With the continuous development of display screen technology, more and more display screens capable of supporting high refresh rate display are developed, and in the process of running high frame rate application programs or sliding operation, the smoothness of pictures can be improved by setting the display screens to a high refresh rate mode.

For a display screen adopting an application processor (Application Processor, AP) -display driving chip (Display Driver Integrated Circuit, DDIC) -Panel (Panel) driving architecture, in the image display process, the DDIC adaptively adjusts the refresh frequency according to the output frame rate of the AP (i.e. the rate of outputting image data), so as to realize adaptive frequency conversion.

However, since the output frame rate of the AP fluctuates in a certain range, the refresh frequency of the DDIC fluctuates, and when the refresh frequency is greatly hopped, problems of flicker and jitter of the picture occur, which affects the image display quality.

Disclosure of Invention

The embodiment of the application provides an image display method, a display driving chip, a display screen module and a terminal. The technical scheme is as follows:

in one aspect, an embodiment of the present application provides an image display method, which is used for a DDIC of a display screen, and the method includes:

Receiving nth frame image data sent by an AP, wherein n is a positive integer;

responding to the historical transmission rate of the AP meeting a display delay condition, performing display delay operation on the nth frame of image data, wherein the display delay operation is used for delaying the display of the nth frame of image;

and controlling the display screen to display the nth frame image based on the nth frame image data in response to completion of the display delaying operation.

In another aspect, an embodiment of the present application provides a DDIC chip applied to a display screen, where the DDIC chip is used for:

receiving nth frame image data sent by an AP, wherein n is a positive integer;

responding to the historical transmission rate of the AP meeting a display delay condition, performing display delay operation on the nth frame of image data, wherein the display delay operation is used for delaying image display;

and controlling the display screen to display an nth frame image based on the nth frame image data in response to completion of the display delay operation.

On the other hand, the embodiment of the application provides a display screen module, which comprises a display screen and a DDIC, wherein the DDIC is used for driving the display screen, and the DDIC is used for realizing the image display method according to the above aspect.

On the other hand, the embodiment of the application provides a terminal, which comprises an application processor AP, a display screen and a display driving chip DDIC, wherein the AP is connected with the DDIC through a mobile industry processor interface MIPI, and the DDIC is used for realizing the image display method in the aspect.

In the embodiment of the application, by introducing a display delay mechanism, after the DDIC receives image data sent by the AP, whether a display delay condition is met or not is determined based on the historical display rate of the AP, and when the display delay condition is met, the image display flow is delayed; compared with the method that the DDIC immediately displays the image after receiving the image data sent by the AP, the method has the advantages that scattered acceleration requests of the AP (namely, the AP display sending rate is temporarily improved to lead to the advanced display of the image data and the temporarily improved display sending rate cannot be kept) can be filtered through setting the display delay condition, the problem that the DDIC refreshing frequency is greatly jumped due to the fluctuation of the AP display sending rate, and then the problem of flicker and jitter of the image is caused is avoided, the stability of the DDIC refreshing frequency in the image display process is improved, and the effect of improving the image display quality is achieved.

Drawings

FIG. 1 is a schematic diagram of an image display process under an AP-DDCI-Panel architecture;

Fig. 2 is a schematic diagram of an image data transmission method according to an embodiment of the present application;

FIG. 3 illustrates a flowchart of an image display method according to an exemplary embodiment of the present application;

FIG. 4 is a graph comparing refresh rates when display delay is introduced and when a display delay mechanism is not introduced;

fig. 5 illustrates a flowchart of an image display method according to another exemplary embodiment of the present application;

FIG. 6 is a schematic diagram of Vsync, VBP, vact and VFP shown in one exemplary embodiment;

FIG. 7 is a schematic diagram illustrating an implementation of a display delay process according to an exemplary embodiment of the present application;

FIG. 8 is a schematic diagram illustrating an implementation of a display delay process according to another exemplary embodiment of the present application;

FIG. 9 is a schematic diagram illustrating an implementation of an image rescanning process according to an exemplary embodiment of the present application;

FIG. 10 is a flow chart of an image display process provided by another embodiment of the present application;

fig. 11 is a block diagram showing the structure of a terminal according to an exemplary embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the embodiments of the present application will be described in further detail with reference to the accompanying drawings.

References herein to "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.

As shown in fig. 1, in the AP-DDIC-Panel architecture, an AP side performs layer drawing rendering through an Application (App), and then performs layer drawing on the drawn layer through a surfeflinger to obtain image data, and further sends (writes) the image data to the DDIC through MIPI. The DDIC stores the image data sent from the AP in a Buffer (Buffer), and controls a Display Panel (Panel) to perform image refresh Display (Display) by scanning (reading) the image data in the Buffer. In implementing adaptive frequency conversion, the DDIC adaptively adjusts the refresh frequency according to the display rate of the AP (i.e., the amount of image data the AP transmits to the DDIC in a unit time, or the speed at which the AP transmits the image data to the DDIC). For example, when the output frame rate of the AP decreases, the DDIC down-regulates the refresh frequency, and when the output frame rate of the AP increases, the DDIC up-regulates the refresh frequency.

In the self-adaptive frequency conversion process, the small-range change of the refresh frequency in a short time does not affect the image display quality, and when the refresh frequency is changed in a large range in a short time (namely, greatly jumps), the problems of flicker, jitter and the like can occur, so that the image display quality is affected.

For example, in some scenes, since there is a fluctuation in the speed of preparing image data at the AP side, the display rate of the AP is changed from 60Hz to 45Hz in a short time, and then, when the display rate is changed from 45Hz to 72Hz, the refresh frequency of the DDIC is changed from 60Hz to 45Hz, and when the refresh frequency of the DDIC is changed from 45Hz to 72Hz, the flicker jitter of the picture is not caused, and when the refresh frequency is changed from 60Hz to 72Hz, the variation amplitude of the refresh frequency is too large, so that the flicker jitter of the picture is caused.

In order to solve the above technical problems, in the embodiment of the present application, a display delay mechanism is introduced at the DDIC side. Under the mechanism, as shown in fig. 2, after receiving image data sent by an AP, the DDIC detects a display delay condition for a historical sending and displaying rate of the AP according to a receiving time position of the image data, and when the display delay condition is detected to be met, performs a display delay operation for the image data through a refresh frequency stabilizing algorithm, so that a refresh frequency of the DDIC is prevented from being greatly hopped due to scattered acceleration requests at the AP side, an effect of stabilizing the refresh frequency of the DDIC is achieved, and further, a problem of flickering of a display picture caused by the display delay condition is reduced. The historical display rate is the transmission rate when the AP transmits a plurality of frames of image data before the current display frame to the DDIC.

For example, in the process of running the game application with the reference frame rate of 60FPS, when the refresh frequency of the DDIC to the n-1 th frame is less than 60Hz and the AP sends the n-th frame of image data in advance (i.e. when the frequency of sending the image data is greater than 60 Hz), if the DDIC immediately controls the display screen to display images according to the n-th frame of image data, the refresh frequency of the DDIC will jump (for example, jump from 45Hz to 72 Hz); after the display delay mechanism is introduced, the DDIC performs display delay operation on the nth frame of image when determining that the nth frame of image meets the display delay condition based on the historical display rate of the AP, namely, delays a period of time after receiving the nth frame of image data, and then controls the display screen to perform image display, so that the refresh frequency of the DDIC is prevented from being greatly jumped (for example, the refresh frequency is changed from 72Hz to 60Hz after the display delay operation).

The method provided by the embodiment of the application is applied to the terminal, and the DDIC in the display screen of the terminal executes the image display method. The terminal may include a smart phone, a tablet computer, a wearable device (such as a smart watch), a portable personal computer, a smart television, etc., and the embodiment of the present application does not limit the specific type of the terminal.

Referring to fig. 3, a flowchart of an image display method according to an exemplary embodiment of the present application is shown. The method comprises the following steps:

step 301, receiving nth frame image data sent by an AP, where n is a positive integer.

When the DDIC is ready to refresh the next frame image, a Tearing Effect (TE) signal is output, and the AP transmits the ready image data to the DDIC by detecting the TE signal, and the DDIC performs image scanning (or referred to as frame scanning). The TE signal output by the DDIC may be a single-TE signal or a multiple-TE signal. The single-TE signal is a TE signal with a continuous high level output by the DDIC, and the multiple-TE signal is a TE signal with continuous DDIC according to a preset frequency, wherein the preset frequency can be a light emitting frequency of the display screen, for example, the frequency of the multiple-TE signal output by the DDIC is 360Hz. Correspondingly, when the DDIC outputs a single-TE signal, the AP transmits new image data to the DDIC when detecting that the TE signal is in a high level state; when the DDIC outputs a multiple-TE signal, the AP transmits new image data to the DDIC upon detecting a rising edge of the TE signal.

When the image rendering speed at the AP side is increased (the image rendering speed is related to factors such as the complexity of the image), the AP can send and display at a faster speed compared with the current sending and displaying speed, namely, compared with sending and displaying in advance, and correspondingly, the DDIC immediately scans the image after receiving the image data, so that the refresh frequency of the DDIC can be correspondingly increased; when the image rendering speed of the AP side is reduced, delay occurs in AP display, and accordingly, the DDIC scans the image after receiving the image data, and the refresh frequency of the DDIC is reduced accordingly. However, if the DDIC immediately scans an image after receiving the image data, when there is a large fluctuation in the image rendering speed, the sporadic acceleration request on the AP side may cause a jump in the refresh frequency of the DDIC, resulting in a flicker of the image. Among them, a phenomenon in which the image data preparation speed on the AP side increases greatly in a short time and cannot be held for a long time (that is, the image data preparation speed on the AP side decreases greatly in a short time) is called scattered acceleration, and when the scattered acceleration occurs, the image data transmitted from the AP to the DDIC is regarded as a scattered acceleration request.

In step 302, in response to the historical display rate of the AP meeting the display delay condition, performing a display delay operation on the nth frame image data, the display delay operation being used for delaying display of the nth frame image.

In order to reduce the fluctuation of the refresh frequency and avoid the occurrence of the flicker of the picture, in the embodiment of the application, after the DDIC receives the image data sent by the AP, it is required to detect whether the nth frame of image meets the display delay condition according to the historical display sending rate of the AP, that is, detect whether the current acceleration request of the AP is a scattered acceleration request, and when the acceleration request is a scattered acceleration request (that is, when the display delay condition is met), perform the display delay operation on the nth frame of image data, and delay the display of the nth frame of image.

Optionally, the historical sending rate is used to characterize the rate at which the AP sent image data over the last period of time. In some embodiments, based on the historical display rate, the DDIC may identify whether the AP continuously transmits in advance in a recent period of time, and further filter scattered acceleration requests on the AP side (i.e., filter non-continuous in advance transmission), so as to avoid a substantial jump in refresh frequency of the DDIC caused by the scattered acceleration requests.

In one possible embodiment, the display delay operation DDIC performs a display delay operation based on the target refresh frequency, thereby stabilizing the refresh frequency of the DDIC at the target refresh frequency.

Step 303, in response to completion of the display delay operation, controlling the display screen to display the nth frame image based on the nth frame image data.

After finishing the display delay operation of the nth frame image data, the DDIC performs image scanning and controls the display screen to display the nth frame image based on the nth frame image data.

By adopting the scheme provided by the embodiment of the application, the DDIC filters scattered acceleration requests of the AP, so that the stability of the DDIC refresh frequency is improved; meanwhile, the display delay mechanism is controlled by the DDIC through hardware logic, and AP is not required to control, so that timeliness and accuracy of a control process are improved.

In an illustrative example, as shown in fig. 4, without introducing a display delay mechanism, the refresh frequency of the DDIC jumps from 45Hz to 72Hz during the display of the 5 th and 6 th frame images, and from 51Hz to 72Hz during the display of the 13 th and 14 th frame images. After the display delay mechanism is introduced, the refresh frequency of the DDIC is changed from 45Hz to 60Hz in the process of displaying the 5 th frame and the 6 th frame images, and the refresh frequency of the DDIC is changed from 51Hz to 60Hz in the process of displaying the 13 th frame and the 14 th frame images.

In summary, in the embodiment of the present application, by introducing a display delay mechanism, after receiving image data sent by an AP, the DDIC determines whether a display delay condition is satisfied based on a historical display rate of the AP, and delays an image display flow when the display delay condition is satisfied; compared with the method that the DDIC immediately displays the image after receiving the image data sent by the AP, the method has the advantages that scattered acceleration requests of the AP (namely, the sending and displaying speed of the AP is temporarily improved to lead to the sending and displaying of the image data in advance and the sending and displaying speed after being temporarily improved cannot be kept) can be filtered through setting the display delay condition, the problem that the DDIC refresh frequency is greatly jumped due to the fluctuation of the sending and displaying speed of the output frame rate of the AP, so that the problem of flicker and jitter of the image is caused is avoided, the stability of the DDIC refresh frequency in the image display process is improved, and the effect of improving the image display quality is achieved.

In one possible embodiment, the DDIC determines whether the AP has an advance display based on a receiving position of the image data (the receiving position is used to indicate a time when the image data is received), and records a continuous number of times the AP has the advance display by using a counter, thereby identifying and filtering the scattered acceleration request on the AP side based on the continuous number of times, wherein the continuous number of times of the advance display is used to characterize a frame number of the AP transmitting the image data to the DDIC in advance, for example, when the continuous number of times of the advance display is 3, it is indicated that the image data of the last 3 frames of images are all advanced by the AP to the DDIC. The following description uses exemplary embodiments.

Referring to fig. 5, a flowchart of an image display method according to another exemplary embodiment of the present application is shown. The method comprises the following steps:

in step 501, the nth frame of image data sent by the AP is received, where n is a positive integer.

In one possible embodiment, after the DDIC receives the nth frame of image data, it is first determined whether the nth frame of image data is transmitted in advance based on the receiving position of the image data. Regarding the specific manner of determining whether to send ahead of time, in one possible implementation, the DDIC determines a first column forward interval (Vertical Front Porch, VFP) duration based on the first refresh frequency and defines that image data received within the first VFP duration belongs to image data sent ahead of time and that image data received outside the first VFP duration belongs to image data not sent ahead of time.

The relationship among the Vertical synchronization signal (Vertical Synchronous Signal, vsync), the column-backward delay interval (Vertical Back Porch, VBP), the column-wise active line number (Vact) and the VFP is shown in fig. 6, wherein Vact is a frame scanning process and VFP is a waiting process after the frame scanning is completed.

In general, the frame rate in the running process of the application is kept stable as a whole, and in order to reduce the display power consumption on the premise of ensuring the display smoothness, the refresh frequency of the DDIC needs to be kept as consistent as possible with the basic frame rate of the application. In this embodiment, the DDIC determines a first refresh frequency that matches a reference frame rate in a running process of the foreground application as a target refresh frequency, so as to determine whether the AP sends and displays in advance based on a first VFP duration corresponding to the first refresh frequency.

Wherein the target refresh rate matches the reference frame rate means that the difference between the target refresh rate and the reference frame rate is less than a threshold (e.g., the threshold is 5 Hz), and optionally the target refresh rate is equal to the reference frame rate, or the target refresh rate is slightly greater than the reference frame rate, or the target refresh rate is slightly less than the reference frame rate.

In one illustrative example, when the reference frame rate of the foreground application is 60Hz, the DDIC determines that the first refresh frequency is 60Hz.

In one possible implementation manner, the DDIC determines, in advance, a correspondence between different refresh frequencies and VFP durations with reference to a highest refresh frequency of the display screen, where the VFP durations are integer multiples of an EM period, that is, the VFP durations are pulse durations of at least one light emitting pulse (EM pulse), and a period in which the display screen emits light once is an EM period. For example, when the EM frequency of the display screen is 360Hz, the duration of each EM cycle is 2.8ms.

In one illustrative example, the correspondence between the refresh frequency of the DDIC and the VFP is shown in table one.

List one

In connection with the data shown in Table one, when the first refresh frequency is 60Hz, the DDIC determines that the first VFP duration is 8.3ms.

Optionally, the DDIC detects whether the receiving position of the nth frame image data is within the first VFP duration, and if so, determines that the sending of the nth frame image data is advanced, and performs step 502 described below.

Step 502, in response to receiving the nth frame of image data in the first VFP duration corresponding to the first refresh frequency, obtaining a count value of a counter, where the count value of the counter is used to characterize a continuous number of advanced transmission and display of the AP.

When it is determined that the nth frame image data is sent in advance, the DDIC needs to determine whether the nth frame image data is scattered sent in advance further based on the historical sending rate of the AP before the nth frame image data. In some embodiments, if a number of consecutive frames of image data are also sent in advance before the nth frame of image data, the DDIC determines that the AP side continues to send in advance; if the frame of image data which is not sent in advance exists in a plurality of frames of continuous image data before the nth frame of image data, the DDIC determines that the AP side is not sent in advance continuously, namely scattered AP side is sent in advance.

In this embodiment, the DDIC records the continuous number of times of the advanced transmission of the AP through the counter, and when the nth frame of image data is transmitted in advance, the DDIC determines whether the AP is continuously transmitted in advance based on the count value of the counter. Wherein the initial count value of the counter is 0.

Further, the DDIC detects whether the count value of the counter reaches the count threshold, if not, the DDIC determines that the AP does not continuously send and display in advance, and determines that the display delay condition is satisfied, and performs the following steps 503 to 505; if the count threshold is reached, the DDIC determines that the AP continues to transmit in advance and determines that the display delay condition is not satisfied, and performs steps 506 to 507 described below.

The counting threshold may be preset or may be customized by the user, which is not limited in this embodiment.

In one illustrative example, when the count threshold is set to 2, indicating that the image data is being sent in advance for consecutive 3 frames (including the current frame), the DDIC determines that the AP is being sent in advance continuously.

In step 503, in response to the count value of the counter being less than the count threshold, it is determined that the historical transmission rate of the AP satisfies the display delay condition, and the display delay operation is performed on the nth frame image data based on the first VFP duration.

When the count value of the counter is smaller than the count threshold value, the DDIC determines that the display delay condition is satisfied, and it is necessary to delay display the nth frame image. In one possible implementation manner, in order to make the refresh frequency of the DDIC as stable as possible at the first refresh frequency, the DDIC performs a display delay operation on the nth frame image data based on the first VFP duration, so as to avoid a sudden increase in refresh frequency when the nth frame image is displayed within the first VFP duration.

In some embodiments, the DDIC determines a delay time length of the display delay operation based on the first VFP time length and a receiving position of the nth frame image data, so that the display delay operation is performed on the nth frame image data based on the delay time length, that is, in response to a waiting time length after the n-1 th frame scanning is completed not reaching the first VFP time length, the DDIC does not control the display screen to display the nth frame image based on the nth frame image data, so as to avoid the nth frame image from being displayed in advance due to the advanced display. The delay time length is the time length of DDIC delay n frame scanning, and the delay time length is the interval between the receiving position of the n frame image data and the corresponding position of the first VFP time length.

In an illustrative example, when the DDIC determines that the first VFP duration is 3 EM periods, the DDIC determines that the nth frame image needs to be displayed after being delayed by 1 EM period, when the DDIC receives the nth frame image data at the 2 nd EM period; when the DDIC receives the nth frame image data at the 1 st EM period and the DDIC determines that the first VFP duration is 3 EM periods, the DDIC determines that the nth frame image needs to be displayed after being delayed by 2 EM periods. Illustratively, as shown in fig. 7, when the base frame rate of the foreground application is 60FPS, the DDIC determines that the first VFP duration is 3 EM periods, thereby detecting whether new image data transmitted by the AP is received within 3 EM periods after the current frame image scanning is completed. Since the DDIC receives the 6 th frame image data within the first VFP period (at the 2 nd EM period), the DDIC determines that the 6 th frame image data is sent in advance, and acquires the current count value of the counter as 0 (none of the 1 st to 5 th frame image data is sent in advance). Since the current count value is smaller than the count threshold (2), the DDIC determines that the display delay condition is satisfied, and determines that a display delay operation of 1 EM cycle is required for the 6 th frame image data.

Step 504, update the count value of the counter.

In one possible implementation, after the display delay condition detection is completed, the DDIC needs to update the count value of the counter, that is, perform an addition operation based on the current count value.

Illustratively, as shown in FIG. 7, the DDIC updates the count value of the counter from 0 to 1.

Of course, in other possible embodiments, when the nth frame of image data is received within the first VFP duration corresponding to the first refresh frequency, the DDIC may update the count value of the counter first and then perform the display delay condition detection (compared to the scheme of updating the count value first and then performing the detection, the count threshold needs to be increased by 1 in the scheme of updating the count value first and then performing the detection), which is not described herein again.

And step 505, in response to the waiting time after the n-1 frame scanning is completed reaching the first VFP time, controlling the display screen to display the n-th frame image based on the n-th frame image data.

When the waiting time after the n-1 frame scanning is completed reaches the first VFP time, the DDIC controls the display screen to display images based on the n-th frame image data, so that the refresh frequency of the DDIC is stabilized at the first refresh frequency.

Schematically, as shown in fig. 7, if the DDIC immediately scans an image after receiving the image data without introducing a display delay mechanism, when there is a temporary display advance at the time of transmitting the 6 th frame of image data by the AP, the refresh frequency of the DDIC suddenly rises to 72Hz; when the AP has delay of 1 EM period when sending 7 th frame image data, the refresh frequency of the DDIC suddenly drops to 45Hz, so that the refresh frequency jumps in a large range; under the condition of introducing a display delay mechanism, when the DDIC receives the 6 th frame image data sent by the AP in advance, the count value of the counter does not reach the count threshold, so that the DDIC does not directly scan the image, but performs 1 EM period display delay operation, and the refresh frequency is kept at 60Hz; when there is a delay of 1 EM period at the time of the AP transmitting the 7 th frame image data, the refresh frequency of DDIC is reduced from 60Hz to 51Hz, and the stability of the refresh frequency is remarkably improved.

And step 506, in response to the count value of the counter being greater than or equal to the count threshold, determining that the historical transmission rate of the AP does not meet the display delay condition, and controlling the display screen to display the nth frame image based on the nth frame image data.

When the count value of the counter reaches the count threshold, the AP is indicated to continuously send display in advance in the latest time, namely, a continuous acceleration request exists, and the DDIC determines that the display delay condition is not met, so that image scanning is performed based on the nth frame of image data, and the refresh frequency of the DDIC is kept consistent with the sending display rate of the AP.

Illustratively, as shown in fig. 8, when the 4 th frame image data transmitted in advance by the AP is received, since the count value 0 of the counter < the count threshold 2, the DDIC determines that the display delay condition is satisfied, thereby performing the display delay operation (delay of 2 EM cycles) on the 4 th frame image data; when receiving the 5 th frame image data sent in advance by the AP, the DDIC determines that the display delay condition is satisfied because the count value 1 of the counter is less than the count threshold value 2, thereby performing a display delay operation (delay of 1 EM period) on the 5 th frame image data; when receiving the 6 th frame image data which the AP transmits in advance, since the count value of the counter is 2=count threshold 2, the DDIC determines that the display delay condition is not satisfied, that is, the 6 th frame image data is not subjected to the display delay, but the image scanning is performed immediately.

In step 507, the count value of the counter is updated.

In one possible implementation, the DDIC also needs to update the count value of the counter in case the display delay condition is not satisfied. Illustratively, as shown in fig. 8, when receiving the 6 th frame image data transmitted in advance by the AP, the DDIC updates the count value of the counter to 3.

In this embodiment, the DDIC determines whether the AP has advanced transmission and display based on a positional relationship between a receiving position of the image data and a first VFP duration, and records a continuous number of advanced transmission and display times of the AP by using a counter, so as to identify and filter scattered acceleration requests on the AP side based on the continuous number, and avoid refresh frequency fluctuation of the DDIC caused by the scattered acceleration requests; and moreover, the display delay judgment is realized by using the counter, the realization process is simple, and the judgment timeliness of the display delay time is improved.

Since the first refresh frequency matches the reference frame rate of the foreground application and there may be a difference between the reference frame rates of different foreground applications, such as 60FPS for the game application and 45FPS for the instant messaging application, in order to enable the refresh frequency of the DDIC to adapt to the currently running foreground application, in one possible implementation, the AP sends a control instruction to the AP containing the corresponding reference frame rate of the foreground application when detecting that the foreground application is running. Correspondingly, after receiving a control command sent by the AP, the DDIC determines a first refresh frequency based on a reference frame rate in the control command, and further sets a first VFP duration based on the first refresh frequency. Optionally, the DDIC determines the first refresh frequency based on the reference frame rate, thereby determining the first VFP duration based on a correspondence between the refresh frequency and the VFP duration.

In one possible case, when there is a large delay in the AP-side transmission, the DDIC needs to rescan (repeating) the currently displayed image and continue outputting the TE signal after rescanning so that the AP can transmit image data to the DDIC when the TE signal is detected. In one possible implementation, in addition to determining whether the AP is transmitting in advance based on a first VFP duration corresponding to the first refresh frequency, the DDIC needs to determine whether the AP has an excessive delay in transmitting based on a second VFP duration corresponding to the second refresh frequency.

Optionally, in response to the nth frame of image data not being received within the first VFP duration and the nth frame of image data being received within the second VFP duration corresponding to the second refresh frequency, the DDIC determines that the nth frame of image data is slightly delayed, and correspondingly, if the continuous advanced display of the AP side is interrupted before the nth frame of image data, resets the count value of the counter. For example, DDIC resets the count value of the counter to 0.

The second refresh frequency is smaller than the first refresh frequency, so that the second VFP time length corresponding to the second refresh rate is longer than the first VFP time length corresponding to the first refresh rate, and the second VFP time length is also an integral multiple of the EM period. In one illustrative example, when the first refresh frequency is 60Hz, the second refresh frequency is 30Hz, and the second VFP duration is 9 EM periods.

Illustratively, as shown in fig. 7, in the case of introducing a display delay mechanism, the DDIC receives the 7 th frame image data transmitted by the AP outside the first VFP period (at the 7 th EM period), thereby resetting the count value of the counter to 0; as shown in fig. 8, the DDIC receives the 7 th frame image data transmitted by the AP outside the first VFP period (at the 6 th EM period), thereby resetting the count value of the counter to 0.

Optionally, in response to not receiving the nth frame image data within the second VFP duration, the DDIC resets the count value of the counter, and controls the display screen to repeatedly display the nth-1 frame image based on the nth-1 frame image data.

For example, as shown in fig. 9, when the DDIC does not receive the 4 th frame image data transmitted by the AP during the first VFP period corresponding to the first refresh frequency of 60Hz and does not receive the 4 th frame image data transmitted by the AP during the second VFP period corresponding to the second refresh frequency of 30Hz, the DDIC determines that there is an excessive transmission delay at the AP end, thereby resetting the count value of the counter, and rescanning the 3 rd frame image based on the 3 rd frame image data, wherein the DDIC continues to output the TE signal during the rescanning the 3 rd frame image so that the AP transmits the 4 th frame image data ready to be completed when detecting the TE signal.

In an illustrative example, the DDIC controls the display screen to display an image as shown in fig. 10.

In step 1001, it is detected whether image data transmitted by the AP is received. If no image data is received, execute step 1002; if image data is received, step 1004 is performed.

Alternatively, the DDIC detects whether image data is received at the same frequency as the EM frequency (image data transmitted by the AP is identified with 0x 2C).

Step 1002, it is detected whether temp_extension_pulse (temporary extension Pulse) reaches adfr_max_extension_pulse (ADFR extension Pulse upper limit). If ADFR_Max_Extend_pulse is reached, then step 1008 is performed; if ADFR_Max_ExtendPulse is not reached, step 1003 is performed.

The temp_extended_pulse is the number of EM cycles passed after the image scanning, adfr_max_extended_pulse is the second VFP duration in the above embodiment, and the display frequency conversion technology automatically implemented by DDIC in the frequency conversion range is called adaptive dynamic frequency conversion (Adaptive Dynamic Frame Rate, ADFR).

In step 1003, an add operation is performed on temp_extension_pulse.

Step 1004, detects if temp_extended_pulse is less than adfr_delay_extended_pulse_threshold. If so, go to step 1005; if greater than or equal, then step 1008 is performed.

The adfr_delay_extension_pulse_threshold is the first VFP duration in the above embodiment.

In step 1005, it is checked whether Temp_Delay_count is less than ADFR_Delay_count_Threshold (ADFR Delay Count Threshold). If so, execute step 1006; if greater than or equal to, step 1009 is performed.

Wherein temp_delay_count is the Count value of the counter in the above embodiment, and adfr_delay_count_threshold is the Count Threshold.

In step 1006, add one operation to temp_delay_count.

Step 1007, delay temp_extended_pulse to adfr_delay_extended_pulse_threshold.

The step is that the DDIC performs display delay operation when the display delay condition is satisfied, and performs image scanning when the waiting time after the image scanning reaches the first VFP time.

Step 1008, reset temp_delay_count.

Step 1009, controlling the display screen to display the image.

When Temp_Extend_pulse reaches ADFR_Max_Extend_pulse, the DDIC controls the display screen to redisplay the image; when temp_delay_count is greater than or equal to adfr_delay_count_threshold, the DDIC control displays a new image frame.

In some embodiments, the method provided by the embodiment of the application is applied to a mobile terminal, that is, the DDIC of the OLED display screen in the mobile terminal executes the image display method. Because the mobile terminal is usually powered by a battery, and the electric quantity of the battery is limited (the battery is sensitive to power consumption), the power consumption of the mobile terminal can be reduced while the display quality of the mobile terminal is improved after the method provided by the embodiment of the application is used for the mobile terminal. The mobile terminal may include a smart phone, a tablet computer, a wearable device (such as a smart watch), a portable personal computer, and the like, and the embodiment of the present application is not limited to a specific type of mobile terminal.

Of course, the method provided in the embodiment of the present application may also be used for other terminals that are not battery powered, such as a television, a display, or a personal computer, which is not limited in this embodiment of the present application.

The embodiment of the application also provides a DDIC which is applied to the display screen and is used for:

receiving nth frame image data sent by an Application Processor (AP), wherein n is a positive integer;

Optionally, the DDIC is configured to:

responding to the received nth frame image data in a first column forward delay interval (VFP) duration corresponding to a first refresh frequency, and obtaining a count value of a counter, wherein the count value of the counter is used for representing the continuous times of the AP forward display;

responsive to the count value of the counter being less than a count threshold, determining that the historical transmission rate of the AP satisfies the display delay condition, performing the display delay operation on the nth frame image data based on the first VFP duration;

And updating the count value of the counter.

Optionally, the DDIC is configured to:

determining a delay time length of the display delay operation based on the first VFP time length and a receiving position of the nth frame image data;

and carrying out the display delay operation on the nth frame of image data based on the delay time length.

Optionally, the DDIC is configured to:

and responding to the waiting time after the scanning of the n-1 th frame is completed to reach the first VFP time, and controlling the display screen to display the n-th frame image based on the n-th frame image data.

Optionally, the DDIC is further configured to:

in response to the count value of the counter being greater than or equal to the count threshold, determining that the historical transmission rate of the AP does not meet the display delay condition, and controlling the display screen to display the nth frame image based on the nth frame image data;

and updating the count value of the counter.

Optionally, the DDIC is further configured to:

and in response to the nth frame of image data not being received within the first VFP duration and the nth frame of image data being received within a second VFP duration corresponding to a second refresh frequency, resetting the count value of the counter, wherein the second refresh frequency is less than the first refresh frequency and the second VFP duration is greater than the first VFP duration.

Optionally, the DDIC is further configured to:

resetting a count value of the counter in response to the nth frame of image data not being received within the first VFP duration and the nth frame of image data not being received within the second VFP duration;

and controlling the display screen to repeatedly display the n-1 frame image based on the n-1 frame image data.

Optionally, the first VFP duration and the second VFP duration are both integer multiples of a light emitting EM period.

Optionally, the first refresh frequency is matched with a reference frame rate in a running process of the foreground application.

Optionally, the DDIC is further configured to:

receiving a control instruction sent by the AP, wherein the control instruction comprises the reference frame rate of the foreground application;

determining the first refresh frequency based on the reference frame rate;

the first VFP duration is set based on the first refresh frequency.

Optionally, the DDIC is applied to an organic light emitting diode OLED display screen.

The detailed process of the DDIC in implementing the image display method may refer to the above method embodiments, and this embodiment is not described herein again.

In addition, the embodiment of the application also provides a display screen module, which comprises a display screen and a DDIC, wherein the DDIC is used for driving the display screen, and the DDIC is used for realizing the image display method provided by the above method embodiments.

Referring to fig. 11, a block diagram illustrating a structure of a terminal 1100 according to an exemplary embodiment of the present application is shown. The terminal 1100 may be a smart phone, tablet computer, notebook computer, etc. The terminal 1100 of the present application may include one or more of the following components: processor 1110, memory 1120, display module 1130.

Processor 1110 may include one or more processing cores and processor 1110 may be an AP as described in the above embodiments. The processor 1110 performs various functions of the terminal 1100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 1120, and invoking data stored in the memory 1120, using various interfaces and lines to connect the various components within the overall terminal 1100. Alternatively, the processor 1110 may be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable Logic Array, PLA). The processor 1110 may integrate one or a combination of several of a central processing unit (Central Processing Unit, CPU), an image processing unit (Graphics Processing Unit, GPU), a Neural network processing unit (Neural-network Processing Unit, NPU), a modem, and the like. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the touch display screen module 1130; the NPU is used to implement artificial intelligence (Artificial Intelligence, AI) functionality; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor 1110 and may be implemented on a single chip.

The Memory 1120 may include a random access Memory (Random Access Memory, RAM) or a Read-Only Memory (ROM). Optionally, the memory 1120 includes a non-transitory computer readable medium (non-transitory computer-readable storage medium). Memory 1120 may be used to store instructions, programs, code, sets of codes, or instruction sets. The memory 1120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (e.g., a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments of the present application, etc.; the storage data area may store data (e.g., audio data, phonebook) created according to the use of the terminal 1100, etc.

The display module 1130 is a display module for displaying images, and is typically provided on the front panel of the terminal 1100. The display module 1130 may be designed as a full screen, a curved screen, a contoured screen, a double-sided screen, or a folded screen. The display module 1130 may also be configured to be a combination of a full screen and a curved screen, a combination of a special-shaped screen and a curved screen, which is not limited in this embodiment.

In an embodiment of the present application, the display module 1130 includes a DDIC 1131 and a display 1132 (panel). The display 1132 may be an OLED display, which may be a Low Temperature Polysilicon (LTPS) AMOLED display or a low temperature polysilicon oxide (Low Temperature Polycrystalline Oxide, LTPO) AMOLED display.

The DDIC 1131 is used to drive the display screen 1132 to display images, so as to implement the image display methods provided in the above embodiments. In addition, the DDIC 1131 is connected to the processor 1110 through an MIPI interface, and is configured to receive image data and instructions issued by the processor 1110.

In one possible implementation, the display module 1130 also has a touch function by which a user can perform a touch operation on the display module 1130 using any suitable object, such as a finger, a stylus, or the like.

In addition, those skilled in the art will appreciate that the structure of the terminal 1100 illustrated in the above-described figures does not constitute a limitation of the terminal 1100, and the terminal may include more or less components than illustrated, or may combine certain components, or may have a different arrangement of components. For example, the terminal 1100 further includes a microphone, a speaker, a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (Wireless Fidelity, wiFi) module, a power supply, a bluetooth module, and the like, which are not described herein.

Those skilled in the art will appreciate that in one or more of the examples described above, the functions described in the embodiments of the present application may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, these functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

The foregoing description of the preferred embodiments of the present application is not intended to limit the application, but rather, the application is to be construed as limited to the appended claims.

Claims

1. An image display method, characterized by a display driving chip for a display screen, the method comprising:

receiving nth frame image data sent by an application processor, wherein n is a positive integer;

in response to receiving the nth frame of image data in a first column forward delay interval duration corresponding to a first refresh frequency, obtaining a count value of a counter, wherein the count value of the counter is used for representing continuous times of advanced display of the application processor;

In response to the count value of the counter being less than a count threshold, determining that the historical display rate of the application processor meets a display delay condition, performing a display delay operation on the nth frame image data based on the first column forward delay interval duration, the display delay operation being used for delaying display of the nth frame image; updating the count value of the counter;

2. The method of claim 1, wherein said performing a display delay operation on said nth frame of image data based on said first column-forward delay interval duration comprises:

determining a delay time length of the display delay operation based on the first column forward delay interval time length and a receiving position of the nth frame image data;

3. The method of claim 1, wherein the controlling the display screen to display the nth frame image based on the nth frame image data in response to completing the display delaying operation comprises:

And controlling the display screen to display the nth frame image based on the nth frame image data in response to the waiting time after the scanning of the nth-1 frame is completed reaching the first column forward delay interval time.

4. The method of claim 1, wherein after the obtaining the count value of the counter, the method further comprises:

responsive to the count value of the counter being greater than or equal to the count threshold, determining that the historical display rate of the application processor does not meet the display delay condition, controlling the display screen to display the nth frame image based on the nth frame image data;

and updating the count value of the counter.

5. The method according to claim 1, wherein the method further comprises:

and in response to the nth frame of image data not being received within the first column forward delay interval duration and the nth frame of image data being received within a second column forward delay interval duration corresponding to a second refresh frequency, resetting the count value of the counter, wherein the second refresh frequency is less than the first refresh frequency and the second column forward delay interval duration is greater than the first column forward delay interval duration.

6. The method of claim 5, wherein the method further comprises:

resetting a count value of the counter in response to the nth frame of image data not being received within the first column forward delay interval duration and the nth frame of image data not being received within the second column forward delay interval duration;

7. The method of claim 5, wherein the first column-forward-delay interval duration and the second column-forward-delay interval duration are each an integer multiple of a light-emitting period.

8. The method of claim 1, wherein the first refresh frequency matches a reference frame rate during operation of a foreground application.

9. The method of claim 8, wherein the method further comprises:

receiving a control instruction sent by the application processor, wherein the control instruction comprises the reference frame rate of the foreground application;

determining the first refresh frequency based on the reference frame rate;

the first column forward delay interval duration is set based on the first refresh frequency.

10. The method according to any one of claims 1 to 9, wherein the display driving chip is applied to an organic light emitting diode display screen.

11. The display driving chip is characterized in that the display driving chip is applied to a display screen and is used for:

12. The display driver chip of claim 11, wherein the display driver chip is configured to:

13. The display driver chip of claim 11, wherein the display driver chip is configured to:

14. The display driver chip of claim 11, wherein the display driver chip is further configured to:

and updating the count value of the counter.

15. The display driver chip of claim 11, wherein the display driver chip is further configured to:

16. The display driver chip of claim 15, wherein the display driver chip is further configured to:

17. The display driver chip of claim 15, wherein the first column forward-run interval duration and the second column forward-run interval duration are each an integer multiple of a light-emitting EM period.

18. The display driver chip of claim 11, wherein the first refresh frequency matches a reference frame rate during operation of a foreground application.

19. The display driver chip of claim 18, wherein the display driver chip is further configured to:

determining the first refresh frequency based on the reference frame rate;

20. The display driver chip of any of claims 11-19, wherein the display driver chip is applied to an organic light emitting diode display.

21. A display screen module, characterized in that the display screen module comprises a display screen and a display driving chip, the display driving chip is used for driving the display screen, and the display driving chip is used for realizing the image display method according to any one of claims 1 to 10.

22. A terminal, characterized in that the terminal comprises an application processor, a display screen and a display driving chip, the application processor is connected with the display driving chip through a mobile industry processor interface, and the display driving chip is used for realizing the image display method according to any one of claims 1 to 10.