WO2023160282A1

WO2023160282A1 - Display rendering method and apparatus, electronic device and readable storage medium

Info

Publication number: WO2023160282A1
Application number: PCT/CN2023/071284
Authority: WO
Inventors: 刘鹏宇
Original assignee: 京东方科技集团股份有限公司
Priority date: 2022-02-25
Filing date: 2023-01-09
Publication date: 2023-08-31
Also published as: CN114527980A

Abstract

The present disclosure provides a display rendering method and apparatus, an electronic device and a readable storage medium. The display rendering method is applied to the electronic device, and comprises the following steps: when canvas data is changed, determining a target element located in a visual area; in a redraw thread, generating redraw canvas, and drawing the target element on the redraw canvas; and in an interface render thread, superposing and drawing the redraw canvas to interface rendering canvas, and refreshing a display interface according to the interface rendering canvas.

Description

A display rendering method, device, electronic device and readable storage medium

Cross References to Related Applications

This application claims priority to Chinese Patent Application No. 202210179865.3 filed in China on February 25, 2022, the entire contents of which are hereby incorporated by reference.

technical field

The present disclosure relates to the computer field, and in particular to a display rendering method, device, electronic equipment and readable storage medium.

Background technique

When updating the display interface of an electronic device, the display interface is usually redrawn and refreshed based on the canvas (Canvas), but the content displayed by the electronic device may include more complex objects, such as complex pictures or handwriting, etc. The redrawing of complex objects takes a long time, which takes a long time to update the display interface of large-size or high-resolution electronic devices, which may cause flickering or freeze on the display interface, affecting the display Effect.

Contents of the invention

In some aspects, an embodiment of the present disclosure provides a display rendering method applied to an electronic device, and the method includes the following steps:

When the canvas data changes, determine the target element located in the visible area;

In the redrawing thread, generate a redrawing canvas, and draw the target element on the redrawing canvas;

In the interface rendering thread, the repainting canvas is overlaid and drawn to the interface rendering canvas, and the display interface is refreshed according to the interface rendering canvas.

In some embodiments, the generating a repainting canvas, and drawing the target element on the redrawing canvas includes:

Establishing a plurality of redrawing sub-threads, and generating a redrawing sub-canvas in the redrawing sub-threads, wherein the redrawing sub-threads correspond to the redrawing sub-canvases one by one;

Divide the target element into the redrawing sub-canvas, and draw the target element corresponding to each redrawing sub-canvas to the corresponding redrawing sub-canvas;

The plurality of redrawing sub-canvases are superimposed on the redrawing canvas.

In some embodiments, the multiple redrawing sub-threads are parallel.

In some embodiments, the number of redrawing sub-canvases is determined according to the computing capability of the electronic device.

In some embodiments, the redrawing thread and the interface rendering thread are serial.

In some embodiments, the generating a repainting canvas, and drawing the target element on the repainting canvas, further includes:

detecting the quantity of said target element;

If the number of the target elements is greater than the preset number threshold, then execute the step of establishing multiple redrawing sub-threads;

If the number of the target elements is not greater than the preset number threshold, draw the target elements on the repainting canvas.

In some embodiments, the visible area is an area of the canvas corresponding to the display interface of the electronic device, and the target element is an element located in the visible area in the canvas data.

In some embodiments, the target element includes an element corresponding to handwriting corresponding to a writing operation on the electronic device.

In some embodiments, the electronic device is an intelligent interactive tablet.

In some aspects, an embodiment of the present disclosure provides a display rendering device, which is applied to an electronic device, including:

The target element acquisition module is used to determine the target element located in the visible area when the canvas data changes;

A repainting canvas generating module, configured to generate a repainting canvas, and draw the target element on the repainting canvas;

The interface refreshing module is configured to, in the interface rendering thread, overlay and draw the repainting canvas to the interface rendering canvas, and refresh the display interface according to the interface rendering canvas.

In some aspects, an embodiment of the present disclosure provides an electronic device, including: a memory, a processor, and a program stored in the memory and operable on the processor;

The processor is configured to read the program in the memory to implement the steps in the display rendering method according to any one of the first aspect.

In some aspects, the embodiments of the present disclosure provide a readable storage medium for storing a program, and when the program is executed by a processor, the steps in the display rendering method according to any one of the first aspect are implemented.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments of the present disclosure. Obviously, the accompanying drawings in the following description are only some embodiments of the present disclosure. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 is a flowchart of a display rendering method according to an embodiment of the present disclosure;

FIG. 2 is another flowchart of a display rendering method according to an embodiment of the present disclosure;

FIG. 3 is a structural diagram showing a rendering device according to an embodiment of the present disclosure;

FIG. 4 is a structural diagram of an electronic device in an embodiment of the present disclosure.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present disclosure with reference to the accompanying drawings in the embodiments of the present disclosure. Apparently, the described embodiments are part of the embodiments of the present disclosure, not all of them. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other. Based on the embodiments in the present disclosure, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present disclosure.

An embodiment of the present disclosure provides a display rendering method.

The display rendering method is applied to an electronic device. In some embodiments, the electronic device is specifically an intelligent interactive panel, and the intelligent interactive panel usually has a larger display panel and a higher resolution, such as 2K or 4K or even higher resolution. The smart interactive tablet can run based on operating systems such as the Android system.

What needs to be understood is that when some operating systems update the display interface, they need to clear the original content first, and then draw new content on the canvas. The content to be drawn can be understood as points, lines, arcs, etc. Composed of various elements, if the content to be drawn is complex, it will increase the time to draw the content, which may cause stuttering, flickering and other phenomena during the screen update process, affecting the display effect.

It should be understood that the technical solution of this embodiment can also be applied to electronic devices with other operating systems, as long as the screen update in the operating system is performed based on the above principles.

In some embodiments, the display rendering method includes the following steps:

Step 101: When the canvas data changes, determine the target element located in the visible area.

In the technical solution of this embodiment, when the canvas data changes, the display interface is updated.

When updating the display screen, first determine the visible area. In this embodiment, the visible area can be understood as the corresponding area on the current display screen, that is, the area corresponding to the canvas and the display interface of the electronic device.

Exemplarily, in the handwriting interface of the electronic device, in one view, the size of the handwriting interface is equal to the display interface of the electronic device, and all the handwriting interfaces are displayed on the display interface. At this point, all handwriting interfaces are visible areas. When the handwriting interface is enlarged, the display interface only displays a part of the area of the handwriting interface. At this time, the area displayed on the electronic device is a visible area, and the canvas data corresponding to this area is a target element located in the visible area.

It should be understood that if the display screen displays the area corresponding to all canvases, the visible area corresponds to the entire canvas. In some cases, the display screen corresponds to a part of the canvas area. The screen displayed by the device is only a part of the canvas.

During implementation, the boundary of the visible area can be determined according to the current display interface, and further, elements within the boundary of the visible area can be determined as target elements.

Step 102: In the redrawing thread, generate a redrawing canvas, and draw the target element on the redrawing canvas.

In this embodiment, a redrawing thread is established. In the redrawing thread, a redrawing canvas is provided, and target elements to be drawn are drawn on the redrawing canvas.

In some of these embodiments, step 102 includes:

detecting the quantity of said target element;

If the quantity of the target element is greater than the preset quantity threshold, then perform the step of establishing multiple redrawing sub-threads;

In the technical solution of this embodiment, the preset number threshold is determined according to the hardware and software performance of the electronic device. It should be understood that electronic devices with different hardware and software can provide different computing capabilities. If the computing capabilities provided are relatively The higher the number of elements that can be drawn in the unit time of a redrawing thread, the more elements can be drawn in the unit time of a redrawing thread. Correspondingly, if the provided computing power is relatively low, the The number of elements is also reduced.

If the total number of target elements is relatively small, for example, less than or close to the number of elements that can be drawn per unit time of one redrawing thread, then in the redrawing thread, the target elements can be directly drawn on the redrawing canvas.

In this embodiment, the preset number threshold can be determined according to the computing power provided by the electronic device. For example, the preset number threshold can be set to be equal to or slightly lower than the number of redrawing threads that can be drawn per unit time. The value of the number of elements.

If the number of target elements is not greater than the preset number threshold, the target elements can be directly drawn on the repainting canvas.

If the number of target elements is relatively large, for example greater than the preset number threshold, multiple redrawing threads are established to increase the drawing speed of the target elements.

Specifically, if the number of target elements is greater than the preset number threshold, the following steps are performed:

Create a plurality of redrawing sub-threads, and generate a redrawing sub-canvas in the redrawing sub-threads, wherein the redrawing sub-threads correspond to the redrawing sub-canvases one by one

dividing the target element into the redrawing sub-canvas, and drawing the target element corresponding to each redrawing sub-canvas to the corresponding redrawing sub-canvas;

In this embodiment, multiple redrawing sub-threads are established in the redrawing thread, each redrawing sub-thread corresponds to a redrawing sub-canvas, in other words, there is a one-to-one correspondence between redrawing sub-canvas and redrawing sub-threads. By establishing multiple redrawing sub-threads, the corresponding target elements are drawn in parallel on multiple redrawing sub-canvases. The drawing speed of the element.

Parallel is also called parallel communication, and refers to a communication mode in which multiple channels of data are transmitted at the same time. In this embodiment, it can be specifically understood that multiple redrawing sub-threads are performed at the same time.

After the corresponding target elements are drawn on each redrawing sub-canvas, all the redrawing sub-canvas are superimposed to obtain the redrawing canvas. In this way, the obtained redrawing canvas includes all target elements. Threads are parallel, which can effectively save the drawing time of target elements.

In some embodiments, the number of redrawing canvases is determined according to the computing power of the electronic device. Specifically, according to the unoccupied remaining computing power of the electronic device, a certain number of redrawing sub-threads are established, and the established redrawing The computing power occupied by the sub-threads is not greater than the remaining computing power.

In some embodiments, in order to avoid affecting the threads that may need to be established, the computing power occupied by the established redrawing sub-thread is not greater than 30% of the remaining computing power. Obviously, this value can be set to 10%, 10% or 10% according to needs. 20%, 25% and other different values.

In this way, the technical solution of this embodiment can make full use of the computing power of the electronic device, and at the same time avoid occupying the computing power required by other threads and avoid affecting other threads.

Take three redrawing sub-threads and their one-to-one corresponding three redrawing sub-canvases as an example.

During implementation, all elements in the canvas data can be evenly or approximately evenly distributed to three redrawing sub-threads. Here, all elements include elements located in the visible area and primitives located outside the visible area. In some implementations In an example, in order to balance the processing time of each redrawing sub-thread, the number of target elements allocated to each redrawing sub-thread is also equal or substantially equal.

In some other embodiments, only target elements may be evenly or approximately evenly distributed to each redrawing sub-thread, and elements in non-visible areas are not processed because they do not need to be displayed.

The elements corresponding to each of the redrawing sub-threads are traversed sequentially.

If the assigned elements are all elements, during the traversal process, it is necessary to confirm whether the corresponding element is the target element, and ensure that the target element has been drawn on the corresponding redrawing sub-canvas. If the assigned element is the target element, it is necessary to ensure that the target element has been drawn on the corresponding redrawing sub-canvas during the traversal process.

After traversing the elements corresponding to a redrawing sub-thread, it can be ensured that all target elements corresponding to the redrawing sub-thread have been drawn on the redrawing sub-canvas corresponding to the redrawing sub-thread.

According to the above steps, after each redrawing sub-thread traverses the corresponding elements in parallel, the drawing of the target element on each redrawing sub-canvas is completed, and further, each redrawing sub-canvas is superimposed on the redrawing canvas to obtain all Repaints the canvas for the target element.

Step 103: In the interface rendering thread, overlay the repainting canvas to the interface rendering canvas, and refresh the display interface according to the interface rendering canvas.

It should be understood that in related technologies, the data required by the interface rendering thread is processed in the interface rendering thread. It can be understood that in related technologies, the target element is drawn on the canvas in the interface rendering thread for display The update of the screen will increase the load on the interface rendering thread and increase the processing time.

In the technical solution of this embodiment, a redrawing thread is further set, and the drawing of the target element on the canvas is completed in the redrawing thread. Specifically, the target element is drawn on the redrawing canvas in the redrawing thread. Next, The interface rendering thread can directly call the redrawing canvas provided by the redrawing thread to draw the target element.

In some embodiments, the redraw thread and the interface rendering thread are serial.

Serial is also called serial communication, which refers to the communication method of transmitting one bit of data each time on the data channel and continuously performing the above single process, that is to say, the redrawing thread and the interface rendering thread are carried out sequentially , when the redrawing thread ends, it will output the processed redrawing canvas to the interface rendering thread for the interface rendering thread to update the interface.

Specifically, the interface rendering canvas can be provided through the UI interface (User Interface, human-computer interaction interface), and then the repainting canvas is superimposed and drawn on the interface rendering canvas. In the update thread of the UI interface, only one drawing action is required. Complete the update of the content on the interface rendering canvas.

As shown in FIG. 2 , the technical solution of this embodiment can be summarized as the following steps.

If the canvas data has changed and needs to be redrawn, it will enter the redraw thread.

In the redrawing thread, first obtain the boundary of the visible area, and determine the target element located in the visible area.

Detect whether the number of target elements is greater than a preset number threshold. In this embodiment, the preset number threshold is 100 for illustration.

If the number of target elements is not greater than 100, the repainting canvas is directly drawn in the redrawing thread.

If the number of target elements is greater than 100, multiple redrawing sub-threads are established, and the target elements are assigned to multiple redrawing sub-threads for drawing respectively.

In the above-mentioned drawing process of the target element of each redrawing sub-thread, the elements corresponding to each redrawing sub-thread are traversed, and if the traversed element is the target element, the target element is further drawn to the redrawing sub-thread on canvas. Finally, the redrawing canvas is obtained by superimposing the redrawing sub-canvas corresponding to multiple redrawing threads.

The interface rendering thread calls the redrawing canvas generated by the redrawing thread. The interface rendering thread notifies the UI interface to update the display interface. After entering the interface rendering thread, the UI interface superimposes the redrawing on the interface rendering canvas, and finally completes the redrawing and rendering process.

An embodiment of the present disclosure provides a display rendering device, which is applied to electronic equipment.

As shown in FIG. 3, in one embodiment, the display rendering device 300 includes:

A target element acquisition module 301, configured to determine the target element 302 located in the visible area when the canvas data changes;

The interface refreshing module 303 is configured to overlay and draw the redrawing canvas to the interface rendering canvas in the interface rendering thread, and refresh the display interface according to the interface rendering canvas.

In some embodiments, the repainting canvas generation module 302 includes:

Establishing a sub-module, configured to establish a plurality of redrawing sub-threads, and generate a redrawing sub-canvas in the redrawing sub-threads, wherein the redrawing sub-threads correspond to the redrawing sub-canvases one by one;

A dividing sub-module, configured to divide the target element into the redrawing sub-canvas, and draw the target element corresponding to each redrawing sub-canvas to the corresponding redrawing sub-canvas;

The overlay submodule is configured to overlay the multiple redrawing sub-canvases on the redrawing canvas.

In some embodiments, the multiple redrawing sub-threads are parallel.

In some embodiments, the repainting canvas generation module 302 includes:

A detection submodule is used to detect the quantity of the target element;

The drawing submodule is specifically configured to perform the step of dividing the canvas data into multiple redrawing canvases if the number of the target elements is greater than a preset number threshold;

The drawing submodule is further configured to draw the target elements on the repainting canvas if the number of the target elements is not greater than the preset number threshold.

The embodiment of the present invention also provides an electronic device. Referring to FIG. 4 , the electronic device may include a processor 401 , a memory 402 and a program 4021 stored in the memory 402 and executable on the processor 401 . When the program 4021 is executed by the processor 401, any steps in the method embodiment corresponding to FIG. 1 can be implemented and the same beneficial effect can be achieved, so details will not be repeated here.

Those of ordinary skill in the art can understand that all or part of the steps for implementing the methods of the above embodiments can be completed by program instructions related hardware, and the program can be stored in a readable medium.

An embodiment of the present invention also provides a readable storage medium, where a computer program is stored on the readable storage medium, and when the computer program is executed by a processor, any step in the above-mentioned method embodiment corresponding to FIG. 1 can be implemented, and The same technical effect can be achieved, so in order to avoid repetition, details will not be repeated here.

The storage medium is, for example, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

It should be noted that it should be understood that the division of the above modules is only a division of logical functions, which may be fully or partially integrated into a physical entity or physically separated during actual implementation. And these modules can all be implemented in the form of calling software through processing elements; they can also be implemented in the form of hardware; some modules can also be implemented in the form of calling software through processing elements, and some modules can be implemented in the form of hardware. For example, the determining module may be a separate processing element, or may be integrated into a chip of the above-mentioned device. In addition, it may also be stored in the memory of the above-mentioned device in the form of program code, and a certain processing element of the above-mentioned device may Call and execute the functions of the modules identified above. The implementation of other modules is similar. In addition, all or part of these modules can be integrated together, and can also be implemented independently. The processing element mentioned here may be an integrated circuit with signal processing capability. In the implementation process, each step of the above method or each module above can be completed by an integrated logic circuit of hardware in the processor element or an instruction in the form of software.

For example, each module, unit, subunit or submodule may be one or more integrated circuits configured to implement the above method, for example: one or more specific integrated circuits (Application Specific Integrated Circuit, ASIC), or, one or Multiple microprocessors (digital signal processor, DSP), or, one or more field programmable gate arrays (Field Programmable Gate Array, FPGA), etc. For another example, when one of the above modules is implemented in the form of a processing element scheduling program code, the processing element may be a general-purpose processor, such as a central processing unit (Central Processing Unit, CPU) or other processors that can call program codes. For another example, these modules can be integrated together and implemented in the form of a system-on-a-chip (SOC).

The above descriptions are preferred implementations of the embodiments of the present invention. It should be pointed out that for those of ordinary skill in the art, some improvements and modifications can be made without departing from the principles of the present invention. These improvements and Retouching should also be regarded as the protection scope of the present invention.

Claims

A display rendering method applied to electronic equipment, said method comprising the following steps:

When the canvas data changes, determine the target element located in the visible area;

In the redrawing thread, generate a redrawing canvas, and draw the target element on the redrawing canvas;

In the interface rendering thread, the repainting canvas is overlaid and drawn to the interface rendering canvas, and the display interface is refreshed according to the interface rendering canvas.
The method according to claim 1, wherein said generating a redrawing canvas and drawing said target element on said redrawing canvas comprises:

Establishing a plurality of redrawing sub-threads, and generating a redrawing sub-canvas in the redrawing sub-threads, wherein the redrawing sub-threads correspond to the redrawing sub-canvases one by one;

dividing the target element into the redrawing sub-canvas, and drawing the target element corresponding to each redrawing sub-canvas to the corresponding redrawing sub-canvas;

The plurality of redrawing sub-canvases are superimposed on the redrawing canvas.
The method of claim 2, wherein the plurality of redrawing sub-threads are parallel.
The method according to claim 2, wherein the number of redrawing the sub-canvas is determined according to the computing capability of the electronic device.
The method according to claim 1 or 2, wherein the redrawing thread and the interface rendering thread are serial.
The method according to any one of claims 2 to 4, wherein said generating a repainting canvas, and drawing said target element on said repainting canvas, further comprises:

detecting the quantity of said target element;

If the number of the target elements is greater than the preset number threshold, then execute the step of establishing multiple redrawing sub-threads;

If the number of the target elements is not greater than the preset number threshold, draw the target elements on the repainting canvas.
The method according to any one of claims 1 to 4, wherein the visible area is the area where the canvas corresponds to the display interface of the electronic device, and the target element is located in the visible area in the canvas data. Elements of the viewport.
The method according to any one of claims 7, wherein the target element includes an element corresponding to handwriting corresponding to a writing operation on the electronic device.
The method according to any one of claims 1 to 4, wherein the electronic device is an intelligent interactive tablet.
A display rendering device applied to electronic equipment, comprising:

The target element acquisition module is used to determine the target element located in the visible area when the canvas data changes;

A repainting canvas generating module, configured to generate a repainting canvas, and draw the target element on the repainting canvas;

The interface refreshing module is configured to, in the interface rendering thread, overlay and draw the repainting canvas to the interface rendering canvas, and refresh the display interface according to the interface rendering canvas.
An electronic device, comprising: a memory, a processor, and a program stored in the memory and operable on the processor;

The processor is configured to read the program in the memory to implement the steps in the display rendering method according to any one of claims 1-9.
A readable storage medium for storing a program, and when the program is executed by a processor, the steps in the display rendering method according to any one of claims 1 to 9 are realized.