CN112114767A

CN112114767A - Screen projection frame rate control method and device and computer readable storage medium

Info

Publication number: CN112114767A
Application number: CN202011154799.1A
Authority: CN
Inventors: 常磊
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2020-10-26
Filing date: 2020-10-26
Publication date: 2020-12-22
Anticipated expiration: 2040-10-26
Also published as: CN112114767B

Abstract

The invention discloses a screen projection frame rate control method, equipment and a computer readable storage medium, wherein the method comprises the following steps: generating a monitoring pixel point for monitoring a vertical synchronous signal in the interactive interface; then, judging whether the monitoring pixel points are on the frame or not through a display layer; and finally, if the monitoring pixel point has no upper frame, the generation operation of the screen projection display data is not executed, and if the monitoring pixel point has the upper frame, the screen projection display data is generated and sent at a fixed refresh rate. The humanized screen projection frame rate control scheme is realized, the screen projection display data frame rate of the terminal equipment cannot be influenced by the display frame rate which is suddenly high or suddenly low, the undesirable phenomena of blockage, untimely display updating, display delay and the like in the screen projection process are avoided, and the screen projection display experience of the terminal equipment is improved.

Description

Screen projection frame rate control method and device and computer readable storage medium

Technical Field

The present invention relates to the field of mobile communications, and in particular, to a method and an apparatus for controlling a screen projection frame rate, and a computer-readable storage medium.

Background

In the prior art, along with the rapid development of intelligent terminal equipment, the display demand of a user on the intelligent terminal equipment is higher and higher. For example, more and more smart terminal devices are beginning to support screen refresh rates higher than 60Hz, so that users can obtain a smoother display effect.

However, the refresh rate of various applications in the terminal devices such as the mobile phone is suddenly high and low at present, that is, under the dynamic condition of the mobile phone screen, the refresh rate of the screen may reach 144Hz, and under the static condition, the refresh rate is relatively low, so the effect of the mobile phone screen being projected out is also affected by the suddenly high and suddenly low refresh rate, which causes the display effect of the screen being projected to be unsatisfactory, for example, in the process of screen projection, the bad phenomena of jam, untimely display update, display delay and the like in the transmission process may occur, thereby reducing the user experience.

Disclosure of Invention

In order to solve the technical defects in the prior art, the invention provides a screen projection frame rate control method, which comprises the following steps:

generating a monitoring pixel point for monitoring a vertical synchronous signal in the interactive interface;

judging whether the monitoring pixel points are on the frame or not through a display layer;

if the monitoring pixel point has no upper frame, the generation operation of the screen projection display data is not executed, and if the monitoring pixel point has the upper frame, the screen projection display data is generated and sent at a fixed refresh rate.

Optionally, the generating a listening pixel point for listening to the vertical synchronization signal in the interactive interface includes:

creating the monitoring pixel point of one pixel in an application layer;

and determining rendering callback frequency of a display screen of the terminal equipment, and taking each odd or even callback in the rendering callback frequency as each refreshing of the monitoring pixel point so as to determine the refreshing rate of the monitoring pixel point.

Optionally, the determining, by the display layer, whether the monitoring pixel is framed includes:

acquiring a first drawing signal on the display layer, and saving all layer objects required to be drawn according to the first drawing signal;

and judging whether the layer object is related to the monitoring pixel point, and if so, judging whether the monitoring pixel point is on the frame.

Optionally, if the monitoring pixel has no previous frame, the generating operation of the screen projection display data is not executed, and if the monitoring pixel has a previous frame, the screen projection display data is generated and sent at a fixed refresh rate, including:

if the monitoring pixel point has a previous frame, acquiring a second drawing signal on the display layer;

and synthesizing a layer object related to the monitoring pixel point according to the second drawing signal.

Optionally, if the monitoring pixel has no previous frame, the generating operation of the screen projection display data is not executed, and if the monitoring pixel has a previous frame, the screen projection display data is generated and sent at a fixed refresh rate, further comprising:

acquiring a virtual device name, and determining whether the virtual device name is generated by the screen projection application;

if the virtual equipment name is generated by the screen projection application, determining a refreshing state corresponding to a last frame state of the monitoring pixel point;

and generating and sending the screen projection display data according to the refresh rate corresponding to the refresh state.

The invention also provides a device for controlling the screen-casting frame rate, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the computer program realizes that:

Optionally, the computer program when executed by the processor implements:

creating the monitoring pixel point of one pixel in an application layer;

Optionally, the computer program when executed by the processor implements:

synthesizing a layer object related to the monitoring pixel point according to the second drawing signal;

The present invention further provides a computer-readable storage medium, in which a screen-casting frame rate control program is stored, and when being executed by a processor, the screen-casting frame rate control program implements the steps of the screen-casting frame rate control method according to any one of the above items.

By implementing the screen-casting frame rate control method, the screen-casting frame rate control equipment and the computer readable storage medium, a monitoring pixel point for monitoring a vertical synchronous signal is generated in an interactive interface; then, judging whether the monitoring pixel points are on the frame or not through a display layer; and finally, if the monitoring pixel point has no upper frame, the generation operation of the screen projection display data is not executed, and if the monitoring pixel point has the upper frame, the screen projection display data is generated and sent at a fixed refresh rate. The humanized screen projection frame rate control scheme is realized, the screen projection display data frame rate of the terminal equipment cannot be influenced by the display frame rate which is suddenly high or suddenly low, the undesirable phenomena of blockage, untimely display updating, display delay and the like in the screen projection process are avoided, and the screen projection display experience of the terminal equipment is improved.

Drawings

The invention will be further described with reference to the accompanying drawings and examples, in which:

fig. 1 is a schematic diagram of a hardware structure of a mobile terminal according to the present invention;

fig. 2 is a communication network system architecture diagram provided by an embodiment of the present invention;

FIG. 3 is a flowchart illustrating a method for controlling a frame rate of a screen projection according to a first embodiment of the present invention;

FIG. 4 is a flowchart illustrating a second embodiment of a method for controlling a frame rate of a screen projection according to the present invention;

FIG. 5 is a flowchart illustrating a third embodiment of a method for controlling a frame rate of a screen projection according to the present invention;

FIG. 6 is a flowchart illustrating a fourth embodiment of a method for controlling a frame rate of a screen projection according to the present invention;

fig. 7 is a flowchart of a fifth embodiment of the screen projection frame rate control method according to the present invention.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.

The terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a wearable device, a smart band, a pedometer, and the like, and a fixed terminal such as a Digital TV, a desktop computer, and the like.

The following description will be given by way of example of a mobile terminal, and it will be understood by those skilled in the art that the construction according to the embodiment of the present invention can be applied to a fixed type terminal, in addition to elements particularly used for mobile purposes.

Referring to fig. 1, which is a schematic diagram of a hardware structure of a mobile terminal for implementing various embodiments of the present invention, the mobile terminal 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, a/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 1 is not intended to be limiting of mobile terminals, which may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The following describes each component of the mobile terminal in detail with reference to fig. 1:

the radio frequency unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, receive downlink information of a base station and then process the downlink information to the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA2000(Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division duplex Long Term Evolution), and TDD-LTE (Time Division duplex Long Term Evolution).

WiFi belongs to short-distance wireless transmission technology, and the mobile terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 102, and provides wireless broadband internet access for the user. Although fig. 1 shows the WiFi module 102, it is understood that it does not belong to the essential constitution of the mobile terminal, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or a backlight when the mobile terminal 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.

Further, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although the touch panel 1071 and the display panel 1061 are shown in fig. 1 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the mobile terminal, and is not limited herein.

The interface unit 108 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and external devices.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The mobile terminal 100 may further include a power supply 111 (e.g., a battery) for supplying power to various components, and preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system.

Although not shown in fig. 1, the mobile terminal 100 may further include a bluetooth module or the like, which is not described in detail herein.

In order to facilitate understanding of the embodiments of the present invention, a communication network system on which the mobile terminal of the present invention is based is described below.

Referring to fig. 2, fig. 2 is an architecture diagram of a communication Network system according to an embodiment of the present invention, where the communication Network system is an LTE system of a universal mobile telecommunications technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and an IP service 204 of an operator, which are in communication connection in sequence.

Specifically, the UE201 may be the terminal 100 described above, and is not described herein again.

The E-UTRAN202 includes eNodeB2021 and other eNodeBs 2022, among others. Among them, the eNodeB2021 may be connected with other eNodeB2022 through backhaul (e.g., X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide the UE201 access to the EPC 203.

The EPC203 may include an MME (Mobility Management Entity) 2031, an HSS (Home Subscriber Server) 2032, other MMEs 2033, an SGW (Serving gateway) 2034, a PGW (PDN gateway) 2035, and a PCRF (Policy and Charging Rules Function) 2036, and the like. The MME2031 is a control node that handles signaling between the UE201 and the EPC203, and provides bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location register (not shown) and holds subscriber specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034, PGW2035 may provide IP address assignment for UE201 and other functions, and PCRF2036 is a policy and charging control policy decision point for traffic data flow and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).

The IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem), or other IP services, among others.

Although the LTE system is described as an example, it should be understood by those skilled in the art that the present invention is not limited to the LTE system, but may also be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems.

Based on the above mobile terminal hardware structure and communication network system, the present invention provides various embodiments of the method.

Example one

Fig. 3 is a flowchart of a first embodiment of a screen projection frame rate control method according to the present invention. A screen projection frame rate control method comprises the following steps:

s1, generating a monitoring pixel point for monitoring the vertical synchronizing signal in the interactive interface;

s2, judging whether the monitoring pixel points are on the frame or not through a display layer;

and S3, if the monitoring pixel has no upper frame, the generation operation of the screen projection display data is not executed, and if the monitoring pixel has an upper frame, the screen projection display data is generated and sent at a fixed refresh rate.

In this embodiment, first, a monitoring pixel for monitoring a vertical synchronization signal is generated in an interactive interface; then, judging whether the monitoring pixel points are on the frame or not through a display layer; and finally, if the monitoring pixel point has no upper frame, the generation operation of the screen projection display data is not executed, and if the monitoring pixel point has the upper frame, the screen projection display data is generated and sent at a fixed refresh rate.

Specifically, in this embodiment, in view of the prior art, when the terminal device adopts an Android operating system, a virtual display object is mostly created, a MediaCodec object is created, and then interconnection between a screen projecting end and a projected end is realized through a Surface object of the MediaCodec, in this process, since the virtual display data is directly transmitted to the Surface of the MediaCodec, that is, after the MediaCodec acquires the related screen projecting display data, subsequent screen projecting transmission and display are directly performed. Therefore, when the refresh rate of the mobile phone screen is in a high or low state, the effect of the screen projected by the mobile phone screen is also affected by the high or low refresh rate, which causes the unsatisfactory display effect of the screen projected, for example, in the screen projection process, the bad phenomena of blocking, untimely display update, delayed display and the like may occur in the transmission process, thereby reducing the user experience. Therefore, in this embodiment, in order to solve the above technical problem, a screen-casting frame rate control scheme that is not affected by the refresh rate of the current mobile phone screen is provided, specifically, first, a monitoring pixel for monitoring a vertical synchronization signal is generated in an interactive interface, for example, a monitoring pixel that does not cause interference to user usage is created in the interactive interface of a screen casting application, and the vertical synchronization signal in a subsequent screen casting process is monitored through the monitoring pixel; then, judging whether the monitoring pixel points are on the frame or not through the display layer, for example, acquiring and recording the frame-on state of the monitoring pixel points, and determining a certain refresh rate according to the frame-on state, wherein the refresh rate is related to the refresh rate of the mobile phone screen, and in order to ensure the smoothness and stability of screen projection, the refresh rate can be a fixed refresh rate which is less than the refresh rate of the mobile phone screen, for example, taking each odd number or even number refresh of the mobile phone screen as each refresh of the monitoring pixel points, thereby taking the half-time value of the refresh rate of the mobile phone screen as the fixed refresh rate of subsequent screen projection; and finally, if the monitoring pixel point has no upper frame, the generation operation of the screen projection display data is not executed, and if the monitoring pixel point has the upper frame, the screen projection display data is generated and sent at a fixed refresh rate, so that the screen projection display data which is subsequently generated and sent also keeps the fixed refresh rate based on the fixed refresh rate of the monitoring pixel point.

The method has the advantages that a monitoring pixel point for monitoring the vertical synchronous signal is generated in the interactive interface; then, judging whether the monitoring pixel points are on the frame or not through a display layer; and finally, if the monitoring pixel point has no upper frame, the generation operation of the screen projection display data is not executed, and if the monitoring pixel point has the upper frame, the screen projection display data is generated and sent at a fixed refresh rate. The humanized screen projection frame rate control scheme is realized, the screen projection display data frame rate of the terminal equipment cannot be influenced by the display frame rate which is suddenly high or suddenly low, the undesirable phenomena of blockage, untimely display updating, display delay and the like in the screen projection process are avoided, and the screen projection display experience of the terminal equipment is improved.

Example two

Fig. 4 is a flowchart of a second embodiment of the screen frame rate control method according to the present invention, and based on the above embodiments, the generating a listening pixel point for listening to a vertical synchronization signal in an interactive interface includes:

s11, creating the monitoring pixel point of one pixel in the application layer;

s12, determining rendering callback frequency of a display screen of the terminal equipment, and taking each odd or even callback in the rendering callback frequency as each refreshing of the monitoring pixel point so as to determine the refreshing rate of the monitoring pixel point.

In this embodiment, first, the monitoring pixel point of one pixel is created in the application layer; and then, determining rendering callback frequency of a display screen of the terminal equipment, and taking each odd or even callback in the rendering callback frequency as each refreshing of the monitoring pixel point so as to determine the refreshing rate of the monitoring pixel point.

Specifically, in this embodiment, first, a graphic point of one or more pixels is created in the interactive interface as a monitoring pixel point of this embodiment, and then, the application layer monitors a Vsync (vertical synchronization) signal through addframecall back (callback after rendering). For example, when the current refresh rate of the end device is 120Hz, the addFrameCallBack will perform 120 callback operations in 1 second time. In the process, a variable num is added, the initial value of which can be 0, and the variable num is added with 1 each time a callback operation is executed, so that in the monitoring process, whether the value of the variable num is an odd number or an even number is judged, and the callback frequency with half multiplying power is determined as the refresh rate of the monitored pixel. For example, when the value of the variable num is an even number, the listening pixel is notified to perform the refresh operation, and when the value of the variable num is an odd number, the listening pixel does not perform the refresh operation. Based on this, the fixed refresh rate of the monitoring pixel point is realized.

The embodiment has the advantages that the monitoring pixel point of one pixel is established in the application layer; and then, determining rendering callback frequency of a display screen of the terminal equipment, and taking each odd or even callback in the rendering callback frequency as each refreshing of the monitoring pixel point so as to determine the refreshing rate of the monitoring pixel point. The method provides a basis for monitoring and determining the refresh rate for realizing a humanized screen-projecting frame rate control scheme, so that the frame rate of screen-projecting display data of the terminal equipment is not influenced by the display frame rate which is suddenly high or low, bad phenomena such as screen jamming, untimely display updating, display delay and the like in the screen-projecting process are avoided, and the screen-projecting display experience of the terminal equipment is improved.

EXAMPLE III

Fig. 5 is a flowchart of a third embodiment of the method for controlling a screen-casting frame rate according to the present invention, where based on the above embodiments, the determining, by the display layer, whether the monitored pixel is on a frame includes:

s21, acquiring a first drawing signal on the display layer, and saving all layer objects required to be drawn according to the first drawing signal;

and S22, judging whether the layer object is related to the monitoring pixel point, and if so, judging whether the monitoring pixel point is on the frame.

In this embodiment, first, a first rendering signal is obtained in the display layer, and all layer objects to be rendered are saved according to the first rendering signal; and then, judging whether the layer object is related to the monitoring pixel point, and if so, judging whether the monitoring pixel point is on the frame.

Specifically, in this embodiment, since the monitoring of the pixel point is realized by the floating frame, the corresponding bottom layer is a layer object. Based on this, first, a variable flag is defined as false in a surfefinger (a system service for processing and outputting graphics data), when a surfefinger layer receives a first drawing signal of message.

The method has the advantages that the first drawing signal is obtained from the display layer, and all layer objects required to be drawn are saved according to the first drawing signal; and then, judging whether the layer object is related to the monitoring pixel point, and if so, judging whether the monitoring pixel point is on the frame. The frame-loading judgment basis of the monitoring pixel points is provided for realizing a humanized screen-projecting frame rate control scheme, so that the frame rate of screen-projecting display data of the terminal equipment cannot be influenced by the display frame rate which is suddenly high and suddenly low, the undesirable phenomena of blocking, untimely display updating, display delay and the like in the screen-projecting process are avoided, and the screen-projecting display experience of the terminal equipment is improved.

Example four

Fig. 6 is a flowchart of a fourth embodiment of the method for controlling a screen-casting frame rate according to the present invention, where based on the above embodiments, if the monitoring pixel has no previous frame, the method does not perform the operation of generating screen-casting display data, and if the monitoring pixel has a previous frame, the method generates and transmits the screen-casting display data at a fixed refresh rate, and includes:

s31, if the monitoring pixel has a previous frame, acquiring a second drawing signal on the display layer;

and S32, synthesizing the layer object related to the monitoring pixel point according to the second drawing signal.

In this embodiment, first, if the monitoring pixel has a previous frame, a second drawing signal is obtained in the display layer; and then, synthesizing a layer object related to the monitoring pixel point according to the second drawing signal.

Specifically, in this embodiment, based on the above embodiment, when the surface flicker layer receives the second drawing signal of message.

In the above processing procedure, it may be determined whether the current screen-casting application is created according to the current VirtualDisplay device name, if not, no processing is performed, if so, it is determined whether the variable flag is true, and if so, it is determined that the monitoring pixel has a previous frame, and meanwhile, a predetermined logic processing is performed, that is, it is determined that the screen-casting display data can be released, and if the variable flag is false, it is determined that the previous frame does not have the refresh of the monitoring pixel, that is, the screen-casting display data is not released.

The method has the advantages that a second drawing signal is obtained on the display layer by judging whether the monitoring pixel has a previous frame; and then, synthesizing a layer object related to the monitoring pixel point according to the second drawing signal. The screen-projecting display data synthesis judgment basis is provided for realizing a humanized screen-projecting frame rate control scheme, so that the screen-projecting display data frame rate of the terminal equipment is not influenced by the display frame rate which is suddenly high and suddenly low, the undesirable phenomena of blocking, untimely display updating, display delay and the like in the screen projecting process are avoided, and the screen-projecting display experience of the terminal equipment is improved.

EXAMPLE five

Fig. 7 is a flowchart of a fifth embodiment of a method for controlling a screen-casting frame rate according to the present invention, where based on the above embodiments, if the monitoring pixel has no previous frame, the method does not perform a generation operation of screen-casting display data, and if the monitoring pixel has a previous frame, the method generates and transmits the screen-casting display data at a fixed refresh rate, and further includes:

s33, acquiring a virtual device name, and determining whether the virtual device name is generated by the screen projection application;

s34, if the virtual equipment name is generated by the screen projection application, determining a refreshing state corresponding to the last frame state of the monitoring pixel point;

and S35, generating and sending the screen projection display data according to the refresh rate corresponding to the refresh state.

In this embodiment, first, a virtual device name is obtained, and it is determined whether the virtual device name is generated by the screen projection application; then, if the virtual equipment name is generated by the screen projection application, determining a refreshing state corresponding to the last frame state of the monitoring pixel point; and finally, generating and sending the screen projection display data according to the refresh rate corresponding to the refresh state.

Specifically, as described in the above example, it is determined whether the current screen-casting application is created according to the name of the current virtual display device, if not, no processing is performed, and if so, a refresh state corresponding to the previous frame state of the monitoring pixel is determined, that is, whether the variable flag is true is determined, and if the variable flag is true, it is determined that the monitoring pixel has a previous frame, and meanwhile, a predetermined logic process is performed, and finally, the screen-casting display data is generated and transmitted according to the refresh rate corresponding to the refresh state, that is, it is determined that the screen-casting display data can be released, the screen-casting display data can be cast, and if the variable flag is false, it is determined that the previous frame has no refresh of the monitoring pixel, that is, and the screen-casting display data is not released. Therefore, the effect of keeping the refresh rate consistent between the last frame of the monitoring pixel and the last frame of the projection display data is achieved.

Optionally, the screen projection frame rate control scheme of this embodiment may also be applied to a screen recording process, and may also implement a screen recording scheme with a consistent screen recording flow, a consistent refresh rate, and a low delay.

The method has the advantages that the name of the virtual equipment is obtained, and whether the name of the virtual equipment is generated by the screen projection application is determined; then, if the virtual equipment name is generated by the screen projection application, determining a refreshing state corresponding to the last frame state of the monitoring pixel point; and finally, generating and sending the screen projection display data according to the refresh rate corresponding to the refresh state. The release judgment basis of the screen projection display data is provided for realizing a humanized screen projection frame rate control scheme, so that the screen projection display data frame rate of the terminal equipment cannot be influenced by the display frame rate which is suddenly high or suddenly low, bad phenomena of blocking, untimely display updating, display delay and the like in the screen projection process are avoided, and the screen projection display experience of the terminal equipment is improved.

EXAMPLE six

Based on the foregoing embodiments, the present invention further provides a device for controlling a screen-projection frame rate, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the computer program implements:

if the monitoring pixel point has no upper frame, the generation operation of screen projection display data is not executed, and if the monitoring pixel point has no upper frame, the generation operation of screen projection display data is not executed

EXAMPLE seven

Based on the above embodiments, the computer program when executed by the processor implements:

creating the monitoring pixel point of one pixel in an application layer;

Example eight

Example nine

if the monitoring pixel has a previous frame, acquiring a second drawing signal in the display layer, and synthesizing a layer object related to the monitoring pixel according to the second drawing signal;

In another embodiment, first, a virtual device name is obtained, and it is determined whether the virtual device name is generated by the screen projection application; then, if the virtual equipment name is generated by the screen projection application, determining a refreshing state corresponding to the last frame state of the monitoring pixel point; and finally, generating and sending the screen projection display data according to the refresh rate corresponding to the refresh state.

Example ten

Based on the foregoing embodiments, the present invention further provides a computer-readable storage medium, where a screen-casting frame rate control program is stored, and when executed by a processor, the screen-casting frame rate control program implements the steps of the screen-casting frame rate control method according to any one of the foregoing embodiments.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A method for controlling a screen projection frame rate, the method comprising:

2. The method for controlling a screen-casting frame rate according to claim 1, wherein the generating a listening pixel point for listening to a vertical synchronization signal in the interactive interface comprises:

creating the monitoring pixel point of one pixel in an application layer;

3. The method for controlling a frame rate of a screen projection according to claim 2, wherein the determining whether the listening pixel is on a frame by a display layer comprises:

4. The method of claim 3, wherein the generating of the screen-casting display data is not performed if the monitoring pixel has no previous frame, and the screen-casting display data is generated and transmitted at a fixed refresh rate if the monitoring pixel has a previous frame, comprising:

5. The method of claim 4, wherein if the monitoring pixel has no previous frame, the method does not perform the operation of generating the display data for screen projection, and if the monitoring pixel has a previous frame, the method generates and transmits the display data for screen projection at a fixed refresh rate, further comprising:

6. A screen-casting frame rate control apparatus, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program when executed by the processor implementing:

7. The device of claim 6, wherein the computer program when executed by the processor implements:

creating the monitoring pixel point of one pixel in an application layer;

8. The device of claim 7, wherein the computer program when executed by the processor implements:

9. The device of claim 8, wherein the computer program when executed by the processor implements:

10. A computer-readable storage medium, wherein a screen-casting frame rate control program is stored thereon, and when executed by a processor, implements the steps of the screen-casting frame rate control method according to any one of claims 1 to 5.