CN114980286A

CN114980286A - Electronic equipment screen-off display method

Info

Publication number: CN114980286A
Application number: CN202210468981.7A
Authority: CN
Inventors: 黄斌
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-04-29
Filing date: 2022-04-29
Publication date: 2022-08-30
Anticipated expiration: 2042-04-29
Also published as: CN117320131A; CN114980286B

Abstract

The embodiment of the application discloses a screen-off display method for electronic equipment, and relates to the field of electronic equipment. The electronic equipment can quickly judge the use intention of the user after being folded, and the external screen is controlled to be turned off when the user does not have the use intention in a short time, so that the corresponding expenditure is saved. The specific scheme is as follows: when the electronic equipment is in the unfolding state, a first interface is displayed on an inner screen of the electronic equipment, the first interface comprises a first part and a second part, the first part comprises a first element set, the second part comprises a second element set, a first operation of a user is received, the first operation is used for triggering the electronic equipment to be folded, and a second interface is displayed on an outer screen in response to the first operation. The second interface comprises a first element set and a second element set, or the second interface comprises the first element set, and a first part corresponding to the first element set is a focus interface of the first interface. And controlling the outer screen to be turned off under the condition that the user does not continuously watch the outer screen.

Description

Electronic equipment screen-off display method

Technical Field

The embodiment of the application relates to the field of electronic equipment, in particular to a screen-off display method for electronic equipment.

Background

When the electronic equipment is in use, the display screen can display through the bright screen, and a display function is provided for a user. Taking a folding screen mobile phone as an example, in an unfolded state, the folding screen mobile phone can display a bright screen through an inner screen (i.e., a folding screen), and provide a display function for a user. In a folded state, the folding screen mobile phone can display through the bright screen of the outer screen, and provides a display function for a user.

When the user does not need to use the folding screen mobile phone, taking the folding screen mobile phone in a folded state as an example, the external screen can enter a screen-off (or screen-off) state under the operation of the user or after a preset time, so as to save corresponding power consumption.

However, in the current solution, the fast screen-off of the outer screen needs to be dependent on the operation of the user. In the scheme of turning off the screen for the preset time, even if a user does not use the folding screen, the user cannot automatically enter the screen turning-off state within the preset time, and therefore the waste of power consumption of screen turning-on is caused.

That is to say, in the current scheme, the screen-off scheme is not intelligent enough, which causes waste of power consumption.

Disclosure of Invention

The embodiment of the application provides a screen-off display method for electronic equipment, which can enable the electronic equipment to quickly judge the use intention of a user after being folded, and control an external screen to screen off when the user does not have the use intention in a short time, thereby saving corresponding expenses.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

in a first aspect, a method for displaying a screen of an electronic device is provided, where the method is applied to an electronic device provided with a foldable screen, and the method includes: when the electronic device is in the unfolded state, a first interface is displayed on an inner screen of the electronic device and comprises a first part and a second part, the first part comprises a first element set, the second part comprises a second element set, a first operation of a user is received, the first operation is used for triggering the electronic device to be folded, and a second interface is displayed on an outer screen in response to the first operation. The second interface includes the first element set and a second element set, or the second interface includes the first element set, and a first portion corresponding to the first element set is a focus interface of the first interface. And controlling the outer screen to be turned off under the condition that the user does not continuously watch the outer screen.

Based on the scheme, after the electronic equipment is folded by a user, the corresponding interface can be displayed on the outer screen based on different conditions according to the content displayed on the inner screen before the electronic equipment is folded. For example, when the content corresponding to the focus interface in the inner screen is displayed on the outer screen, and if the content displayed on the inner screen does not distinguish the focus interface, all elements of the inner screen, such as the desktop, may be displayed on the outer screen. After the bright screen of the external screen is displayed, the electronic equipment can be triggered by entering a folded state to judge the use intention of the user in a short time. For example, the user is judged to be no longer using the mobile phone within a short time by continuously watching the external screen. Correspondingly, the electronic equipment can control the external screen to be turned off, so that the external screen is not lightened for display any more, and corresponding power consumption is saved.

In one possible design, before the controlling the outer shield to extinguish the shield, the method further includes: it is determined that the user is not continuously gazing at the outer screen. Based on the scheme, an action example of the electronic equipment in the concrete implementation process of the scheme is provided. For example, the electronic device may determine to trigger the outer screen to be extinguished by determining that the user is not continuously looking at the current screen, i.e., the outer screen.

In one possible design, it is determined that the user does not continuously watch the external screen when the maximum detection duration after the electronic device is folded includes at least one time when the duration in which the user does not continuously watch the external screen is greater than a non-watching threshold. Based on this scheme, a specific example of a scheme for determining that the user is not continuously gazing at the screen is provided. For example, within the maximum detection time period, if there is a time period in which the user does not continuously watch the screen which is greater than a preset non-watching threshold value, the time period corresponds to the time period in which the user does not continuously watch the screen. The duration that the user does not continuously watch the screen may be a duration from when the user no longer watches the screen to when the user starts watching the screen next time (or reaches a maximum detection duration).

In one possible design, the electronic device has a smart perception capability that provides human eye gaze detection functionality, the electronic device including a folded gaze detection module. After the electronic device is folded, the method further comprises: the folding gaze detection module sends a first registration request to the intelligent perception capability, the first registration request is used for registering eye gaze detection, when the user gaze situation changes in response to the first registration request, the intelligent perception capability feeds back a first identifier or a second identifier to the folding gaze detection module, the first identifier is used for indicating that the user gaze situation changes to user gaze, and the second identifier is used for indicating that the user gaze situation changes to user non-gaze. Based on the scheme, a scheme example that the electronic equipment acquires the condition of the user watching the screen is provided. By obtaining the state change condition of the user watching the screen, the folding watching detection module in the electronic equipment can determine whether the condition that the user does not watch the screen continuously exists in the maximum detection time.

In one possible design, the determining that the user is not continuously gazing at the outer screen includes: the folding gaze detection module counts a first time length between the second identifier and a next first identifier within a maximum detection time length, wherein the first time length is a time length of one-time non-continuous gaze of the user on the external screen. Determining that the user is not continuously gazing at the outer screen when at least one of the first time periods is greater than the non-gazing threshold. Based on the scheme, the electronic equipment can determine whether the user continuously does not watch the screen according to the time length between the two adjacent identifications.

In one possible design, if the last received identifier of the folded gaze detection module within the maximum detection duration is the second identifier, the method further includes: and the folding gaze detection module counts a second time length between the last second identification received and the maximum detection time length, and determines that the user does not continuously gaze the external screen when the second time length is greater than the non-gaze threshold. Based on the scheme, the electronic device can also determine whether the user continuously watches the screen according to the time length from the last second identifier to the end of detection.

In one possible design, upon determining that the first duration is greater than the non-gaze threshold, the method further comprises: the folding gaze detection module sends a first de-registration request to the smart perceptibility, the first de-registration request being for de-registering eye gaze detection, the smart perceptibility no longer feeding back the first identity or the second identity to the folding gaze detection module in response to the first de-registration request. Based on the scheme, after determining that the user does not continuously watch the screen, the electronic device may perform quick screen turn-off. Correspondingly, the electronic device can register the detection process of the pair of human eyes, so that the acquisition of the human eye gazing related information (such as the first identifier and the second identifier) is stopped, and the cost of the human eye gazing detection is saved.

In one possible design, a boundary white list is preset in the electronic device, the boundary white list includes interface information of at least one interface, the interface information includes a package name and a class name of a corresponding interface, and the package name and the class name of the second interface are not included in the boundary white list. Before controlling the outer screen to extinguish the screen, the method further comprises: and determining that the interface information of the second interface is not in the interface white list. Based on the scheme, the electronic equipment can also determine whether the user has the intention of continuing to use the electronic equipment through the package name and the class name of the current external screen display interface. For some application interfaces, the user's use may be continued from the inner screen to the outer screen, such as a video call, a voice call, and so on. Then, the interfaces may be set in the interface white list, so that the electronic device may determine that the currently displayed interface is in the interface white list, and then fast screen-saving is not correspondingly performed. On the contrary, if the current interface is not in the interface white list, the quick screen-turning can be executed.

In one possible design, a folding gaze detection module is disposed in the electronic device, and the determining that the interface information of the first interface is not in the interface white list includes: the folding gaze detection module obtains interface information of the current interface from a window manager of the electronic device to obtain the interface information of the first interface, and the folding gaze detection module searches the interface white list according to the interface information of the first interface to determine that the interface information of the first interface is not in the interface white list. Based on the scheme, the folding gaze detection module of the electronic device can acquire the package name and the class name of the current interface, namely the display interface on the outer screen, through interaction with the window manager.

In one possible design, at least one camera is disposed in the electronic device, and before controlling the outer screen to be turned off, the method further includes: it is determined that all cameras are not used. Based on the scheme, the electronic equipment can also determine whether the user has the intention of continuously using the electronic equipment according to the use condition of the camera. For example, when a camera is operated (i.e., when the camera is used), the scene corresponds to a shot, a video, etc., and then the user may need to continue using the electronic device. Therefore, when all the cameras are not used, corresponding to the situation that the user does not use the camera, the corresponding mobile phone can be combined with other judgment mechanisms to accurately determine whether the user has the intention of continuing to use the electronic equipment.

In one possible design, a folded gaze detection module is provided in the electronic device, the determining that the at least one camera is not used, comprising: the folding gaze detection module sends a second registration request to a camera manager of the electronic device, where the second registration request is used to obtain a working state of each camera in the at least one camera, and the working state of the camera includes working and non-working. In response to the second registration request, the camera manager sends a camera state change message to the folded gaze detection module when the working state of each camera changes, where the camera state change message includes an identifier of the corresponding camera and a third identifier or a fourth identifier, the third identifier is used to indicate that the working state of the camera changes to working, and the fourth identifier is used to indicate that the working state of the camera changes to non-working. And the folding gaze detection module stores or updates the working state of each camera according to the received camera state change message. And when the working states of all the cameras are not working, determining that all the cameras are not used. Based on the scheme, the folding gaze detection module of the electronic equipment can acquire the working state of each camera through interaction with the camera manager, so as to judge whether all cameras are unused or not.

In one possible design, before controlling the outer screen to extinguish the screen, the method further includes: determining that the electronic device is not in a call. Based on the scheme, the electronic equipment can also determine whether the user has the intention of continuing to use the electronic equipment through the call state. For example, in a call state, the user may need to use some functions on the interface, such as viewing an address book, etc., that is, the user may need to continue to use the electronic device. Therefore, the electronic device can accurately determine whether the user has the intention of continuing to use the electronic device or not by combining the call state.

In one possible design, providing a folded gaze detection module in the electronic device, the determining that the electronic device is not in a call, includes: the folding gaze detection module sends a third registration request to a call manager of the electronic device, wherein the third registration request is used for acquiring call states of the electronic device, and the call states include in-call, no-call, and hang-up. In response to the third registration request, when the call state of the call manager changes, sending a fifth identifier, a sixth identifier, or a seventh identifier to the folding gaze detection module, where the fifth identifier is used to indicate that the call state is changed to a call, the sixth identifier is used to indicate that the call state is changed to an un-call, and the seventh identifier is used to indicate that the call state is changed to an off-hook. And the folding gaze detection module stores or updates the call state according to the received fifth identifier, sixth identifier or seventh identifier. And when the current call state is on-hook or not on call, determining that the electronic equipment is not in call. Or when the folding gaze detection module determines that the identifier of the last received call state is the sixth identifier or the seventh identifier, determining that the electronic device is not in a call. Based on the scheme, the folding watching detection module of the electronic equipment can acquire the updated call state through interaction with the call manager, so that whether the electronic equipment is not in the call is judged.

In one possible design, before controlling the outer screen to extinguish the screen, the method further includes: and determining that the current screen is not turned off and is not locked. Based on the scheme, the electronic equipment can also determine whether the user has the intention of continuing to use the electronic equipment or not by combining the on-off screen state and the screen locking state of the current screen. In the screen-off state, there may be a need to quickly turn off the screen. If the external screen is locked in a short time, the external screen indicated by the user generally enters a screen locking state, and accordingly, the user may not use the electronic device in a short time.

In one possible design, a folded gaze detection module is provided in the electronic device, the determining that the outer screen is not extinguished, including: the folding gaze detection module obtains a screen on/off state of a current screen from a power manager of the electronic device, the current screen being a screen providing a display function to a user. The folding gaze detection module determines that the outer screen is not turned off according to the screen turning-on and turning-off state fed back by the telephone manager as a screen turning-on state. Should confirm that the outer screen is not locked the screen, include: the folding gaze detection module obtains a screen locking state of a current screen from a screen locking manager of the electronic device, the current screen being a screen providing a display function to a user. And the folding gaze detection module determines that the external screen is unlocked according to the screen locking state fed back by the telephone manager as the current screen. Based on the scheme, a scheme example for acquiring the on-off screen state and the screen locking state is provided.

In one possible design, before the controlling the outer shield to extinguish the shield, the method further includes: determining that the folding screen electronic device is folded. Based on the scheme, the trigger mechanism of the scheme is provided. For example, the electronic device may trigger the judgment mechanism of each dimension when it is determined that the electronic device is folded, and perform quick screen-off when the user does not intend to continue using the electronic device.

In one possible design, the determining that the folding-screen electronic device is folded includes: this folding detection module of gazing sends the fourth registration request to this electronic equipment's equipment state manager, and this fourth registration request is used for acquireing this folding screen fold condition, and this folding screen fold condition is including folding, half folding, expandes. Responding to the fourth registration request, when the state of the folding screen of the call manager is changed into folding, sending an eighth identifier to the folding gaze detection module, where the eighth identifier is used to indicate that the folding screen is folded, and the folding gaze detection module determines that the folding screen electronic device is folded according to the received eighth identifier. Based on this scheme, an example of a scheme for acquiring a folded state is provided. Then, each time an eighth identifier is received, the judgment of fast screen turning provided by the scheme can be triggered.

In a second aspect, an electronic device is provided that includes one or more processors and one or more memories; one or more memories coupled with the one or more processors, the one or more memories storing computer instructions; the computer instructions, when executed by the one or more processors, cause the electronic device to perform the electronic device off-screen display method as described above in the first aspect and in any of the various possible designs.

In a third aspect, a chip system is provided, which includes an interface circuit and a processor; the interface circuit and the processor are interconnected through a line; the interface circuit is used for receiving signals from the memory and sending signals to the processor, and the signals comprise computer instructions stored in the memory; when the processor executes the computer instructions, the system-on-chip performs the electronic device off-screen display method as described above in the first aspect and in any of a variety of possible designs.

In a fourth aspect, there is provided a computer readable storage medium comprising computer instructions which, when executed, perform the electronic device screen-off display method of the first aspect and any one of various possible designs as described above.

In a fifth aspect, there is provided a computer program product comprising instructions which, when run on a computer, enable the computer to perform the electronic device off-screen display method as described in the first aspect above and in any of the various possible designs in accordance with the instructions.

It should be understood that, in the technical solutions provided in the second aspect, the third aspect, the fourth aspect, and the fifth aspect, technical features of the technical solutions may all correspond to the electronic device screen-off display method provided in the first aspect and possible designs thereof, so that similar beneficial effects can be achieved, and details are not described herein.

Drawings

FIG. 1 is a schematic view of a folded screen configuration;

FIG. 2 is a schematic illustration of a display of an interface before and after folding;

FIG. 3 is a schematic view of a screen being extinguished after being folded;

fig. 4 is a schematic composition diagram of an electronic device according to an embodiment of the present disclosure;

fig. 5 is a schematic diagram of a software architecture of an electronic device according to an embodiment of the present application;

FIG. 6 is a schematic diagram of module interaction provided in an embodiment of the present application;

fig. 7A is a schematic diagram of determining a usage intention of a user in multiple dimensions according to an embodiment of the present application;

FIG. 7B is a schematic view of a fast turn-off screen provided in an embodiment of the present application;

FIG. 8 is a schematic view of an interface provided by an embodiment of the present application;

FIG. 9 is a schematic view of a scenario interaction for determining whether an interface is in an interface white list according to an embodiment of the present application;

fig. 10 is a schematic view of a lock screen provided in an embodiment of the present application;

fig. 11 is an interaction diagram of a scheme for acquiring a current on-off screen state according to an embodiment of the present application;

fig. 12 is an interaction diagram of a scheme for acquiring a current screen locking state according to an embodiment of the present application;

fig. 13 is a schematic view of a call interface provided in an embodiment of the present application;

fig. 14 is a schematic view illustrating interaction of a scheme for acquiring a current call state according to an embodiment of the present application;

fig. 15 is an interaction diagram of a scheme for acquiring a current camera use state according to an embodiment of the present disclosure;

fig. 16 is a schematic view of a non-continuous fixation provided by an embodiment of the present application;

fig. 17 is an interactive schematic view of a scheme for obtaining current eye gaze detection according to an embodiment of the present application;

FIG. 18 is a schematic view of a scenario interaction for obtaining a current folded state according to an embodiment of the present application;

FIG. 19 is a schematic diagram illustrating comparison between the present solution and the existing solution provided in the embodiments of the present application;

fig. 20 is a schematic diagram illustrating module interaction of a screen turning scheme according to an embodiment of the present application;

fig. 21 is a schematic flowchart of a screen turning scheme according to an embodiment of the present application;

FIG. 22 is a schematic view of an interface arrangement provided by an embodiment of the present application;

fig. 23 is a schematic composition diagram of an electronic device according to an embodiment of the present application;

fig. 24 is a schematic composition diagram of a chip system according to an embodiment of the present disclosure.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Before describing embodiments of the control method of the translation control and the electronic device provided by the present application, some terms to be mentioned immediately below need to be described. In the description of the embodiments of the present application, unless otherwise specified, "a plurality" means two or more, for example, a plurality of processing units means two or more processing units, or the like; plural elements means two or more elements, and the like.

The terms "first" and "second," and the like, in the description and in the claims herein are used for distinguishing between different objects and not for describing a particular order of the objects. When the present application refers to the terms "first" or "second" etc. ordinal, it should be understood that they are used for distinguishing purposes only, unless they do express an order in accordance with the context.

The term "and/or" herein is an association relationship describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. The symbol "/" herein denotes a relationship in which the associated object is or, for example, a/B denotes a or B.

In the embodiments of the present application, words such as "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.

With the development of display screen manufacturing technology, in order to meet the demand of larger display area of electronic equipment, the foldable screen is gradually and widely used in the electronic equipment. In the embodiments of the present application, an electronic device provided with a folding screen is also referred to as a foldable electronic device. For example, the electronic device is taken as a folding screen mobile phone as an example. A folding screen mobile phone provided with a folding screen is also referred to as a foldable mobile phone or a folding screen mobile phone. The folding screen mobile phone can be provided with a rotating structure (such as a rotating shaft) so that the folding screen mobile phone can be folded, unfolded and the like based on the rotating structure.

It will be appreciated that in order to provide a more convenient viewing experience for the user, a folding screen handset may be provided with a plurality of display screens including a folding screen. To illustrate when the folding screen handset is fully unfolded, the folding screen handset may include a first side and a second side. The first surface can be an inward folding surface in the folding process of the folding screen mobile phone. That is, after folding, the first side is wrapped inside the folding screen phone and cannot be directly seen by the user. Correspondingly, the second face may be the face opposite the first face. After folding, the second face can be exposed as the appearance face of the folding screen mobile phone.

In some embodiments, the foldable screen may be disposed on the first side such that when a user unfolds the foldable screen phone, the foldable screen phone provides a display function to the user through the foldable screen. In the following description, the folding screen provided on the first side may be referred to as an inner screen.

Other display screens, such as non-folding screens, may also be included in a folding screen handset. The non-folding screen may be disposed on at least a portion of the second side to continue to provide display functionality to the user through the non-folding screen after the user folds the folding screen handset. In the following description, the non-folding screen provided at least in part on the second face may be referred to as an outer screen. For example, after the folding screen mobile phone is folded, the second surface can be folded into two parallel parts respectively corresponding to the upper and lower appearance surfaces of the folding screen mobile phone. Then, when one outer screen is provided in the folding screen mobile phone, the outer screen may be provided on any one of the two appearance faces. When two outer screens are arranged in the folding screen mobile phone, the outer screens can be respectively arranged on two appearance surfaces.

It should be noted that the above descriptions of the inner screen and the outer screen are only examples, and do not constitute a specific limitation to the foldable electronic device according to the embodiments of the present application. For example, continuing with the example of a folding screen mobile phone, the inner screen may be formed by splicing two or more non-folding screens, and/or the outer screen may be a folding screen, etc. In the following examples, the inner screen is a foldable screen, and the foldable electronic device is further provided with an outer screen.

It should be understood that a folding screen phone, when used by a user, may be divided into a plurality of states depending on the folding situation. For example, the plurality of states of the folding screen mobile phone may include a folded state, a half-folded state, and an unfolded state (or referred to as an opened state).

Wherein, fold condition can correspond the complete folding state of folding screen cell-phone. In this folded state, the first face is closed inwardly and not directly visible to the user. The inner screen (i.e. the folding screen) is also correspondingly closed inwards, and the electronic equipment provides a display function for a user through the outer screen. In this folded state, the folding angle is 0 degrees. The folding angle is an included angle of two parts of the same surface in the folding process of the electronic equipment by taking the rotating structure as an axis.

The unfolded state may correspond to a fully unfolded state of the folding screen handset. In the unfolded state, the first side is flattened and presented to the user as an appearance of the electronic device. Correspondingly, the second surface is completely flattened to serve as the other appearance surface of the electronic device. In this unfolded state, the electronic apparatus can provide a display function to a user through the inner screen provided on the first face. In this unfolded state, the folding angle is 180 degrees.

Between the folded state and the unfolded state, a half-folded state may also be included. In this half-folded state, the fold angle tends to be between 0 degrees and 180 degrees. The display screen of the electronic device providing the display function for the user may be an external screen or an internal screen. For example, in the case where the folding angle is less than 45 degrees, the electronic apparatus may provide a display function to the user through the outer screen. As another example, in the case where the folding angle is greater than 90 degrees, the electronic apparatus may provide a display function or the like to the user through the inner screen.

To more clearly illustrate the foldable electronic device to which the present application relates, fig. 1 shows several examples of foldable electronic devices (e.g., folding screen phones) in different folded states. In the unfolded state, the first face is completely flattened, as shown in fig. 1. On the first side a folding screen 11 may be arranged. The folding screen 11 may be divided into two parts, such as 11a and 11b, along the folding axis. In this example, the folding screen phone may also be provided with an outer screen. The outer screen may be a screen 12 disposed opposite to 11a of the folding screen 11.

It should be noted that, in order to provide the shooting function for the user, one or more cameras may be further disposed on the foldable mobile phone. For example, as shown in fig. 1, a camera may be provided on 11b of the folding screen 11 to provide a user with a photographing function (e.g., a self-photographing function) when the user uses the inner screen. The camera arranged on the folding screen 11 (i.e. the inner screen) may also be referred to as an inner screen camera, or an inner screen front camera.

From the unfolded state, the foldable phone can be folded along the folding axis, as shown in fig. 1, to enter a semi-folded state. In the half-folded state, the folding panels 11a and 11b are gradually brought closer to each other until they are closed. When the folding screen 11 is completely covered with the folding screen 11a at 11b, i.e. the folding angle is reduced from 180 degrees in the unfolded state to 0 degree, the outer screen 12 can be presented to the user as an appearance surface so as to provide the corresponding display function. At this time, the folding axis may be located at one edge of the outer panel 12. As shown in fig. 1, in some embodiments, a camera may also be provided on the outer screen 12, such that in the folded state, the camera may be used to provide a self-timer function to the user. In this example, the camera disposed on the outer screen 12 may be referred to as an outer screen camera, or an outer screen front camera.

It can be understood that the cameras disposed on the inner screen 11 and the outer screen 12 can provide a self-photographing function to the user in respective corresponding states, and therefore both the cameras can be referred to as front cameras of the folding screen mobile phone. Correspondingly, on the second surface, the portion of the inner screen 11 opposite to 11b can be used as the back surface of the folding screen mobile phone in the folded state, and can also be used as the back surface of the folding screen mobile phone in the unfolded state. A rear camera may be provided at this position to provide a rear photographing function to a user in a folded state and/or an unfolded state.

As described above, when the folding screen mobile phone shown in fig. 1 is operated, a display function can be provided to a user through the inner screen and/or the outer screen thereof. For example, take the example of displaying a desktop. Referring to fig. 2, when the folding screen mobile phone is in the unfolded state, a desktop interface 21 as shown in fig. 2 may be displayed on the inner screen thereof. The distribution of the elements such as the components and the application icons included in the desktop interface 21 may be appropriately scaled according to the size of the inner screen to obtain a display effect corresponding to the size of the inner screen. Accordingly, the folding screen phone may display the desktop interface 22 on the outer screen after being folded into the folded state. In contrast to the desktop interface 21, the desktop interface 22 may also include elements such as various components and application icons on the desktop. The display distribution of the desktop interface 22 may be commensurate with the size of the outer screen. For example, the desktop interface 22 is appropriately scaled in the width direction compared to the desktop interface 21 so as to obtain an appropriate display effect on the outer screen.

In this example, the folded outer screen displays all the contents of the inner screen. In other implementations, the inner screen may display a parallel view in the expanded state. Illustratively, the interface of application a is displayed on the inner screen. One interface of the application a may be displayed on the left half 11a of the inner screen 11, and another interface of the application a may be displayed on the right half 11b of the inner screen 11. For example, when the application a is a reading application, in the display of the improved parallel view, two continuous pages of graphics and texts provided by the reading application can be respectively displayed on the left half-screen 11a and the right half-screen 11b, so as to achieve the effect of displaying a simulated book to a user. In the case where the inner screen displays a parallel view, one focus interface may be included in two interfaces respectively displayed in the left half screen 11a and the right half screen 11 b. The focus interface may be the interface the user is reading. Then, after the folding as shown in fig. 2, the content of the focus interface can be displayed on the outer screen for the user to read. In the present application, the interface displayed on the screen may include a plurality of elements, such as icons, text, boxes, and the like. The set of multiple elements may correspond to all of the information displayed by the interface. For example, if the inner screen 11 displays a first interface, the first interface may include a first portion and a second portion. The first and second portions may correspond to the displayed content of 11a and 11b, respectively. Then, the plurality of element sets of the first portion displayed on 11a may be referred to as a first element set. The plurality of element sets of the second portion displayed on 11b may be referred to as a second element set. Take the interface displayed on 11a as the focus interface as an example. Then, after the folding screen phone is folded, the interface displayed on the external screen may include the first set of elements. So that the user continues to view the focus interface through the outer screen. In other cases, if the interface displayed by the inner screen 11 in the expanded state does not distinguish the interface in focus, for example, the combination of all elements in 11a and 11b corresponds to a desktop interface. Then, after the folding mobile phone is folded, the interface displayed on the outer screen may include all elements displayed on the inner screen, that is, the first element set and the second element set.

In some cases, since the inner screen is completely closed when the folding screen mobile phone is in the folding state, and does not provide a display function to the user, the inner screen may be in the screen-off state in the folding state. In the embodiment of the present application, the screen-off state may refer to that no display is performed on the corresponding screen, or only a small number of identifiers (such as time, date, and the like) are displayed on the screen to implement the screen-off display function.

It can be understood that compared with the bright screen state, the screen in the off screen state basically does not need to be displayed, so that power consumption caused by corresponding screen display can be saved.

In the folded state, it is also possible for the outer screen to enter the screen-out state in some cases. For example, in the case shown in fig. 3, after the outer screen is displayed on the bright screen, if the operation input by the user is not received within the preset time period, the screen-off state may be entered. For example, the outer screen, when displayed in a bright screen, may display a desktop interface 22 as shown in FIG. 2. If the operation input by the user is not received all the time, the external screen can enter the screen-off state after the preset time (such as 15s or more) is reached. For example, after entering the screen-off state, the outer screen may not be displayed at all, and enter a resting state (such as a lower power state) until the user inputs another operation to light up the screen. For another example, the outer screen may be displayed as shown at 33, with no display being made in most of the area of the display screen, and only a small amount of information such as time, date, week, etc. being displayed at 34. In some implementations, the display content corresponding to 34 can be selected and set in the "off screen display" function option in a folding screen handset. Of course, the examples 31 and 32 are only one possible implementation, and the user may also instruct the electronic device to enter the screen-off state by other means, such as by a preset gesture, a combined operation of a virtual key and a physical key, and the like.

As shown in fig. 3, the folding screen mobile phone may also enter a screen-off state in response to a screen-off operation after the user inputs the screen-off operation. For example, the screen-off operation may be an operation in which the user presses a power-off key. In response to the screen-off operation, the folding screen mobile phone can enter a screen-off state.

It can be seen that the external screen is required to enter the screen-off state, and the external screen can enter the mobile phone by itself after waiting for a preset time period under the condition that any operation of a user is not received, so that when the user does not use the folding screen mobile phone, the power consumption related to the display of the external screen is saved. The current preset duration is generally 15s or more, so that the folding screen mobile phone cannot enter a screen-off state within the preset duration. If the preset time is set to be less than 15s (for example, 5s or 8s), the external screen may automatically enter the screen-off state under the condition that the user needs to use the folding screen mobile phone but does not perform related operations of quick input, so that the user experience is affected.

The embodiment of the application provides a screen extinguishing scheme, which can determine the use intention of a user on electronic equipment based on the state of foldable electronic equipment, and accurately judge whether the display screen (such as an outer screen) needs to be controlled to rapidly enter a screen extinguishing state, so that unnecessary power consumption overhead of screen display is saved while the use of the user is not influenced.

In order to explain the technical solution provided in the embodiments of the present application in detail, first, an electronic device to which the technical solution is applied will be briefly described below.

The scheme provided by the application can be applied to foldable electronic equipment. As explained before, the foldable electronic device may be provided with a folding screen. In some embodiments, the electronic device may also be provided with at least one external screen. In different implementations, the foldable electronic device may be different. For example, the electronic device may be a portable mobile device provided with a folding screen mobile phone, a tablet computer, a media player, and the like, and the electronic device may also be a wearable electronic device provided with a folding screen.

Please refer to fig. 4, which is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. The electronic device 400 may include a processor 410, an external memory interface 420, an internal memory 421, a Universal Serial Bus (USB) interface 430, a charging management module 440, a power management module 441, a battery 442, an antenna 1, an antenna 2, a mobile communication module 450, a wireless communication module 460, an audio module 470, a speaker 470A, a receiver 470B, a microphone 470C, an earphone interface 470D, a sensor module 480, a key 490, a motor 491, an indicator 492, a camera 493, a display 494, a Subscriber Identification Module (SIM) card interface 495, and the like. The sensor module 480 may include a pressure sensor 480A, a gyroscope sensor 480B, a magnetic sensor 480D, an acceleration sensor 480E, a distance sensor 480F, a proximity light sensor 480G, a fingerprint sensor 480H, a touch sensor 480K, an ambient light sensor 480L, and the like.

It is to be understood that the illustrated structure of the embodiment of the present application does not specifically limit the electronic device 400. In other embodiments of the present application, electronic device 400 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 410 may include one or more processing units, such as: the processor 410 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), among others. The different processing units may be separate devices or may be integrated into one or more processors. For example, the processor 410 is configured to execute the method for detecting the ambient light in the embodiment of the present application.

The electronic device 400 implements display functions via the GPU, the display screen 494, and the application processor, among other things. The GPU is an image processing microprocessor that is coupled to a display screen 494 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 410 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 494 is used to display images, videos, and the like. The display screen 494 includes a display panel. The display panel may employ an organic light-emitting diode (OLED). In some embodiments, the electronic device 400 may include 1 or N display screens 494, N being a positive integer greater than 1. For example, in connection with the examples of fig. 1-3, the N display screens 494 may include an inner screen, such as the folding screen 11. The N display screens 494 can also include at least one external screen, such as screen 12.

It should be understood that fig. 4 described above illustrates one hardware structural component in the electronic device. In the present application, the electronic device 400 may also be divided from another perspective. For example, referring to FIG. 5, a software partitioning diagram of an electronic device 400 is shown.

Illustratively, in an example as shown in fig. 5, the electronic device may have a hierarchical architecture. Wherein the layered architecture divides the software into a number of layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In this example, the electronic device operates as

The (Android) operating system is an example. The system comprises an application program layer (APP layer, which is referred to as an application layer for short), an application program Framework layer (Framework layer for short), a kernel layer, a hardware layer and the like from top to bottom. In other divisions, a Hardware Abstraction Layer (HAL), a system library, etc. may also be included between the framework Layer and the kernel Layer.

In this example, the application layer may include a series of application packages. Illustratively, the application packages may include camera, phone, alarm, gallery, calendar, map, navigation, WLAN, bluetooth, music, video, short message, etc. system applications based on the operating system of the electronic device. In some implementations, the application package may also include other third party applications, such as

Connectionless, etc. applications that can provide voice/video telephony functionality. In some embodiments, the application layer may be provided with relevant software components if AO capabilities are configured in the electronic device. For example, a gaze fence may be provided at the application layer for enabling perception of a user's gaze on the screen.

Wherein, the AO (always ON) module can provide intelligent perception capability for the electronic device. For example, human faces, gestures, objects, etc. are recognized by the AI in the case of ground power consumption overhead. A plurality of software/hardware modules may be included in the AO module. Different software and hardware cooperate to achieve perception of different objects. For example, a software module watching fence may be included in the AO module, and the watching fence may instruct an AO service (AO service) to cooperate with a camera in a case that the electronic device needs to sense whether a user watches a screen, and analyze and determine a watching situation of the current user based on the acquired image information, thereby implementing the sensing of the user watching the screen.

A framework layer in an electronic device may provide an Application Programming Interface (API) and a programming framework for applications at an application layer. The framework layer includes some predefined functions. For example, in the embodiment of the present application, the framework layer may include a power manager for performing screen-off/screen-on management, a screen-locking manager for performing screen-locking management, a device state manager for managing folded states of the folded screen, a camera manager for managing cameras, a call manager for managing calls such as voice/video, and the like.

In addition, some basic modules may be arranged in the frame layer. Such as a window manager, activity manager, content provider, view system, resource manager, notification manager, input manager, etc. As an example, the Window Manager provides Window Management (WMS), which may be used for Window management, Window animation management, surface management, and a relay station as an input system. The Activity Manager may provide Activity Manager Service (AMS), which may be used for the start-up, switching, scheduling of system components (e.g., activities, services, content providers, broadcast receivers), and management and scheduling work of application processes.

As shown in fig. 5, in the present application, a folded gaze detection module (also called hnswingfoldoldaohub) may also be provided in the frame layer. The folded gaze detection module may be used to interact with other related services or managers to synthetically determine the current user's usage intent.

The manner of interaction between the modules or services may vary in different implementations.

Illustratively, in some embodiments, automatic return on state change may be implemented by the registration monitor. It should be understood that there may be a variety of ways of state return for some module/service interactions. In a specific implementation, a module (e.g., a folding gaze detection module) that wants to acquire another module/service may send a corresponding state return manner when registering with the other module/service, so that the opposite-end module/service may return the state according to the specified return manner. For example, when the folded gaze detection module indicates that the state is changed, the state return is performed, and then the corresponding module/service may return corresponding state information to the folded gaze detection module when the state is changed (e.g., the angle reaches a preset critical angle, a call is started, etc.).

In other embodiments, the folded gaze detection module may obtain status information for other modules/services by sending a request message (or query message). For example, the folded gaze detection module may send data request information to the AO module when it is desired to obtain information whether the current user is gazing at the screen. For another example, the folding gaze detection module may send corresponding request information to the power manager when determining whether the current display screen is in a bright screen state.

It should be noted that, in some embodiments, each module disposed in the framework layer may also correspond to one or more processes/threads in the system operation process.

Illustratively, in conjunction with fig. 6, after the electronic device is started, a process corresponding to a system service (SystemServer) may be initiated. In a system services process, multiple threads may be initiated for implementing different functions. For example, by initiating a hnswingfoldoldaohub for implementing the functionality of the folded gaze detection module in the present application; the function of the device state manager in the application is realized by initiating a DeviceStatemanager; the function of the power supply manager in the application is realized by initiating the PowerManager; the method comprises the steps that KeyguardManager is initiated to realize the function of a screen locking manager in the application; the camera manager is used for realizing the functions of the camera manager in the application by launching the Camera manager; the function of the call manager in the application is realized by initiating TelephonyManager.

The multiple threads can interact with each other to realize corresponding functions. For example, the folding gaze detection module may interact with the device state manager to determine that the current folding screen mobile phone is in a folded state; the folding gaze detection module can interact with the power manager to determine whether the current folding screen mobile phone is in a bright screen state; the folding gaze detection module may interact with the lock screen manager to determine whether the current folding screen handset is in a lock screen state, and the like.

The core layer in an electronic device may comprise a number of drives of different components, such as sensor drives, display drives, camera drives, AO drives, etc. Through each driver arranged in the kernel layer, the application layer or the framework layer can smoothly call corresponding components in the hardware layer, and corresponding functions are realized by executing corresponding commands. For example, taking a camera call as an example, an application (e.g., a video call application) in the application layer may issue a command for calling the camera, and the command may be processed by the framework layer, and the command may be passed to the camera downward by calling a camera driver in the kernel layer, so as to start the camera, so as to support the function of the video call.

The hardware layer may correspond to a physical component for implementing each function. Such as a camera for image acquisition, a display screen for display, etc.

Furthermore, in some embodiments, android runtime, native C/C + + libraries, and the like may also be included in the electronic device. The android runtime comprises a core library and an android runtime. Android runtime is responsible for converting source code into machine code. Android runtime mainly includes adopting Advanced (AOT) compilation technology and Just In Time (JIT) compilation technology. The core library is mainly used for providing basic functions of the Java class library, such as basic data structure, mathematics, Input Output (IO), tool, database, network and other libraries. The core library provides an API for android application development of users. The native C/C + + library may include a plurality of functional modules. For example: surface manager (surface manager), Media Framework (Media Framework), Standard C library (libc), open graphics library for Embedded Systems (OpenGL for Embedded Systems, OpenGL ES), Vulkan, SQLite, Webkit, and the like.

It should be understood that the solutions provided in the embodiments of the present application can be applied to electronic devices having the structural compositions shown in fig. 4-6.

The following describes the technical solutions provided by the embodiments of the present application in detail with reference to the examples of the electronic device shown in fig. 5 and fig. 6. Take an electronic device as a folding screen mobile phone as an example.

Based on the screen extinguishing scheme provided by the embodiment of the application, the folding screen mobile phone can more quickly and accurately execute screen extinguishing control of the corresponding screen. For example, the scheme can be applied to the situation that a user does not use the folding screen mobile phone in a short time after the folding screen mobile phone is folded, the folding screen mobile phone can control the outer screen to quickly turn off the screen, and corresponding power consumption is saved. In other embodiments, the scheme can also be applied to a scene that whether the inner screen needs to be quickly turned off or not after the folding screen mobile phone is opened.

In the following example, whether the external screen is quickly turned off after the mobile phone with the foldable screen is folded is described as an example. For other scenarios, such as a scenario in which a fast screen-off is performed on an internal screen, the specific implementations thereof may be referred to each other.

In the application, the folding screen mobile phone can have the capability of determining the use intention of the user. For example, after the folding screen mobile phone enters the folded state, the folding screen mobile phone may comprehensively judge the use intention of the user from multiple angles, so as to obtain an accurate judgment result. As an example, as shown in fig. 7A, a folding screen mobile phone may determine that the user is intended for use by any one of the following: the display content of the external screen interface, whether the electronic device is turned off, whether the electronic device is locked, whether the electronic device is in a call, whether the electronic device uses a camera, whether a user watches a display screen, and the like.

In the embodiment of the present application, in conjunction with the foregoing description, the folding-screen mobile phone may display the interface 21 before being folded (for example, in an unfolded state), and this interface 21 may also be referred to as a first interface. Upon receiving a user input of a fold operation, the folded state may be entered, with the interface 22 (also referred to as a second interface) displayed on the outer screen. Based on the scheme, as shown in fig. 7B, the folding screen mobile phone can control the external screen to be quickly turned off under the condition that it is determined that the user does not intend to use, so that corresponding power consumption overhead is saved. The scheme provided by the embodiment of the application is described in detail below with reference to the accompanying drawings.

In some embodiments, the folding screen mobile phone can determine whether the user is using the folding screen mobile phone according to the display content of the external screen interface.

Generally, some usage behaviors of the user have continuity. For example, in the process of performing a voice/video call, even if the user adjusts the folding screen mobile phone from the unfolded state (or the semi-folded state) to the folded state, the voice/video call will not be terminated. That is, after the mobile phone enters the folded state, the user still has an intention to use the folding screen mobile phone, and the folding screen mobile phone needs to display an interface of the voice/video call to the user on a corresponding interface. With reference to the illustration in fig. 2, when the folding-screen mobile phone is folded, the content displayed on the inner screen may be displayed on the outer screen interface. Therefore, in the voice/video call scene, the folding screen mobile phone can determine that the user still needs to use the folding screen mobile phone according to the related interface displayed on the external screen, and the screen cannot be turned off. Similarly, for other continuous use behaviors, the folding screen mobile phone can determine that the user still uses the folding screen mobile phone according to the corresponding interface and cannot turn off the screen.

In this embodiment, a whitelist of interfaces may be configured in the folding-screen mobile phone, and the whitelist of interfaces may include information corresponding to at least one interface. For example, the information corresponding to the interface may include a package name, a class name, etc. of the interface. The interface in the interface white list can be a scene corresponding to a continuous use behavior in the process of using the folding screen mobile phone by the user. That is to say, when any interface in the interface white list is displayed on the external screen interface, the user still needs to use the folding screen mobile phone and cannot turn off the screen.

As an example, the interface in the interface whitelist may include at least one of:

a voice/video interface (e.g., com. intent. mm/com. intent. mm. plugin. voip. ui. video activity);

a call interface of a folding screen mobile phone (such as com. android. incallui/com. android. incallactivity);

the video/voice interface (e.g., com. event. mobile qq/com. event. av. activity);

an open conversation interface (e.g., com. huawei. meetime/com. huawei. hicallmanager. incall activity).

That is, at least the package name and the class name corresponding to one or more interfaces in the interfaces may be included in the interface white list in the electronic device.

In this embodiment of the application, the folding gaze detection module may be configured to obtain a package name and a class name of a current external screen display interface, match the package name and the class name with an interface white list, and determine whether the current external screen display interface is included in the interface white list.

Illustratively, each interface consists of an activity, which in turn consists of a view, which is the existence form of a window, which is the carrier of the view. For example, a voice interface is taken as an example. The application providing the voice function can pull up the activity corresponding to the voice interface in the corresponding process after receiving the instruction for performing the voice chat input by the user. After the activity is established, the application may send the package name and the class name of the interface corresponding to the activity to the window manager, and correspondingly, the window manager may instruct the display screen to display the corresponding interface according to the received information.

For example, in conjunction with FIG. 8, the voice call interface displayed on the display screen may be interface 81 as in FIG. 8. The package name corresponding to the interface 81 may be a package name 82, and the class name corresponding to the interface 81 may be a class name 83.

Then, the folded gaze detection module may obtain the package name and the class name of the interface currently being displayed from the window manager. The folding gaze detection module may search from the interface white list based on the obtained package name and class name, and determine whether the package name and class name of the interface corresponding to the currently displayed activity are included in the interface white list. And if so, determining that the current external screen display interface corresponds to the condition that the user is using the folding screen mobile phone and does not enter the quick screen turning-off state. Otherwise, if the current external screen display interface does not correspond to the user, the user does not use the folding screen mobile phone temporarily, and other judgment steps are carried out. If no other determination step is configured, the folding gaze detection module may instruct the folding screen mobile phone to quickly turn off the screen.

For example, in connection with FIG. 9, the folded gaze detection module may enable the determination of the interface in this example via S91-S92. S91, the folded gaze detection module obtains the package name 82 and the class name 83 of the current interface from the window manager. And S92, the folding gaze detection module carries out matching search from the interface white list according to the package name 82 and the class name 83. When the white list of the interface has the completely same item with the package name 82 and the class name 83, the corresponding matching is successful. Otherwise, if there is no completely identical item in the interface white list with the package name 82 and the class name 83, the corresponding matching fails.

Therefore, after the folding screen mobile phone is folded by the electronic equipment, if the packet name and the class name of the external screen display interface are the same as any one of the interface white lists, it is determined that the current user is using the folding screen mobile phone, and the rapid screen-off cannot be executed. On the contrary, if the corresponding item is not matched in the interface white list, the folding screen mobile phone can be controlled to be quickly turned off, and the power consumption is saved.

In other embodiments, the folding screen mobile phone can determine whether the user is using the folding screen mobile phone according to whether the external screen is turned off or locked.

Referring to the illustration of fig. 2, after the folding screen mobile phone enters the folded state from the semi-folded state, the outer screen can continue to display the content of the inner screen. That is, the screen of the folding screen mobile phone is not automatically turned off or locked within a short time (e.g. within 10 s) after the folding screen mobile phone is folded. Under the condition, if the user does not need to continue to use the folding screen mobile phone, the folding screen mobile phone can be manually controlled to enter a screen extinguishing state or a screen locking state. For example, in connection with the operation illustrated at 32 in fig. 3, the user may press a button such as a power-off key to instruct the fold-screen phone to turn off the screen. Correspondingly, the folding screen mobile phone can extinguish the outer screen, and the state after the outer screen is extinguished is shown as 33 in fig. 3. For another example, the user may instruct the external screen to enter the screen-locking state by inputting a corresponding operation. For example, please refer to fig. 10. Upon entering the folded state, the outer screen may display an interface 101 as shown in fig. 10. In the current interface, a user can input a preset gesture to indicate that the folding screen mobile phone enters a screen locking state. For example, the preset gesture is the gesture 102 shown in fig. 10. After receiving the input of the gesture 102, in response to the input, the folding-screen mobile phone may switch and display the screen locking interface shown as 103 on the external screen, and enter a screen locking state. In the screen locking state, the outer screen can be in a bright screen, and simple information such as time, date and the like is displayed on the screen locking interface. In this example, the screen locking interface may further include a screen locking prompt identifier 104, and the user is prompted to be currently in the screen locking state by displaying the screen locking prompt identifier 104. In other implementations, the user may also instruct the folding screen mobile phone to enter the screen locking state through voice control or the like.

In the screen locking state, if the user needs to continue using the folding screen mobile phone, relevant operations such as sliding, screen clicking and the like can be performed, and unlocking information such as passwords, unlocking gestures and the like can be input in subsequent interfaces. Certainly, in some cases, the user can unlock the folding screen mobile phone for continuous use in modes of face unlocking, fingerprint unlocking, voiceprint unlocking and the like.

Through the above description, it can be seen that, in a short time after the folding screen mobile phone enters the folding state, the corresponding screen-off state or screen-locking state is entered under the active control of the user. And the user can only control the folding screen mobile phone to enter the screen extinguishing state or the screen locking state under the condition that the folding screen mobile phone is not needed to be used in a short time. In this example, the folding-screen mobile phone may determine whether the user needs to continue using the folding-screen mobile phone according to whether the current folding-screen mobile phone is in the screen-off state or the screen-locking state. For example, when the folding screen mobile phone is in any one of the screen-off state and the screen-locking state, the folding screen mobile phone may determine that the user does not use the folding screen mobile phone in a short time.

In the embodiment of the application, the folding gaze detection module may further be configured to acquire related information of whether to turn off the screen or not and whether to lock the screen.

For example, in conjunction with the descriptions of fig. 5 and fig. 6, the power manager may be used for screen-off/screen-on management, and the screen lock manager may be used for screen lock management. In this example, the folding gaze detection module may interact with the power manager to determine whether the current screen is bright, and the folding gaze detection module may also interact with the lock screen manager to determine whether the current screen is bright.

As an example, referring to fig. 11, in S111, the folded gaze detection module may send a status request message a to the power manager, such as the status request message a may include powermanager. In response to the status request message a, in S112, the power manager may return a value corresponding to the current on-off screen status to the folded gaze detection module, such as "true" for on-screen and "false" for off-screen. Then, based on the return value, the folded gaze detection module may know whether the current screen state is bright.

In further examples, referring to fig. 12, in S121, the folded gaze detection module may further send a status request message B to the lock screen manager, such as the status request message B may include keyguard manager. In response to the state request message B, in S122, the lock screen manager may return a value corresponding to the current lock screen state to the folding gaze detection module, return true representing lock screen, and return false representing unlock screen. Then, based on the return value, the folded gaze detection module may know whether the current screen state is locked.

It should be noted that, in different implementations, the interaction time of the folding gaze detection module with the power manager and the screen lock manager may be different. For example, in some embodiments, the folding gaze detection module may interact with the power manager to determine whether to lock the screen after determining that the current screen state is a bright screen. Therefore, under the condition that the current screen state is the screen off state, the folding watching detection module does not need to interact with the screen locking manager, and therefore signaling overhead and corresponding power consumption in the electronic equipment are saved. In other embodiments, the folding gaze detection module may interact with the screen lock manager, and after determining that the current screen state is unlocked, interact with the power manager to determine whether to turn off the screen. Therefore, under the condition that the current screen state is the screen locking state, the folding watching detection module does not need to interact with the power supply manager, and therefore signaling overhead and corresponding power consumption in the electronic equipment are saved. In other embodiments, the folding gaze detection module may further send respective corresponding status request messages to the power manager and the screen locking manager at the same time, so as to quickly obtain the current on/off screen status and the screen locking status, thereby saving time and expense.

Therefore, after the folding screen mobile phone is folded, if the screen is not locked or turned off, whether the electronic device is rapidly turned off or not can be considered.

In other embodiments, the folding screen handset may determine whether the user is using the folding screen handset based on whether the user is currently on the call.

It can be appreciated that if the folding screen handset is providing a call service to a user before folding, the call service does not stop as the folding screen handset enters the folded state until the user or the opposite end user hangs up the current call. During the conversation, the user may need to use other functions provided by the folding screen mobile phone through the interface. Illustratively, FIG. 13 shows an illustration of a call interface displayed on an external screen. A plurality of expanded function icons can be included on the call interface. Such as 131. During the call, the user can record the audio of the current call by touching or clicking the recording icon 131. As another example, 132 corresponds to a contact icon. During the call, the user can view the address book by touching or clicking the contact icon 132. Then, if a fast screen-off is performed during this process, the user's use of the above-described functions may be affected.

In this embodiment of the application, the folding gaze detection module may be further configured to obtain a current call state. For example, the call state may include an un-call state, a call state (or called a state in call), a hang-up state between the call state and the un-call state, and the like.

Illustratively, the folding gaze detection module may obtain the call state by interacting with the call manager.

In this example, as shown in fig. 14, in S141, the folding gaze module may register with the call manager to listen for call state monitoring (e.g., phonestateilist) so that the call manager may send the corresponding call state to the folding gaze module.

In some embodiments, the collapsed registration detection module may carry a callback method of the hope call manager return message in registration request C (or referred to as a third registration request) at registration listening. For example, the folded gaze module may carry the onCallStateChanged callback method in the registration request C. In this way, in S142, the call manager may send a corresponding state change message D to the folded attention module when the call state changes. For example, a value (e.g., a value of state) for instructing to switch to a certain state may be included in the state change message D. If the state is 0 (corresponding to the sixth identifier), the non-call state is correspondingly entered, that is, the call is already ended. If the state is 1 (corresponding to the fifth identifier), the call state is correspondingly entered, that is, the call connection is already established, and both parties can already start the call. If the state is 2 (corresponding to the seventh identifier), the hang-up state is correspondingly entered, that is, the call connection is disconnected, that is, the non-call state is to be entered.

The folding registration detection module can use the call state corresponding to the current new state change message D to cover the previous call state every time the folding registration detection module receives a state change message D, so as to ensure that the current stored call state is the latest state.

Thus, if the folding screen mobile phone is in a call, the user is determined to be using the folding screen mobile phone, and the quick screen-off is not executed correspondingly. On the contrary, if the current folding screen mobile phone does not have a call, the execution of the fast screen off can be considered, and the power consumption is saved.

In other embodiments, the folding screen phone may determine whether the user is using the folding screen phone based on whether the camera is in use.

With reference to the examples of fig. 1 and fig. 2, a plurality of cameras may be disposed on the folding screen mobile phone. For example, the plurality of cameras may include an inner screen camera, an outer screen camera, a rear camera, and the like. In this example, the foldable screen may determine that the user is not using the image capture-related function of the foldable screen mobile phone when the camera is not in use, and then may consider performing a fast screen-off.

It can be understood that the folding screen mobile phone can acquire images through any one or more cameras arranged therein, and provide related functions for users based on the acquired images. For example, a folding screen mobile phone can provide a shooting function through a camera. Such as self-timer shooting using an external screen camera, or shooting using a rear camera, etc. For another example, a folding screen mobile phone can provide a code scanning function through a camera. For example, a rear camera is used for scanning a target two-dimensional code, a bar code and the like to obtain related information. When the camera of the folding screen mobile phone is in use, the user is indicated to use the corresponding function. Therefore, in this example, when any one of the cameras on the folding-screen mobile phone is operated, quick screen-off cannot be performed.

In this embodiment of the application, the folding gaze detection module may be further configured to acquire a current working state of each camera. Such as active or inactive.

Illustratively, the folded gaze detection module may interact with the camera manager to obtain the operating state of each camera. In this example, as shown in fig. 15, similarly to acquiring the on-off screen state and the screen locking state, in S151, the folded gaze detection module may also acquire the operating state of each camera by means of registration monitoring.

In some embodiments, the collapsed registration detection module may carry a callback method in registration request E (or referred to as a second registration request) that wants the camera manager to return a message when listening to the camera manager registration. For example, the fold gaze module may carry the camera manager. In this way, when the operating state of the camera changes, the camera manager may send a corresponding state change message F to the folded gaze module in S152. For example, the status change message F may include onCameraAvailable and/or oncameraumavailable. The onCameraAvailable is used for indicating the registration of the camera, and the onCameraUnavailable is used for indicating the deregistration of the camera.

In the present application, each of the plurality of cameras may correspond to one camera ID. Both the oncamera available (for example, referred to as a third identifier) and the oncamera unavailable (for example, referred to as a fourth identifier) returned by the camera manager may carry the ID of the corresponding camera. For example, the camera manager returns oncamera available (1), indicating that the camera with ID 1 starts to operate. As another example, the camera manager returns oncamera available (3), indicating that the camera with ID 3 stops working.

The folding registration detection module can update the working state of the corresponding camera by using the current new state change message F every time the folding registration detection module receives a state change message F from the camera manager, so as to ensure that the currently stored working state of each camera is the latest state.

Therefore, after the folding screen mobile phone is folded, if the camera is in the working state, the electronic equipment indicates that the user is using the folding screen mobile phone, and the electronic equipment does not execute the quick screen turning-off. On the contrary, if each camera is in a non-working state, for example, the latest working state of each camera is transmitted through the oncamera unavailable, then it can be considered to perform fast screen-off, and power consumption is saved.

In other embodiments, the folding screen phone may determine whether the user is using the folding screen phone based on whether the user is currently looking at the screen.

It will be appreciated that a user will typically look at the screen when using a folding screen handset. Correspondingly, the outer screen of the folding screen mobile phone can be in a bright screen state, and the content which the user needs to watch is displayed on the interface of the folding screen mobile phone. Conversely, if the user is not looking at the screen, this indicates that the user may not have the intent to use a folding screen handset.

While the user may alternately look at the screen and not look at the screen during the use of the folded screen phone. If the user has the intention of using the folding screen mobile phone, the user can watch the screen for a long time, and correspondingly, the duration of continuously not watching the screen is not too long. In the embodiment of the application, after the screen is watched by the user is detected, if the duration that the user does not continuously watch the screen within a period of time exceeds a preset non-watching threshold, the folding screen mobile phone confirms that the user does not watch the screen. Correspondingly, if the duration that the user does not continuously watch the screen is less than the preset non-watching threshold value in the time period (namely the maximum detection duration), the intention of the user to use the folding screen mobile phone is indicated, the rapid screen-off can not be executed, and the interference on the use of the user is avoided.

For example, if the duration that the user does not continuously watch the screen within 4s exceeds 2s, the user is considered not to watch the screen. Fig. 16 shows a schematic representation of this scheme. After time T0, the user gazes at the screen for a short period of time and no longer gazes at the screen. Next, the gazing screen and the non-gazing screen appear alternately. For example, the user does not look at the screen for a duration L1 in the time period T1-T2 within 4s after T0. During the time period T2-T3, the user continues to look at the screen. The user is not looking at the screen for a duration L2 within the time period T3-T4. Next, the duration L3 of the non-gazing screen also alternates.

In this example, the folding screen mobile phone may detect whether the duration of continuous non-watching of the screen by the user exceeds a preset duration of 2s from time T0. For example, starting from the time T0, the folding screen mobile phone detects L1 in the time period T1-T2, the user does not watch the screen, and the L1 is less than the preset 2s, and the detection is continued. The folding screen mobile phone detects that the L2 is in the time period of T3-T4, the user does not watch the screen, and the L2 is larger than the preset 2s, so that the folding screen mobile phone can consider that the user does not watch the screen. In some embodiments, the folding screen phone may cease detecting whether the user is gazing at the screen when it determines at time T4 that the user is not gazing at the screen.

Of course, in the example of fig. 16, if L2 is still less than the preset 2s, the folding screen phone may continue to check whether the user is looking at the screen until the maximum duration of check for T0+4s is calculated from the time T0. If all of L1, L2, and L3 are smaller than the preset 2s, the folding-screen phone can confirm that the user has an intention to use the folding-screen phone.

It should be noted that, in the above example, the maximum detection time length 4s and the time length 2s of the continuous non-watching screen are all examples. In other implementations of the present application, the maximum detection duration and the duration of continuous non-watching screen can be flexibly set according to actual situations.

In the above example, the case where the folding-screen mobile phone detects the user's gaze on the screen is illustrated as an example. With reference to the descriptions of fig. 5 and fig. 6, in some implementations of the present application, a folded gaze detection module disposed in a folding screen mobile phone may implement detection of a user gaze situation by interacting with an AO module.

Illustratively, as shown in fig. 17. When gaze detection of the user is required, the folded gaze detection module may register eye gaze detection with the AO module in S171. In some embodiments, the folded gaze detection module may send a registration request G (or referred to as a first registration request) to the AO module for registering eye gaze detection. For example, the registration request G may enable registration of eye gaze detection by an aware client. In this registration request G, a method may be carried that wants the AO-module to return information. For example, the registration request G may carry a feceeventlistener callback method, and instruct the AO module to return the human eye gaze detection result in a manner corresponding to the onEvent. Correspondingly, in S172, when the state of the gaze and the non-gaze of the human eye is changed, the AO module may correspondingly return to the state change message H. Illustratively, the result of the human eye gaze state change may be encapsulated in the state change message H by a fecevent. Correspondingly, the folded gaze detection module may, upon receiving the state change message H, look for an entry for a fecevenet. In the found item, an identifier (e.g. true, or referred to as a first identifier) for indicating that the current user gazes at the screen or an identifier (e.g. false, or referred to as a second identifier) for indicating that the current user does not gaze at the screen may be included. It should be appreciated that the duration between the receipt of the second indication that the user is currently not looking at the screen and the receipt of the next first indication that the user is currently looking at the screen (e.g., referred to as the first duration) may be the duration of one continuous non-looking screen for the user. If the user is in the maximum detection duration, if the last identifier received is the second identifier, the duration from the time the second identifier is received to the end of the maximum detection duration (e.g., referred to as the second duration) may also correspond to the duration that the user does not look at the screen continuously once.

In connection with fig. 16, at time T0, the folded gaze detection module may send a registration request G to the AO module. Correspondingly, the AO module starts to provide the folded gaze module with information about whether the human eye is gazing at the screen or not. For example, at time T0 when registration request G is received, the AO module may return a state change message H carrying true to the folded gaze module, indicating that the user is gazing at the screen. At time T1, the AO module may return a status change message H carrying false to the fold gaze module indicating that the user is no longer gazing at the screen. Beginning at this point, the folded gaze detection module begins timing until the next state change message H carrying true is received at time T2. The folded gaze detection module may determine that the user is beginning to gaze at the screen. Then the folded gaze detection module may determine the magnitude relationship between the duration L1 between time T2 and time T1 and a preset non-gaze threshold (2 s as in the above example), and continue detection if L1 is less than 2 s. So repeatedly, the folded gaze detection module may receive a status change message H carrying false at time T3, indicating that the user is no longer gazing at the screen. The folded gaze detection module starts timing until the next state change message H carrying true is received at time T4. The folded gaze detection module may determine a magnitude relationship between a duration L2 between time T4 and time T3 and a preset non-gaze threshold (e.g., 2s in the above example), and if L2 is greater than 2s, stop the detection, determine that the user has not gazed at the screen for a long time, that is, the user has not an intention to continue using the folded-screen phone, and may consider triggering a fast screen-off. If L2 is still less than 2s, the above detection process is repeated until a continuous non-fixation threshold greater than 2s occurs, or a maximum detection duration is reached, and detection may be stopped by sending a de-registration request (e.g., referred to as a first de-registration request).

In some embodiments, upon cessation of detection, if it is determined that L2 is greater than 2s, and if the maximum detection duration is reached, the folded gaze detection module may send a deregistration message to the AO module instructing the AO module to no longer provide eye gaze detection functionality to the folded gaze detection module.

Therefore, if the time that the human eyes continuously watch the screen is longer than the preset non-watching threshold value, the rapid screen turn-off can be considered, and the power consumption is saved.

With reference to the foregoing descriptions of fig. 7A to fig. 17, the embodiment of the present application provides at least 6 dimensions, so that the foldable screen mobile phone can only detect and determine the usage intention of the user through the foldable gaze detection module, and further determine whether to trigger the fast screen-off. As an example, when it is determined that a fast screen-off is triggered, the folding gaze detection module may send a screen-off indication to the power management module, so that the power management module turns off the screen, and saves screen-on power consumption. For example, the screen-off indication may include a powermanager.

In addition, in the above examples, the description is given by taking an example in which the foldable screen mobile phone is folded to perform rapid screen-off of the external screen. Then, the trigger mechanism of this solution may be set to bring the folding screen mobile phone into a folded state.

Illustratively, as shown in fig. 18, the folded gaze detection module may interact with the device state manager to obtain the current state of the folded screen. So that when the folded state is determined to be currently entered, the judging mechanism is triggered to determine whether to execute the quick screen-off. For example, in S181, the folded gaze detection module may register listening with the device state manager, such as sending a registration request I (e.g., referred to as a fourth registration request). The registration request I may carry a devicestatemanager devicestatecallback callback, instructing the device state manager to notify the folding gaze detection module of a change in the current folding state by using a callback method onStateChanged. Correspondingly, in S182, the device status manager may return a status change message J to the folded gaze detection module when the registration request I is received and the subsequent folded status is changed, where the status change message J may carry an identifier indicating the current folded status. If the flag is 1, the current folding state is unfolding, that is, the folding angle is 180 degrees. If the mark is 2 (corresponding to the eighth mark), the current folding state is folding, that is, the folding angle is 0 degree.

The folding gaze detection module may trigger the above-described determination of whether to perform a fast screen-off or not, each time an indication is received that the current folding state is folded.

It should be noted that, in a specific implementation, the display content of the external screen interface provided in the foregoing description, whether the electronic device turns off the screen, whether the electronic device locks the screen, whether the electronic device is in a call, whether the electronic device uses a camera, and whether the user is watching the application sequence of the display screen may be flexibly set.

For example, in some embodiments, the folding gaze detection module may sequentially execute display contents of the external screen interface, whether the electronic device is turned off, whether the electronic device is locked, whether the electronic device is in a call, whether the electronic device uses a camera, and whether a user is gazing at 6 dimensions of the display screen, and trigger a fast screen turn-off when the determination results of all the dimensions are that the user does not have an intention to use.

In other embodiments, the folding gaze detection module may sequentially execute display content of the external screen interface, whether the electronic device is turned off, whether the electronic device is locked, whether the electronic device is in a call, and whether the electronic device uses a camera, where any two or more of the judgments may be performed in parallel, and when any one of the judgments is that the user has an intention to use, the judgments of other dimensions are stopped, it is determined that the user has an intention to use, and the quick turn-off of the screen is not triggered. And when the judgment results of all the 5 dimensions are that the user has no use intention, continuing to judge whether the user is watching the display screen, and if the conclusion is that the user still has no use intention, triggering the quick screen-off. In this way, the interaction process with the more complex AO module is set after all other judgments, so that if any one of the other judgments determines that the user has the use intention, the interaction of the AO module does not need to be executed, thereby saving the corresponding overhead.

In other embodiments, the folded gaze detection module may further select at least one dimension of the above 6 dimensions to determine whether the user has an intention to use. In the scheme of selecting multiple dimension judgments, under the condition that all dimensions indicate that the user has no use intention, the quick screen-off is triggered.

It should be noted that, in a specific implementation, the serial detection time of 5 dimensions, that is, the display content of the external screen interface, whether the electronic device is turned off, whether the electronic device is locked, whether the electronic device is in a call, and whether the electronic device uses the camera, does not exceed 1 s. And the detection time of whether the user is looking at the display screen may be set to not more than 4s (i.e., the maximum detection time period). Then, under the condition that the judgment results of all dimensions are that the user does not intend to use, the folding screen mobile phone can realize quick screen turn-off within 5 s. Fig. 19 shows a comparison with a prior art screen-out solution. Take the existing screen-out scheme as the time-out screen-out scheme shown as 31 in fig. 3 as an example. The folding screen mobile phone enters a folding state within 0s, correspondingly, under the condition of adopting the scheme, the folding screen mobile phone can enter a screen-off state within 5s at the shortest time, and the folding screen mobile phone can enter the screen-off state after 15s by adopting an overtime screen-off scheme. It can be seen that by adopting the scheme, the bright screen power consumption can be saved by at least 10 s.

In order to more clearly explain the scheme provided by the embodiment of the present application, the interaction between the modules is exemplarily described below by taking a serial judgment of 6 dimensions as an example with reference to the interaction diagram of each module shown in fig. 20.

As shown in fig. 20, the scheme may include:

s201, the folding gaze detection module registers and monitors to the equipment state manager.

Illustratively, the operating system of a folding screen handset will start the SystemServer process when the system is started (e.g., when the system is powered on). In the present application, the HnSwingFoldAOHub thread (i.e., the folded gaze detection module) may be pulled up in the SystemServer process.

The HnSwingFoldAOHub thread may register a DeviceStateManager, devicestatepcallback callback, at startup, instructing the DeviceStateManager (i.e., the device state manager) to notify the HnSwingFoldAOHub thread whether a folder cell phone is folded.

S202, the device state manager sends the folding state of the folding screen to the folding gaze detection module.

For example, DeviceStateManager may return the current collapsed state to the HnSwingFoldAOHub thread when the HnSwingFoldAOHub thread registers DeviceStateManager. DeviceStationeMenager may also update the collapsed state to the HnSwingFoldAOhub thread when the collapsed state changes.

And S203, the folding gaze detection module stores/updates the folding state of the folding screen.

Illustratively, upon receiving the collapsed state, the HnSwingFoldAOHub thread may store the collapsed state and update the collapsed state each time a new collapsed state is received.

In this example, the execution process of S201-S203 may refer to the description of fig. 18.

And S204, registering and monitoring the camera manager by the folding gaze detection module.

For example, the HnSwingFoldAOHub thread may register a CameraManager availabiliitycalback callback at startup, instructing the CameraManager (i.e., camera manager) to notify the HnSwingFoldAOHub thread of camera registration and de-registration events via onCameraAvailable and oncamerauuvailable.

And S205, the camera manager sends the working state of the camera to the folding gaze detection module.

For example, the CameraManager may return the current operating status of each camera to the HnSwingFoldAOHub thread when the HnSwingFoldAOHub thread registers CameraManager. If the working state of the inner screen camera, the working state of the outer screen camera and the working state of the rear camera are included. The Camera manager can also update the working state of the camera to the HnSwingFoldAOhub thread when the working state of the camera is changed.

And S206, the folding gaze detection module stores/updates the working state of the camera.

For example, after receiving the folded state, the HnSwingFoldAOHub thread may store each camera operating state and update the corresponding camera operating state each time a new camera operating state is received.

In this example, the execution process of S204-S206 can refer to the description of fig. 15.

And S207, registering and monitoring the call manager by the folding gaze detection module.

For example, the HnSwingFoldAOHub thread may register a phonestalistener callback at startup, instructing TelephonyManager (i.e., call manager) to notify the HnSwingFoldAOHub thread of the current call state via callback method oncallstatechange.

And S208, the call manager sends the call state to the folding gaze detection module.

Illustratively, TelephonyManager may return the current call state to the HnSwingFoldAOHub thread when the HnSwingFoldAOHub thread registers a PhoneStateListener callback. TelephonyManager may also update the call state to the HnSwingFoldAOhub thread when a change in call state occurs.

And S209, the folding gaze detection module stores/updates the call state.

For example, the HnSwingFoldAOHub thread may store call states after receiving a folded state and update the stored call states each time a new call state is received.

In this example, the execution process of S207-S209 can refer to the description of fig. 14.

In the above example, the registration process to the device state manager, the camera manager, and the call manager is performed when the folded gaze detection module is started. In other implementations, any of the three registration processes described above may also be completed after the folded gaze detection module is initiated.

In this example, when the folded gaze detection module determines that the current folded screen state is the folded state, execution of S210 below may be triggered.

S210, the folding gaze detection module judges whether the current interface is in an interface white list. If not, S211 is executed. If so, the flow is stopped. The execution of S210 is triggered again until the next time the screen folding state is the folding state.

For example, the execution process of S210 may refer to the execution processes and descriptions of fig. 8 and fig. 9.

S211, the folding gaze detection module sends a status request message a to the power manager.

S212, the power manager sends a value corresponding to the current on-off screen state to the folding gaze detection module.

S213, the folding gaze detection module judges whether the screen is turned off currently. If not, S214 is performed. If so, the flow is stopped. The execution of S210 is triggered again until the next time the screen folding state is the folding state.

For example, the execution processes of S211 to S213 may refer to the execution process and description of fig. 11.

And S214, the folding gaze detection module sends a state request message B to the screen locking manager.

S215, the screen locking manager sends a value corresponding to the current screen locking state to the folding gaze detection module.

S216, the folding gaze detection module judges whether the screen is locked currently. If not, S217 is performed. If so, the flow is stopped. The execution of S210 is triggered again until the next time the screen folding state is the folding state.

For example, the execution of the steps S214 to S216 may refer to the execution and description of fig. 12.

S217, the folding gaze detection module judges whether the camera is used.

For example, the HnSwingFoldAOHub thread may determine whether the camera is in use through the camera status stored/updated in S206. If all the cameras are not used, that is, if the judgment result is no, S218 is executed. Otherwise, if there is at least one camera in use, the flow is stopped. The execution of S210 is triggered again until the next time the screen folding state is the folding state.

S218, the folding gaze detection module judges whether the call is in progress.

For example, the hnswing foldaohub thread may determine whether the current call state is present through the camera state stored/updated in S209. If the mobile terminal is not in the call state, such as in the non-call state or the hang-up state, i.e., if the determination result is negative, S219 is executed. Otherwise, if the mobile terminal is in the on-call state, the flow is stopped. The execution of S210 is triggered again until the next time the screen folding state is the folding state.

S219, the folding gaze detection module registers the human eye gaze detection with the AO module.

For example, the HnSwingFoldAOHub thread may register the eye gaze detection through an aware client, so that the AO module returns a corresponding eye gaze detection result through a FenceEventListener callback method onEvent method.

And S220, the AO module sends a state change message H to the folding gaze detection module.

For example, the AO module may return the current user's gaze situation to the HnSwingFoldAOHub thread when the HnSwingFoldAOHub thread registers eye gaze detection. The AO module may also change the gaze state of the user to the HnSwingFoldAOHub thread when the gaze state changes.

S221, the folding gaze detection module judges whether gaze is continuously not watched. If the judgment result is no, the following S222 is executed. Otherwise, if the rule of continuous non-fixation is not met, the flow is stopped. The execution of S210 is triggered again until the next time the screen folding state is the folding state.

In this example, the execution processes of S219 to S221 may refer to the execution processes and descriptions of fig. 16 to fig. 17 described above.

S222, the folding gaze detection module sends a screen-off instruction to the power management module.

For example, the HnSwingFoldAOHub thread may instruct the power manager to perform the screen-off process by using a powermanager.

In the description of fig. 20, if the result of the determination at any one of the determining steps corresponds to the user' S intention, the process may return to S210 to wait for the next time the folded screen state is changed to the folded state, thereby triggering the fast screen-off scheme. In some embodiments of the application, under the condition that the judgment result of any one of the judgment steps corresponds to the user's intention, the foldable mobile phone may further enter other screen-off schemes before the next folding screen state is changed into the folding state. For example, in a case that the judgment result of any judgment step corresponds to the user's intention, before the state of the foldable screen is changed to the foldable state next time, the foldable mobile phone may enter the scheme shown in 31 in fig. 3 for turning off the screen after the preset time period. Then, the foldable cellular phone may also enter the screen-out state if the user does not input any operation for a preset time period (e.g., 15s) before the next time the screen-folding state is changed to the folding state. Of course, if the user inputs the screen-off operation shown as 32 in fig. 3 when any of the foregoing steps is performed, then the foldable mobile phone can be directly put into the screen-off state.

With reference to the description of fig. 20, the following describes aspects provided by embodiments of the present application from the perspective of electronic devices. For example, please refer to fig. 21. The method for displaying the screen-off state of the electronic equipment provided by the embodiment of the application is schematically described in the following. As shown in fig. 21, the scheme may include:

s2101, the electronic equipment enters a folded state.

S2102, the electronic equipment determines that the interface is not in the interface white list before displaying.

S2103, the electronic equipment determines that the electronic equipment is not in the screen-off state or the screen-locking state currently.

S2104, the electronic device determines that it is not currently in a call and the camera is not used.

S2105, the electronic device determines that the user is not continuously gazing at the screen.

S2106, the electronic equipment controls the display screen to be turned off.

It should be understood that each step of the scheme shown in fig. 21 corresponds to each step in the above-mentioned scheme and fig. 20, and therefore specific implementation processes in the steps may refer to each other, and beneficial effects that can be obtained are similar, and are not described herein again.

It should be noted that, the technical solutions provided in the embodiments of the present application may be preset in an electronic device and automatically executed. In other embodiments, the electronic device may also provide a first-closing setting interface for the user, so that the user can set the setting according to needs.

Illustratively, as shown in fig. 22, in a setting interface (e.g., interface 2201 shown in fig. 22) of the electronic device, personalized setting tags for various functions of the electronic device may be included. A label 2202 for adjusting display and brightness, among other things, may be included. The user may click or touch the tab 2202 and, correspondingly, the electronic device may display the particular contents of the display and intensity tab 2202 in the right expansion bar. For example, in an expansion bar of the display and brightness tab 2202, multiple options for turning off the screen after closing the folding screen phone may be displayed. In this example, the multiple screen-out schemes may include a scheme option of "bright screen while looking at the outer screen". Then the user activates the scenario by clicking on the tab 2203 corresponding to the scenario option. Therefore, according to the screen-off scheme provided by any one of the embodiments of the present application provided in the above description, when it is determined that the user does not intend to use, the electronic device may perform a fast screen-off, so as to save power consumption and prolong the service life of the electronic device.

An example of the setting interface in fig. 22 is illustrated by displaying through an inner screen (i.e., a folding screen). It should be understood that the folding screen mobile phone may also provide an interface for opening the screen-off scheme provided by the embodiments of the present application on the external screen.

It should be noted that, in some embodiments, the folding-screen mobile phone may determine whether the user continuously watches the screen for more than a preset non-watching threshold within the maximum detection duration through the interaction between the AO module and the folding-watching detection module. If yes, the user is determined not to use the mobile phone in a short time, and the quick screen-off triggering can be considered. In this implementation, the folding screen phone may invoke a camera to determine the condition of the user looking at the screen. Then, in some implementations of the application, when the user indicates that the foldable screen mobile phone is turned on to watch without turning off the screen, the foldable screen mobile phone may call the camera to determine the condition that the user watches the screen after the user is authorized.

The above description mainly introduces the solutions provided in the embodiments of the present application from the perspective of each service module. To implement the above functions, it includes hardware structures and/or software modules for performing the respective functions. Those of skill in the art would readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation.

Fig. 23 is a schematic diagram showing a composition of an electronic apparatus 2300. As shown in fig. 23, the electronic device 2300 may be provided with a folding screen. The electronic device 2300 may further include: a processor 2301 and a memory 2302. The memory 2302 is used to store computer executable instructions. For example, in some embodiments, the processor 2301, when executing the instructions stored in the memory 2302, can enable the electronic device 2300 to perform any one of the electronic device off-screen display methods described in the above embodiments.

It should be noted that all relevant contents of each step related to the above method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again.

Fig. 24 shows a schematic diagram of a chip system 2400. The chip system 2400 may include: processor 2401 and communication interface 2402 may be used to enable a related device (e.g., a folding screen mobile phone) to implement the functions described in the embodiments above. In one possible design, the chip system further includes a memory for storing necessary program instructions and data for the folding screen handset. The chip system may be constituted by a chip, or may include a chip and other discrete devices. It should be noted that in some implementations of the present application, the communication interface 2402 can also be referred to as an interface circuit.

The functions or actions or operations or steps, etc., in the above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using a software program, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The procedures or functions described in accordance with the embodiments of the present application are all or partially generated upon loading and execution of computer program instructions on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website, computer, server, or data center to another website, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or can comprise one or more data storage devices, such as a server, a data center, etc., that can be integrated with the medium. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

Although the present application has been described in conjunction with specific features and embodiments thereof, it will be evident that various modifications and combinations can be made thereto without departing from the spirit and scope of the application. Accordingly, the specification and figures are merely exemplary of the present application as defined in the appended claims and are intended to cover any and all modifications, variations, combinations, or equivalents within the scope of the present application. It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include such modifications and variations.

Claims

1. A screen-off display method for electronic equipment is characterized by being applied to the electronic equipment which is provided with a folding screen, and the method comprises the following steps:

when the electronic device is in an unfolded state, a first interface is displayed on an inner screen of the electronic device, the first interface comprises a first part and a second part, the first part comprises a first element set, and the second part comprises a second element set,

receiving a first operation of a user, wherein the first operation is used for triggering the electronic equipment to fold,

responding to the first operation, and displaying a second interface on an external screen; the second interface comprises the first element set and a second element set, or the second interface comprises the first element set, and a first part corresponding to the first element set is a focus interface of the first interface;

and controlling the outer screen to be turned off under the condition that the user does not continuously watch the outer screen.

2. The method of claim 1, wherein prior to said controlling said outer screen out, said method further comprises: determining that the user is not continuously gazing at the outer screen.

3. The method according to claim 1 or 2, wherein the user is determined not to continuously look at the external screen when the maximum detection time after the electronic device is folded includes at least one time when the time during which the user does not continuously look at the external screen is greater than a non-watching threshold value.

4. The method of claim 3, wherein the electronic device has smart sensing capabilities that provide human eye gaze detection functionality, the electronic device comprising a folded gaze detection module;

after the electronic device is folded, the method further comprises:

the folded gaze detection module sending a first registration request to the smart perception capabilities, the first registration request for registering eye gaze detection,

respond to first registration request, when the user gazes the condition and changes, wisdom perception ability to folding gazing detection module feedback first sign or second sign, first sign is used for instructing the user to gaze the condition change and gazes for the user, the second sign is used for instructing the user to gaze the condition change and not gazes for the user.

5. The method of claim 4, wherein the determining that the user is not continuously gazing at the outer screen comprises:

the folding gaze detection module counts a first time length between the second identifier and the next first identifier within a maximum detection time length, wherein the first time length is a time length for which the user does not continuously gaze the external screen for one time;

determining that the user is not continuously gazing at the outer screen when there is at least one of the first time periods greater than the non-gazing threshold.

6. The method of claim 5, wherein if the last received identifier of the folded gaze detection module is the second identifier within the maximum detection duration, the method further comprises:

and the folding gaze detection module counts a second time length between the last second identification received and the maximum detection time length, and determines that the user does not continuously gaze the external screen when the second time length is greater than the non-gaze threshold.

7. The method of claim 5 or 6, wherein upon determining that the first time period is greater than the non-gaze threshold, the method further comprises:

the folded gaze detection module sends a first de-registration request to the smart perception capabilities, the first de-registration request for de-registering eye gaze detection,

in response to the first de-registration request, the smart perception capability no longer feeds back the first or second identification to the folded gaze detection module.

8. The method according to any one of claims 1 to 7, wherein a whitelist of interfaces is preset in the electronic device, the whitelist of interfaces includes interface information of at least one interface, the interface information includes a package name and a class name of a corresponding interface, and the package name and the class name of the second interface are not included in the whitelist of interfaces;

prior to controlling the outer screen out, the method further comprises:

determining that the interface information of the second interface is not in the interface white list.

9. The method of claim 8, wherein a folded gaze detection module is disposed in the electronic device,

the determining that the interface information of the first interface is not in the interface white list comprises:

the folding gaze detection module obtains interface information of the current interface from a window manager of the electronic device to obtain interface information of the first interface,

and the folding gaze detection module searches the interface white list according to the interface information of the first interface and determines that the interface information of the first interface is not in the interface white list.

10. The method according to any one of claims 1-9, wherein at least one camera is provided in the electronic device, and before controlling the outer screen to be extinguished, the method further comprises:

it is determined that all cameras are not used.

11. The method of claim 10, wherein a folded gaze detection module is disposed in the electronic device,

the determining that the at least one camera is not used comprises:

the folding gaze detection module sends a second registration request to a camera manager of the electronic device, wherein the second registration request is used for acquiring the working state of each camera in the at least one camera, and the working state of each camera comprises working state and non-working state;

responding to the second registration request, when the working state of each camera is changed, the camera manager sends a camera state change message to the folding gaze detection module, wherein the camera state change message comprises an identifier of the corresponding camera and a third identifier or a fourth identifier, the third identifier is used for indicating that the working state of the camera is changed into working, and the fourth identifier is used for indicating that the working state of the camera is changed into non-working;

the folding gaze detection module stores or updates the working state of each camera according to the received camera state change message;

and when the working states of all the cameras are not working, determining that all the cameras are not used.

12. The method of any of claims 1-11, wherein prior to controlling the outer screen out, the method further comprises:

determining that the electronic device is not in a call.

13. The method of claim 12, wherein a folded gaze detection module is disposed in the electronic device,

the determining that the electronic device is not in a call includes:

the folding gaze detection module sends a third registration request to a call manager of the electronic equipment, wherein the third registration request is used for acquiring call states of the electronic equipment, and the call states comprise in-call, no-call and hang-up;

responding to the third registration request, when the call state of the call manager changes, sending a fifth identifier, a sixth identifier or a seventh identifier to the folding gaze detection module, wherein the fifth identifier is used for indicating that the call state changes to a call, the sixth identifier is used for indicating that the call state changes to a non-call, and the seventh identifier is used for indicating that the call state changes to a hang-up;

the folding gaze detection module stores or updates the call state according to the received fifth identifier, sixth identifier or seventh identifier; when the current call state is on-hook or not on-call, determining that the electronic equipment is not in the call; or,

and when the folding gaze detection module determines that the identifier of the finally received call state is the sixth identifier or the seventh identifier, determining that the electronic equipment is not in the call.

14. The method of any of claims 1-13, wherein prior to controlling the outer screen to turn off, the method further comprises:

and determining that the current screen is not turned off and is not locked.

15. The method of claim 14, wherein a folded gaze detection module is disposed in the electronic device,

the determining that the outer screen is not turned off comprises:

the folding gaze detection module acquires a screen on/off state of a current screen from a power manager of the electronic device, wherein the current screen is a screen providing a display function for a user;

the folding gaze detection module determines that the outer screen is not extinguished according to the screen on-off state fed back by the telephone manager as a screen on-off state;

the determining that the external screen is unlocked includes:

the folding gaze detection module acquires a screen locking state of a current screen from a screen locking manager of the electronic device, wherein the current screen is a screen providing a display function for a user;

and the folding gaze detection module determines that the external screen is not locked according to the screen locking state fed back by the telephone manager as the current screen is not locked.

16. The method of any of claims 1-15, wherein prior to the controlling the outer screen out, the method further comprises:

determining that the folding screen electronic device is folded.

17. The method of claim 16, wherein the determining that the folding screen electronic device is folded comprises:

the folding gaze detection module sends a fourth registration request to an equipment state manager of the electronic equipment, wherein the fourth registration request is used for acquiring a folding state of the folding screen, and the folding state of the folding screen comprises folding, half-folding and unfolding;

in response to the fourth registration request, when the state of the folding screen is changed to be folded, the call manager sends an eighth identifier to the folding gaze detection module, where the eighth identifier is used to indicate that the folding screen is folded,

and the folding gaze detection module determines that the folding screen electronic equipment is folded according to the received eighth identifier.

18. An electronic device, characterized in that the electronic device comprises one or more processors and one or more memories; the one or more memories coupled with the one or more processors, the one or more memories storing computer instructions;

the computer instructions, when executed by the one or more processors, cause the electronic device to perform the electronic device screen-off display method of any of claims 1-17.

19. A computer-readable storage medium comprising computer instructions which, when executed, perform the electronic device screen-off display method of any of claims 1-17.

20. A computer program product, characterized in that the computer program comprises instructions which, when executed by a computer, perform the electronic device screen-off display method according to any of claims 1-17.

21. A chip system, comprising a processor and a communication interface; the processor is used for calling and running a computer program stored in a storage medium from the storage medium, and executing the electronic device screen-off display method according to any one of claims 1-17.