WO2020087504A1

WO2020087504A1 - Screenshot interaction method, electronic device, and computer-readable storage medium

Info

Publication number: WO2020087504A1
Application number: PCT/CN2018/113700
Authority: WO
Inventors: 李欠欠
Original assignee: 深圳市柔宇科技有限公司
Priority date: 2018-11-02
Filing date: 2018-11-02
Publication date: 2020-05-07
Also published as: CN112889020A

Abstract

A screenshot interaction method, an electronic device (50), and a computer-readable storage medium. The method comprises: receiving a screenshot instruction for acquiring content displayed in a first display region of a display screen (100); in response to the screenshot instruction, acquiring a screenshot image (102); and displaying the screenshot image in the first display region, and displaying an operation control associated with the screenshot image in a second display region of the display screen (104), wherein the second display region and the first display region are located at different regions of the display screen. According to the method, a screenshot image is displayed in a first display region, and an operation control is displayed in a second display region different from the first display region, such that a user can perform, in the second display region, an interaction operation corresponding to a screenshot, thereby simplifying user operations.

Description

Screen capture-based interaction method, electronic device and computer-readable storage medium

Technical field

The present invention relates to the field of communications, and in particular to an interactive method based on screenshots, an electronic device, and a computer-readable storage medium.

Background technique

The existing operation method of the mobile terminal electronic product after taking a screenshot will reduce the screenshot to a certain extent, so that the screenshot image and the virtual buttons for sharing and editing are displayed in the current interface; wherein, the virtual buttons for sharing and editing are generally displayed In the current interface, other display areas than the display area of the screenshot image. After editing the screenshot image, if you need to share, you need to jump to another application display interface, and you need to select the path where the edited screenshot image is located before you can share the operation. Because the operation is performed in the same interface, the entire user The operation process is more inconvenient.

Summary of the invention

Embodiments of the present invention provide an interactive method based on screenshots, an electronic device, and a computer-readable storage medium, which can facilitate interactive operations for screenshot images and help improve user experience.

A first aspect of an embodiment of the present invention provides an interaction method, including:

Receiving a screen capture instruction to obtain the content displayed in the first display area of the display screen;

Acquiring a screenshot image in response to the screenshot command;

Controlling the screenshot image to be displayed in the first display area, and controlling the operation controls associated with the screenshot image to be displayed in the second display area of the display screen, wherein the second display area is The first display area is in a different area of the display screen.

A second aspect of the embodiments of the present invention provides an electronic device, including:

The display screen includes a first display area and a second display area, and the second display area and the first display area are different areas of the display screen;

A processor, configured to receive a screen capture instruction for acquiring the content displayed in the first display area of the display screen; the processor is configured to obtain a screen capture image in response to the screen capture instruction, and display the screen capture image on the first A display area; the processor is further used to display the operation controls associated with the screenshot image on the second display area of the display screen.

A third aspect of the embodiments of the present invention provides a computer-readable storage medium that stores computer instructions that, when executed by a processor, implement some or all of the steps described in any method of the first aspect of the embodiments of the present invention. .

The above screenshot-based interaction method, electronic device, and computer-readable storage medium can display the screenshot image in the first display area, and display the operation controls in the second display area in different first display areas, which is helpful for the user to pass the first The interactive operation corresponding to the screenshot is completed within the second display, which simplifies the user's operation process and helps to improve the user's experience.

BRIEF DESCRIPTION

In order to more clearly explain the embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, without paying any creative work, other drawings can be obtained based on these drawings.

FIG. 1 is a flowchart of steps in a screen capture-based interaction method in a first embodiment provided by the present invention.

2 is a schematic structural diagram of an embodiment of an electronic device with a flexible display screen according to an embodiment of the present invention.

3 is a schematic structural diagram of an embodiment of an electronic device with a flexible display screen according to an embodiment of the present invention.

FIG. 4 is a flowchart of steps in a screen capture-based interaction method in a second embodiment provided by the present invention.

FIG. 5 is a flowchart of steps of a screen capture-based interaction method in a third embodiment provided by the present invention.

6 is a schematic block diagram of an electronic device according to an embodiment of the invention.

7 is a schematic diagram of a screenshot operation in an embodiment of the present invention.

8 is a schematic diagram of generating a screenshot image in an embodiment of the present invention.

9 is a schematic diagram of a sliding operation in an embodiment of the present invention.

10 is a schematic diagram of an operation interface in an embodiment of the present invention.

detailed description

In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is a part of the embodiments of the present invention, but not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without making creative efforts fall within the protection scope of the present invention.

The terms "first", "second", etc. in the description and claims of the present invention and the above drawings are used to distinguish different objects, not to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally also includes Other steps or units inherent to these processes, methods, products, or equipment.

Reference herein to "embodiments" means that specific features, structures, or characteristics described in connection with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art understand explicitly and implicitly that the embodiments described herein can be combined with other embodiments.

The following describes the embodiments of the present invention in detail.

Please refer to FIG. 1, which shows a flowchart of steps in the screen capture-based interaction method in the first embodiment provided by the present invention. The interactive method includes the following steps:

Step 100: Receive a screen capture instruction to obtain the content displayed in the first display area of the electronic device.

The electronic device has an operating system and can run one or more application programs. The electronic device may be a mobile phone, a tablet computer, a personal digital assistant (Personal Digital Assistant, PDA), a mobile Internet device (Mobile Internet Device, MID) and other mobile terminals, which are not limited in the embodiments of the present invention.

The display screen of the electronic device may have one or more display screens.

When the electronic device has only one display screen, the display screen may be a curved screen or a flexible display screen. When the display screen is displayed, one or more display areas can be defined. For example, a curved screen defines a main screen display area and a side screen display area during display, where the main screen display area corresponds to the front of the housing of the electronic device, and the side screen display area corresponds to the side of the housing of the electronic device. The main screen display area is used to display an application program interface or a system interface, for example, to display an application program interface currently running in the foreground of an electronic device. The side screen display area can display the navigation bar of the system interface or display the operation icons of the applications currently running in the foreground. For example, when the instant messaging application is running in the foreground, the interface of the instant messaging application is displayed in the main screen display area. The operation icon of the instant communication application is displayed in the side screen display area. When the operation icon is triggered, the interface corresponding to the triggered instant communication application icon is displayed in the main screen display area.

Please refer to FIG. 2 together. The display screen of the electronic device 50 is a flexible display screen 580. The flexible display screen 580 includes a bending area 582 and non-bending areas 584 on both sides of the bending area 582. When the flexible display screen 580 is bent around the bendable area 582, the electronic device 50 of the flexible display screen may have a bent state, and a main screen display area 570 and an auxiliary screen display area 572 are formed on the flexible display screen 580. The main screen display area 570 and the auxiliary screen display area 572 are located in the non-bending area 584 on both sides of the bendable area of the flexible display screen 580.

In another embodiment, when the electronic device is in a bent state, the housing of the electronic device includes a first front surface 590, a second front surface 592, and a side surface 594 of the housing. The flexible display screen also includes a curved screen display area 574. The curved screen display area 574 corresponds to the bendable area 582 of the flexible display screen 580, and is located between the main screen display area 570 and the auxiliary screen display area 572. When the flexible display screen is in a bent state, the curved screen display area 574 may include a first sub-display area 5741 adjacent to the main screen display area 570 and a second sub-display area 5743 adjacent to the auxiliary screen display area 572. In this way, the main screen display area 570 and the first sub-display area 5741 can display the same information together; the auxiliary screen display area 572 and the second sub-display area 5743 can also display the same information together. In this embodiment, the main screen display area 570 and the auxiliary screen display area 572 are the display areas corresponding to the first front face 590 and the second front face 592 of the electronic device housing in the bent state, and the curved screen display area 574 is located The display area corresponding to the side surface 594 of the casing of the electronic device in the bent state. When the electronic device 50 is in the unfolded state, the first front surface 590, the second front surface 592, and the side surface 594 of the housing may be located in the same plane. In other embodiments, the curved screen display area may not be partitioned, that is, the curved screen display area 574 may be used as a whole.

The electronic device is used to generate a screen capture instruction in response to a user's input operation. The user's input manipulation includes the user touching the screen capture buttons such as pressing physical buttons such as the power button and volume down button of the electronic device at the same time, or clicking the screenshot icon in the status bar, or entering a specific gesture operation. In another embodiment, the third-party software may also be used to obtain the screenshot command. For example, when the user opens a third-party application (such as clicking the icon of the screenshot application), the screenshot command may be received, or the user may select the first When the screenshot options provided by the three-party application (such as the screenshot function menu provided by the Weibo application), the electronic device can also receive the screenshot command.

Step 102: Acquire a screenshot image in response to the screenshot command.

The electronic device further includes a second display area, where the first display area and the second display area are in different areas of the display screen of the electronic device.

The electronic device may be a device having a curved screen, including a main screen display area and a side screen display area, wherein the main screen display area may correspond to the first display area, and the side screen display area may correspond to the second display area. Therefore, after receiving the screen capture instruction, the electronic device may use the current display interface (or content) of the main screen display area as the screen capture image.

The electronic device may be a device with a flexible display screen. The electronic device of the flexible display screen may include a main screen display area, an auxiliary screen display area, and a curved screen display area when in a bent state, according to the interactive area of the flexible display screen electronic device To determine the first display area and the second display area. When the electronic device is in the bent state, the user can interact through the main screen display area or the curved screen display area. When the main screen display area is in the interactive state, the main screen display area may be the first display area, and the curved screen display area may be the second display area; when the auxiliary screen display area is in the interactive state, the first display area may be the auxiliary screen display area , The second display area can be curved screen display area.

In an embodiment, the electronic device may be a device with a flexible display screen, which may include a main screen display area and a sub-screen display area when it is in a bent state (that is, it may not include the above-mentioned curved screen display area), and the main screen display area It is the first display area, and the auxiliary screen display area is the second display area.

In one embodiment, the electronic device determines the first display area and the second display area according to the screen status. For example, when the auxiliary screen display area is in the off-screen state, the main screen display area is the first display area; when the main screen display area is in the off-screen state, the auxiliary screen display area is the first display area.

In one embodiment, the screen status can be recognized by a sensor, such as a distance sensor or a camera. For example, when the electronic device is in a bent state, a distance sensor (including but not limited to an optical distance sensor, a linear proximity sensor, an ultrasonic distance sensor) provided corresponding to the display area of the main screen can sense that the user is within a preset distance, or The camera set corresponding to the main screen display area can determine (including but not limited to face recognition) that when the user is facing the main screen display area, the main screen display area can be used as the first display area. When the electronic device is in the bent state, the distance sensor corresponding to the auxiliary screen display area can sense that the user is within a preset distance, or the camera corresponding to the auxiliary screen display area can determine (including but not limited to face recognition) When the user is facing the auxiliary screen display area, the auxiliary screen display area may be used as the first display area.

The current display interface of the first display area may include an application program interface or a system interface. That is to say, when the first display area displays an application interface, the screenshot image may include the contents of the application interface, status bar, and navigation bar; when the first display area displays the system interface, the screenshot image may include the application Program icon area, status bar and navigation bar. In one embodiment, the navigation bar may be hidden, that is, when the navigation bar is hidden, the content of the navigation bar may not be included in the screenshot image; and when the system displays the navigation bar, the content of the navigation bar is included in the screenshot image. In other embodiments, the screenshot image may not include the content of the status bar. Therefore, during the screenshot operation, corresponding settings can be made according to specific requirements to determine whether the content of the status bar and / or the navigation bar is included.

After receiving the screen capture instruction, the electronic device may perform a screen capture operation on the content of the first display area to obtain a screen capture image corresponding to the content of the first display area.

Step 104, controlling the screenshot image to be displayed in the first display area, and controlling the operation controls associated with the screenshot image to be displayed in the second display area of the electronic device, wherein the first display The area and the second display area are different areas on the display screen of the electronic device.

To facilitate the user's operation after the screenshot, the operation controls associated with the screenshot image can be displayed in the second display area, and the screenshot image can be displayed in the first display area. To perform further processing on the screenshot image, including but not limited to, editing the screenshot image or sharing the screenshot image.

When the electronic device performs the screen capture operation, the screen capture can be achieved by calling an interface provided by the operating system or directly reading the framebuffer device to obtain the screen capture image.

In an embodiment, the resolution of the screenshot image may be the same as the resolution of the first display area.

For example, the resolution of the first display area can be 1080 * 2246 pixels (pixel columns * pixel rows), and the resolution of the screenshot image obtained through the screenshot operation can also be 1080 * 2246 pixels, or the resolution of the obtained screenshot image The rate can be 1080 * 2102 pixels. Therefore, when the screenshot image is displayed in the first display area, the electronic device may display the screenshot image at the second resolution in the first display area having the first resolution, wherein the first resolution of the first display area There is at least one direction (pixel row direction and / or pixel column direction) that is the same as the second resolution of the screen capture image in the first display area, or the second resolution of the screen capture pixel row and / or pixel column The number is equal to the number of pixel rows and / or pixel columns corresponding to the first resolution. That is to say, when the first resolution of the first display area is 1080 * 2246, and the second screen resolution of the first display is 1080 * 2246, it means that the first resolution of the first display area is in pixels The resolution direction of the column * pixel row is the same as the second resolution in the first display area occupied by the displayed screenshot image; when the first resolution in the first display area is 1080 * 2246, the displayed screenshot image occupies the first display When the second resolution is 1080 * 2102, it means that the first resolution of the first display area in the pixel column direction is the same as the length resolution direction of the second resolution in the first display area occupied by displaying the screenshot image, and the first The first resolution of a display area 510 is not the same as the pixel line resolution direction of the second resolution in the first display area 510 occupied by displaying the screenshot image 524 in the pixel line resolution direction.

The electronic device may also display the screenshot image substantially the same size (or size) as the first display area in the first display area. When generating a screenshot image, since the resolution of the screenshot image is basically the same as that of the first display area, after the screenshot, the user may not be able to tell whether the screenshot was successful or not, that is, whether the first display area is a screenshot image, so , Pre-processing can be performed on the screenshot image to obtain the pre-processed image, such as adding a border to the screenshot image to obtain a screenshot image containing the border. After that, a screenshot image including a frame can be displayed in the first display area. Since the border has a certain width (for example, each border has a width of 2 pixels), the screenshot image displayed in the first display area will be smaller than the size (such as resolution) of the first display area. The size of the first display area will be smaller than the size of the first display area.

For an electronic device with a curved screen, the screenshot image can be displayed in the first display area corresponding to the main screen display area, and the operation controls can be displayed in the second display area corresponding to the side screen display area.

For an electronic device with a flexible display screen, when the electronic device is in a bent state, the screenshot image can be displayed in the main screen display area or the auxiliary screen display area corresponding to the first display area, and the operation control can be displayed in the corresponding second display The curved screen of the zone shows the zone.

In one embodiment, after the screenshot image in the first display area is acquired at the first time, if the screenshot image is displayed at the second time, there may be a change in the screen corresponding to the first display area of the electronic device of the flexible display screen, so , The screen that displays the screenshot image at the second time will also change accordingly. For example, the user modifies or changes the display screen of the electronic device. For example, after acquiring the screenshot image corresponding to the first display area (that is, the first display area is located on the main screen display area 570) at the first time, the user will switch The display screen of the electronic device becomes the auxiliary screen display area 572, so when displaying the screenshot image, it can be displayed in the auxiliary screen display area 572; or, after the screenshot image corresponding to the main screen display area is acquired at the first time, the user passes The display screen of the electronic device is changed into the auxiliary screen display area (if the electronic device is turned over, the auxiliary screen display area 572 becomes the first display area), therefore, when displaying the screenshot image, it can be displayed in the auxiliary screen display area 572 .

In one embodiment, after acquiring the screenshot image in the first display area (that is, the first display area is located on the main screen display area 570) at the first time, if the screenshot image is displayed at the second time, the first display area may become The secondary screen display area 572 is displayed. At this time, the screenshot image can be displayed in the secondary screen display area 572 at the second time. At the same time, the operation controls that would be displayed in the first sub-display area 5741 can be displayed in the second 5742 within the sub display area.

In an embodiment, when the electronic device with a flexible display screen is in a bent state, the screenshot image can be displayed in the first display area, and the operation control can be displayed in the second display area; when the flexible display screen has When the electronic device is in the expanded state, the screenshot images and operation controls are displayed in the same display area.

The above screenshot-based interaction method displays the screenshot image in the first display area and displays the operation controls in the second display area of different first display areas, which is beneficial to the user to complete the interactive operation of the corresponding screenshot through the second display , Simplifying the user's operation process. In addition, by displaying the screenshot images with substantially the same resolution in the first display area without greatly reducing the screenshot images, it is beneficial to improve the user experience. For an electronic device with a flexible display screen, when it is in an open state, it can also display screenshot images and operation controls in the same display area, which is helpful to maintain some user needs.

Please refer to FIG. 4, which shows a flowchart of steps of a screen capture-based interaction method in a second embodiment provided by the present invention. The interactive method includes the following steps:

Step 200: Receive a screen capture instruction to obtain the content displayed in the first display area of the electronic device.

Step 202: Acquire a screenshot image in response to the screenshot command.

Step 204: Control the screen shot image to be displayed in the first display area, and control the operation control associated with the screen shot image to be displayed in the second display area of the electronic device, wherein the second display The area and the first display area are at different positions on the display screen of the electronic device.

Step 206: Receive an instruction triggered by the operation control in response to the user's touch operation.

The electronic device displays a preset area corresponding to each operation control in the second display area, where the operation control includes an editing operation, a first sharing operation, and a second sharing operation. Among them, the editing operation is used to trigger the editing process of the screenshot image, the first sharing operation is used to share the screenshot image to the first application (such as WeChat), and the second sharing operation is used to share the screenshot image to the second application ( Such as mailbox). Therefore, whether the instruction is generated can be judged by detecting whether the area where the operation control is located is triggered. When an area is triggered, an instruction of the control control corresponding to the area can be generated. In an embodiment, when the user can perform a long-press operation on the screenshot image and slide the screenshot image from the first display area to the corresponding editing control, an instruction corresponding to the editing control can be generated, and the electronic device can The sliding distance zooms the screenshot image. For example, when the sliding operation is smaller from the second display area, the smaller the size of the screenshot image displayed in the first display area, which is convenient for large-screen electronic devices (such as 8.9 inches, 11.1 Inch, 10.2 inches, 12.1 inches, 13.3 inches, 13.4 inches, etc.) operation is also conducive to enhancing the user experience.

In an embodiment, a preset number of operation controls can be displayed in the second display area, and since the number of operation controls that can be displayed in the second display area is limited, it can be determined that the preset number of associated operation controls Whether it can be displayed on the same interface of the second display area, if it cannot be displayed on the same interface of the second display area, a page display operation can be performed on the operation controls, such as when multiple operation icons are displayed in the second display area At this time, if the operation icon cannot be displayed on one page, it can be displayed in pages in the second display area. Therefore, the user can also perform simple page turning and clicking operations in the second display area to select the corresponding operation control. The operation control may be an operation icon or an operation button, which is not specifically limited herein.

In one embodiment, the electronic device may display the operation controls displayed in the second display area in a preset order. For example, according to the frequency or number of times the operation controls are used, the operation control with the highest frequency may be displayed on the first In the first position of the second display area, the operation control with the second lowest frequency is displayed in the second position of the second display area.

When the electronic device does not receive the screen capture command, the second display area may display other application icons, such as recording, memo, scan, QR code, etc.

Step 208: Perform the interactive operation corresponding to the instruction.

After the triggered instruction is generated, the corresponding interactive operation can be performed. For example, when the instruction corresponds to an editing operation, the running interface of the application program corresponding to the editing operation may be generated in the first display area, wherein the running interface of the editing operation application program includes a screenshot image, and also includes different filtering, cropping, etc. Function options to facilitate users to edit the screenshot images accordingly. When the instruction corresponds to a sharing operation, such as clicking in the operation control or dragging the screenshot image to the first sharing operation control, the electronic device can call the first application program interface corresponding to the first sharing operation, and A display area displays the running interface of the application program to control the sharing of the screenshot image to the application program corresponding to the first sharing control, so that the user can perform subsequent operations.

In one embodiment, when the first display area displays the operation interface, the operation controls displayed in the second display area may be hidden.

After the user completes the editing operation on the screenshot image, it can also trigger the sharing operation control to share the edited screenshot image, which avoids the existing user may need to switch the interface between the editing operation and the sharing operation, simplifying the user The operation process is also conducive to improving the user experience.

The above screenshot-based interaction method can also determine whether the area corresponding to the operation control in the second display area is triggered, and display the corresponding running interface when the area is triggered, and the user can complete the screenshot without performing an operation jump. Image editing and sharing operations.

Please refer to FIG. 5, which shows a flowchart of steps in the screenshot-based interaction method in the third embodiment provided by the present invention. The interactive method includes the following steps:

Step 300: Receive a screen capture instruction to obtain the content displayed in the first display area of the electronic device.

Step 302: Acquire a screenshot image in response to the screenshot command.

Step 304, controlling the screenshot image to be displayed in the first display area, and controlling the operation controls associated with the screenshot image to be displayed in the second display area of the electronic device, wherein the second display The area and the first display area are in different areas of the display screen of the electronic device.

Step 306: Determine whether an instruction is received within a preset time, wherein the instruction is triggered based on the operation control in response to a user operation; if yes, perform step 310; if not, perform step 308.

When the preset time is exceeded (such as the preset time after the operation control is displayed in the second display area), it may indicate that the user wants to cancel this screenshot operation or the screenshot caused by accidental touch without the user's knowledge Operation, so you can cancel this screenshot operation in this case. In one embodiment, the preset time may be 3 seconds, or 0.3 seconds, or other time intervals. The specific time interval may be set according to actual needs.

Step 308: Control the operation controls displayed in the second display area to hide.

When the preset time is exceeded, the current screenshot operation can be canceled by hiding the operation controls displayed in the second display area. In other embodiments, the screenshot image displayed in the first display area can be cancelled to cancel the screenshot operation, or a corresponding prompt message can be output to the user to determine whether the user wants to continue or cancel the screenshot operation .

Step 310: Perform the interactive operation corresponding to the instruction.

In addition to the technical effects of the above embodiments, the above screenshot-based interaction method also cancels this screenshot operation by setting a preset time, or avoids the screenshot operation caused by accidental touch without the user ’s knowledge. Improve user experience.

Please refer to FIG. 6, which is a schematic block diagram of an electronic device according to an embodiment of the present invention. As shown in FIG. 6, the above-mentioned embodiments can be applied to the electronic device. The following describes the electronic device 50 provided by the present invention. The electronic device 50 may further include a processor 500, a storage device 502, a display screen 504, and storage In the storage device 502 and a computer program (instructions) that can be run on the processor 500, the electronic device 50 may also include other hardware parts, such as buttons, fingerprint collection modules, communication devices, etc., This will not be repeated here. The processor 500 can exchange data with the storage device 502 and the display screen 504 through the bus 506.

The processor 500 may be a central processing unit (Central Processing Unit, CPU), or other general-purpose processors, digital signal processors (Digital Signal Processors, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The processor is the control center of the electronic device 50, and uses various interfaces and lines to connect the various parts of the entire electronic device 50 .

The storage device 502 may be used to store the computer program and / or module. The processor 500 executes or executes the computer program and / or module stored in the storage device 502 and calls the storage device 502. Data to realize various functions of the screenshot-based interaction method. The storage device 502 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one function required application programs, etc .; the storage data area may store data created according to the use of a mobile phone, etc. . In addition, the storage device 502 may include a high-speed random access storage device, and may also include a non-volatile storage device, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart, Media, Card, SMC), and a secure digital (Secure Digital) , SD) card, flash memory card (Flash Card), at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.

The display screen 504 may include a front touch display area and a side touch display area, and may display a user interface (UI) or a graphical user interface (GUI), including data such as photos, videos, and chat content. The display screen 504 also includes Can be used as input device and output device, the display screen can include liquid crystal display (LCD), thin film transistor LCD (TFT-LCD), organic light-emitting diode (OLED) touch display, flexible touch display, three-dimensional (3D) touch display, ink screen At least one of the display and the like may have a fingerprint module built into the display screen 504 to collect fingerprint information of the user during the touch operation of the display screen 504. The display screen 504 may include one or more display screens.

When the processor 500 executes the computer program, the steps in the screenshot-based interaction method in the foregoing embodiments are implemented, for example, steps 100-104 shown in FIG. 1, steps 200-205 shown in FIG. 2, and steps shown in FIG. 3.示的步骤 300-310. Alternatively, the processor 500 implements the functions of each module / unit when executing the computer program.

Exemplarily, the computer program may be divided into one or more modules / units, and the one or more modules / units are stored in the storage device 502 and executed by the processor 500 to complete this invention. The one or more modules / units may be a series of computer program instruction segments capable of performing specific functions, and the instruction segments are used to describe the execution process of the computer program in the electronic device 50, so as to implement the above embodiments Steps in the interactive method based on screenshots.

Please refer to FIG. 7 together, which is a schematic diagram of a screen capture operation according to an embodiment of the present invention. The display screen of the electronic device 50 may include a first display area 510 and a second display area 512, wherein the first display area 510 may include a status bar 518 located above the first display area 510, and an application located in the middle of the first display area 510 The program icon area 514 and the navigation bar 520 located at the lower part of the first display area 510.

The processor 500 is used for receiving a screen capture instruction displayed in the first display area 510. For example, when the user presses a screenshot button (such as pressing a physical button such as the power button and volume down button of the electronic device at the same time, or clicking the screenshot icon "Screenshot" from the status bar 518), the processor 500 may obtain a screenshot input by the user instruction. In another embodiment, a third-party software may also be used to obtain the screenshot command. For example, when the user opens a third-party application (such as clicking the icon of the screenshot application), the processor 500 may receive the screenshot command, or the user When a screenshot option provided by a third-party application (such as a screenshot function menu provided by a Weibo application) is selected, the processor 500 can also obtain a screenshot instruction.

Please refer to FIG. 8 together, which is a schematic diagram of generating a screenshot image in an embodiment of the present invention. The processor 500 is further used to obtain a screenshot image 524 corresponding to the first display area 510 of the electronic device 50.

After receiving the screen capture instruction, the processor 500 may perform a screen capture operation on the content displayed in the first display area 510 to obtain a screen capture image 524 corresponding to the first display area.

When the first display area 510 displays an application program interface, the screenshot image 524 obtained by the processor 500 may include the contents of the application program interface, status bar 518, and navigation bar 520; when the first display area 510 displays a system interface At this time, the screenshot image 524 may include an application icon area 514, a status bar 518, and a navigation bar 520.

The processor 500 is used for displaying the screenshot image 524 in the first display area 510 and displaying the operation control 516 associated with the screenshot image 524 in the second display area 512 of the electronic device.

To facilitate the user's operation after the screenshot, the processor 500 may display the operation control 516 associated with the screenshot image 524 in the second display area 512, and display the screenshot image 524 in the first display area 510. The user can perform interactive operations on the screenshot image 524 through the operation controls 516 located in the second display area 512, including but not limited to editing operations on the screenshot image 524 or sharing operations on the screenshot images.

When the electronic device performs the screen capture operation, the processor 500 may implement the screen capture by calling the interface provided by the operating system or directly reading the framebuffer device to obtain the screen capture image 524. When the interface displayed in the first display area 510 is a system interface, the resolution of the first display area 510 may be 1080 * 2246 pixels (length * width), and the resolution of the screenshot image 524 obtained through the screenshot operation may also be 1080 * 2246 pixels; or the resolution of the screenshot 524 obtained is 1080 * 2102 pixels. When the processor 500 displays the screenshot image 524 in the first display area 510, the first resolution of the first display area 510 has at least one direction (length direction and / or width direction) and the display screenshot image 524 occupies the first display The second resolution of area 510 is the same. For example, when the first resolution of the first display area 510 is 1080 * 2246, and the screenshot image 524 displayed by the processor 500 occupies the second resolution of the first display of 1080 * 2246, it means that the screenshot image 524 is displayed in full screen The method is displayed in the first display area 510, which also indicates that the first resolution of the first display area 510 is the same as the second resolution in the first display area 510 occupied by the display screenshot 524 in the length and width directions; When the first resolution of the first display area 510 is 1080 * 2246, and the processor 500 displays the screenshot image 524 as the second resolution of the first display is 1080 * 2102, it means the first resolution of the first display area 510 The length direction is the same as the length direction of the second resolution in the first display area 510 occupied by the display screenshot 524, and the first resolution of the first display area 510 is the same as the first display in the width direction displayed by the screenshot The width direction of the second resolution in the area 510 is different.

The processor 500 may also display the screenshot image 524 in the first display area 510 that is substantially the same size as the first display area 510. When the screenshot image 524 is generated, since the resolution of the screenshot image 524 is basically the same as the resolution of the first display area 510, after the screenshot, the user may not be able to distinguish whether the screenshot is successful. Therefore, the processor 500 may preset the screenshot image 524 Processing, generating a screenshot image 524 containing a frame. After that, the processor 500 may display the screenshot image 524 including the frame in the first display area 510. Since the frame has a certain width, the screenshot image 524 displayed in the first display area 510 will be smaller than the size of the first display area 510, so the size of the screenshot image 524 in the first display area 510 will be smaller than the first display area The size of 510, and the size of the first display area 510 is equal to the size of the pre-processed image.

For an electronic device with a curved screen, the screenshot image 524 can be displayed in the first display area 510 corresponding to the main screen display area, and the operation control 516 can be displayed in the second display area 512 corresponding to the side screen display area.

For an electronic device with a flexible display screen, the processor 500 can also be used to obtain the working state of the electronic device 50, such as a bent state or an unfolded state. When the electronic device 50 is in the bent state, the processor 500 may display the screenshot image 524 in the main screen display area or the auxiliary screen display area corresponding to the first display area 510, and display the operation control 516 in the corresponding second display area 512 In the screen display area.

The processor 500 is used to determine whether an instruction is received within a preset time, wherein the instruction is triggered based on the operation control in response to a user operation, and if so, it may indicate that the user wants to cancel the screenshot operation or because the user does not know In the case of an accidental screenshot operation, the processor 500 may hide the operation control 516 displayed in the second display area 512 to cancel the current screenshot operation. In other embodiments, the processor 500 may also cancel or hide the screenshot image 524 displayed in the first display area 510 to cancel the screenshot operation, or output a corresponding prompt message to the user to determine whether the user wants to continue Or cancel this screenshot operation. The preset time can be 3 seconds, 0.3 seconds, or other time intervals. The specific time interval can be set according to actual needs.

The processor 500 may control the second display area 512 to display preset areas corresponding to the operation controls 516, wherein each preset area may be an area where the icon of the corresponding operation control is located. The operation control 516 includes, but is not limited to, an editing operation, a first sharing operation, and a second sharing operation icon, where the editing operation is used to trigger the editing process of the screenshot image, and the first sharing operation is used to share the screenshot image to the first application , The second sharing operation is used to share the screenshot image to the second application. .

Please also refer to FIG. 9, which is a schematic diagram of a sliding operation in an embodiment of the present invention. The processor 500 can detect whether the area where the operation control is located is triggered. When the area is triggered, the processor 500 may generate an instruction of an operation control corresponding to the area. When the corresponding area is clicked or there is a sliding operation from the first display area 510 to the second display area 512, the processor 500 generates an instruction. For example, when the editing operation icon in the operation control 516 is clicked, the user can perform a long-press operation on the screenshot image 524, and slide the screenshot image 524 from the first display area to the corresponding editing control, the processor 500 may generate Commands corresponding to editing operations. When sliding from the first display area 510 to the second display area 512, the processor 500 may zoom and display the screenshot image 524 in the first display area 510 according to the sliding distance, such as when the sliding operation is away from the second display The smaller the distance of the area 512, the smaller the size of the screenshot image 524 displayed in the first display area 510 by the processor 500, which can facilitate the operation of a large-screen electronic device and also help to improve the user experience.

In an embodiment, the second display area 512 can display a preset number of operation controls, and since the number of operation controls that the second display area 512 can display is limited, the processor 500 can determine that the preset number of operation controls Whether the associated operation control can be displayed in the same interface of the second display area, if the operation control cannot be displayed on the same interface of the second display area, the processor 500 can perform a paging display operation on the operation control, to The operation controls are displayed in different paging interfaces, therefore, the user can also perform simple page turning and clicking operations in the second display area to select the corresponding operation controls.

In an embodiment, the processor 500 may display the operation controls displayed in the second display area in a preset order. For example, according to the frequency or number of times the operation controls are used, the operation controls with the highest frequency may be displayed on In the first position of the second display area, the operation control with the second lowest frequency of use is displayed in the second position of the second display area.

When the screen capture instruction is not received, the processor 500 may display other application icons in the second display area 512, such as recording, memo, scan, QR code, etc.

Please refer to FIG. 10 together, which is a schematic diagram of an operation interface in an embodiment of the present invention. After the processor 500 generates an instruction, the processor 500 may display the corresponding running interface 522 in the first display area 510 to perform the corresponding interactive operation. For example, when the instruction corresponds to an editing operation, the processor 500 may generate an operation interface 522 of the editing operation in the first display area 510, wherein the screenshot image in the editing operation interface 522 also includes different functional options such as filtering and cropping To facilitate the user to edit the screenshot 524 accordingly. When the instruction corresponds to a sharing operation, such as clicking in the operation control or dragging the screenshot image 524 to the first sharing operation control, the processor 500 may call the first application program interface corresponding to the first sharing operation, and may The running interface 522 of the application program is displayed on the first display area 510 to control the sharing of the screenshot image 524 to the application program corresponding to the first sharing control, so that the user can perform subsequent operations.

After the editing operation selected by the user is completed, the screenshot corresponding image 524 after the editing can be shared in the area corresponding to the triggering sharing operation control, avoiding the existing user who may need to switch between the editing operation and the sharing operation , Simplifies the user's operation process, and also helps to improve the user's experience.

In one embodiment, after the running interface is displayed in the first display area 510, the processor 500 can simultaneously hide the operation controls displayed in the second display area 512, which can be used to prompt the user of the screenshot image 524 can perform subsequent interactive operations.

The above electronic device displays the screenshot image in the first display area and displays the operation controls in the second display area in different first display areas, which is beneficial to the user to complete the interactive operation of the corresponding screenshot through the second display, without The operation jump is required, which simplifies the user's operation process. In addition, by displaying the screenshot images with substantially the same resolution in the first display area without greatly reducing the screenshot images, it is beneficial to improve the user experience. For an electronic device with a flexible display screen, when it is in an open state, a screenshot image and operation controls can also be displayed in the same display area, which is helpful for maintaining some user needs. In addition, by judging whether the preset area in the second display area is triggered, and displaying the corresponding running interface in the first display area when the preset area is triggered, the user does not need to perform an operation jump.

In the above embodiments, the description of each embodiment has its own emphasis. For a part that is not detailed in an embodiment, you can refer to related descriptions in other embodiments.

The embodiments of the present invention have been described in detail above, and specific examples have been used in this article to explain the principles and implementations of the present invention. The descriptions of the above embodiments are only used to help understand the method and the core idea of the present invention; Those of ordinary skill in the art, according to the ideas of the present invention, may have changes in specific implementations and application scopes. In summary, the content of this specification should not be construed as limiting the present invention.

Claims

An interactive method based on a screenshot is applied to an electronic device including a display screen. The interactive method includes:

Receiving a screen capture instruction to obtain the content displayed in the first display area of the display screen;

Acquiring a screenshot image in response to the screenshot command;

Displaying the screenshot image in the first display area, and displaying operation controls associated with the screenshot image in the second display area of the display screen, wherein the second display area and the The first display area is a different area of the display screen.
The interaction method according to claim 1, wherein the display screen is a curved screen, and the first display area is a display area of the curved screen corresponding to the front of the housing of the electronic device, the The second display area is a display area corresponding to the curved screen and the side of the casing of the electronic device.
The interaction method according to claim 1, wherein the display screen is a flexible display screen, and the first display area corresponds to the front of the housing of the electronic device when the flexible screen is in a bent state The second display area is a display area corresponding to the flexible display screen and the side of the housing of the electronic device.
The interaction method according to claim 2 or 3, wherein the interaction method further comprises:

Receiving an instruction triggered by the operation control in response to the user's touch operation;

Perform the interactive operation corresponding to the instruction.
The interaction method according to claim 4, wherein the operation control comprises an editing control and a sharing control, the editing control is used to edit the screenshot image, and the sharing control is used to convert the screenshot image Share to the running interface of the application.
The interactive method according to claim 5, wherein the interactive operation corresponding to the execution of the instruction specifically includes:

When a long-press operation is received on the screenshot image and the first display area is slid onto the editing control, the editing operation on the screenshot image is controlled.
The interaction method according to claim 6, wherein the interaction method further comprises:

Controlling an editing interface for displaying the screenshot image in the first display area, the editing interface including options for different editing functions.
The interaction method according to claim 6, wherein after the editing operation of the screenshot image, the control specifically includes:

Control to hide the operation controls displayed in the second display area.
The interaction method according to claim 5, wherein when the sharing control receives a touch operation, it controls to share the screenshot image to an application corresponding to the sharing control.
The interaction method according to claim 9, wherein the controlling to share the screenshot image to an application corresponding to the sharing control specifically includes:

Controlling to display the running interface of the application program in the first display area, and the running interface includes the screenshot image.
An electronic device, characterized in that the electronic device includes:

The display screen includes a first display area and a second display area, and the second display area and the first display area are different areas of the display screen;

A processor, configured to receive a screen capture instruction for acquiring the content displayed in the first display area of the display screen; the processor is configured to obtain a screen capture image in response to the screen capture instruction, and display the screen capture image on the first A display area; the processor is further used to display the operation controls associated with the screenshot image on the second display area of the display screen.
The electronic device according to claim 11, wherein the display screen is a curved screen, and the first display area is a display area of the curved screen corresponding to the front of the housing of the electronic device, the The second display area is a display area corresponding to the curved screen and the side of the casing of the electronic device.
The electronic device according to claim 11, wherein the display screen is a flexible display screen, and the first display area is that the flexible screen is in a bent state corresponding to the front of the housing of the electronic device The second display area is a display area corresponding to the flexible display screen and the side of the housing of the electronic device.
The electronic device according to claim 12 or 13, wherein the processor is further configured to execute an interactive operation corresponding to the instruction after receiving an instruction triggered by the operation control in response to a user operation.
The electronic device according to claim 14, wherein the operation control comprises an editing control and a sharing control, the editing control is used to edit the screenshot image, and the sharing control is used to convert the screenshot image Share to the running interface of the application.
The electronic device according to claim 15, wherein the processor is further configured to control the control when a long-press operation is received on the screenshot image and the first display area is slid onto the editing control Edit the screenshot image.
The electronic device of claim 16, wherein the processor is further configured to control an editing interface that displays the screenshot image in the first display area, the editing interface includes options for different editing functions .
The electronic device according to claim 16, wherein the processor is further configured to control hiding the operation controls displayed in the second display area after controlling the editing operation on the screenshot image.
The electronic device according to claim 15, wherein the processor is further configured to control the sharing of the screenshot image to an application corresponding to the sharing control when the sharing control receives a touch operation in.
The electronic device of claim 19, wherein the processing is further used to control the display of the running interface of the application program in the first display area, the running interface including the screenshot image.
A computer-readable storage medium storing computer instructions, characterized in that, when the computer instructions are executed by a processor, a screen capture-based interaction method according to any one of claims 1 to 10 is implemented.