CN117454421A

CN117454421A - Privacy protection method and device

Info

Publication number: CN117454421A
Application number: CN202311415377.9A
Authority: CN
Inventors: 张黎; 武锐; 罗振波; 唐堂
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2015-12-24
Filing date: 2015-12-24
Publication date: 2024-01-26
Also published as: CN106919849A; KR102610013B1; KR20170076553A; CN117633868A

Abstract

The application discloses a privacy protection method and device, wherein the method comprises the following steps: detecting to start a privacy protection mode; determining a multimedia content set to be hidden based on the specified multimedia content; and hiding the determined multimedia content set to be hidden. The method and the device realize privacy protection of the multimedia content, simplify operation and improve efficiency.

Description

Privacy protection method and device

The application is a divisional application of an invention patent application with the application number of 201510983094.3 and the invention name of privacy protection method and device

Technical Field

The present disclosure relates to the field of terminal devices, and in particular, to a privacy protection method and apparatus.

Background

With the continuous development of communication technology, terminal devices such as mobile phones and tablet computers are becoming more popular, and the functions to be realized are also becoming more and more.

People can take photos and videos, talk, send and receive short messages, surfing the internet, chatting and the like by using the terminal devices, so that more and more information is stored in the terminal devices, such as photos and videos taken by users, call records of users, short message records, surfing records and chatting records of users and the like. Many of the above information stored in the terminal device is related to personal privacy, and once the terminal device is viewed by another person, the information related to personal privacy is revealed.

Disclosure of Invention

In view of this, the present application provides a privacy protection method and apparatus.

The technical scheme of the application is as follows:

in one aspect, a privacy protection method is provided, including:

detecting to start a privacy protection mode;

determining a multimedia content set to be hidden based on the specified multimedia content;

the multimedia content set to be hidden is hidden.

Wherein the specified multimedia content comprises at least one of:

designating multimedia contents contained in the multimedia file;

specifying specified content contained in the multimedia file;

designating multimedia content corresponding to the theme;

designating multimedia content corresponding to the subject to which the multimedia file belongs;

multimedia content containing a specified object;

multimedia content including objects in a specified multimedia file;

multimedia content containing specified privacy information;

multimedia content including private information in a specified multimedia file;

multimedia content corresponding to a user type to which a current user belongs;

and the multimedia content corresponding to the environment type of the current environment.

Wherein, based on the appointed multimedia content, the multimedia content set to be hidden is determined, which comprises:

searching multimedia content which is the same as semantic information of the appointed multimedia content;

And determining a multimedia content set to be hidden based on the searched multimedia content.

Wherein the set of multimedia content to be hidden is determined by at least one of:

if an instruction for publicly specifying the multimedia content is detected, determining that the multimedia content set to be hidden does not contain the searched multimedia content;

if an instruction for hiding the appointed multimedia content is detected, determining that the multimedia content set to be hidden contains the searched multimedia content;

if the appointed multimedia content meets the hiding condition, determining that the multimedia content set to be hidden contains the searched multimedia content;

if the appointed multimedia content meets the disclosure condition, determining that the multimedia content set to be hidden does not contain the searched multimedia content.

Wherein the hiding condition includes: specifying that the multimedia content contains specified privacy information; and/or designating a theme of the multimedia content as a designated theme;

the disclosed conditions include at least one of the following: the specified multimedia content does not contain specified privacy information; the subject matter of the specified multimedia content is not the specified subject matter; only multimedia content of the user who is currently using the terminal device.

Wherein the semantic information comprises at least one of the following: objects, number of objects, scene, event.

Wherein when determining the multimedia content set to be hidden based on the specified multimedia content, at least one of the following is further included:

determining the historically disclosed multimedia content as content which is not contained in the multimedia content set to be hidden;

determining the historical hidden multimedia content as the content contained in the multimedia content set to be hidden;

determining the multimedia content related to the currently determined publicable multimedia content as the content which is not contained in the multimedia content set to be hidden;

and determining the multimedia content which is associated with the currently determined multimedia content to be hidden as the content contained in the multimedia content set to be hidden.

Wherein, when determining the multimedia content set to be hidden based on the specified multimedia content, the method further comprises:

integrating and displaying the currently determined public multimedia content, and sequencing and displaying other multimedia content; or (b)

And integrating and displaying the multimedia content which is currently determined to be needed to be hidden, and sequencing and displaying other multimedia contents.

Wherein, order other multimedia content, include specifically:

other multimedia content is ordered according to at least one of the following information: and the association degree, the corresponding theme, the corresponding object and the contained privacy information of the determined multimedia content which can be disclosed or needs to be hidden.

Wherein before displaying the ordered other multimedia content, the method further comprises:

for other multimedia contents, the multimedia contents with the same association degree with the determined multimedia contents which can be disclosed or need to be hidden are integrated and displayed or the appointed number of multimedia contents are selected to be displayed preferentially.

Wherein the privacy preserving mode is detected to be turned on by at least one of:

input voice, keys, gestures, biological characteristics, an augmented reality human-computer interaction interface and an external controller.

When detecting to start the privacy protection mode through the external controller, determining a multimedia content set to be hidden based on the specified multimedia content, specifically including:

after detecting a privacy protection mode starting instruction sent by an external controller, sequencing and displaying currently unobserved multimedia contents based on at least one of a theme, an object and privacy information corresponding to the multimedia contents;

after detecting a setting instruction corresponding to the multimedia content set to be hidden sent by the external controller, determining the multimedia content set to be hidden according to the setting instruction.

Wherein the method further comprises:

the publicly available multimedia content is ordered according to at least one of the following information: association degree, corresponding theme, corresponding object and contained privacy information of the appointed multimedia content;

Displaying the sequenced multimedia content.

Wherein the method further comprises:

detecting a user currently using the terminal device;

and searching the object to only contain the detected multimedia content of the user from the multimedia content set currently determined to be needed to be hidden, and displaying the searched multimedia content.

Wherein the method further comprises:

after detecting the multimedia content set adjusting instruction sent by the external controller, adjusting the multimedia content set to be hidden according to the multimedia content set adjusting instruction.

Wherein the method further comprises:

detecting application prompt information to be displayed;

and carrying out hidden display on the privacy information contained in the application prompt information, or transferring the privacy information contained in the application prompt information to other related terminal equipment for display.

The application prompt information comprises at least one of the following: incoming call prompt information, short message prompt information, chat message prompt information, email prompt information, schedule prompt information and memo prompt information.

Wherein the method further comprises at least one of the following operations:

inhibit use of the specified application;

disabling a specified function in the specified application;

Prohibiting calling the multimedia content determined to be hidden;

privacy information in a specified application is hidden.

Wherein the multimedia content comprises at least one of the following:

an image, a portion of the content in the image, a video clip, a video image frame, a portion of the content in the video image frame, an audio clip.

In another aspect, there is also provided a privacy protecting apparatus, including:

the starting detection module is used for detecting starting the privacy protection mode;

the determining module is used for determining a multimedia content set to be hidden based on the appointed multimedia content;

and the display module is used for hiding the multimedia content set which is determined by the determination module and needs to be hidden.

In yet another aspect, a privacy protection method is provided, including:

the first terminal equipment determines a multimedia content set to be hidden when the second terminal equipment performs privacy protection based on the appointed multimedia content;

and the first terminal equipment sends the setting instruction corresponding to the multimedia content set to be hidden to the second terminal equipment.

Before the first terminal device determines that the second terminal device needs to hide the multimedia content set when performing privacy protection, the method further comprises the following steps:

and when the first terminal equipment detects that the second terminal equipment does not start the privacy protection mode, sending an instruction for starting the privacy protection mode to the second terminal equipment.

the first terminal equipment sorts the multimedia content which is not browsed currently in the second terminal equipment according to at least one of the theme, the object and the privacy information corresponding to the multimedia content;

the first terminal device displays the sequenced multimedia content.

The method for privacy protection of the second terminal device comprises the steps that a first terminal device determines a multimedia content set to be hidden when the second terminal device performs privacy protection, and specifically comprises the following steps: when the first terminal equipment detects that the second terminal equipment starts a privacy protection mode, determining a multimedia content set which is adjusted by a multimedia content set to be hidden when the second terminal equipment currently performs privacy protection based on the appointed multimedia content;

the first terminal device sends a setting instruction corresponding to the multimedia content set to be hidden to the second terminal device, and the method specifically comprises the following steps: and the first terminal equipment sends the multimedia content set adjusting instruction corresponding to the adjusted multimedia content set to be hidden to the second terminal equipment.

In still another aspect, there is provided a privacy protecting apparatus disposed in a first terminal device, including:

The determining module is used for determining a multimedia content set to be hidden when the second terminal equipment performs privacy protection based on the appointed multimedia content;

and the sending module is used for sending the setting instruction corresponding to the multimedia content set to be hidden, which is determined by the determining module, to the second terminal equipment.

The above technical scheme of this application has realized following technical effect:

the terminal equipment detects and opens the privacy protection mode, determines a multimedia content set to be hidden based on the appointed multimedia content, and finally hides the multimedia content set to be hidden, thereby realizing the privacy protection of the multimedia content.

Drawings

Fig. 1 is a flowchart of a privacy preserving method according to a first embodiment of the present application;

fig. 2 is a display diagram of finding out single images of all users B from single images of users B designated by users a and abbreviated and combined to a first image position display according to the first embodiment of the present application;

fig. 3 is a flowchart of a privacy preserving method according to a second embodiment of the present application;

fig. 4 is a display diagram of a terminal device according to a second embodiment of the present application when the terminal device determines a theme according to an image specified by a user;

fig. 5 is a flowchart of a privacy preserving method of embodiment three of the present application;

Fig. 6 is a flowchart of a method for determining a multimedia content set to be hidden and a publicly available multimedia content set according to a user type to which a current user belongs in accordance with the third embodiment of the present application;

fig. 7 is a flowchart of a method for determining a multimedia content set to be hidden and a publicly available multimedia content set according to an environment type to which a current environment belongs in accordance with the third embodiment of the present application;

fig. 8 is a display sequence diagram of a terminal device adjusting a publicable multimedia content according to an object corresponding to the multimedia content after a privacy protection mode is turned on in a fourth embodiment of the present application;

fig. 9 is a display diagram of an image of a hidden user B by an external controller according to the fourth embodiment of the present application;

fig. 10 is a display diagram of an image of a hidden user C by an external controller according to the fourth embodiment of the present application;

fig. 11 is a display diagram of the fifth embodiment of the present application when the user designates again that the single image of the user C is publicable after determining that the single image of the user B is publicable and incorporated into the first image position display;

FIG. 12 is an initial display diagram of a fifth embodiment of the present application after the privacy preserving mode is turned on;

fig. 13 is a display diagram of fig. 12 with the addition of a single photograph showing one user currently using the terminal device;

Fig. 14 is a display diagram for additionally displaying a group photo of a plurality of users currently using the terminal device in fig. 12;

fig. 15 is a display diagram of receiving and displaying incoming call prompt information after the privacy preserving mode is turned on in the sixth embodiment of the present application;

fig. 16 is a display diagram of hiding received hint information and displaying preset content after the privacy preserving mode is turned on in the sixth embodiment of the present application;

fig. 17 is a display diagram of transferring received hint information to an external controller for display after the privacy preserving mode is turned on in the sixth embodiment of the present application;

FIG. 18 is a display diagram of disabling related functions in an album application after a privacy preserving mode is enabled in accordance with a sixth embodiment of the present application;

fig. 19 is a display diagram of a prompt given by a terminal device before exiting a current account after a privacy protection mode is turned on in a sixth embodiment of the present application;

fig. 20 is a display diagram of a terminal device presenting a prompt before hiding history information after the privacy preserving mode is turned on in the seventh embodiment of the present application;

fig. 21 is a schematic structural diagram of a privacy protecting apparatus applied to a terminal device according to an embodiment of the present application;

fig. 22 is another structural schematic diagram of the privacy protecting apparatus applied to the terminal device according to the embodiment of the present application;

Fig. 23 is a schematic diagram of still another configuration of a privacy securing apparatus applied to a terminal device according to an embodiment of the present application;

fig. 24 is a schematic structural view of a privacy protecting apparatus applied to an external controller according to an embodiment of the present application;

fig. 25 is another structural schematic diagram of the privacy securing apparatus applied to the external controller according to the embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the present application is further described in detail below with reference to the accompanying drawings.

The embodiment of the application provides a privacy protection method and device. In the privacy protection method, the terminal equipment detects and starts the privacy protection mode, determines the multimedia content set to be hidden based on the appointed multimedia content, and finally hides the multimedia content set to be hidden, thereby realizing privacy protection of the multimedia content. The terminal equipment determines the multimedia content set to be hidden, then correspondingly determines the multimedia content set to be disclosed, and the terminal equipment hides the multimedia content set to be hidden and displays the multimedia content set to be disclosed.

In the prior art, a user needs to select a multimedia file, and the multimedia file is set to be hidden in a menu mode, so that privacy protection of the multimedia file is realized, and therefore, the user needs to select the multimedia files one by one and set the multimedia files, the operation is complex, and the working efficiency is low. In the privacy protection method of the embodiment of the application, after the terminal equipment detects that the privacy protection mode is started, based on the appointed multimedia content, all the multimedia content to be hidden can be determined and then the hidden protection is carried out, so that the effect of determining the privacy protection range in real time is realized, and as users only need to appoint a small amount of multimedia content, all the privacy protection ranges can be determined, the user operation workload is less, and the work efficiency is improved.

In the embodiment of the application, when the multimedia content set to be hidden is determined based on the specified multimedia content, the multimedia content with the same semantic information as the specified multimedia content can be searched from the stored multimedia content, and then the multimedia content set to be hidden is determined based on the searched multimedia content. Wherein the semantic information comprises at least one of the following: objects, number of objects, scene, event.

If an instruction for publicly specifying the multimedia content is detected, determining that the multimedia content set to be hidden does not contain the searched multimedia content; if an instruction for hiding the appointed multimedia content is detected, determining that the multimedia content set to be hidden contains the searched multimedia content; if the appointed multimedia content meets the hiding condition, determining that the multimedia content set to be hidden contains the searched multimedia content; if the appointed multimedia content meets the disclosure condition, determining that the multimedia content set to be hidden does not contain the searched multimedia content. Wherein the hiding condition includes: specifying that the multimedia content contains specified privacy information; and/or designating a theme of the multimedia content as a designated theme; the disclosed conditions include: the specified multimedia content does not contain specified privacy information; and/or, the subject matter of the specified multimedia content is not the specified subject matter; and/or only multimedia content of the user who is currently using the terminal device.

Wherein the specified multimedia content comprises at least one of: designating multimedia contents contained in the multimedia file; specifying specified content contained in the multimedia file; designating multimedia content corresponding to the theme; designating multimedia content corresponding to the subject to which the multimedia file belongs; multimedia content containing a specified object; multimedia content including objects in a specified multimedia file; multimedia content containing specified privacy information; multimedia content including private information in a specified multimedia file; multimedia content corresponding to a user type to which a current user belongs; and the multimedia content corresponding to the environment type of the current environment.

Wherein the multimedia content comprises at least one of the following: an image, a portion of the content in the image, a video clip, a video image frame, a portion of the content in the video image frame, an audio clip. The multimedia contents may be multimedia contents stored in the terminal device after the user photographs through the photographing device; or multimedia content acquired by a user through the Internet and the like; or may be multimedia content obtained by editing (e.g., cutting, synthesizing, toning, etc.) the stored multimedia content.

Example 1

As shown in fig. 1, the privacy protection method according to the first embodiment of the present application includes the following steps:

step S101, detecting a privacy protection mode starting instruction;

step S102, finding out the multimedia content which is the same as the semantic information of the appointed multimedia content;

the terminal device firstly acquires specified multimedia content, wherein if the user specifies a multimedia file and/or specifies part of the content in the multimedia file, the specified multimedia content comprises: specifying multimedia content contained in the multimedia file, and/or specifying specified content contained in the multimedia file.

For example, if a user designates an image in the album by pressing for a long time, the image is the designated multimedia file, the content in the image is the multimedia content included in the designated multimedia file, or if the user designates an image portion of the user B (the image includes an image portion of the user B and an image portion of the user C) in the image in the album by pressing for a long time, the image portion of the user B in the image is the designated content included in the designated multimedia file.

The specified multimedia content may be plural, and the user may specify plural multimedia files or plural portions of the content in the multimedia files, that is, the specified multimedia files may be plural, and the specified content included in the specified multimedia files may be plural.

For example, the image a is the above specified multimedia file, the terminal device searches the stored multimedia content for the multimedia content identical to the semantic information of the image a, or the image portion of the user B in the image a is the specified content contained in the above specified multimedia file, and the terminal device searches the stored multimedia content for the multimedia content identical to the semantic information of the image portion of the user B in the image a.

In the actual implementation process, the user can specify the multimedia content first and then send out a command for starting the privacy protection mode; or firstly sending out a command for starting the privacy protection mode, and then designating the multimedia content; the multimedia content may also be specified and the instruction to turn on the privacy preserving mode may be issued simultaneously.

In step S102, the terminal device combines technologies such as image recognition, text recognition, and image classification to find multimedia content identical to the specified multimedia content in at least one semantic information such as objects, number of objects, scenes, and events.

For example, if the user a designates an image that includes only the user B, the images that are identical to the semantic information of the image include only the user B, or if the user a designates an image that includes only the user B and moves, the images that are identical to the semantic information of the image include only the user B and move.

Step S103, judging whether an instruction for publishing the specified multimedia content or an instruction for hiding the specified multimedia content is detected, if the instruction for publishing the specified multimedia content is detected, executing step S104, and if the instruction for hiding the specified multimedia content is detected, executing step S105;

step S104, determining that the publicable multimedia content set contains the multimedia content searched in the step S102, wherein the multimedia content set to be hidden does not contain the multimedia content searched in the step S102;

in the actual implementation process, after detecting a command of starting the privacy protection mode of a user, the terminal device may first enter a privacy protection preset mode, set a multimedia content set to be hidden and a multimedia content set to be disclosed in the privacy protection preset interface, and after the user completes the setting, confirm that the privacy protection mode is started by one or more combinations of voice, keys, gestures, biological characteristics, an augmented reality man-machine interaction interface, an external controller and the like. After the terminal equipment detects the confirmation instruction, the privacy protection preset mode is switched to the privacy protection mode, and the multimedia content set to be hidden is hidden.

In step S104, the terminal device may further detect whether a public multimedia content set includes a multimedia content containing the specified privacy information, and if so, remove the multimedia content from the public multimedia content set, and rank the display order of the multimedia content in the privacy protection preset interface to a later position. The above specified privacy information may be at least one of the following contents related to personal privacy: personal identity information, personal account information, financial billing information, bank card information, and the like. The specified privacy information may be preset by the system or may be specified in advance by a user, for example, the user specifies that the personal identity information and the personal account information are protected during privacy protection, and the terminal device may perform privacy protection on the multimedia content including the personal identity information and the personal account information when the privacy protection is required subsequently. In addition, the specified privacy information can be specified by the user in real time in the process of starting privacy protection or performing privacy protection.

In addition, when the user sets the specified multimedia content in the privacy protection preset interface, multiple settings may be required, so as to facilitate the user to set the specified multimedia content again. In addition, other multimedia contents can be displayed and marked as hidden after being ordered according to a preset ordering mode, wherein the preset ordering mode can be at least one of the following information ordering modes: and the association degree, the corresponding theme, the corresponding object and the contained privacy information of the determined publicable multimedia content. For example, the other multimedia contents are sequentially displayed in order of the degree of association with the publicable multimedia contents from the highest to the lowest, and the multimedia contents not including the privacy information are preferentially displayed, and the multimedia contents including the privacy information are displayed later.

In addition, before displaying the other sequenced multimedia contents, the multimedia contents with the same association degree with the determined publicable multimedia contents in the other multimedia contents can be integrated and displayed or the appointed number of multimedia contents can be selected for preferential display. By the method, the determined contents can be integrated and displayed in the user setting process, and the undetermined contents are differentially presented, so that the user can quickly set and designate the multimedia contents, and the time for starting and setting privacy protection is shortened.

For example, as shown in fig. 2, the user a wants to watch the images of the user B to friends, designates a single image of the user B, gives an instruction to open the designated multimedia content, and after the terminal device searches the single images of all the users B based on the images designated by the user a, determines that the publicly available multimedia content set contains the searched single images of the user B, detects whether the publicly available multimedia content set contains images of private pictures, and as a result, detects images of several private pictures containing the user B, the images are moved out of the publicly available multimedia content set, and the display order of the images in the privacy protection preset interface is put back. The user B single image in the publicable multimedia content set is abbreviated and displayed at the position of the first image, and marked as publicable. The terminal equipment can sort other images according to the degree of association with the determined public single user B image, and the images with high degree of association are ranked in front. For example, the group photo of the user B and other people is arranged at the forefront, and the image of the other people in the group photo is arranged at a position relatively forward. Meanwhile, for the currently determined multimedia content to be hidden, one or more representative multimedia contents can be selected from different types of multimedia contents respectively, and the multimedia contents are preferentially arranged in front. Wherein the types of multimedia contents may be divided by scene, object, etc.

In addition, the display sequence of the multimedia content in the privacy protection preset interface may not be changed, that is, after the terminal device searches the publicable multimedia content according to the specified multimedia content set by the user, the terminal device marks the multimedia content on the basis of not changing the original display sequence. The method has the advantages that the user can clearly preview the specific part of the image marked as publicable under the condition of keeping the original display sequence unchanged, and the user can conveniently adjust the original display sequence.

It is also possible to change only the display order of a part of the multimedia contents, for example, to adjust only the display order of the multimedia contents determined to be publicable, and the display order of the other multimedia contents is not changed. For another example, only the display order of the other multimedia contents is changed, and it is determined that the display order of the publicable multimedia contents is unchanged.

Step S105, determining that the publicable multimedia content set does not contain the multimedia content searched in step S102, and the multimedia content set to be hidden contains the multimedia content searched in step S102;

in step S105, the terminal device may integrate and display the multimedia content currently determined to be hidden in the privacy protection preset interface, specifically, typeset a plurality of multimedia contents to be hidden on the same image position to display and mark the same as the multimedia content to be hidden, and finally, may thumbnail all the multimedia contents to be hidden to a small number of image positions to display, so that the user may quickly view the remaining multimedia contents and re-designate the multimedia contents. In addition, other multimedia contents can be displayed and marked as publicable after being ordered according to a preset ordering mode, wherein the preset ordering mode can be ordered according to at least one of the following information: and the association degree, the corresponding theme, the corresponding object and the contained privacy information of the multimedia content to be hidden are determined.

In addition, before displaying the other sequenced multimedia contents, the multimedia contents with the same association degree with the determined multimedia contents to be hidden in the other multimedia contents can be integrated and displayed or the appointed number of multimedia contents can be selected for preferential display. By the method, the determined contents can be integrated and displayed in the user setting process, and the undetermined contents are differentially presented, so that the user can quickly set and designate the multimedia contents, and the time for starting and setting privacy protection is shortened.

In addition, the display sequence of the multimedia content in the privacy protection preset interface may not be changed, that is, after the terminal device searches the multimedia content to be hidden according to the specified multimedia content set by the user, the terminal device marks the multimedia content on the basis of not changing the original display sequence. The method has the advantages that the user can clearly preview the specific part of the image marked to be hidden under the condition of keeping the original display sequence unchanged, and the user can conveniently adjust the original display sequence.

It is also possible to change only the display order of a part of the multimedia contents, for example, only the display order of the multimedia contents determined to be hidden is adjusted, and the display order of other multimedia contents is not changed. For another example, only the display order of other multimedia contents is changed, and it is determined that the display order of the multimedia contents to be hidden is unchanged.

Through the above steps S102 to S105, the multimedia content set to be hidden and the publicable multimedia content set are determined based on the specified multimedia content set by the user.

Step S106, after the confirmation instruction is detected, a privacy protection mode is started, a publicly available multimedia content set is displayed, and the multimedia content set to be hidden is hidden.

When the specified multimedia content is an image and/or part of the content in the image, the terminal equipment analyzes semantic information such as objects, object number, scenes, events and the like in the specified multimedia content through technologies such as image classification, image recognition algorithm and the like, and searches for the image, part of the content in the image, video fragment, video image frame, part of the content in the video image frame, audio and audio fragment which are the same as the specified multimedia content in at least one semantic information in the multimedia library. After the privacy protection mode is turned on, when a certain video is played, only the multimedia content determined to be publicable is played, and other multimedia content determined to be hidden is skipped when playing. When the video image frame serving as the video cover in a certain video is determined to be needed to be hidden, the video cover of the video is replaced by the first frame of the video image frame which can be disclosed on the display interface of the terminal equipment.

When the multimedia content is designated as at least one of the following: when video, video clips, video image frames, portions of content in video image frames, a user may specify not only the entire video file, but also clips (made up of multiple consecutive video image frames) in the video file, one or more video image frames in the video file, and portions of content in the video image frames. The terminal device analyzes semantic information such as objects, object numbers, scenes, events and the like in the appointed multimedia content through technologies such as image classification, image recognition algorithm and the like, and searches images, partial contents in the images, videos, video clips, video image frames and partial contents, audios and audio clips in the video image frames which are the same as the appointed multimedia content in at least one piece of semantic information in the multimedia library.

When the appointed multimedia content is audio and/or audio fragment, extracting semantic information in the appointed audio and/or audio fragment by voice recognition, semantic recognition and other technologies, and searching the image, part of the content, video fragment, video image frame and part of the content, audio and audio fragment in the multimedia library which are the same as the appointed audio and/or audio fragment in the semantic information according to the semantic information.

In addition, in the actual implementation process, after receiving an instruction of starting a privacy protection mode of a user, the terminal equipment enters a privacy protection preset mode, if an instruction of disclosing specified multimedia content is detected, the fact that the displayable multimedia content set contains the multimedia content searched in the step S102 is determined, the multimedia content set to be hidden does not contain the multimedia content searched in the step S102, the multimedia content determined to be openable is marked as openable in a privacy protection preset interface, and the multimedia content determined to be hidden is marked as hidden; if an instruction for hiding the appointed multimedia content is detected, determining that the publicly available multimedia content set does not contain the multimedia content searched in the step S102, wherein the multimedia content to be hidden contains the multimedia content searched in the step S102, marking the multimedia content determined to be hidden as hidden in a privacy protection preset interface, and marking the multimedia content determined to be publicly available as publicly available; and finally, after receiving the confirmation instruction, entering a privacy protection mode, displaying the multimedia content marked as publicable, and hiding the multimedia content marked as the multimedia content to be hidden.

Or after receiving an instruction of starting a privacy protection mode of a user, not entering a privacy protection preset mode, and if an instruction of publicly specifying the multimedia content is received, determining that the publicly available multimedia content set contains the multimedia content searched in the step S102, wherein the multimedia content set to be hidden does not contain the multimedia content searched in the step S102; if an instruction for hiding the specified multimedia content is received, determining that the multimedia content searched in the step S102 is not contained in the publicly available multimedia content set and is needed to be hidden, wherein the multimedia content set to be hidden contains the multimedia content searched in the step S102; and finally, after receiving the confirmation instruction, entering a privacy protection mode, displaying the multimedia content determined to be publicable, and hiding the multimedia content determined to be needed to be hidden.

The user can trigger the instruction for opening the privacy protection mode and the instruction for disclosing the appointed multimedia content at the same time, the terminal equipment can detect the two instructions at the same time, in addition, the user can trigger the instruction for opening the privacy protection mode and the instruction for hiding the appointed multimedia content at the same time, and the terminal equipment can detect the two instructions at the same time.

The following is illustrative: user a wishes to give friends an image of user B in the terminal device, but the terminal device also holds some images of the scene which are more private and which are not suitable for exposure to friends.

Example 1: the method comprises the steps that a user starts an image browsing mode, presses a certain user B image for a long time, shakes a terminal device up and down, enters a privacy protection preset mode after receiving a privacy protection mode starting instruction and a multimedia content publishing instruction which are generated by shaking the terminal device up and down, confirms a public multimedia content set according to the user B image which is specified by the user through long-time pressing operation, marks the public image as a public image in a privacy protection preset interface, marks the rest images as a hidden image, and the user shakes the terminal device again to generate a confirmation instruction, and starts the privacy protection mode and displays the confirmed public image after the terminal device detects the confirmation instruction. After that, the user gives the terminal device to the friend, who can only see the image related to the publicable user B.

Example 2: the user starts an image browsing mode, discovers that some images contain private pictures, the user does not want the pictures to be seen by friends, presses the user on a certain image containing the private pictures for a long time, shakes the terminal equipment left and right, enters a privacy protection preset mode after receiving a privacy protection mode starting instruction and a multimedia content hiding instruction generated by the user by shaking the terminal equipment left and right, determines a multimedia content set to be hidden according to the image containing the private pictures, which is specified by the user through long press operation, for example, the image containing the specified private pictures, marks the images as to be hidden in a privacy protection preset interface, other images are marked as to be publicable, and shakes the terminal equipment again to generate a confirmation instruction, so that the terminal equipment starts the privacy protection mode and only displays publicable multimedia content. After that, the user gives the terminal device to the friend, and the friend cannot see all the images comprising the private picture.

All instructions in the embodiments of the present application, including an instruction to start a privacy protection mode, an instruction to open a specified multimedia content, an instruction to hide a specified multimedia content, a confirmation instruction, and the like, may be generated by one or more combinations of voice, keys, gestures, biological features, an augmented reality human-computer interaction interface, an external controller, and the like.

Specifically, in the voice mode, the user may preset voices corresponding to the instruction to turn on the privacy protection mode, for example, "see the images for you", disclose voices corresponding to the instruction to specify the multimedia content, for example, "disclose the images", hide voices corresponding to the instruction to specify the multimedia content, for example, "hide the images", confirm voices corresponding to the instruction, for example, "confirm the images"; after the terminal equipment recognizes the voice instructions, corresponding operations are executed. In addition, the same preset voice may also correspond to a plurality of instructions, for example, "see you for these images" corresponds to an instruction to turn on the privacy preserving mode and an instruction to publicly specify multimedia contents.

In the key manner, the keys may be hardware keys, different hardware keys correspond to different instructions, for example, long-press of the volume key or the Home key corresponds to an instruction for starting the privacy protection mode, and the user generates an instruction for starting the privacy protection mode by long-press of the volume key or the Home key; the buttons can also be virtual buttons, such as virtual control buttons, menus and the like on a screen, the terminal equipment can display the virtual buttons in an interface of a multimedia content browsing mode, and a user can generate different instructions by pressing different virtual buttons; in addition, various characteristic information such as pressure, speed, time, frequency and the like of the user key can be combined to represent different meanings, such as clicking an instruction corresponding to disclosure of the specified multimedia content, repeatedly clicking an instruction corresponding to hiding of the specified multimedia content, for example, clicking an instruction corresponding to disclosure of the specified multimedia content for a long time, clicking an instruction corresponding to hiding of the specified multimedia content for a quick time, and the like. In addition, the same key may also correspond to a plurality of instructions, for example, a re-press of an instruction corresponding to turning on the privacy preserving mode and an instruction to hide the specified multimedia content.

In the gesture mode, the gesture includes a screen gesture, such as a double-click screen, a long-press screen, and the like, and various characteristic information such as pressure, speed, time, frequency, and the like of the gesture can be combined to represent different meanings, such as a light press corresponding to an instruction for publicly designating the multimedia content, a heavy press corresponding to an instruction for hiding the designated multimedia content, a long press corresponding to an instruction for publicly designating the multimedia content, a quick double-click corresponding to an instruction for hiding the designated multimedia content, and the like. The gestures also include blank gestures, such as shaking, flipping, tilting, and the like, in which different directions, angles, speeds, durations, and forces may represent different meanings during shaking, flipping, tilting, and the like, such as shaking up and down, corresponding to commands for publishing a specified multimedia content, shaking left and right, corresponding to commands for hiding a specified multimedia content, and tilting left, corresponding to commands for displaying, and tilting right, corresponding to commands for hiding a specified multimedia content. The gestures may be single gestures or any combination of any gestures, such as pressing a screen for a long time and shaking the terminal device corresponding to an instruction for publishing the specified multimedia content, pressing a screen for a long time and flipping the terminal device corresponding to an instruction for hiding the specified multimedia content. In addition, the same gesture may also correspond to multiple instructions, for example, a shake-left corresponding to an instruction to turn on the privacy preserving mode and an instruction to hide specified multimedia content.

In the biometric feature mode, the biometric feature may be a handwriting feature, a fingerprint feature, or a voiceprint feature, and the terminal device determines that an instruction for starting the privacy protection mode is received if it is determined that the detected biometric feature is consistent with a biometric feature of a user registered in advance in the multimedia content browsing mode. At this time, the user may generate an instruction to open the specified multimedia content, an instruction to hide the specified multimedia content, or a confirmation instruction by means of a combination of one or more of voice, key, gesture, and external controller.

In the external controller mode, the external controller may be a handwriting pen associated with the terminal device, for example, after the terminal device detects that the handwriting pen is taken out and then is quickly inserted back, or a preset key on the handwriting pen is pressed, or a user makes a preset air gesture by using the handwriting pen, and then confirms that a corresponding instruction is received; the external controller may also be a wearable device or other devices associated with the terminal device, where the wearable device may be a smart watch, smart glasses, etc., the other devices may be other mobile phones or other accessories or independent devices, the wearable device or other devices may establish a connection with the terminal device through any one of WIFI (wireless fidelity), NFC (Near Field Communication), bluetooth, and a data network, and the wearable device or other devices may generate an instruction to start a privacy protection mode, an instruction to disclose specified multimedia content, an instruction to hide specified multimedia content, and an acknowledgement instruction, etc. through at least one of voice, keys, gestures, and biological features.

In the method of the embodiment of the application, a user only needs to specify the multimedia content, the terminal equipment can find the multimedia content which is the same as the semantic information of the specified multimedia content, and when an instruction of the user for publishing the specified multimedia content is detected, the fact that the publicable multimedia content contains the found multimedia content in a concentrated manner is determined, and the multimedia content which needs to be hidden does not contain the found multimedia content in the concentrated manner is determined; when an instruction of hiding appointed multimedia content of a user is detected, the fact that the public multimedia content set does not contain the searched multimedia content is determined, the multimedia content to be hidden contains the searched multimedia content in the set, and further, after a privacy protection mode is started, the multimedia content to be hidden is hidden, and the public multimedia content is displayed. The user can hide the related multimedia content only by designating a small amount of multimedia content without selecting the multimedia content to be hidden one by one and setting the multimedia content, so that the operation is simplified and the efficiency is improved.

In addition, the privacy protection can be carried out on the whole video, and the privacy protection can be carried out on video image frames, video clips and/or partial contents in the video image frames, so that more privacy protection requirements of users are met.

In the above method of the embodiment of the present application, before the privacy protection mode is turned on, after the privacy protection preset mode is turned on, and after the privacy protection mode is turned on, the user may further adjust the multimedia content to be hidden and the multimedia content that can be disclosed. In addition, when the user sets the specified multimedia content in the privacy protection preset interface, multiple settings may be required, so that in order to facilitate the user to set the specified multimedia content again, the determined multimedia content to be hidden or publically disclosed can be integrated and displayed, and other multimedia contents are displayed after being ordered, thereby facilitating the user to quickly look up.

In addition, a plurality of instruction issuing modes are provided for users, and the instruction issuing modes are more diversified and flexible.

Example two

As shown in fig. 3, the privacy protection method in the second embodiment of the present application includes the following steps:

step S201, detecting a privacy protection mode starting instruction;

step S202, finding out the multimedia content conforming to the specific type;

wherein the specific types include at least one of: specifying a theme, specifying a theme to which a user-specified multimedia file belongs, specifying an object in the multimedia file, specifying privacy information, and specifying privacy information in the multimedia file.

The specific type of multimedia content may be considered as the above-described specified multimedia content. Wherein the specified multimedia content comprises at least one of: designating multimedia content corresponding to the theme; designating multimedia content corresponding to the subject to which the multimedia file belongs; multimedia content containing a specified object; multimedia content including objects in a specified multimedia file; multimedia content containing specified privacy information; multimedia content containing private information in a specified multimedia file. The terminal device finds multimedia content conforming to a specific type, and it can be considered that the terminal device finds multimedia content identical to semantic information of the specified multimedia content.

Step S203, judging whether an instruction for publishing the specified multimedia content or an instruction for hiding the specified multimedia content is received, if the instruction for publishing the specified multimedia content is received, executing step S204, and if the instruction for hiding the specified multimedia content is received, executing step S205;

step S204, determining that the publicable multimedia content set contains the multimedia content searched in the step S202, and the multimedia content set to be hidden does not contain the multimedia content searched in the step S202;

Step S205, determining that the publicable multimedia content set does not contain the multimedia content searched in step S202, and the multimedia content set to be hidden contains the multimedia content searched in step S202;

step S206, after detecting the confirmation instruction, starting a privacy protection mode, displaying the publicable multimedia content set, and hiding the multimedia content set to be hidden.

When the particular type includes a specified topic and/or a topic to which the user-specified multimedia file belongs, one or more topic types to be hidden (or disclosed) may be specified by the user, such as: and the terminal equipment searches multimedia contents (images, partial contents in the images, videos, video clips, video image frames, partial contents in the video image frames, audios and audio clips) which accord with the specified theme according to the specified theme, and hides (or discloses) the multimedia contents, wherein the multimedia contents which accord with the specified theme are multimedia contents with the same semantic information as the multimedia contents corresponding to the specified theme.

Or, at least one multimedia file may be designated by the user, the terminal device determines the theme to which the designated multimedia file belongs by using technologies such as image detection, image classification, image recognition, and the like, and then, in combination with detailed information such as shooting time and shooting location, all multimedia contents (including images, partial contents in images, videos, video clips, video image frames, partial contents in video image frames, audio and audio clips) conforming to the determined theme are searched for and hidden (or disclosed), where the multimedia contents conforming to the determined theme are multimedia contents having the same semantic information as the multimedia contents corresponding to the theme to which the designated multimedia file belongs.

As shown in fig. 4, the terminal device includes two types of subject images: the method comprises the steps that a user designates an image of a dog and gives out an instruction for publishing appointed multimedia content when the user wants to disclose the image of the dog and the image of a person, and the terminal equipment determines that the theme of the designated image is the dog, and then searches all images conforming to the theme, so that the images of all dogs can be searched, the found images can be determined to be publically disclosed, and the rest images, namely the images of the person, are determined to be hidden.

In this embodiment of the present invention, the theme of the multimedia content may be divided according to the object type, the event type, the scene type, etc. corresponding to the multimedia content, for example, when the object type corresponding to the multimedia content is a person, the theme may be a person, when the event type corresponding to the multimedia content is sports, the theme may be sports, and when the scene type corresponding to the multimedia content is outdoor, the theme may be outdoor.

When a particular type includes a specified object and/or an object in a multimedia file, one or more objects to be hidden (or disclosed) may be specified by a user, such as: the terminal device searches all multimedia contents (images, partial contents in images, videos, video clips, video image frames, partial contents in video image frames, audios and audio clips) containing the specified object or only containing the specified object according to the specified object to hide (or disclose), wherein the contained object belongs to the specified object or only contains the multimedia content of the specified object, namely, the multimedia content which is the same as semantic information of the multimedia content containing the specified object.

Or, one or more objects in at least one multimedia file may be designated by the user, for example, a person image is designated and one or more faces are selected by a frame, and the terminal device searches, according to the designated object, for the multimedia content (image, partial content in the image, video clip, video image frame, partial content in the video image frame, audio clip) that includes the object belonging to the designated object or that includes only the designated object, that is, the multimedia content that is the same as the semantic information of the multimedia content that includes the object in the designated multimedia file, to hide (or disclose).

When the specific type includes the specified private information and/or the private information in the specified multimedia file, the user may specify one or more types of private information to be hidden (or disclosed), such as personal identity information, personal account information, private images, private articles, and the like, and the terminal device searches for the multimedia content (image, partial content in the image, video clip, video image frame, partial content in the video image frame, audio, and audio clip) containing the private information belonging to the specified private information to be hidden (or disclosed), where the multimedia content containing the private information belonging to the specified private information is the same multimedia content as the semantic information of the multimedia content containing the specified private information.

Or, one or more multimedia files containing private information may be designated by the user, for example, an image containing a personal identification card is designated, the terminal device analyzes and obtains, according to the designated multimedia file, the private type of the private information contained in the designated multimedia file by using technologies such as image detection, image classification, image recognition, and the like, and then, by combining detailed information such as shooting time and shooting place, the multimedia content (image, part of the content in the image, video clip, video image frame, part of the content in the video image frame, audio, and audio clip) containing the private information belonging to the determined private type is searched for and hidden (or disclosed), where the multimedia content containing the private information belonging to the determined private type is the multimedia content identical to the semantic information of the multimedia content containing the private information in the designated multimedia file.

In the first and second embodiments, the user may generate the instruction to exit the privacy protection mode by using one or more of voice, keys, gestures, biological features, an augmented reality man-machine interface, and an external controller, and the terminal device may exit the privacy protection mode after detecting the instruction to exit the privacy protection mode; or the terminal device can also automatically detect the current environment type and the current user type of the user, and exit the privacy protection mode partially or completely.

In the method of the second embodiment of the present application, the user designates a specific type (at least one of a theme, an object and privacy information), and the terminal device may determine, according to the type designated by the user, multimedia content that needs to be hidden (or publically) and conforms to the designated type; or, the user can designate the multimedia file, the terminal device can determine the specific type (designate at least one of the subject to which the multimedia file belongs, the object contained and the privacy information contained) according to the multimedia file designated by the user, then determine the multimedia content which is required to be hidden (or can be disclosed) and accords with the determined type, so that the related multimedia content can be hidden without selecting the multimedia content which is required to be hidden one by one and setting, the operation is simplified, and the efficiency is improved.

Example III

In this embodiment, the multimedia content set to be hidden and the multimedia content set to be disclosed may also be determined according to the user type of the user or the environment type of the terminal device.

When determined according to the user type of the user, as shown in fig. 5, the privacy preserving method includes the steps of:

step S301, determining a user type to which a user currently using the terminal device (i.e., a current user or a current user) belongs;

In the actual implementation process, step S301 may be performed after a user' S instruction to open the privacy protection mode is detected, or step S301 may be performed after an application related to user privacy, such as a multimedia application, is detected to be opened, which is not limited in the embodiment of the present application.

Multiple user types may be predefined by the user, each user type corresponding to a set of publicly available multimedia content or to a set of multimedia content to be hidden.

Contacts in the address book, contacts in the chat application program and the like can be manually added into different user types by the user; or, the terminal device may automatically add, for example, automatically detect a face object in the multimedia content, and if the face object is consistent with an avatar of a certain contact in the address book, add the contact to a corresponding user type according to a group to which the contact belongs; or, according to analysis of historical chat records, short message records and the like in the chat application program, the intimacy degree between different contacts and the owner is obtained, so that the different contacts are added into different user types.

In addition, one or more kinds of characteristic information corresponding to each user, such as face characteristics, fingerprint characteristics, voiceprint characteristics, handwriting signature characteristics, biological characteristics (such as fingerprint, heart rate and the like) and the like, are stored in the terminal equipment in advance. In the using process, the characteristic information of the user who is currently using the terminal equipment is detected and matched with the characteristic information stored in advance, so that the user who is currently using the terminal equipment is determined, and the user type to which the user belongs is further determined.

For example, the owner is added to the highest user type in advance, head portrait information, fingerprint information, handwritten signature information, voiceprint information and the like of the owner are recorded, and in the process that the owner uses the terminal equipment, the terminal equipment detects whether the user currently using the terminal equipment only contains the owner according to the stored characteristic information, and if so, all multimedia contents in the terminal equipment are visible.

Step S302, searching a set of multimedia contents corresponding to the user type determined in step S301;

step S303, judging whether the searched set of the multimedia contents is publicable or to be hidden, if so, executing step S304, and if so, executing step S305;

Step S304, determining that the publicly available multimedia content set contains the searched multimedia content set, and the multimedia content set to be hidden does not contain the searched multimedia content set;

step S305, determining that the publicly available multimedia content set does not contain the searched multimedia content set, and the multimedia content set to be hidden contains the searched multimedia content set;

step S306, a privacy protection mode is started, a publicly available multimedia content set is displayed, and the multimedia content set to be hidden is hidden.

Through the steps S303 to S305, the multimedia content set to be hidden may be determined based on the multimedia content found in step 302.

When determined by the environment type, a plurality of environment types may be predefined by the user, each environment type corresponding to a set of publicly available multimedia contents or to a set of multimedia contents to be hidden. After receiving a command of opening a privacy protection mode of a user, or after detecting that an application program related to user privacy such as a multimedia application program is opened, the terminal device can determine the environment type of the environment (i.e. the current environment) where the terminal device is currently located through a GPS (global positioning system), a camera device, voice and environment information (such as a conference mode, an outdoor mode and the like in scene mode setting) contained in the user setting, and then the terminal device searches a multimedia content set corresponding to the determined environment type, namely, searches multimedia content which can be disclosed or needs to be hidden in the determined environment type, thereby obtaining a publicly-disclosed multimedia content set and a multimedia content set needing to be hidden, and finally, after opening the privacy protection mode, displaying the publicly-disclosed multimedia content set and hiding the multimedia content set needing to be hidden. For example, multimedia content which is unsafe in the determined environment type is searched for as multimedia content to be hidden, and multimedia content which is safe in the determined environment type is searched for as publicly available multimedia content. In this way, the terminal device can determine the publicable multimedia content set based on the multimedia content corresponding to the environment type to which the current environment belongs.

For example, as shown in fig. 6, the method for determining a multimedia content set to be hidden and a publicly available multimedia content set according to a user type of a current user includes the steps of:

step S401, classifying the multimedia content in the terminal equipment to obtain a plurality of multimedia content classification sets;

for example, the multimedia content stored in the terminal device can be classified into: individuals, homes, offices, outdoors, etc.

Step S402, detecting the user type of the current user;

specifically, the current user can be detected through the camera device, and the current user can be comprehensively detected through different unlocking modes, handwriting features, gestures, biological features (such as fingerprints, heart rate and the like) and wearable equipment combined with the user, and the user type of the current user is determined.

Step S403, for each multimedia content classification set, judging whether the multimedia content in the multimedia content classification set is safe to the user type to which the current user belongs, if yes, executing step S404, otherwise, executing step S405;

step S404, determining that the publicable multimedia content set contains the multimedia content in the multimedia content classified set, and the multimedia content set to be hidden does not contain the multimedia content in the multimedia content classified set;

Step S405 determines that the publicable multimedia content set does not include the multimedia content in the multimedia content classified set, and the multimedia content set to be hidden includes the multimedia content in the multimedia content classified set.

As shown in fig. 7, the method for determining the multimedia content set to be hidden and the publicable multimedia content set according to the environment type of the current environment includes the following steps:

step S501, classifying the multimedia content in the terminal equipment to obtain a plurality of multimedia content classification sets;

Step S502, obtaining the environment type of the current environment (namely, the current environment) of the terminal equipment;

specifically, the environment type of the current environment (i.e., the current environment) of the terminal device can be determined through the GPS, the camera, the voice, and the environment information (such as a conference mode and an outdoor mode in a scene mode setting) included in the user setting.

Step S503, for each multimedia content classification set, judging whether the multimedia content in the multimedia content classification set is safe to the environment type of the current environment, if so, executing step S504, otherwise, executing step S505;

Step S504, determining that the publicable multimedia content set contains the multimedia content in the multimedia content classified set, and the multimedia content set to be hidden does not contain the multimedia content in the multimedia content classified set;

in step S505, it is determined that the publicable multimedia content set does not include the multimedia content in the multimedia content classification set, and the multimedia content set to be hidden includes the multimedia content in the multimedia content classification set.

In addition, the method can also comprehensively judge which multimedia content is safe to the user type under the environment type and which multimedia content is unsafe to the user type under the environment type by combining the user type of the user (namely the current user or the current user) which uses the terminal equipment and the environment type of the environment in which the terminal equipment is currently positioned.

In the method of the embodiment, the terminal device can automatically determine the multimedia content set to be hidden and the multimedia content set to be disclosed according to the user type of the current user and/or according to the environment type of the current environment, so that the automatic determination of the privacy protection range is realized, the operation is simplified, and the working efficiency is improved.

Example IV

The mode of starting the privacy protection mode on the terminal device comprises the following steps: a quick opening mode and a setting and opening mode.

In the quick opening mode, the user does not need to specify the content to be disclosed or hidden, and the terminal equipment automatically analyzes the publicable multimedia content set and the multimedia content set to be hidden. The user firstly sends a privacy protection mode starting instruction through any one or combination of a voice mode, a key mode, a gesture mode, a biological characteristic mode, an augmented reality man-machine interaction interface, an external controller and the like, after the privacy protection mode starting instruction is detected, the terminal equipment searches multimedia content which is the same as semantic information of the appointed multimedia content, the appointed multimedia content is the multimedia content meeting the hiding condition or the disclosing condition, if the appointed multimedia content is the multimedia content meeting the hiding condition, the publicly available multimedia content is determined not to contain the searched multimedia content, the multimedia content set to be hidden contains the searched multimedia content, if the appointed multimedia content is the multimedia content meeting the disclosing condition, the publicly available multimedia content set is determined to contain the searched multimedia content, and the multimedia content set to be hidden does not contain the searched multimedia content. And finally, after the terminal equipment detects the confirmation instruction, starting a privacy protection mode, displaying a publicable multimedia content set, and hiding the multimedia content set to be hidden.

Wherein the hiding condition includes at least one of: the specified multimedia content contains specified privacy information (such as user personal identity information); the theme of the multimedia content is designated as a designated theme.

The disclosure conditions include at least one of: the specified multimedia content does not contain specified privacy information (e.g., the scene is multimedia content of a public place); the subject matter of the specified multimedia content is not the specified subject matter; only multimedia content of the user who is currently using the terminal device. Wherein, the specified subject may be a human subject.

In the actual implementation process, the terminal device can find the multimedia content consistent with the semantic information of the multimedia content meeting the hiding condition or the disclosure condition from the multimedia content which is not browsed, thereby determining the multimedia content to be hidden and the multimedia content which can be disclosed, and automatically entering the privacy protection mode.

When the user sends a privacy protection mode starting instruction through an external controller mode, the external controller can be a handwriting pen, a wearable device or other devices related to the terminal device, wherein the wearable device can be an intelligent watch, an intelligent glasses or the like, the other devices can be mobile phones, accessories or independent devices or the like, and the wearable device or the other devices can be connected with the terminal device through WIFI, NFC, bluetooth or a data network or the like.

For example, the terminal device is already on the friend's hand, but at this point the privacy protection mode is not on, and the user suddenly thinks that there are some private images in the album, which is not desired to be seen by the friend. At this time, the user may send a command for starting the privacy protection mode to the terminal device through the external controller, so that the terminal device starts the privacy protection mode.

In the quick opening mode, the terminal device can detect the multimedia content consistent with the semantic information of the multimedia content meeting the hiding condition or the public condition through technologies such as scene detection, character detection and the like in image recognition. Further, the terminal device may further detect whether the multimedia content includes a private picture through an image recognition algorithm, recognize text content in the multimedia content through an OCR (Optical Character Recognition ) technology and a handwriting recognition technology, and then detect whether the multimedia content includes personal identification information, personal account number information, financial bill information, bank card information and other contents related to personal privacy, and quickly hide the multimedia content.

The terminal device may also automatically analyze the history setting information of the user, determine the multimedia content that has been determined to be hidden (i.e., the multimedia content that is hidden in the history) as the content included in the set of multimedia contents to be hidden, determine the multimedia content that has been determined to be publicable (i.e., the multimedia content that is publically disclosed) as the content not included in the set of multimedia contents to be hidden, and quickly hide the set of multimedia contents to be hidden. The multimedia content related to the privacy of the owner is protected from exposure to the greatest extent. The quick opening mode has the advantages that the terminal equipment can automatically analyze the multimedia content to be hidden or publically disclosed, user specification is not needed, and the privacy protection mode can be quickly opened and started in emergency.

After the terminal device opens the privacy protection mode, the terminal device may sort the multimedia content in the publicable multimedia content set according to at least one of the following information, and then display the sorted multimedia content set: association with specified multimedia content, corresponding theme, corresponding object, contained privacy information.

The terminal device can adjust the display sequence of the multimedia contents in the publicable multimedia content set according to the objects corresponding to the multimedia contents, then display the sequenced multimedia contents, wherein the higher the privacy degree of the objects corresponding to the multimedia contents is, the more the arrangement sequence is. For example, as shown in fig. 8, the terminal device determines that the image of the pet dog, the group photo of the pet dog and the child, and the image of the child are publicable multimedia contents, so that after the privacy protection mode is turned on, the terminal device preferentially displays the image of the pet dog, then displays the group photo of the pet dog and the child, and finally displays the image of the child, thereby maximally protecting the multimedia contents including the privacy of the owner from being exposed.

In the set-up and turn-on mode, the user is required to specify multimedia content, including at least one of: designating multimedia contents contained in the multimedia file; specifying specified content contained in the multimedia file; designating multimedia content corresponding to the theme; designating multimedia content corresponding to the subject to which the multimedia file belongs; multimedia content containing a specified object; multimedia content including objects in a specified multimedia file; multimedia content containing specified privacy information; multimedia content including private information in a specified multimedia file; multimedia content corresponding to a user type to which a current user belongs; and the multimedia content corresponding to the environment security type of the current environment. The terminal device determines a publicly available multimedia content set according to the specified multimedia content specified by the user. See the first to third embodiments described above.

In the setting and starting mode, a user starts a privacy protection mode of the terminal device through the external controller, and the external controller is required to support an input function and/or a display function, wherein the input function can be key input, voice input, touch screen input and the like and is used for designating multimedia content, and the display function is used for displaying the content on the terminal device in real time. In the privacy preserving method in this case, the external controller generates the operation flow when the privacy preserving mode is turned on, the instruction for specifying the multimedia content is opened, the instruction for specifying the multimedia content is hidden, and the confirmation instruction.

Specific: the method comprises the steps that a user informs an external controller of setting a multimedia content set to be hidden when the terminal equipment is subjected to privacy protection through any one or combination of a plurality of modes such as voice, keys, gestures, biological characteristics, an augmented reality human-computer interaction interface and the like, after the external controller detects an instruction for setting the multimedia content set to be hidden when the terminal equipment is subjected to privacy protection, whether the terminal equipment is in a privacy protection mode or not is detected, wherein the external controller can acquire the current privacy protection state of the terminal equipment through data connection with the terminal equipment, if the external controller detects that the terminal equipment is not in the privacy protection mode currently through the current privacy protection state of the terminal equipment, the external controller sends an instruction for starting the privacy protection mode to the terminal equipment; after detecting a privacy protection mode starting instruction sent by an external controller, the terminal equipment pre-processes the multimedia content which is not browsed currently, and orders and displays the multimedia content which is not browsed currently based on at least one of a theme, an object and privacy information corresponding to the multimedia content, for example, the multimedia content of a public place, a non-person or only a viewer can be preferentially presented; the external controller determines a multimedia content set to be hidden when the terminal equipment performs privacy protection based on the appointed multimedia content, and sends a setting instruction corresponding to the multimedia content set to be hidden to the terminal equipment; after detecting the setting instruction sent by the external controller, the terminal equipment determines a multimedia content set to be hidden and a publicly available multimedia content set according to the setting instruction, hides the multimedia content set to be hidden, and displays the publicly available multimedia content set.

After detecting the privacy protection mode starting instruction sent by the external controller, the terminal equipment can send the multimedia content which is not currently browsed in the terminal equipment to the external controller.

The external controller sorts the multimedia content which is not currently browsed in the terminal device according to at least one of the subject, the object and the privacy information corresponding to the multimedia content, for example, preferentially displays the multimedia content which possibly relates to privacy, such as the image of a private place or a person, and then displays the sorted multimedia content, so that the user can quickly set the multimedia content which can be disclosed or needs to be hidden.

The embodiment of the invention provides that after a user sets the publicable multimedia content or the multimedia content to be hidden on the external controller, the external controller can send the user setting to the terminal equipment in real time, and the terminal equipment adjusts the current display content in real time.

As shown in fig. 9, when the user a designates an image of the user B on the external controller and issues an instruction to hide the designated multimedia content, the terminal device hides the image of the user B that is not browsed; as shown in fig. 10, if the user designates an image of the user C on the external controller and issues an instruction to hide the designated multimedia content, the terminal device hides the image of the user C that is not browsed.

In the method of the fourth embodiment of the present application, the user may quickly start the privacy protection mode on the terminal device through the external controller.

In the method of the embodiment of the present application, the terminal device may use a fast opening mode to automatically find the multimedia content set to be hidden and the multimedia content set that can be disclosed, and in some special cases, for example, the terminal device is used by a non-host when the privacy protection mode is not opened, the terminal device may use the fast opening mode to automatically open the privacy protection mode, and perform privacy protection on the multimedia content to be hidden.

Example five

In the embodiment of the present application, in the privacy protection preset mode and after the privacy protection mode is turned on (i.e., in the privacy protection process), the multimedia content to be hidden and publicable can also be adjusted in real time.

1) In the privacy protection preset mode, the multimedia content to be hidden and publicable is regulated

In the actual implementation process, after the privacy protection preset mode is started, the multimedia content which needs to be hidden and can be disclosed can be continuously adjusted.

Specifically comprises at least one of the following:

the method comprises the steps of determining historical public multimedia contents as contents contained in a public multimedia content set, namely contents which are not contained in the multimedia content set and need to be hidden;

determining the historical hidden multimedia content as the content which is not contained in the publicable multimedia content set, namely the content which is contained in the multimedia content set and needs to be hidden;

determining the multimedia content associated with the currently determined publicable multimedia content as content contained in the publicable multimedia content set, namely content which is not contained in the multimedia content set and needs to be hidden;

and determining the multimedia content which is related to the currently determined multimedia content to be hidden as the content which is not contained in the publicable multimedia content set, namely the content which is contained in the multimedia content set to be hidden.

For example, after entering the privacy protection preset mode, the terminal device determines the multimedia content to be hidden (or publically) according to the specified multimedia content, when the user sets the specified multimedia content again, determines the multimedia content to be hidden (or publically) according to the multimedia content set again by the user, then determines whether the multimedia content which is determined to be hidden (or publically) before the present time exists in the terminal device, if so, searches the terminal device for the multimedia content which is related to the determined multimedia content to be hidden (or publically) and the multimedia content which is determined to be hidden (or publically) before the present time, determines the determined multimedia content to be hidden (or publically) before the present time, determines the multimedia content which is determined to be hidden (or publically) before the present time, and determines that the rest of multimedia content in the terminal device is hidden (or needs to be hidden).

For example, the user a designates an image of the user B and issues an instruction to disclose the designated multimedia content, and the terminal device searches for single images of all the users B according to the designated user B image and marks as publicable; when the user wants to further disclose the image of the user C, the user designates the image of the user C again, and then the terminal equipment firstly searches the single images of all the users C according to the designated image of the user C and marks the single images as publicable; then, the terminal device analyzes whether the images related to the single image of the user C searched this time and the single image of the user B searched previously exist in the terminal device, and as a result, all the group shadows of the user B and the user C are searched, as shown in fig. 11, the terminal device marks the group shadows as publicable.

2) In the privacy protection process, the multimedia content to be hidden and publicable is regulated

After the privacy protection mode is started, only a list of the public multimedia content sets which are allowed to be browsed by other users is displayed on the display list of the terminal equipment, and other multimedia contents are hidden. In the display process, if the user needs to readjust the currently publicable multimedia content, further specification can be carried out on the basis of the current display. The terminal device also adjusts the display list in real time.

In addition, after the privacy protection mode is started, the terminal device may sort the publicable multimedia content according to at least one of the following information: association degree, corresponding theme, corresponding object and contained privacy information of the appointed multimedia content; displaying the sequenced multimedia content.

Wherein the degree of association with the specified multimedia content characterizes to some extent the degree of matching of the user's display intent. In displaying the publicly available multimedia content sets, the display order may be to preferentially display the multimedia content that best satisfies the user's display intention. For example, display in sequence: the user designates the displayed picture and designates the group photo picture of the person contained in the displayed picture.

After the privacy protection mode is started, the terminal device can judge whether additional protection is needed or not by detecting the environment type of the current environment and the current user.

Specifically, the user who is currently using the terminal device is detected, and from the multimedia content which is currently determined to be hidden, the search object only contains the detected multimedia content of the user, and the searched multimedia content is displayed.

If the number of users currently in use is one, the multimedia content including only the user is additionally displayed, and if the number of users currently in use is plural, the multimedia content including only the group photo of the plurality of users is additionally displayed.

For example, after the terminal device has turned on the privacy protection mode, the display interface at the beginning is as shown in fig. 12, and at this time, images and videos taken outdoors are displayed, and no person is included in the images and videos. Subsequently, when the multimedia content in the terminal equipment is checked by a certain friend, the terminal equipment acquires a face appearing in front of a screen through a front-mounted camera device, the face is matched with an object in the multimedia content in a multimedia library, if the face is detected to belong to the same person as the face of the object in the certain multimedia content, the multimedia content only containing the object is determined to be publicable, and the multimedia content is additionally displayed, as shown in fig. 13; when the multimedia contents in the terminal device are viewed by a plurality of friends, the multimedia contents including only the plurality of friends are found according to the above method, and the multimedia contents displaying the group photo of the plurality of friends are added, as shown in fig. 14.

Similarly, after the privacy protection mode has been started, the user may manually adjust the multimedia content to be hidden (or publically) and send a multimedia content set adjustment instruction through one or more of voice, gesture, biological feature, external controller and other modes, so that the terminal device starts the privacy protection preset mode, determines the multimedia content to be hidden (or publically) according to the multimedia content specified by the user, then determines whether the multimedia content to be hidden (or publically) exists in the terminal device, if so, finds the multimedia content associated with the determined multimedia content to be hidden (or publically) and the determined multimedia content to be hidden (or publically), determines the determined multimedia content to be hidden (or publically), and the found multimedia content to be hidden (or publically), and determines that the rest multimedia content to be hidden (or publically) in the terminal device.

And after detecting a multimedia content set adjustment instruction sent by an external controller, adjusting the multimedia content set to be hidden according to the multimedia content set adjustment instruction.

When a user adjusts through an external controller, the user informs the external controller of setting a multimedia content set to be hidden when the terminal equipment performs privacy protection through any one or combination of a plurality of modes such as voice, keys, gestures, biological characteristics, an augmented reality man-machine interaction interface and the like, after the external controller detects an instruction for setting the multimedia content set to be hidden when the terminal equipment performs privacy protection, whether the terminal equipment starts a privacy protection mode is detected, wherein the external controller can acquire the current privacy protection state of the terminal equipment through data connection with the terminal equipment, if the external controller detects that the terminal equipment starts the privacy protection mode currently through the current privacy protection state of the terminal equipment, the external controller determines a multimedia content set to be hidden when the terminal equipment performs privacy protection currently based on specified multimedia content, then sends a multimedia content set adjustment instruction corresponding to the adjusted multimedia content set to be hidden to the terminal equipment, and adjusts the multimedia content set to be hidden according to the multimedia content set adjustment instruction sent by the external controller after the terminal equipment detects the multimedia content set adjustment instruction.

After detecting that the terminal equipment has started the privacy protection mode, the external controller can acquire the multimedia content currently being displayed on the terminal equipment from the terminal equipment to display, then, the user can see the single-person image of the user B which is marked as publicable before in the privacy protection preset mode on the external controller, on the basis, the user designates the image of the user C as a further publicable object, and the external controller notifies the terminal equipment of the designated image of the user C; the terminal equipment determines a single image of the user C according to the image of the user C designated by the user and marks the single image as publicable, then searches a group photo of the user B and the user C associated with the image of the user C determined this time and the image of the user B determined before, and marks the searched group photo of the user B and the user C as publicable.

In the method of the embodiment of the present application, the multimedia content to be hidden and the multimedia content to be disclosed may be further adjusted, specifically, the historical public multimedia content is determined to be a content included in the set of the public multimedia content, the historical hidden multimedia content is determined to be a content not included in the set of the public multimedia content, the multimedia content associated with the currently determined public multimedia content is determined to be a content included in the set of the public multimedia content, the multimedia content associated with the currently determined multimedia content to be hidden is determined to be a content not included in the set of the public multimedia content; and/or after the privacy protection mode is started, the multimedia content only comprising the current user is additionally displayed, so that various ways for adjusting the multimedia content which needs to be hidden and can be disclosed are provided, the adjustment forms are more diversified, and various requirements of users are met.

Example six

After the privacy protection mode is started, the prompt information appearing on the terminal equipment can be correspondingly privacy protected.

After detecting the application prompt information to be displayed, the terminal equipment performs hidden display on the privacy information contained in the application prompt information, or transfers the privacy information contained in the application prompt information to other associated terminal equipment for display.

Specifically, after the terminal device receives the prompt information of any application program, judging whether the received prompt information contains the privacy information, if so, hiding the privacy information contained in the received prompt information, or if so, detecting whether the user currently using the terminal device is a machine owner, and if not, hiding the privacy information contained in the received prompt information. The privacy information contained in the received prompt information is hidden, and the privacy information is not displayed, or the privacy information is replaced to display preset content.

If the received prompt information contains the privacy information, the terminal device can transfer the received prompt information to other associated terminal devices for display, the other associated terminal devices can be wearable devices, and after the received prompt information is transferred to the other associated terminal devices for display, the terminal device can not display the prompt information.

The prompt information of the application program can be one of the following: incoming call prompt information, short message prompt information, chat message prompt information, email prompt information, schedule prompt information and memo prompt information. Obviously, the prompt information of the application program may also be other prompt information, which is not limited in the embodiment of the present application.

Specifically, the terminal device has already turned on the privacy protection mode, and the terminal device is on the hand of a friend of the owner, when the friend views the image, the terminal device receives an incoming call, and in normal circumstances, the incoming call prompt information may be displayed on the screen of the terminal device, where the incoming call prompt information may include: the head portrait, name, phone number, etc. of the caller may be privacy information that the user does not want to see by the friend, and the answer or reject button in the incoming call prompt may be misoperated by the friend, as shown in fig. 15.

By using the method of the embodiment of the application, the terminal equipment has started the privacy protection mode, and the terminal equipment is on the hands of friends of a machine owner, when the friends view images, the terminal equipment receives an incoming call, whether the user currently using the terminal equipment is the machine owner is judged through the front-mounted camera device, if not, the prompt information protection function is started, the incoming call prompt information is hidden, and the answer button and the answer rejection button are forbidden. The call-in-progress information may also be displayed alternatively as default or content previously edited by the user, such as "sorry, my owner has a call, please call the phone to my owner bar". After the friend sees such content, the terminal device will be returned to the owner. When the owner takes back the terminal equipment, the front camera device of the terminal equipment can detect the face in front of the screen, and when the user who is currently using the terminal equipment is judged to be the owner, the terminal equipment can display incoming call prompt information. After the owner receives the call, if the friend still wants to continue to view the image, the owner can give the terminal device to the friend again. At this time, the front-end camera detects whether the user who is currently using the terminal device is the owner, and if not, resumes the previous privacy-preserving mode, as shown in fig. 16.

For another example, when the terminal device has turned on the privacy protection mode, the incoming call prompt information is received, whether the incoming call prompt information includes the privacy information is determined, if the incoming call prompt information includes the privacy information, whether the user who is currently using the terminal device is the owner is determined by the front-end camera device, if the user is not the owner, the prompt information protection function is started, the current display content is kept unchanged on the terminal device, and all the incoming call prompt information is transferred to an external controller of the owner for display, as shown in fig. 17. In this way, the friends are not influenced to view the multimedia content on the terminal device in the process of answering the phone by the owner.

In addition, the user can set the prompt information of which application programs need to be protected according to the needs, can set whether all information or part of information in the application programs need to be protected, and can set whether part of information of contacts need to be protected.

Such as: the user may mark part of the content in the application as private content, only protect the private content in the application, and not enable privacy protection for other content. For example, in a short message application, a user may mark one or more keywords as content to be hidden. In the privacy protection mode, when the short message containing the keywords is received, the short message is hidden, otherwise, the short message is not hidden.

Another example is: the user can mark part of the contact persons as private contact persons, if the incoming call, short message, chat message and other information of the private contact persons are received, the information is hidden, otherwise, the information is not hidden.

In addition, after the privacy protection mode is started, the use of the designated application program can be forbidden, and/or the use of the designated function in the designated application program can be forbidden, and/or the calling of the multimedia content which needs to be hidden can be forbidden. Thus, privacy protection of privacy-related applications and/or functions is achieved.

Specifically, after the privacy protection mode is started, whether a user who is currently using the terminal equipment is a machine owner or not is detected, if the user is not the machine owner, a specified application program and/or a specified function in the specified application program is forbidden, and the multimedia content which is determined to be needed to be hidden is forbidden to be called; the appointed application program is an application program preset by a user and/or the determined application program related to privacy; the specified function is a function preset by the user and/or a determined privacy-related function.

For example, after the terminal device turns on the privacy protection mode, if the terminal device is on the hands of a friend, the friend may operate some functions in the album application, such as sending and sharing, so as to reveal the privacy of the owner. After the terminal equipment starts the privacy protection mode, the front camera device is started, the face in front of the screen is detected, whether the user who is currently using the terminal equipment is a owner or not is judged, if not, related functions such as sharing, sending, editing, deleting and setting in the album application program are forbidden, and therefore other people are prevented from sending the content on the terminal equipment to other equipment or a network, misoperation of other people on the terminal equipment is avoided, and multimedia content in the terminal equipment is tampered or deleted. Wherein, the disabled function can also be preset by the user. As shown in fig. 18, when the terminal device is used by other people, some functions in the album application are available and some are disabled. When an incorrect operation is detected, a prompt message may be issued, such as an audible prompt, or a prompt may be presented on a display screen of the associated other device, etc.

For another example, after the privacy preserving mode is turned on, the privacy information in all the application programs including the user name, the password, the automatic login setting, and the remembering password setting are temporarily cleared. If there is an application that is currently enabled, then the account for that application may be temporarily exited. When exiting the current account, the terminal device allows the user to select default automatic exiting, and can give a prompt before exiting to inform the user that the account of the application program is exited after the privacy protection mode is started. The user may choose to exit or not exit as shown in fig. 19. If the user chooses to exit, the user needs to re-input the account number and the password when reentering the application program, and the automatic login setting and the remembering of the password setting are disabled.

Furthermore, when the terminal device gives prompt information before exiting, more detailed information can be provided for the user to refer to. If a detailed list of the application programs needs to be protected, the login options corresponding to each application program can be set by the user in a self-defined mode.

For another example, when the terminal device has turned on the privacy protection mode, the terminal device turns on the front camera, detects a face in front of the screen, determines whether the user who is currently using the terminal device is a owner, if not, when an application program such as a WeChat is turned on, the terminal device automatically cancels the default functions of remembering the password and automatically logging in, and clears the user name and the password, and if the current user wants to use the WeChat application program, the user needs to log in by using his own account number and password. After login, if the multimedia content is desired to be called, only the multimedia content determined to be publicable and the multimedia file newly added after the privacy preserving mode is turned on are permitted to be called. After the privacy protection mode is canceled, all the settings in the privacy protection mode can be restored to the original state, so that the subsequent use of the user is not affected.

And, after the privacy preserving mode is turned on, if the other application calls the multimedia content in the album application, only the multimedia content newly added after the privacy preserving mode is turned on or the multimedia content determined to be publicable is allowed to be called.

In the method of the embodiment of the application, privacy protection can be performed on the prompt information of the application program.

Example seven

After the privacy protection mode is started, privacy information in the specified application program in the terminal device, such as historical information related to privacy, can be hidden, so that the protection of the privacy information in the specified application program is realized.

Specifically, after the privacy protection mode is started, the terminal device hides the privacy information in the appointed application program, or after the privacy protection mode is started, whether the user who is currently using the terminal device is a machine owner or not is detected, if not, the privacy information in the appointed application program is hidden, wherein the privacy information in the appointed application program comprises at least one of the following: short message, contact information, call record, notepad information, web browsing record, and favorites information.

For example, as shown in fig. 20, after the privacy preserving mode is turned on, privacy-related privacy information in some applications, including sms list, address book list, call record, notepad information, life log information, web browsing history, network favorites, etc., is temporarily hidden. The terminal device allows the user to select default automatic hiding, and also can select to prompt the user before hiding, and inform the user that the information is hidden after the privacy protection mode is started. It is then determined by the user whether this information needs to be hidden.

Furthermore, when prompting the user whether to hide the private information, the terminal device can provide more detailed information for the user, such as a detailed list of specific applications to be protected, which private information each application corresponds to, a time period of the private information, a classification option of the private information, and the like, so that the user can further define specific content to be hidden.

In addition, the terminal device allows the user to choose to hide the entire application and to hide some of the application's functionality in the privacy settings options. After the user sets the entire application to be hidden, the application is not visible to the user in the privacy-preserving mode. When a user sets a function of hiding a part of an application, the application may be opened in a privacy-preserving mode, but when in use, some functions may be disabled according to rules set by the user. Such as social chat applications, when the user turns on the privacy preserving mode, the user may choose to prohibit the application from sending files and from viewing the history chat log. When the social chat application is opened in the privacy preserving mode, other users cannot use the function of sending files, and cannot view the history chat record of the application. Thus, the normal use of the application program is not affected, and the privacy of the user can be protected according to the specific requirements of the user.

For example: under the condition that the terminal equipment starts the privacy protection mode, the terminal equipment starts a front-mounted camera device, detects a face in front of a screen, judges whether a current user is a machine owner or not, and if the current user is not the machine owner, when an application program such as a short message is started, all historical information in the application program can be hidden, so that the historical information is privacy protected. If other people want to use the short message application program, warning content, such as text information of ' non-owner ' sent ' can be automatically added in front of the short message sent at the moment. At the same time, other persons are not allowed to forward the existing history information, or are only allowed to call the multimedia content and/or information newly added after the privacy preserving mode is started.

In the above seven embodiments, the manner of exiting the privacy preserving mode includes: automatic exit and manual exit.

The terminal device automatically exits the privacy preserving mode when it is detected that the user currently using the terminal device is a owner or trusted user and/or when it is detected that the environment type of the environment in which the terminal device is currently located is a secure environment (e.g. home).

The terminal device can detect whether the user currently using the terminal device is a machine owner or a trusted user through a front-end camera device, a biological feature and the like. The terminal device can confirm whether the current environment is safe or not through a camera device, a microphone, a GPS and the like.

In the automatic exit mode, both cases of full exit and partial exit are included. If it is detected that the user currently using the terminal device is a owner and the environment is safe, and this state continues for a certain time, the terminal device will all exit the privacy preserving mode. If the terminal device receives the incoming call or the short message prompt message after the privacy protection mode is started, the terminal device can automatically and partially exit the privacy protection mode under the condition that the terminal device is used by a machine owner, the incoming call or the short message prompt message is displayed, but other protection states are required to be kept unchanged, such as a publicable multimedia content list in an album application program is kept unchanged, and when the terminal device returns to the hand of other users (other than the machine owner), the terminal device can be switched to the privacy protection mode.

Wherein, the active exit means that the user can actively exit the privacy protection mode in some ways. The mode of actively exiting privacy protection includes at least one of the following modes: the privacy protection mode is exited by inputting a password, using keys, using gestures, using biometric features (such as fingerprint authentication, signature authentication, voiceprint authentication, etc.), using voice, an augmented reality human-machine interaction interface, and controlling the terminal device through an external controller.

In the above method of the embodiment of the present application, the specified application program in the terminal device and/or the specified function in the specified application program may be performed, and privacy information in the specified application program in the terminal device may be also privacy-protected.

For the method in the above embodiment, a privacy protecting apparatus to which the method can be applied is provided in the embodiment of the present application, where the apparatus is applied to the terminal device in the method in the above embodiment.

As shown in fig. 21, the privacy protection apparatus includes the following modules: a start detection module 401, a determination module 402, and a display module 403, wherein:

an opening detection module 401, configured to detect that the privacy protection mode is opened;

a determining module 402, configured to determine a set of multimedia contents to be hidden based on the specified multimedia contents;

a display module 403, configured to hide the multimedia content set to be hidden determined by the determining module 402.

Wherein the specified multimedia content comprises at least one of:

designating multimedia contents contained in the multimedia file;

specifying specified content contained in the multimedia file;

designating multimedia content corresponding to the theme;

Multimedia content containing a specified object;

multimedia content including objects in a specified multimedia file;

multimedia content containing specified privacy information;

Wherein, the determining module 402 includes: a content search unit and a disclosure set determination unit, wherein:

the content searching unit is used for searching the multimedia content which is the same as the semantic information of the appointed multimedia content;

and the public set determining unit is used for determining a multimedia content set to be hidden based on the multimedia content searched by the content searching unit.

Wherein the disclosure set determining unit determines the multimedia content set to be hidden by at least one of the following means:

Wherein the hiding condition includes: specifying that the multimedia content contains specified privacy information; and/or designating a theme of the multimedia content as a designated theme; the disclosed conditions include at least one of the following: the specified multimedia content does not contain specified privacy information; the subject matter of the specified multimedia content is not the specified subject matter; only multimedia content of the user who is currently using the terminal device.

Wherein the determining module 402 is specifically configured to perform at least one of the following when determining, based on the specified multimedia content, a set of multimedia contents to be hidden:

Wherein, the determining module 402 includes: an integrated display unit and a ranking display unit, wherein:

the integrated display unit is used for carrying out integrated display on the multimedia content currently determined to be publicable or carrying out integrated display on the multimedia content currently determined to be required to be hidden when the set of the multimedia content required to be hidden is determined based on the designated multimedia content;

and the ordering display unit is used for ordering and displaying other multimedia contents except the currently determined public multimedia content or the currently determined multimedia content to be hidden when the multimedia content set to be hidden is determined based on the designated multimedia content.

The ordering display unit is specifically configured to: other multimedia content is ordered according to at least one of the following: and the association degree, the corresponding theme, the corresponding object and the contained privacy information of the determined multimedia content which can be disclosed or needs to be hidden.

The sorting display unit is also used for integrating or selecting a specified number of multimedia contents for preferential display in other multimedia contents, wherein the multimedia contents have the same association degree with the determined multimedia contents which can be disclosed or need to be hidden before the sorted multimedia contents are displayed.

Wherein the on detection module 401 detects that the privacy preserving mode is on by at least one of: input voice, keys, gestures, biological characteristics, an augmented reality human-computer interaction interface and an external controller.

When the on detection module 401 detects that the privacy protection mode is on through the external controller, the determining module 402 includes: an ordering display unit and a disclosure set determination unit, wherein:

the ordering display unit is configured to, after the opening detection module 401 detects an instruction of opening the privacy protection mode sent by the external controller, order and display currently unviewed multimedia content based on at least one of a theme, an object and privacy information corresponding to the multimedia content;

and the public set determining unit is used for determining the multimedia content set to be hidden according to the setting instruction after detecting the setting instruction corresponding to the multimedia content set to be hidden sent by the external controller.

The display module 403 includes: a sorting unit and a content display unit, wherein:

a ranking unit for ranking the publicly available multimedia contents according to at least one of the following information: association degree, corresponding theme, corresponding object and contained privacy information of the appointed multimedia content;

And the content display unit is used for displaying the multimedia content sequenced by the sequencing unit.

As shown in fig. 22, the privacy protection apparatus further includes: a user detection module 404 and an object lookup module 405, wherein:

a user detection module 404, configured to detect a user who is currently using the terminal device;

an object searching module 405, configured to search, from the multimedia content set currently determined to be hidden by the determining module 402, for objects that only include the detected multimedia content of the user;

the display module 403 is further configured to display the multimedia content searched by the object searching module 405.

The privacy protection device further comprises: and the adjusting module is used for adjusting the multimedia content set to be hidden according to the multimedia content set adjusting instruction after detecting the multimedia content set adjusting instruction sent by the external controller.

As shown in fig. 23, the privacy protecting apparatus further includes: a prompt detection module 406 and a prompt processing module 407, wherein:

the prompt information detection module 406 is configured to detect application prompt information to be displayed;

the prompt information processing module 407 is configured to hide and display the privacy information contained in the application prompt information detected by the prompt information detection module 406, or transfer the privacy information contained in the application prompt information to other associated terminal devices for display.

As shown in fig. 23, the privacy protection apparatus further includes: a disabling module 408, configured to perform at least one of the following operations:

inhibit use of the specified application;

disabling a specified function in the specified application;

the prohibited call determination module 402 determines that the multimedia content is to be hidden;

privacy information in a specified application is hidden.

Wherein the multimedia content comprises at least one of the following: an image, a portion of the content in the image, a video clip, a video image frame, a portion of the content in the video image frame, an audio clip.

In addition, in the embodiment of the present application, there is also provided a privacy protection method applied to an external controller, where the above terminal device may be referred to as a second terminal device, and the external controller may be referred to as a first terminal device, and the method includes the following steps:

the first terminal device displays the sequenced multimedia content.

The first terminal device sends a setting instruction corresponding to the multimedia content set to be hidden to the second terminal device, and specifically includes: and the first terminal equipment sends the multimedia content set adjusting instruction corresponding to the adjusted multimedia content set to be hidden to the second terminal equipment.

In addition, in the embodiment of the present application, there is further provided a privacy protection apparatus applied to an external controller (first terminal device), as shown in fig. 24, where the apparatus includes the following modules: a determining module 501 and a transmitting module 502, wherein:

a determining module 501, configured to determine, based on the specified multimedia content, a multimedia content set to be hidden when the second terminal device performs privacy protection;

and the sending module 502 is configured to send the setting instruction corresponding to the multimedia content set to be hidden, which is determined by the determining module 501, to the second terminal device.

As shown in fig. 24, the apparatus further includes: an opening detection module 503, configured to detect, before the determining module 501 determines, based on the specified multimedia content, a set of multimedia contents that needs to be hidden when the second terminal device performs privacy protection, whether the second terminal device has already opened a privacy protection mode;

the sending module 502 is further configured to send an instruction to the second terminal device to start the privacy protection mode when the start detection module 503 detects that the second terminal device does not start the privacy protection mode.

As shown in fig. 25, the device further includes: a ranking module 504 and a display module 505, wherein:

the ordering module 504 is configured to order, before the determining module 501 determines, based on the specified multimedia content, a set of multimedia contents to be hidden when the second terminal device performs privacy protection, currently unviewed multimedia contents in the second terminal device according to at least one of a theme, an object, and privacy information corresponding to the multimedia contents;

the display module 505 is configured to display the multimedia content ranked by the ranking module 504.

The determining module 501 is specifically configured to: when the opening detection module 503 detects that the second terminal device has opened the privacy protection mode, determining a multimedia content set after adjusting a multimedia content set to be hidden when the second terminal device is currently privacy protected based on the specified multimedia content;

the sending module 502 is specifically configured to: and sending the multimedia content set adjusting instruction corresponding to the adjusted multimedia content set to be hidden to the second terminal equipment.

In summary, the above embodiments of the present application may achieve the following technical effects:

(1) The terminal equipment detects and opens the privacy protection mode, determines a multimedia content set to be hidden based on the appointed multimedia content, and finally hides the multimedia content set to be hidden, thereby realizing the privacy protection of the multimedia content.

(2) The user only needs to specify the multimedia content, the terminal equipment can find the multimedia content which is the same as the semantic information of the specified multimedia content, and when the instruction of the user for publishing the specified multimedia content is detected, the fact that the publicable multimedia content set contains the found multimedia content is determined, and the multimedia content set to be hidden does not contain the found multimedia content; when an instruction of hiding appointed multimedia content of a user is detected, the fact that the public multimedia content set does not contain the searched multimedia content is determined, the multimedia content to be hidden contains the searched multimedia content in the set, and further, after a privacy protection mode is started, the multimedia content to be hidden is hidden, and the public multimedia content is displayed. The user can hide the related multimedia content only by designating a small amount of multimedia content without selecting the multimedia content to be hidden one by one and setting the multimedia content, so that the operation is simplified and the efficiency is improved.

(3) The privacy protection method not only can protect the whole video, but also can protect the video image frames, video clips and/or partial contents in the video image frames in the video, thereby meeting more privacy protection requirements of users.

(4) In order to facilitate the user to set the appointed multimedia content again, the determined multimedia content to be hidden or publicable can be integrated and displayed, and other multimedia contents are displayed after being ordered, so that the user can conveniently and quickly look up.

(5) The method provides a plurality of instruction sending modes for users, and the instruction sending modes are more diversified and flexible.

(6) The terminal equipment can determine the multimedia content which is required to be hidden (or disclosed) and accords with the appointed type according to the type appointed by the user; or the user can specify the multimedia content, the terminal equipment can determine at least one type of the theme type, the object type and the privacy type of the specified multimedia content according to the multimedia content specified by the user, then determine the multimedia content which is required to be hidden (or can be disclosed) and accords with the determined type, and the related multimedia content can be hidden without selecting the multimedia content which is required to be hidden one by one and setting, so that the operation is simplified, and the efficiency is improved.

(7) The terminal equipment can automatically determine the multimedia content set to be hidden and the multimedia content set to be disclosed according to the user type of the current user and/or the environment type of the current environment, thereby realizing the automatic determination of the privacy protection range, simplifying the operation and improving the working efficiency.

(8) The terminal device can use a quick opening mode to automatically find the multimedia content set to be hidden and the multimedia content set which can be disclosed, and in some special cases, for example, the terminal device is used by a non-host when the privacy protection mode is not opened, the terminal device can use the quick opening mode to automatically open the privacy protection mode and carry out privacy protection on the multimedia content to be hidden.

(9) The method comprises the steps of further adjusting the multimedia content to be hidden and the publicable multimedia content, specifically, determining the historical publicable multimedia content as the content contained in the publicable multimedia content set, determining the historical hidden multimedia content as the content not contained in the publicable multimedia content set, determining the multimedia content related to the currently determined publicable multimedia content as the content contained in the publicable multimedia content set, and determining the multimedia content related to the currently determined multimedia content to be hidden as the content not contained in the publicable multimedia content set; and/or after the privacy protection mode is started, the multimedia content only comprising the current user is additionally displayed, so that various ways for adjusting the multimedia content which needs to be hidden and can be disclosed are provided, the adjustment forms are more diversified, and various requirements of users are met.

(10) Privacy protection can be carried out on prompt information of the application program; the specific application program and/or the specific function in the specific application program in the terminal device can be further subjected to privacy protection.

The foregoing description of the preferred embodiments of the present invention is not intended to limit the invention to the precise form disclosed, and any modifications, equivalents, improvements and alternatives falling within the spirit and principles of the present invention are intended to be included within the scope of the present invention.

Claims

1. A method performed by an electronic device, comprising:

receiving application prompt information to be displayed;

through face detection, determining that a user currently using the terminal equipment is a machine owner, and displaying the content of the application prompt information;

and through face detection, determining that the user currently using the terminal equipment is switched from a host to a non-host user, and hiding the application prompt information or the content of the application prompt information.

2. The method as recited in claim 1, further comprising:

and through face detection, determining that the user currently using the terminal equipment is switched from the non-owner user to the owner, and restoring and displaying the application prompt information or the content of the application prompt information.

3. The method of claim 1, if the user currently using the terminal device includes a non-owner, the method further comprising:

and displaying the content of the application prompt information in other associated electronic equipment.

4. The method of claim 1, wherein hiding the content of the application hint information comprises:

and hiding the privacy information in the application prompt information.

5. The method of claim 1, wherein if it is determined by face detection that the user currently using the terminal device is switched from the owner to include a non-owner user, the method further comprises at least one of:

hiding the designated application;

hiding privacy information of a specified application program;

inhibit use of the specified application;

disabling a specified function in the specified application;

logging out of the account of the login setting user from the appointed application program;

the forbidden call determines the multimedia content to be hidden.

6. A method performed by an electronic device, comprising:

receiving application prompt information to be displayed;

through face detection, determining that a user currently using the terminal equipment contains a non-host user, and hiding the application prompt information or the content of the application prompt information;

And through face detection, determining that the user currently using the terminal equipment is switched from the non-owner user to the owner, and displaying the received content of the application prompt information.

7. The method as recited in claim 6, further comprising:

and through face detection, if the fact that the user currently using the terminal equipment is switched from the owner to the non-owner user is determined, the application prompt information or the content of the application prompt information is recovered to be hidden.

8. The method of claim 6, if the user currently using the terminal device includes a non-owner, the method further comprising:

9. An electronic device, comprising:

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications configured to: performing the method according to any one of claims 1 to 8.

10. A computer readable storage medium storing at least one instruction, at least one program, code set, or instruction set, the at least one instruction, the at least one program, the code set, or instruction set being loaded and executed by the processor to implement the method of any one of claims 1 to 8.