JP2014146167A - Electronic equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To achieve practical countermeasures against peep for preventing a user operation from being blocked.SOLUTION: Electronic equipment 1 includes: a display screen 11; and an imaging part 12 for acquiring an image in a region in which the display screen 11 is visible. A user is asked to input a password (secret information) in the case of browsing a Web browser, and when the user inputs the password, the imaging part 12 is started, and an input video corresponding to the input password and a countermeasure video based on the image acquired by the imaging part 12 are displayed on the display screen 11. For example, the video of a display region which seems unnecessary for the input of the password is replaced with the video of the image acquired by the imaging part 12.

Description

  The present invention relates to an electronic device.

  With regard to an electronic device having a display screen, so-called peeping by a person other than the user may be a problem.

  Using a camera that captures an image in an area where the display screen can be viewed, the presence or absence of peeping is detected through face detection. When it is determined that there is a peeping, notification information such as a warning is displayed or the field of view A method of narrowing the viewing angle of the display screen using an angle control filter (hereinafter referred to as a first conventional method) has been proposed (see, for example, Patent Document 1 below). In addition, a method of hiding information to be displayed on the display screen (hereinafter referred to as a second conventional method) when it is determined that there is a peep through face detection has been proposed (for example, the following patent document). 2).

JP 2010-128778 A JP 2012-173913 A

  In the peeping countermeasures such as the first and second conventional methods, a warning is given even if there is a false detection of peeping (when it is determined that there is peeping when no peeping is actually made). Measures for peeping such as display are executed. If unnecessary peeping countermeasures are executed due to erroneous detection, the user's operability may be impaired, and the user may feel uncomfortable.

  Accordingly, an object of the present invention is to provide an electronic device that contributes to the realization of a peeping countermeasure that suppresses the inhibition of operation.

  An electronic apparatus according to the present invention includes a display screen, an imaging unit that acquires an image in an area where the display screen can be visually recognized, an information input reception unit that receives input of target information, and a first that corresponds to the target information. A control unit for displaying a video on the display screen and displaying a second video based on an acquired image of the imaging unit on the display screen when the target information belongs to a predetermined type of information at the input timing of the target information; , Provided.

  When the input target information belongs to a predetermined type of information (for example, confidential information), an acquired image of the imaging unit is displayed. Thereby, the user can look at the display screen and cancel the input of the target information by his / her own judgment. As a result, it is suppressed that operability is impaired due to erroneous detection.

  ADVANTAGE OF THE INVENTION According to this invention, it is possible to provide the electronic device which contributes to implementation | achievement of the peeping countermeasure which suppressed the inhibition of operation.

It is an external appearance perspective view of the electronic device which concerns on embodiment of this invention. It is an internal configuration block diagram of an electronic device according to an embodiment of the present invention. It is a figure for demonstrating the imaging | photography area | region of the imaging part of FIG. It is the figure which showed a mode that user input information was displayed on a display screen. It is the figure which showed a mode that the 1st and 2nd display area was set to the display screen. It is a figure which shows the mode of a display screen when the countermeasure image | video (captured image) is displayed with the input information image | video corresponding to a password. It is a figure which shows a mode that the face detection part is provided in the main control part of FIG. It is a figure for demonstrating the countermeasure against peeping relevant to a screen lock concerning 1st Example of this invention. It is a figure for demonstrating the countermeasure against peeping relevant to browsing of a web browser concerning 2nd Example of this invention. It is a figure concerning a 3rd example of the present invention and shows a mode that a plurality of face images are displayed in peeping measures. It is a figure which shows a mode that the image of the unregistered face is displayed in 4th Example of this invention in peeping countermeasures. It is a flowchart of the display control task which concerns on 5th Example of this invention. It is a flowchart of the countermeasure task based on 5th Example of this invention.

  Hereinafter, an example of an embodiment of the present invention will be specifically described with reference to the drawings. In each of the drawings to be referred to, the same part is denoted by the same reference numeral, and redundant description regarding the same part is omitted in principle. In this specification, for simplification of description, a symbol or reference that refers to information, signal, physical quantity, state quantity, member, or the like is written to indicate information, signal, physical quantity, state quantity or Names of members and the like may be omitted or abbreviated.

  FIG. 1 is an external perspective view of an electronic apparatus 1 according to an embodiment of the present invention. The electronic device 1 is an arbitrary information device that can acquire, reproduce, or process arbitrary information. For example, a mobile phone, an information terminal, a personal computer, an electronic book reader, an electronic dictionary, a digital camera, a game device Or it is a navigation device. FIG. 2 is a block diagram of the internal configuration of the electronic device 1. The electronic device 1 is provided with each part referred by the codes | symbols 11-14. Although not read from FIG. 2, the electronic device 1 may be provided with a telephone function, an Internet connection function, an electronic mail transmission / reception function, and / or a music playback function.

  The display screen 11 is a display screen composed of a liquid crystal display panel or the like, and displays an arbitrary video under the control of the main control unit 14. The imaging unit 12 includes an optical system and an imaging device (solid-state imaging device) such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. A photographed image (that is, an image in the photographing region) is acquired by photographing. In the following description, a captured image refers to a captured image by the imaging unit 12 unless otherwise specified.

  In FIG. 3, the hatched area SR represents the imaging area of the imaging unit 12. The imaging direction of the imaging unit 12 faces the display screen 11 side, and the imaging region SR includes all or part of the region where the display screen 11 can be viewed. That is, the imaging unit 12 acquires an image in an area where the display screen 11 can be viewed. In FIG. 3, a person 300 is a user who operates the electronic device 1 while looking at the display screen 11.

  The user 300 can input desired information to the electronic device 1. Information input by the user 300 is received by the information input receiving unit 13. The information input receiving unit 13 may be formed by an operation member such as a mechanical push button switch, and the input of information may be received by the operation member. Here, however, the display screen 11 is provided with a touch panel, and the touch panel It is assumed that input of information is accepted at. The user 300 can perform various operations on the electronic device 1 by touching the touch panel with an operating tool (finger or touch pen). An operation by touching the touch panel with the operating body is called a touch panel operation. The timing (period) at which the user 300 inputs information to the information input receiving unit 13 is referred to as information input timing (information input period), and the information (in other words, the receiving unit 13 is input to the receiving unit 13 by the user 300). Information input to the electronic device 1 through the network) is referred to as user input information (target information).

  The main control unit 14 is formed of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and includes a display control unit 21 and a peeping countermeasure unit 22. The main control unit 14 controls the display contents of the display screen 11 and comprehensively controls the operation of each part in the electronic device 1. Display of an arbitrary video on the display screen 11 is performed in response to the supply of the video signal from the main control unit 14.

  Control of the display content of the display screen 11 is mainly realized by the display control unit 21. When the user 300 inputs information to the information input receiving unit 13, the display control unit 21 displays an input information video (first video) that is a video corresponding to the user input information on the display screen 11 (that is, input information). The display content of the display screen 11 is controlled so that the video is displayed on the display screen 11). For example, when the user 300 inputs a numerical value string “1750” as user input information to the information input receiving unit 13, as shown in FIG. 4, a video 320 indicating the numerical value string “1750” is displayed as an input information video on the display screen 11. Is displayed. When the numerical sequence belongs to confidential information described later, the numerical sequence “1750” itself may not be displayed in the video 320 (for example, a part of the numerical sequence is displayed on the display screen 11 as shown in FIG. 6 described later). (It may be expressed with an asterisk (*)).

  As a characteristic operation, the main control unit 14 can take a peep countermeasure based on the captured image and user input information. Here, peeping means that a person other than the user 300 looks at the display screen 11, and a peeping countermeasure is necessary and useful particularly when the user 300 inputs confidential information.

  At the information input timing, the main control unit 14 (for example, the display control unit 21) determines whether the user input information belongs to confidential information. Hereinafter, this determination is referred to as confidentiality determination. The confidential information is a predetermined type of information, and what kind of information belongs to the confidential information may be determined in advance in the main control unit 14. For example, the password belongs to confidential information. In addition, texts in e-mails may be set as belonging to confidential information. The user 300 may be allowed to set what information belongs to the confidential information through a touch panel operation or the like.

  When it is determined that the user input information belongs to the confidential information, the display control unit 21 issues a countermeasure request to the peep countermeasure section 22. The peeping countermeasure unit 22 that has received the countermeasure request generates countermeasure information from the image captured by the imaging unit 12 and sends the countermeasure information to the display control unit 21. The countermeasure information includes information of a countermeasure video (second video) based on the captured image. Specifically, the countermeasure video may include part or all of the captured image. When the user input information belongs to the confidential information at the information input timing, the display control unit 21 receiving the countermeasure information displays the countermeasure video (second video) together with the input information video (first video) corresponding to the user input information. 11 is displayed. If it is determined by the confidentiality determination that the user input information does not belong to the confidential information, the display control unit 21 displays the input information video on the display screen 11 but does not display the countermeasure information on the display screen 11 (in the first place, the countermeasure) Since no request is issued, no countermeasure information is generated).

  Specifically (see FIG. 5), at the information input timing, the display control unit 21 sets the first display area in the display screen 11 and displays the input information video in the first display area. When the user input information belongs to the confidential information at the information input timing, the display control unit 21 sets a second display area different from the first display area in the display screen 11, and the input information video in the first display area. The countermeasure video is displayed in the second display area while displaying. Display areas 330 and 340 in FIG. 5 are examples of first and second display areas, respectively. The combined area of the first and second display areas may be the entire display area of the display screen 11, or the combined area of the first and second display areas may be a part of the entire display area of the display screen 11. good.

  FIG. 6 shows a state of the display screen 11 when the countermeasure video is displayed together with the input information video corresponding to the password. In the example of FIG. 6, an image captured by the imaging unit 12 is displayed in a display area other than the password input frame 331. More specifically, in the example of FIG. 6, the display control unit 21 measures the video of the display area that is not necessary for password input, other than the input frame 331, out of the entire display area of the display screen 11. The video is replaced (the same applies to FIGS. 8B and 9B described later). In the example of FIG. 6, it is assumed that the user 300 and a person 301 other than the user 300 exist in the shooting area SR. As a result, the person 301 other than the user 300 is included in the video of the shot image as the countermeasure video. Is reflected. The user 300 recognizes the presence of the person 301 from the display screen 11 and thinks that the password may be peeped into the person 301, so that the user 300 can cancel the password input or the display screen 11 from the person 301 as necessary. It can be hidden.

  In the peeping countermeasures such as the first and second conventional methods, peeping countermeasures such as warning display are executed even when there is a false detection of peeping. As described above, when an unnecessary peeping countermeasure is executed due to erroneous detection, the user's operability may be impaired, and the user feels uncomfortable. On the other hand, in the present embodiment, a video image captured by the imaging unit 12 is displayed when confidential information is input. The user 300 looks at the display screen 11 and can cancel the input of confidential information by his / her own judgment, and the operability is prevented from being impaired due to erroneous detection.

  The captured image acquisition operation by the imaging unit 12 may always be performed, but the peeping countermeasure unit 22 may also perform execution presence / absence control of the captured image acquisition operation by the imaging unit 12. Specifically, when the user input information belongs to the confidential information at the information input timing, the peeping countermeasure unit 22 causes the imaging unit 12 to perform a captured image acquisition operation, but the user input information is confidential at the information input timing. If the information does not belong to the information, the operation of acquiring the captured image by the imaging unit 12 may be stopped. Thereby, since the imaging unit 12 is driven only when secret information is input (that is, when peeping countermeasures are required), unnecessary driving of the imaging unit 12 is suppressed and power saving is achieved. On the other hand, in the method of always detecting the peeping through the face detection process and peeping countermeasures by starting the imaging unit when inputting information, the power consumption and the processing load become larger than necessary.

  The main control unit 14 (for example, the countermeasure unit 22) detects whether or not there is a peep, that is, detects a peep, and provides the countermeasure information to the display control unit 21 only when it detects that there is a peep. Anyway. In this case, the main control unit 14 displays the countermeasure video on the display screen 11 only when it is detected that there is a peep at the timing when the user input information belonging to the confidential information is input to the information input receiving unit 13. It will be. However, the main control unit 14 may always display the countermeasure video on the display screen 11 at the timing when the user input information belonging to the confidential information is input to the information input receiving unit 13 without performing peep detection. good.

  For the peep detection, the main controller 14 may be provided with the face detector 23 shown in FIG. The face detection unit 23 detects a person's face from the captured image using a known face detection process based on the image data of the captured image. When the face detection unit 23 detects that the captured image includes a plurality of faces (that is, when it is detected that there are a plurality of face image data in the captured image), the main control unit 14 (for example, The countermeasure unit 22) determines that there is a peep, otherwise it can determine that there is no peep.

  Or you may make the face detection part 23 perform the face recognition process based on the image data of a picked-up image. In the face recognition process, the face detection unit 23 determines whether the face of the person included in the photographed image is a face of a registered person set in advance or other face (hereinafter referred to as an unregistered face). Identify The registered person includes the user 300 and may further include persons other than the user 300. In order to realize the face recognition process, it is preferable to store data on the face of the registered person in the face detection unit 23 in advance. When the face detection unit 23 detects that an unregistered face is included in the captured image (that is, when it is detected that image data of an unregistered face exists in the captured image), the main control unit 14 (For example, the countermeasure unit 22) determines that there is a peep, and otherwise, it can determine that there is no peep.

  When it is determined that there is a peep, the main control unit 14 may not only display the countermeasure video on the display screen 11 but also issue an arbitrary warning notification to the user 300. The warning notification is, for example, a video notification (display of a warning icon or warning text) on the display screen 11, a sound notification (warning sound output, etc.), or an LED (Light Emitting Diode) provided in the electronic device 1. ).

  A plurality of embodiments of the electronic device 1 based on the above-described configuration and operation will be described below. Matters described in one embodiment may be applied to any other embodiment as long as no contradiction arises.

<< First Example >>
A first embodiment will be described. Information that needs to be input as user input information in order to activate a specific function in the electronic device 1 belongs to confidential information (password). For example, the main control unit 14 can apply a screen lock to the display screen 11 when the electronic device 1 is activated. When the screen lock is applied, only a specific release operation is accepted as a touch panel operation, and various information that can be originally displayed by the electronic device 1 is displayed on the display screen 11 only after the release operation is input to the touch panel. Not. The release operation may include inputting a release password for the touch panel (information input receiving unit 13). The release password belongs to confidential information.

  FIG. 8A shows a state of the display screen 11 when the screen lock is applied. In the example of FIG. 8A, when the screen lock is applied, the main control unit 14 causes the display screen 11 to display only the video 350 for requesting the input of the release password. When the user 300 focuses on the portion of the video 350 and starts to input the release password, the display control unit 21 determines that the release password is input and issues a countermeasure request. Then, the countermeasure unit 22 starts the acquisition operation of the captured image by the imaging unit 12 and provides countermeasure information based on the captured image to the display control unit 21. As a result, as shown in FIG. 8B, the display control unit 21 displays user input information in the first display area of the display screen 11 and displays a countermeasure video based on the captured image in the second display area of the display screen 11. To do. The release password is information that is expected to be input as user input information. Note that the display content of the display screen 11 in FIG. 8B is the same as that in FIG.

<< Second Example >>
A second embodiment will be described. Information having an attribute of “type = password” in a script language such as JavaScript also belongs to confidential information (password). For example, when the electronic device 1 connects to the Internet network using the Internet connection function, a predetermined web browser described in a script language such as JavaScript is accessed, and the web browser is requested to input a login password. Think about the case. FIG. 9A shows a state of the display screen 11 when the request is made. The login password belongs to confidential information.

  When the user 300 attempts to start inputting the login password by focusing on the video portion where the login password on the web browser is to be input, the display control unit 21 determines that the login password is input and measures are taken. Issue a request. Then, the countermeasure unit 22 starts the acquisition operation of the captured image by the imaging unit 12 and provides countermeasure information based on the captured image to the display control unit 21. As a result, as shown in FIG. 9B, the display control unit 21 displays the user input information in the first display area of the display screen 11 and displays the countermeasure video based on the photographed image in the second display area of the display screen 11. To do. The login password is information that is expected to be input as user input information.

<< Third Example >>
A third embodiment will be described. When the face detection unit 23 detects that the photographed image includes a plurality of faces at the timing when the user input information belonging to the confidential information is input to the information input receiving unit 13 (that is, the photographed image includes a plurality of faces). When the image data is detected to exist, the main control unit 14 may include a plurality of face images included in the photographed image in the countermeasure video and display them on the display screen 11. For example, the countermeasure unit 22 cuts out the plurality of face images from the photographed image using the face detection result of the face detection unit 23, and provides the plurality of cut out face images as countermeasure information (measurement video) to the display control unit 21 You may do it. FIG. 10 shows an example of the display screen 11 when face images 300f and 301f, which are images of a plurality of faces, are displayed as countermeasure videos. In the example of FIG. 10, a warning text “Is there a peep?” Is also displayed (the same applies to FIG. 11 described later). The face images 300f and 301f are images of the faces of the person 301 other than the user 300 and the user 300, respectively cut out from the captured image.

<< 4th Example >>
A fourth embodiment will be described. When the face detection unit 23 detects that an unregistered face is included in the captured image at the timing when the user input information belonging to the confidential information is input to the information input receiving unit 13 (that is, unregistered in the captured image) The main control unit 14 may include an unregistered face image included in the captured image on the display screen 11 by including it in the countermeasure video. For example, the countermeasure unit 22 cuts out an unregistered face image from the photographed image using the result of the face recognition process of the face detection unit 23, and displays and controls the cut-out unregistered face image as countermeasure information (measurement video). You may provide to the part 21. FIG. 11 shows an example of the display screen 11 when a face image 301f, which is an unregistered face image, is displayed as a countermeasure video.

<< 5th Example >>
A fifth embodiment will be described. In the fifth embodiment, an operation flow of the electronic device 1 focusing on peeping countermeasures will be described. FIG. 12 is a flowchart of a display control task responsible for display control of the display screen 11. The display control unit 21 mainly executes a display control task.

  First, in step S11, the user input information is received by the information input receiving unit 13. Each time arbitrary information is input, the display content of the display screen 11 can change according to the input information. In step S12 following step S11, the main control unit 14 determines whether user input information belonging to the confidential information is currently input via the information input receiving unit 13, and the input is made. In this case, the process proceeds to step S13, but if the input has not been made, the process proceeds to step S17.

  In step S13, the display control unit 21 determines whether the countermeasure task has been activated. If the countermeasure task has not been activated, the display control unit 21 activates the countermeasure task in step S14, and then proceeds to step S15. Activating the countermeasure task corresponds to issuing the countermeasure request described above (see FIG. 2). If the countermeasure task has already been started, the process proceeds directly from step S13 to step S15. The countermeasure task will be described later. In step S15, the display control unit 21 acquires the countermeasure information output from the countermeasure task (that is, the countermeasure unit 22), and generates a countermeasure-included video and displays it on the display screen 11 in the subsequent step S16. The countermeasure-included video includes an input information video corresponding to user input information and a countermeasure video based on the countermeasure information. After step S16, the process returns to step S11.

  In step S17, the display control unit 21 determines whether the countermeasure task has been activated. If the countermeasure task has been activated, the display control unit 21 issues a countermeasure task end instruction in step S18, and then proceeds to step S19. Proceed to If the countermeasure task is not activated, the process proceeds directly from step S17 to step S19. In step S <b> 19, the display control unit 21 generates a normal video and displays it on the display screen 11. The normal video can include an input information video corresponding to user input information, but does not include a countermeasure video. After step S19, the process returns to step S11.

  FIG. 13 is a flowchart of the countermeasure task executed by the countermeasure unit 22. The countermeasure task is executed through the activation process in step S14 of FIG. In the countermeasure task, first, in step S31, the imaging unit 12 is activated (that is, a captured image acquisition operation by the imaging unit 12 is started). In subsequent step S32, the countermeasure unit 22 confirms whether an instruction to end the countermeasure task has been issued. If the end instruction has not been issued, the process proceeds to step S33, but the end instruction has been issued. If it has been performed, the captured image acquisition operation by the imaging unit 12 is stopped (step S37), and the countermeasure task is terminated.

  The countermeasure unit 22 acquires a captured image from the imaging unit 12 in step S33, and performs peep detection based on the captured image in subsequent step S34. The countermeasure unit 22 generates countermeasure information and outputs it to the display control unit 21 when it is detected that there is a peep, but generates and outputs countermeasure information when it is detected that there is no peep. do not do. Thereafter, the process returns to step S32. At the time of starting the countermeasure task, as described above, countermeasure information may be generated and output to the display control unit 21 without performing peep detection (regardless of whether there is a peep).

<< Deformation, etc. >>
The embodiment of the present invention can be appropriately modified in various ways within the scope of the technical idea shown in the claims. The above embodiment is merely an example of the embodiment of the present invention, and the meaning of the term of the present invention or each constituent element is not limited to that described in the above embodiment. The specific numerical values shown in the above description are merely examples, and as a matter of course, they can be changed to various numerical values.

  The target device that is the electronic device 1 or the main control unit 14 can be configured by hardware such as an integrated circuit or a combination of hardware and software. Arbitrary specific functions that are all or part of the functions realized in the target device are described as a program, the program is stored in a flash memory that can be mounted on the target device, and the program is executed by the program execution device. The specific function may be realized by executing on a microcomputer (for example, a microcomputer that can be mounted on the target device). The program can be stored and fixed in an arbitrary recording medium (not shown). A recording medium (not shown) for storing and fixing the program may be mounted or connected to a device (such as a server device) different from the target device.

DESCRIPTION OF SYMBOLS 1 Electronic device 11 Display screen 12 Imaging part 13 Information input reception part 14 Main control part 21 Display control part 22 Peep countermeasure part

Claims (6)

A display screen;
An imaging unit for acquiring an image in an area where the display screen can be visually recognized;
An information input receiving unit for receiving input of target information;
A first video corresponding to the target information is displayed on the display screen, and when the target information belongs to a predetermined type of information at the input timing of the target information, a second video based on an acquired image of the imaging unit is displayed. An electronic apparatus comprising: a control unit that displays on a display screen. The control unit also controls whether or not an image acquisition operation is performed by the imaging unit,
When the target information belongs to the predetermined type of information at the input timing of the target information, the image capturing unit is caused to execute the image acquisition operation,
The electronic apparatus according to claim 1, wherein the image acquisition operation by the imaging unit is stopped when the target information does not belong to the predetermined type of information at the input timing of the target information. When the target information belongs to the predetermined type of information at the input timing of the target information, the control unit displays the first video in the first display area in the display screen while performing the second display on the display screen. The electronic apparatus according to claim 1, wherein the second video is displayed in a region. The electronic apparatus according to claim 1, wherein the second video includes a part or all of an acquired image of the imaging unit. The control unit includes a face detection unit that detects a human face from an acquired image of the imaging unit, the target information belongs to the predetermined type of information at an input timing of the target information, and the imaging unit 2. When it is detected that the acquired image includes a plurality of faces, the images of the plurality of faces included in the acquired image are included in the second video and displayed on the display screen. The electronic device according to claim 4. The control unit includes a face detection unit that detects whether a face of a person included in an acquired image of the imaging unit is a face of a predetermined registered person or an unregistered face other than the face, and the target When it is detected at the information input timing that the target information belongs to the predetermined type of information and the acquired image of the imaging unit includes the unregistered face, the unregistered information included in the acquired image 5. The electronic device according to claim 1, wherein an image of the face is included in the second video and displayed on the display screen. 6.

Images