JP6656166B2 - Program, information processing device, and eyewear - Google Patents

Description

  The present invention relates to a program, an information processing device, and eyewear.

  2. Description of the Related Art Eyewear is known in which a plurality of electrodes are provided in a frame portion and an electrocardiogram signal is obtained from each electrode (for example, see Patent Document 1). In addition, a device that detects the direction of the user's line of sight from an electro-oculogram signal is known (for example, see Patent Document 2).

US Patent Application Publication No. 2004/0070729 JP-A-2011-125692

  However, it is possible to detect a blink or a line of sight from an electro-oculogram signal, but there is no technology that appropriately detects a blink or a line of sight while appropriately switching the detection process of the blink and the line of sight. .

  Then, an object of the present invention is to be able to appropriately switch the processing of detecting blinks and eye movements.

  The program according to one aspect of the present invention includes an acquisition step of acquiring an electrocardiogram signal based on an electrooculogram detected by each electrode in contact with a periphery of a subject's eye; A calculating step of calculating a difference signal between the electrogram signal and the electrogram signal a predetermined time before the diagram signal; a calculating step of calculating a local maximum value and a local minimum value of the differential signal; and a predetermined condition regarding the local maximum value and / or the local minimum value A determination step of determining which of a blink detection process and a line-of-sight movement detection process to perform based on whether or not is satisfied, and a detection step of performing the determined detection process on a computer. Let it run.

  ADVANTAGE OF THE INVENTION According to this invention, the detection process of a blink and a gaze movement can be switched appropriately.

It is a perspective view showing an example from the front of glasses in an example. It is a perspective view showing an example from the back of glasses in an example. FIG. 2 is a block diagram illustrating an example of a processing apparatus according to the embodiment. It is a figure which shows the contact position of the electrode with respect to a user schematically. FIG. 4 is a diagram illustrating an example of a configuration of an amplification unit according to the embodiment. FIG. 4 is a diagram for explaining the reason for providing a buffer amplifier. FIG. 9 is a diagram illustrating another example of the configuration of the amplification unit according to the embodiment. FIG. 3 is a block diagram illustrating an example of a configuration of an external device according to the embodiment. FIG. 4 is a block diagram illustrating an example of a configuration of a determination unit according to the embodiment. It is a block diagram showing an example of a blink detection part in an example. It is a figure showing an example of an electrocardiogram signal. FIG. 7 is a diagram illustrating an example of a difference signal. It is a figure for explaining the judgment processing using a peak ratio. It is a figure for explaining the judgment processing using a time difference. FIG. 5 is a diagram illustrating an example of an electro-oculogram signal indicating vertical movement of an eye. It is a flowchart which shows an example of the process regarding the detection process of a blink and a gaze movement in an Example. 9 is a flowchart illustrating an example of a determination process using a peak ratio according to the embodiment. 9 is a flowchart illustrating an example of a determination process using a time difference according to the embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiment described below is merely an example, and there is no intention to exclude various modifications and application of technology not explicitly described below. That is, the present invention can be variously modified and implemented without departing from the spirit thereof. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals. The drawings are schematic and do not always match actual dimensions and ratios. The drawings may include portions having different dimensional relationships and ratios between drawings.

[Example]
FIG. 1 is a perspective view illustrating an example from the front of the glasses 100 in the embodiment. FIG. 2 is a perspective view illustrating an example from behind the glasses 100 in the embodiment. The glasses 100 include a lens 110 and a frame 120. The glasses 100 and the frame 120 are examples of eyewear.

  The frame 120 supports the pair of lenses 110. The frame 120 includes a rim 122, an eyebrow part (for example, a bridge) 124, a flap 126, a hinge 128, a temple 130, a modern 132, a pair of nose pads 140, a first electrode 152, and a second electrode 154, a third electrode 156, an electric wire (not shown), a processing device 200, and an amplification unit 250. Note that, depending on the type of the glasses 100, the use of a single lens may eliminate the bridge portion of the frame. In this case, the part between the eyebrows of the single lens is defined as the part between the eyebrows.

  The pair of nose pads 140 include a right nose pad 142 and a left nose pad 144. The rim 122, the yoke 126, the hinge 128, the temple 130, and the modern 132 are each provided in a left and right pair.

  The rim 122 holds the lens 110. The spoiler 126 is provided outside the rim 122, and rotatably holds the temple 130 by the hinge 128. The temple 130 presses the upper part of the user's ear to pinch this part. The modern 132 is provided at the tip of the temple 130. The modern 132 contacts the upper part of the user's ear. Note that the modern 132 need not always be provided on the glasses 100.

  The first electrode 152 and the second electrode 154 are provided on respective surfaces of the pair of nose pads 140, and detect an electro-oculogram. For example, the first electrode 152 is provided on the right nose pad 142, and the second electrode 154 is provided on the left nose pad 144.

  The first electrode 152 detects an electro-oculogram of the right eye of the user. The second electrode 154 detects an electro-oculogram of the left eye of the user. As described above, the electrodes for detecting the electro-oculogram are provided on the surface of the nose pad which necessarily comes into contact with the skin of the user. Thus, the burden on the skin of the user can be reduced as compared with the case where two pairs of electrodes are brought into contact with the periphery of the eye of the user.

  The third electrode 156 is provided on the surface of the glabella 124 and detects an electrooculogram. It is assumed that a ground electrode (not shown) is provided on the surface of the modern 132. If there is no modern 132 in the glasses 100, the ground electrode is provided at the tip of the temple 130. In the embodiment, the potential detected by the first electrode 152, the second electrode 154, and the third electrode 156 may be based on the potential detected by the ground electrode.

  The processing device 200 may be provided on the temple 130, for example. This does not impair the design of the glasses 100 when viewed from the front. The installation position of the processing device 200 does not necessarily need to be the temple 130, but may be determined in consideration of the balance when the glasses 100 are worn. The processing device 200 is connected to the amplification unit 250 via an electric wire. Note that the processing device 200 and the amplifying unit 250 may be connected via wireless.

  The amplification unit 250 is provided near the first electrode 152, the second electrode 154, and the third electrode 156, and is connected to each electrode to be amplified via an electric wire. The amplification unit 250 acquires an electrooculogram signal indicating the electrooculogram detected by each electrode. For example, the amplification unit 250 amplifies an electrooculogram signal indicating the electrooculogram detected by the first electrode 152, the second electrode 154, and the third electrode 156.

  In addition, if the amplification unit 250 has a processing unit that processes an electrogram signal, the amplification unit 250 may perform an addition / subtraction process on each electrogram signal before or after amplification. For example, the amplification unit 250 may obtain a reference electro-oculogram signal indicating the potential of the first electrode 152 with reference to the third electrode 156. In addition, the amplification unit 250 may obtain a reference electro-oculogram signal indicating the potential of the second electrode 154 based on the third electrode 156. The signal amplified or processed by the amplification unit 250 is output to the processing device 200.

  The external device 300 is an information processing device having a communication function. For example, the external device 300 is a mobile communication terminal such as a mobile phone and a smartphone owned by the user, a personal computer, and the like. The external device 300 performs a process based on the electro-oculogram signal received from the transmission unit 220. For example, the external device 300 detects a blink or a line-of-sight movement from the received electrogram signal. As a response in the case of detecting a blink, the external device 300 issues a warning for preventing falling asleep, for example, when detecting that the number of blinks of the user is increasing. Details of the external device 300 will be described later.

<Configuration of processing device>
FIG. 3 is a block diagram illustrating an example of the processing device 200 according to the embodiment. As illustrated in FIG. 3, the processing device 200 includes a processing unit 210, a transmission unit 220, and a power supply unit 230. The first electrode 152, the second electrode 154, and the third electrode 156 are connected to the processing unit 210 via, for example, the amplification unit 250. Each component of the processing device 200 may be provided separately on a pair of temples.

  The processing unit 210 acquires the electro-oculogram signal amplified from the amplification unit 250 and processes the electro-oculogram signal. For example, the processing unit 210 may process a reference electro-oculogram signal indicating the potential of the first electrode 152 based on the third electrode 156. The reference electrocardiogram signal is given a “reference” for convenience of description, but is included in the electrocardiogram signal. Further, the processing unit 210 may process a reference electro-oculogram signal indicating the potential of the second electrode 154 with reference to the third electrode 156.

  At this time, the processing unit 210 performs processing on the right eye and the left eye based on the electro-oculogram detected from each electrode so as to generate an electro-oculogram signal indicating vertical and / or horizontal movement of the eye. May go.

  In addition, the processing unit 210 performs a digitization process if the acquired electrogram signal is not digitized, or acquires an electrogram signal amplified from each electrode, For example, the signal is adjusted. Further, the processing unit 210 may directly transmit the electrocardiogram signal acquired from the amplification unit 250 to the transmission unit 220.

  The transmitting unit 220 transmits the electrocardiogram signal processed by the processing unit 210 to the external device 300. For example, the transmission unit 220 transmits an electrogram signal to the external device 300 by wireless communication such as Bluetooth (registered trademark) and a wireless LAN, or by wire communication. The power supply unit 230 supplies power to the processing unit 210, the transmission unit 220, and the amplification unit 250.

  FIG. 4 is a diagram schematically showing a contact position of the electrode with respect to the user. The first contact position 452 indicates a contact position of the first electrode 152. The second contact position 454 indicates a contact position of the second electrode 154. The third contact position 456 indicates a contact position of the third electrode 156. The horizontal center line 460 represents a horizontal center line connecting the center of the right eye 402 and the center of the left eye 404. The vertical center line 462 represents a center line orthogonal to the horizontal center line 460 at the center between the right eye 402 and the left eye 404.

  It is desirable that the first contact position 452 and the second contact position 454 are located below the horizontal center line 460. Further, it is desirable that the first contact position 452 and the second contact position 454 are arranged such that a line connecting the centers of the first contact position 452 and the second contact position 454 is parallel to the horizontal center line 460.

  Further, it is desirable that the first contact position 452 and the second contact position 454 are arranged so that the distance from the first contact position 452 to the right eye 402 and the distance between the second contact position 454 and the left eye 404 are equal. . Further, it is desirable that the first contact position 452 and the second contact position 454 are separated from each other by a certain distance or more.

  The third contact position 456 is preferably located on the vertical center line 462. Further, it is desirable that the third contact position 456 be above the horizontal center line 460 and be apart from the first contact position 452 and the second contact position 454. In addition, for example, the distance between the third contact position 456 and the right eye 402 is made longer than the distance between the right eye 402 and the first contact position 452, and the distance between the left eye 404 and the left eye 404 is The distance may be larger than the distance from the position 454.

  In the eyeball, the cornea side is positively charged, and the retina side is negatively charged. Therefore, when the line of sight moves upward, the potential of the first electrode 152 with respect to the third electrode 156 and the potential of the second electrode 154 with reference to the third electrode 156 become negative. When the line of sight moves downward, the potential of the first electrode 152 based on the third electrode 156 and the potential of the second electrode 154 based on the third electrode 156 become positive.

  When the line of sight moves right, the potential of the first electrode 152 with respect to the third electrode 156 becomes negative, and the potential of the second electrode 154 with respect to the third electrode 156 becomes positive. When the line of sight moves to the left, the potential of the first electrode 152 with respect to the third electrode 156 becomes positive, and the potential of the second electrode 154 with respect to the third electrode 156 becomes negative.

  By detecting the potential of the first electrode 152 with reference to the third electrode 156 and the potential of the second electrode 154 with reference to the third electrode 156, it is possible to preferably reduce the influence of noise. In order to make the third contact position 456 as far as possible from the first contact position 452 and the second contact position 454, the eyebrow part 124 may be arranged at or near the upper end of the rim 122. Further, the third electrode 156 may be provided above the center of the glabella portion 124. In this case, it is desirable to adopt a wide vertical eyebrow portion 124 as the arrangement position of the third electrode 156.

  Note that, instead of detecting the potential of the first electrode 152 based on the third electrode 156, the processing unit 210 uses the third electrode based on the reference electrode based on the potential of the first electrode 152 based on the reference electrode. The potential at 156 may be reduced. Then, similarly, instead of detecting the potential of the second electrode 154 with the third electrode 156 as a reference, the processing unit 210 uses the potential of the second electrode 154 with the reference electrode as a reference, based on the reference electrode. The potential of the three electrodes 156 may be reduced.

  A ground electrode may be used as the reference electrode. Further, a separate reference electrode may be provided at a position of the glasses 100 separated from the first electrode 152, the second electrode 154, and the third electrode 156. For example, the reference electrode may be provided on the modern 132 on the right side. In addition, the reference electrode may be provided at a portion of the right temple 130 that is in contact with the skin of the user.

  Note that the process of subtracting the potential of the third electrode 156 from the potential of the first electrode 152 with reference to the reference electrode and the process of subtracting the potential of the third electrode 156 from the potential of the second electrode 154 with reference to the reference electrode are: The processing may be executed by the processing unit 210, or may be executed by the amplification unit 250 or the external device 300. In this case, the signal indicating the potential to be processed is amplified by the amplifier 250.

<Configuration of amplifying unit>
Next, the configuration of the amplification unit 250 will be described. FIG. 5 is a diagram illustrating an example of a configuration of the amplification unit 250 according to the embodiment. As shown in FIG. 5, the amplification unit 250 has a first amplifier 260 and a second amplifier 270. The first amplifier 260 is located before the second amplifier 270 and functions as a buffer amplifier. Hereinafter, the first amplifier 260 is also referred to as a buffer amplifier 260. The second amplifier 270 is an amplifier that functions as a main amplifier. Hereinafter, the second amplifier 270 is also referred to as a main amplifier 270. The signal amplified by the main amplifier 270 is output to the processing device 200 by wire or wirelessly.

  It is desirable that the installation position of the amplifying unit 250 is the part between the eyebrows 124. The amplifying unit 250 may be provided so as to be embedded in the glabella 124. As described above, it is preferable that the electrodes are separated as much as possible. However, since the installation position of each electrode depends on the shape of the frame 120, there is a limit even if the electrodes are separated.

  For this reason, the potential difference between the electrodes may not be large enough.If noise is mixed in the electro-oculogram signal indicating a small potential detected at each electrode, it is necessary to detect the potential with sufficient accuracy. Becomes difficult.

  Therefore, in the embodiment, the amplification unit 250 is provided near the first electrode 152, the second electrode 154, and the third electrode 156 in order to amplify the detected electrogram signal before noise is mixed. Provided. For example, the amplifying unit 250 is preferably provided in a portion between the eyebrows 124 where there is a space in the frame 120 near each electrode. Accordingly, it is possible to reduce the risk that noise is mixed and the accuracy of the electrogram signal is reduced while the electrogram signal detected by each electrode passes through the electric wire.

  Next, the reason why the buffer amplifier 260 is provided at a position preceding the main amplifier 270 will be described with reference to FIG. FIG. 6 is a diagram for explaining the reason why the buffer amplifier 260 is provided. Although the example shown in FIG. 6 uses the third electrode 156, the same applies to the first electrode 152 and the second electrode 154.

Since the third electrode 156 touches human skin when the eyeglasses 100 are worn, the third electrode 156 may be considered to have a resistance _R0 between itself and the ground. At this time, the resistance R ₀ is, for example, several hundred kΩ. Further, the main amplifier 270, there is an internal resistance _{R 1.} In this case, the use of conventional amplifier as a main amplifier 270, the internal resistance _{R 1} is the number 10kΩ~ number 100 k.OMEGA.

Here, although ideally is that does not flow a current to the main amplifier 270, the internal resistance R ₁ is smaller than the resistance R _0, the current flows to the main amplifier 270 side. Then, the voltage Vi of the electrode and the voltage Vx of the main amplifier 270 are divided and observed. Therefore, a buffer amplifier 260 is provided at a position before the main amplifier 270 to prevent current from flowing into the main amplifier 270.

  FIG. 7 is a diagram illustrating another example of the configuration of the amplification unit according to the embodiment. The amplification unit illustrated in FIG. 7 is denoted by reference numeral 250A. The amplification unit 250A includes a buffer amplifier 260, a main amplifier 270, an A / D conversion unit 280, and a wireless communication unit 290. Since the buffer amplifier 260 and the main amplifier 270 have the same functions as those shown in FIG. 5, the following mainly describes the A / D converter 280 and the wireless communication unit 290.

  The A / D converter 280 converts the signal amplified by the main amplifier 270 from analog to digital. A / D conversion section 280 outputs the digitally converted signal to wireless communication section 290.

  The wireless communication unit 290 transmits the digital signal converted by the A / D conversion unit 280 to the processing device 200 using wireless communication. Therefore, wireless communication section 290 functions as a transmission section. The wireless communication unit 290 uses wireless communication such as Bluetooth (registered trademark) and wireless LAN. In addition, the wireless communication unit 290 may directly transmit a digital signal to the external device 300.

  In the embodiment, an example is shown in which one buffer amplifier 260 and one main amplifier 270 are provided. In this case, however, it is sufficient to amplify the electro-oculogram signals from the respective electrodes in an order. Further, a buffer amplifier 260 and a main amplifier 270 may be provided for each electrode.

<Configuration of external device>
Next, the configuration of the external device 300 will be described. FIG. 8 is a block diagram illustrating an example of a configuration of the external device 300 according to the embodiment. As shown in FIG. 8, the external device 300 includes a communication unit 310, a storage unit 320, and a control unit 330.

  The communication unit 310 receives an electro-oculogram signal by wireless communication such as Bluetooth (registered trademark) and a wireless LAN, or by wired communication. The communication unit 310 outputs the electrocardiogram signal received from the communication unit 220 of the processing device 200 to the control unit 330.

  The storage unit 320 is, for example, a RAM (Random Access Memory), and stores the maximum value and / or the minimum value of the electrogram signals of the right eye and the left eye. Further, the storage unit 320 may store the local maximum value and / or the local minimum value of the difference signal of the electro-oculogram signal. Further, the maximum value or the minimum value may be a maximum value or a minimum value for each predetermined time.

  For example, the storage unit 320 has a FIFO buffer for a local maximum value and a FIFO buffer for a local minimum value. When the storage capacity of the FIFO buffer becomes full due to the maximum value or the minimum value data, the oldest data is erased and the latest data is stored, so that the data stored in the storage area is updated. . The storage unit 320 may store a detection result of the detection unit 340 described below.

  Further, the storage unit 320 stores a program that causes a computer to execute blink detection processing and gaze movement detection processing to be described later. Hereinafter, the blink detection processing and the eye movement detection processing are collectively referred to as detection processing. This program may be installed in the external device 300 via the Internet or a recording medium such as an SD card, or may be preinstalled. Further, the storage unit that stores this program may be different from storage unit 320.

  The control unit 330 is, for example, a CPU (Central Processing Unit), and controls each unit and performs various arithmetic processes. In the example illustrated in FIG. 8, the control unit 330 includes an acquisition unit 332, a difference calculation unit 334, an extreme value calculation unit 336, a determination unit 338, and a detection unit 340.

  The acquisition unit 332 acquires an electrocardiogram signal based on an electro-oculogram detected by each electrode contacting around the eye of the subject. The acquired electrogram signal is an electrogram signal of the right eye and / or the left eye, and may be an electrogram signal of a vertical direction or the like. For example, when acquiring the electrocardiogram signal received by the communication unit 310, the acquisition unit 332 outputs the electrogram signal to the difference calculation unit 334 and the determination unit 338.

  The control unit 330 stores the maximum value and the minimum value of the electrogram signal or the difference signal indicating the movement of the right eye and the left eye with respect to the obtained electrogram signal in the storage unit 320. Further, the control unit 330 may store the maximum value and / or the minimum value of the electrogram signal or the difference signal indicating the movement of the right eye and the left eye in the storage unit 320 every predetermined period.

  The predetermined period is, for example, 200 msec, but is not limited to this. In addition, the predetermined period may be changed over time by using a time window to allow overlap.

  The difference calculation unit 334 calculates a difference signal between the electrogram signal acquired by the acquisition unit 332 and the electrogram signal a predetermined time before the electrogram signal. The electrocardiogram signal before a predetermined time is, for example, an electrocardiogram signal at a measurement point four times before the electrocardiogram signal acquired by the acquisition unit 332 for a discrete electrogram signal, It is not limited to this example. By obtaining the difference signal, it is possible to absorb the fluctuation of the baseline of the electro-oculogram signal as described later.

  The extreme value calculation unit 336 calculates the maximum value and the minimum value of the difference signal calculated by the difference calculation unit 334. The extremum calculation unit 336 outputs the maximum value and the minimum value of the difference signal to the determination unit 338. The extreme value calculating unit 336 may store the calculated local maximum value and local minimum value in the storage unit 320.

  The determination unit 338 performs any one of a blink detection process and a line-of-sight movement detection process based on whether a predetermined condition regarding the maximum value and / or the minimum value calculated by the extreme value calculation unit 336 is satisfied. Is determined. In addition, the determination unit 338 may determine whether or not a predetermined condition is satisfied, also using the electrogram signal acquired by the acquisition unit 332.

  The detection unit 340 performs detection processing of the blink or the line of sight determined by the determination unit 338. Therefore, the detection unit 340 includes a blink detection unit 342 and a gaze movement detection unit 344. The blink detection unit 342 may perform a detection process using a known technique as the blink detection process, or may perform a detection process described later. The line-of-sight movement detection unit 344 may perform a detection process using a known technique as a line-of-sight movement detection process, or may perform a detection process described later. Next, the determination unit 338 and the detection unit 340 will be described in detail.

≪ Judgment processing ≫
FIG. 9 is a block diagram illustrating an example of a configuration of the determination unit 338 according to the embodiment. The determination unit 338 illustrated in FIG. 9 includes a first determination unit 402 that performs a determination process using a predetermined condition regarding a ratio between a local maximum value and a local minimum value, and a time period from a first value to a second value of an electrogram signal. A second determination unit 404 that performs a determination process using predetermined conditions. In the determination process, either of the conditions of the first determination unit 402 and the second determination unit 404 may be used, or if both conditions are satisfied, the determination unit 338 determines the detection process. Is also good.

  When the ratio between the local maximum value and the local minimum value falls within a predetermined range equal to or greater than the first threshold and equal to or less than the second threshold, the first determination unit 402 determines that the blink detection process is to be performed, and this ratio falls within the predetermined range. If not included, it is determined that the gaze movement detection process is to be performed. The ratio between the local maximum value and the local minimum value is, for example, a ratio between a local maximum value or a local minimum value exceeding a threshold value calculated by a threshold value calculation unit 502 described later and a local minimum value or a local maximum value that appears next. Since the minimum value is basically a negative value, the ratio is a negative value, but may be an absolute value. This ratio is also called a peak ratio.

  Using the peak ratio, the first determination unit 402 prevents blinking based on a difference signal that is not appropriate for blink detection. The difference signal that is not appropriate for blink detection is a signal whose amplitude at the maximum is sufficiently larger than the amplitude at the minimum. For example, when chewing gum, a difference signal that is not appropriate for blink detection appears.

  On the other hand, it is known from experiments and the like that the ratio between the local maximum value and the local minimum value at an appropriate blink is within a predetermined range. The first threshold value serving as the lower limit is, for example, from -1.7 to -1.5, and the second threshold value serving as the upper limit is, for example, from -0.5 to -0.3.

  In addition, the first determination unit 402 determines that the gaze movement detection process is to be performed when the peak ratio is equal to or less than a third threshold smaller than the first threshold or equal to or greater than a fourth value greater than the second threshold. Is also good. It is known from experiments and the like that, in the case of a line-of-sight movement, the peak ratio increases when facing upward, and decreases when facing downward. At this time, the third threshold is -2.0, for example, and the fourth threshold is -0.1.

  The second determination unit 404 uses a predetermined condition regarding a time required from a value of the electrogram signal regarding the maximum value or the minimum value to a predetermined value of the electrogram signal. For example, as the predetermined condition, the time taken from the first value of the electrogram signal corresponding to the maximum value of the difference signal to the second value of the electrogram signal falling within a predetermined range from the first value is a predetermined time. Within.

  At this time, the second determination unit 404 determines that the blink detection processing is to be performed when the time required for the transition from the first value to the second value of the electrogram signal is within a predetermined time, If this time is not within the predetermined time, it is determined that the gaze movement detection processing is to be performed.

  It is known from experiments and the like that blinks have a short time from the maximum value of the electrocardiogram signal to the next minimum value, and eye movements have a long time from the maximum value to the next minimum value. Have been. Therefore, the second determination unit 404 only needs to set a condition using the time difference between the first value and the second value of the electro-oculogram signal so that the above can be determined.

  Accordingly, the determination unit 338 appropriately determines whether to perform blink detection or gaze movement detection based on the condition regarding the maximum value or the minimum value of the difference signal or the electro-oculogram signal, and performs the detection process. Can be switched adaptively.

  When a peak ratio is used, noise caused by disturbance or the like can be removed by using the above-described third or fourth threshold, and blink detection or gaze movement detection can be appropriately performed.

≪Blink detection≫
Next, blink detection will be described. FIG. 10 is a block diagram illustrating an example of the blink detection unit 342 according to the embodiment.

  The blink detection unit 342 can use a known blink detection algorithm using an electro-oculogram signal. In the following, an appropriate blink can be detected by changing a threshold used for blink determination. A simple algorithm will be described. The blink detection unit 342 includes a threshold value calculation unit 502.

  The threshold calculation unit 502 calculates a threshold using the maximum value and / or the minimum value stored in the storage unit 320. For example, in order to simplify the process, the threshold value calculating unit 502 may calculate the absolute value of the threshold value from the average value of the absolute values of the local maximum value or the local minimum value.

  Further, threshold calculating section 502 may calculate the fifth threshold using the local maximum value stored in storage section 320, and may calculate the sixth threshold using the local minimum value stored in storage section 320. . Here, the fifth threshold is used to determine that the eye has moved up in the vertical direction, and the sixth threshold is used to determine that the eye has moved down in the vertical direction. Thus, a threshold can be set for each of the upward eye movement and the downward eye movement, so that appropriate threshold determination can be performed.

  Further, the threshold value calculation unit 502 includes a first calculation unit 512 and a second calculation unit 514. The first calculation unit 512 calculates the average value and the standard deviation of the local maximum values stored in the local maximum value FIFO buffer. In addition, the first calculation unit 512 calculates the average value and the standard deviation of the minimum values stored in the minimum value FIFO buffer.

  The second calculator 514 calculates a fifth threshold value based on the average value and the standard deviation of the local maximum values, and calculates a sixth threshold value based on the average value and the standard deviation of the local minimum values. Thereby, the threshold value can be set using, for example, an electro-oculogram signal or a difference signal indicating the latest state of the subject. In addition, the fifth threshold value and the sixth threshold value can be changed according to the intensity of a signal indicating the latest state of the user.

  For example, the second calculating unit 514 sets a value obtained by adding a value obtained by multiplying the average value of the maximum value by a coefficient to the standard deviation of the maximum value as the fifth threshold value. The second calculator 514 sets a value obtained by subtracting a value obtained by multiplying the standard deviation of the minimum value by a coefficient from the average value of the minimum values as the sixth threshold value. Thereby, an appropriate threshold value can be set.

  Further, the threshold value calculating unit 502 updates the fifth threshold value and the sixth threshold value each time the maximum value and / or the minimum value are stored in the storage unit 320. Accordingly, the threshold value calculation unit 502 can set the threshold value based on the past electrogram signal or the difference signal, so that when the user becomes sleepy, the movement of the eye becomes slow, and the electrogram signal becomes weak. Even so, the threshold can be set according to the weakened signal, so that the blink can be detected appropriately. The fifth threshold value and the sixth threshold value calculated by the threshold value calculation unit 502 are used by the determination unit 338 to determine the maximum value and the minimum value exceeding these threshold values in order to increase the accuracy of the maximum value and the minimum value. May be used.

  Further, the threshold value calculation unit 502 sets the average of a predetermined number of local maximum values stored in the storage unit 320 as a fifth threshold value, or sets the average of the predetermined number of local minimum values stored in the storage unit 320 as a sixth threshold value. You may. Further, the threshold value calculation unit 502 may calculate the fifth threshold value and the sixth threshold value using the standard deviation of each of the maximum value and the minimum value stored in the storage unit 320.

  The blink detection unit 342 detects a blink from an electrooculogram signal or a difference signal using the fifth threshold value and the sixth threshold value calculated by the second calculation unit 514. For example, the blink detection unit 342 calculates the first time of the maximum value stored in the storage unit 320 that is equal to or more than the fifth threshold value, and the second time of the minimum value stored in the storage unit 320 that is equal to or less than the sixth threshold value. If the difference is within a predetermined time, a blink is detected. Here, the second time is the latest time after the first time. The predetermined time is, for example, 500 msec, but is not limited to this.

  Note that the blink detection unit 342 detects a blink using the electrogram signals of the right eye and the left eye, and determines a final blink when the blink is detected in both eyes at a timing within a predetermined range. May be detected. Further, the blink detection unit 342 may detect a blink using an average of both electrogram signals, on the assumption that the right eye and the left eye make the same movement. A blink detection algorithm using a specific electrogram signal will be described later with reference to FIG.

≪Gaze movement detection≫
Next, detection of gaze movement will be described. Returning to FIG. 8, the gaze movement detection unit 344 may detect the gaze movement by using a known method. For example, the gaze movement detection unit 344 divides the acquired electrogram signal or difference signal into a right electrogram and a left electrogram, and indicates a negative potential in the right electrogram and the left electrogram. If it is, it is detected that the line of sight has turned upward. In addition, the gaze movement detection unit 344 sets the gaze downward when the right electrogram and the left electrogram show a positive potential, shows the negative potential in the right electrogram, and shows the positive potential in the left electrogram. When the potential is indicated, the line of sight is detected to be right, and when the positive potential is indicated in the right electrogram and the negative potential is indicated in the left electrogram, it is detected that the line of sight has turned to the left.

  Further, the line-of-sight movement detection unit 344 can increase the line-of-sight detection accuracy by adding and subtracting the potential V1 indicated by the right electrogram and the potential V2 indicated by the left electrogram. For example, when V1 + V2 is negative and V1-V2 is substantially zero, it can be detected that the line of sight has been directed upward. When V1 + V2 is positive and V1-V2 is substantially zero, it can be determined that the line of sight has been directed downward. When V1 + V2 is substantially zero and V1-V2 is negative, it can be determined that the line of sight has been turned to the right. When V1 + V2 is substantially zero and V1-V2 is positive, it can be determined that the line of sight has been turned to the left. By adding and subtracting V1 and V2, the calculated positive and negative values increase. Therefore, the threshold value can be set to be larger by that amount, and it is possible to reduce erroneous detection in which noise is erroneously detected as gaze movement.

<Specific examples>
Next, the determination process and the detection process will be described using specific examples of an electro-oculogram signal and a difference signal. FIG. 11 is a diagram illustrating an example of an electrogram signal. In the graph shown in FIG. 11, the electrooculogram strength on the vertical axis is a unit indicating the electrooculogram strength, and is represented by, for example, a measured value of electrocardiogram signal × 1.5 (V) ÷ 2048. The horizontal axis is time.

  In the electrogram signal S1 shown in FIG. 11, the intensity of the base electrogram signal greatly fluctuates. For this reason, the fifth threshold value and / or the sixth threshold value calculated by the above-described threshold value calculation unit 502 greatly varies due to the influence of the intensity of the base electrogram signal S1, and an appropriate threshold value is set. It can be difficult.

  Therefore, in order not to be affected by the fluctuation of the intensity of the base electrogram signal S1, a difference signal of the electrogram signal S1 may be used.

  FIG. 12 is a diagram illustrating an example of the difference signal. In the difference signal S2 shown in FIG. 12, the intensity of the base difference signal is substantially constant. Therefore, if the threshold value calculation unit 502 calculates the threshold value using the difference signal S2, it becomes possible to reduce the influence of noise and the like and calculate an appropriate threshold value.

  FIG. 13 is a diagram for explaining the determination process using the peak ratio. In the example shown in FIG. 13, the fifth threshold value TH1 and the sixth threshold value TH2 are calculated using the difference signal S3.

  At this time, when the maximum value is equal to or greater than the fifth threshold value and the next minimum value is equal to or less than the sixth threshold value, it may be basically detected as a blink. In some cases.

  Thus, in the embodiment, attention is paid to the peak ratio between the local maximum value and the local minimum value next to the local maximum value, and if the peak ratio falls within a predetermined range, the blink detection processing is performed. In the example shown in FIG. 13, the peak value at the symbol P is detected as a blink because the peak ratio is included in the predetermined range and the maximum value exceeds the threshold. On the other hand, at the local maximum value in the code E, the local maximum value exceeds the threshold, but is not detected as a blink because the peak ratio is not included in the predetermined range. Note that the determination in the blink detection process includes a peak ratio determination by the determination unit 338 and a threshold determination by the blink detection unit 342. These are in no particular order, and the threshold determination is performed first, and then the peak determination is performed. A ratio determination may be made, or both determinations may be made in parallel.

  FIG. 14 is a diagram illustrating a determination process using a time difference. FIG. 14A shows an example of an electrogram signal, and FIG. 14B shows an example of a difference signal in the electrogram signal shown in FIG. 14A, but the accuracy of the difference does not matter. In the example shown in FIG. 14, the signal is an electrocardiogram signal or a difference signal in the case of movement of the line of sight. However, in the case of movement of the line of sight, the electrocardiogram signal gradually decreases from the maximum value, unlike blinking. In the embodiment, focusing on this gradualness, the time t from the first value Q1 of the electrogram signal corresponding to the maximum value of the difference signal to the second value Q2 of the value corresponding to Q1 is set to a predetermined condition. Used. For example, when the difference signal is a difference signal between the electrogram signal at time t1 and the electrogram signal at time t2, the first value Q1 is the electrogram signal at time t1, but the electrogram signal at time t2. May be. The second value Q2 may be the same value as the first value Q1, or may be a value obtained by adding an offset to the first value.

  For example, the second determination unit 404 calculates a time t from the first value Q1 to the second value Q2, determines whether the time t is within a predetermined time, and determines whether the time t is within a predetermined time. If so, it is determined that blink detection processing is to be performed, and if the time t is not within the predetermined time, it is determined that gaze movement detection processing is to be performed. The predetermined time is, for example, 500 msec, and an appropriate value may be set by a preliminary experiment or the like. Note that the time t may be a time from a local maximum value to a local minimum value of the electrocardiogram signal, as long as it can be determined whether the gradient of the electrocardiogram signal is gentle or steep.

  Next, the blink detection algorithm will be described using a specific electrogram signal. FIG. 15 is a diagram illustrating an example of an electrogram signal indicating a vertical movement of the eye. The electro-oculogram signal S4 shown in FIG. 15 is an electro-oculogram signal indicating the vertical movement of one eye. The blink detection algorithm described below is an algorithm in a case where a threshold value is calculated using the maximum value and the minimum value in a predetermined period.

(1) Finding the maximum value and the minimum value every predetermined period The control unit 330 finds the maximum value and the minimum value every predetermined period T1 (for example, 500 msec) of the electrogram signal S4.

(2) When the maximum value is the maximum value, save it in the first FIFO buffer. When the maximum value obtained in (1) is the maximum value, the control unit 330 saves it in the first FIFO buffer (storage unit 320).

(3) When the minimum value is the minimum value, save it in the second FIFO buffer. When the minimum value obtained in (1) is the minimum value, the control unit 330 stores the minimum value in the second FIFO buffer in an area different from the first FIFO buffer. Save (storage unit 320). The order of (2) and (3) does not matter. Hereinafter, when the first FIFO buffer and the second FIFO buffer are put together, they are simply referred to as buffers. In FIG. 15, the black points on the electro-oculogram signal S4 represent values detected as the maximum value or the minimum value in each period. Note that the maximum value and the minimum value can be obtained by using differentiation, for example, using a difference signal of the electro-oculogram signal S4.

(4) When the data corresponding to the capacity of the buffer is stored, calculate the average value and the standard deviation. The first calculation unit 512 calculates the average value (a1) and the standard deviation (b1) of the local maximum values stored in the first FIFO buffer. Is calculated. In addition, the first calculator 512 calculates the average value (a2) and the standard deviation (b2) of the minimum values stored in the second FIFO buffer.

(5) Calculating the Threshold The second calculator 514 calculates the fifth threshold and the sixth threshold using the average value and the standard deviation calculated in (4). The fifth threshold (Th1) and the sixth threshold (Th2) are calculated by the following equations.
Th1 = a1 + E × b1 Equation (1)
Th2 = a2−E × b2 Equation (2)
Here, the coefficient E is, for example, 2.
Note that lower limits may be set to the absolute values of the fifth threshold (Th1) and the sixth threshold (Th2). This can prevent erroneous detection of slight vertical movement of the eye as blinking. Further, the coefficient E may be set variably according to the signal strength.

  In FIG. 15, an example of the fifth threshold is represented by a symbol TH1 and an example of the sixth threshold is represented by a symbol TH2. As shown in FIG. 15, each threshold value changes with the passage of time of the electrogram signal, and further, the threshold value is appropriately changed in accordance with the strength (magnitude of the amplitude) of the electrogram signal. . The fifth threshold value TH1 and the sixth threshold value TH2 shown in FIG. 15 are merely conceptual representations of threshold value fluctuations.

(6) Specifying the maximum value equal to or greater than the fifth threshold value and the minimum value equal to or less than the sixth threshold value The detection unit 340 identifies the maximum value equal to or greater than the fifth threshold value calculated in (5). Here, the local maximum value to be subjected to the threshold value determination is a local maximum value stored in the first FIFO buffer and not yet subjected to the threshold value determination.

  Further, the detection unit 340 specifies the minimum value equal to or less than the sixth threshold value calculated in (5). Here, the minimum value to be subjected to the threshold value determination is a minimum value stored in the second FIFO buffer and for which the threshold value determination has not been performed. In FIG. 15, the specified maximum value and minimum value are represented by black points surrounded by squares.

(7) Detecting a blink The detection unit 340, for each of the specified maximum values, includes the first time of the maximum value and the second time of the specified minimum value, and the latest time after the first time. If the difference from the second time is within a predetermined time, the vertical movement of the eye is detected as a blink.

  In FIG. 15, for example, if the difference between the specified maximum value time t11 and the latest specified minimum time t21 after t11 is within a predetermined time, the movement of the eye is detected as a blink. . The predetermined time is, for example, 500 msec.

  The blink detection algorithm has been described above, but this algorithm is merely an example, and the present invention is not limited to this example. In addition, in the process of detecting the blinking and the movement of the line of sight, the same process as the above-described process may be performed using the difference signal of the electro-oculogram signal in the time direction. The difference signal is, for example, a signal obtained by subtracting the electrogram signal at a predetermined time before the time t from the electrogram signal at the time t. Thus, the detection accuracy can be improved by using a differential signal having strong noise resistance.

<Operation>
Next, the operation of the external device 300 in the embodiment will be described. FIG. 16 is a flowchart illustrating an example of a process related to a process of detecting a blink and a line of sight in the embodiment. The flowchart illustrated in FIG. 16 illustrates a state in which the user wears the glasses 100 and the first electrode 152, the second electrode 154, the third electrode 156, and the ground electrode are in contact with the skin of the user. Is started in the operation mode (normal mode), which is a mode for detecting a blink or a line-of-sight movement.

  In step S102 illustrated in FIG. 16, the acquisition unit 332 acquires an electrocardiogram signal from the glasses 100.

  In step S104, the difference calculator 334 calculates a difference signal between the acquired electrogram signal and the electrogram signal a predetermined time before this electrogram signal.

  In step S106, the extremum calculation unit 336 calculates the maximum value and the minimum value of the difference signal. Further, the extreme value calculating unit 336 may calculate the maximum value and the minimum value of the electrogram signal.

  In step S108, the determination unit 338 performs any one of a blink detection process and a line-of-sight movement detection process based on whether a predetermined condition regarding the calculated maximum value and / or minimum value is satisfied. Is determined. The difference between the predetermined conditions will be described later with reference to FIGS.

  In step S110, the blink detection unit 342 performs a blink detection process.

  In step S112, the gaze movement detection unit 344 performs a gaze movement detection process.

  After steps S110 and S112, the process shown in FIG. 16 is repeated until control unit 330 receives an instruction to end the operation mode.

  Next, FIG. 17 is a flowchart illustrating an example of the determination process using the peak ratio in the embodiment. In step S202 shown in FIG. 17, the first determination unit 402 calculates a peak ratio between a local maximum value and a local minimum value.

  In step S204, the first determination unit 402 determines whether the peak ratio falls within a predetermined range between the first threshold and the second threshold. If the peak ratio is within the predetermined range (step S204-YES), the process proceeds to step S110, and if the peak ratio is not within the predetermined range (step S204-NO), the process proceeds to step S206.

  In step S206, the first determination unit 402 determines whether the peak ratio is equal to or less than a third threshold. If the peak ratio is equal to or smaller than the third threshold (step S206-YES), the process proceeds to step S112. If the peak ratio is not equal to or smaller than the third threshold (step S206-NO), the process proceeds to step S102. In step S206, the case where the peak ratio is equal to or larger than the fourth threshold may be added to the determination condition. Further, step S206 may be deleted, and the process may proceed to step S112 after NO in step S204.

  Next, FIG. 18 is a flowchart illustrating an example of a determination process using a time difference in the embodiment. In step S302 illustrated in FIG. 18, the second determination unit 404 acquires a first value Q1 of the electrogram signal corresponding to the local maximum value.

  In step S304, the second determination unit 404 determines whether the electrocardiogram signal acquired next is the second value Q2. If the electrogram signal to be obtained next is the second value Q2 (step S304-YES), the process proceeds to step S306, and if the electrogram signal to be obtained next is not the second value Q2 (step S304). -NO), the process returns to step S304.

  In step S306, the second determination unit 404 calculates the time t by subtracting the time t_Q1 of the first value Q1 from the time t_Q2 of the second value Q2.

  In step S308, the second determination unit 404 determines whether the time t is within a predetermined time (time threshold). If the time t is within the predetermined time (step S308-YES), the process proceeds to step S110, and if the time t is not within the predetermined time (step S308-NO), the process proceeds to step S112.

  As described above, according to the embodiment, it is possible to appropriately switch the processing of detecting the blink and the line of sight. In addition, in order to increase the accuracy of blink detection and line-of-sight detection, the determination process by the determination unit 338 is canceled in the following cases. For example, when the maximum value or the minimum value far exceeds the value that appears at the time of blinking or moving the line of sight, the determination unit 338 determines that the value is noise and cancels the determination processing. In this case, the determination unit 338 may set a threshold whose absolute value is larger than the fifth threshold or the sixth threshold, and cancel the determination processing when the difference signal exceeds this threshold. Further, for example, when the absolute values of the fifth threshold value and the sixth threshold value calculated by the threshold value calculation unit 502 become too small, the determination unit 338 determines that appropriate determination processing cannot be performed and cancels the determination processing. In this case, the determination unit 338 may set a threshold whose absolute value is smaller than the fifth threshold and the sixth threshold, and cancel the determination processing when the difference signal does not exceed the threshold.

  In this embodiment, the case where the eyewear is glasses is described. However, eyewear is not limited to this. The eyewear may be any eye-related equipment, such as eyeglasses, sunglasses, goggles, and head-mounted displays, as well as face or headwear such as these frames.

  In the present embodiment, an example in which the glasses 100 include the third electrode 156 has been described. However, the glasses 100 are not limited to this. The glasses 100 need not include the third electrode 156. In this case, the electro-oculogram indicated by the potential of the first electrode 152 with respect to the reference electrode and the electro-oculogram indicated by the potential of the second electrode 154 with reference to the reference electrode may be transmitted to the external device 300. Here, a ground electrode may be provided at the position of the third electrode 156 to serve as a reference electrode. Further, a ground electrode provided in the left modern may be used as a reference electrode, or an electrode separately provided at a position separated from the first electrode 152 and the second electrode 154 may be used as a reference electrode.

  In the present embodiment, an example in which the eyeglasses 100 include the nose pad 140 integrated with the rim 122 has been described. However, the glasses 100 are not limited to this. The glasses 100 may include a cling attached to the rim 122 and a nose pad 140 attached to the cling. In this case, the electrode provided on the surface of the nose pad 140 is electrically connected to the electric wire embedded in the frame via the krings.

  In the present embodiment, an example in which the first electrode 152 and the second electrode 154 are provided below the center of the nose pad 140 has been described. However, it is not limited to this. The nose pad 140 may include an extension that extends downward, and the first electrode 152 and the second electrode 154 may be provided in the extension. Accordingly, even if the user has the nose pad positioned right beside the eye due to individual differences in the positions of the eyes and the nose, the first electrode 152 and the second electrode 154 are brought into contact below the position of the eyes. Can be.

  In the present embodiment, an example has been described in which the third electrode 156 is provided on the surface of the glabella 124. However, it is not limited to this. The glabella portion 124 may include an extending portion extending upward, and the third electrode 156 may be provided in the extending portion. Further, a movable portion for vertically moving the extended portion may be provided between the extended portion and the interbrow portion 124 so that the position of the third electrode 156 can be adjusted vertically. Thereby, even if the user has a contact position of the third electrode 156 near the eye due to individual differences in the position of the eye, the contact position of the third electrode 156 can be separated from the eye by adjustment. . Further, in the present embodiment, the positions of the electrodes are not limited to the above-described positions, and may be any positions as long as an electrocardiogram signal indicating the vertical and horizontal movement of the eye can be obtained.

  In the present embodiment, as an example of the external device 300, a mobile communication terminal such as a mobile phone and a smartphone or a personal computer, which is separate from the processing device 200, has been described. However, it is not limited to this. The external device 300 may be provided not as a device “outside” the glasses 100 or the processing device 200 but as a unit integrated with the processing device 200. For example, the external device 300 is provided integrally with the eyewear. Further, arbitrary functions of the external device 300 may be provided in the processing device 200A (not shown).

  For example, the processing device 200A may include the functions of the difference calculation unit 334, the extreme value calculation unit 336, the determination unit 338, and the detection unit 340 of the external device 300. In this case, the processing device 200 </ b> A can provide the same effects as those of the above-described processing device 200, and can perform the detection process using a signal that is not affected by a communication error with the external device 300. it can.

  The transmission of the detection result includes real-time processing and batch processing. In the real-time processing, the detection result is transmitted to the external device 300 every time the detection result is obtained. Further, an electrogram signal or the like may be transmitted to the external device 300 in real time along with the detection result. By performing this real-time processing, detailed analysis can be performed at an early stage by the external device 300 or the like.

  In the batch processing, the detection results are totaled for each predetermined time (for example, one minute), and the totaling results are transmitted to the external device 300. The aggregation result may include the electrogram signal during that time. By performing this batch processing, the aggregation result is transmitted at predetermined time intervals, so that the number of transmissions can be reduced and the power consumption of the processing device 200A can be reduced.

  Further, in this embodiment, the use of shielded cables as electric wires may prevent noise from being mixed.

  Further, in this embodiment, the configuration using three electrodes is illustrated in FIG. 1, but a configuration using four or more electrodes may be used. In this case, the glasses have an upper electrode, a lower electrode, a left electrode, and a right electrode. For example, the upper electrode and the lower electrode are provided on the rim 122 shown in FIG. 1, the left electrode is provided on the left temple 130, and the right electrode is provided on the right temple 130. There is no. Note that these electrodes are assumed to be in contact with a part of the face.

  In the example of four electrodes, the vertical direction of the eye can be detected by the voltage difference between the upper electrode and the lower electrode, and the horizontal direction of the eye can be detected by the voltage difference between the left electrode and the right electrode. .

  As described above, the present invention has been described using the embodiments. However, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is apparent to those skilled in the art that various changes or improvements can be made to the above-described embodiment. It is apparent from the description of the appended claims that embodiments with such changes or improvements can be included in the technical scope of the present invention.

100 glasses 120 frame 124 eyebrows 140 nose pad 152 first electrode 154 second electrode 156 third electrode 200 processing device 300 external device 320 storage unit 330 control unit 332 acquisition unit 334 difference calculation unit 336 extreme value calculation unit 338 determination unit 340 Detection unit

Claims (8)

An acquisition step of acquiring an electro-oculogram signal based on an electro-oculogram detected by each electrode contacting around the eye of the subject,
A calculation step of calculating a difference signal between the obtained electrogram signal and the electrogram signal a predetermined time before the electrogram signal,
Calculating a maximum value and a minimum value of the difference signal;
Using said maximum value and / or the minimum value, based on whether or not a predetermined condition related to the switching of the detection processing detection processing or eye movement blink is satisfied, the blink detection process and the eye movement A determining step of determining which of the detection processes to perform,
A detection step of adaptively performing the determined blink detection process or the gaze movement detection process ,
A program that causes a computer to execute.   The program according to claim 1, wherein the predetermined condition is a condition regarding a ratio between the local maximum value and the local minimum value. The predetermined condition is that the ratio is included in a predetermined range equal to or more than a first threshold and equal to or less than a second threshold.
The determining step includes:
If the ratio is within a predetermined range equal to or greater than a first threshold and equal to or less than a second threshold, it is determined that the blink detection process is to be performed. If the ratio is not within the predetermined range, the gaze movement detection process is determined. The program according to claim 2, wherein the program is determined to be performed. The determining step includes:
The program according to claim 3, wherein when the ratio is equal to or smaller than a third threshold smaller than the first threshold or equal to or larger than a fourth threshold larger than the second threshold, it is determined that the gaze movement detection process is performed. .   The program according to claim 1, wherein the predetermined condition is a condition relating to a time required from a value of the electrogram signal regarding the maximum value or the minimum value to a predetermined value of the electrogram signal. The predetermined condition is that the time is within a predetermined time,
The determining step includes:
The method according to claim 5, wherein when the time is within the predetermined time, it is determined to perform the blink detection processing, and when the time is not within the predetermined time, it is determined to perform the gaze movement detection processing. The described program. An acquisition unit that acquires an electrocardiogram signal based on an electrooculogram detected by each electrode that contacts the periphery of the eye of the subject,
A difference calculation unit that calculates a difference signal between the acquired electrogram signal and the electrogram signal a predetermined time before the electrogram signal,
An extreme value calculating unit that calculates a local maximum value and a local minimum value of the difference signal,
Using said maximum value and / or the minimum value, based on whether or not a predetermined condition related to the switching of the detection processing detection processing or eye movement blink is satisfied, the blink detection process and the eye movement A determining unit that determines which of the detection processes to perform,
A detection unit that adaptively performs the detected blink detection process or the gaze movement detection process ,
An information processing apparatus comprising: Between the eyebrows,
A frame having a pair of nose pads,
A first electrode and a second electrode provided on a surface of each of the pair of nose pads,
A third electrode provided on the surface of the glabella,
An acquisition unit that acquires an electrocardiogram signal based on an electrooculogram detected by each electrode,
A difference calculation unit that calculates a difference signal between the acquired electrogram signal and the electrogram signal a predetermined time before the electrogram signal,
An extreme value calculating unit that calculates a local maximum value and a local minimum value of the difference signal,
Using said maximum value and / or the minimum value, based on whether or not a predetermined condition related to the switching of the detection processing detection processing or eye movement blink is satisfied, the blink detection process and the eye movement A determining unit that determines which of the detection processes to perform,
A detection unit that adaptively performs the detected blink detection process or the gaze movement detection process ,
Eyewear with

Images