WO2018123355A1

WO2018123355A1 - User interface device and electronic device

Info

Publication number: WO2018123355A1
Application number: PCT/JP2017/041783
Authority: WO
Inventors: 兼平　浩紀; 佐藤　克則; 赤間　博; 優子千田; 佳共; 光春菅原
Original assignee: デクセリアルズ株式会社
Priority date: 2016-12-28
Filing date: 2017-11-21
Publication date: 2018-07-05
Also published as: JP2018106574A

Abstract

This user interface device is provided with a control unit that outputs, to a display control unit, control information for displaying, on a display panel, a layer selected from a plurality of layers related to an object on the basis of a gesture operation, which is a combination of a touch operation determined on the basis of coordinate detection information and a pressing operation determined on the basis of pressure-sensitive detection information. In addition, the control unit determines a touch operation performed on the object through the layer displayed on the display panel.

Description

User interface device and electronic device

The present invention relates to a user interface device and an electronic device.

In recent years, touch panels that can be easily and sensibly operated with a finger or the like have become widespread, and various studies and developments have been made on downsizing, thinning, lightening, power saving, and cost reduction of touch panels. . As a method for detecting a position where an instruction medium such as a finger touches the touch panel (referred to as “touch position”), a resistance film type that detects a change in electrical resistance, a surface acoustic wave method that uses ultrasonic waves, an electrostatic A capacitance method for detecting a change in capacitance is known. In particular, a capacitive touch panel is attracting attention in that it can detect a plurality of touch positions.

The capacitive touch panel includes a transparent electrode that generates a capacitance and an external circuit that detects a change in the capacitance. In recent years, a touch panel including a pressure-sensitive sensor capable of detecting a pressing force when the touch panel is pressed with a stylus pen, a finger, or the like is being provided.

For example, in Patent Document 1, input determination by pressing on the input operation surface is performed based on a change in capacitance of the upper electrode and lower electrode of the pressure-sensitive sensor displaced by the top plate and the touch panel moving in the pressing direction. A technique for determining that an operation has been performed is disclosed.

Patent Document 2 discloses a sensor device including a pressure-sensitive sensor that does not use an elastic member.

Further, in Patent Document 3, an enlarged image in which an image displayed on the screen is enlarged at a predetermined enlargement display magnification according to the proximity of a finger to the screen is generated, and a part of the image becomes a locally enlarged image. A technique for displaying an image on a screen is disclosed.

JP 2011-134000 A Japanese Unexamined Patent Publication No. 2011-100364 JP 2013-225261 A

Touch panels are used in various electronic devices. As an electronic device using a touch panel, for example, there is a navigation device that is mounted on a car and displays a map, directions, and the like from the current position of the vehicle to a destination on a display panel. A navigation device requires a simple operation. However, the touch panel attached to the conventional navigation device has only a function of detecting the XY coordinates of the touch position, and it is inconvenient because a complicated operation must be performed by the user to obtain a desired result. .

Moreover, in the touch panel provided with the pressure sensitive sensor disclosed in

Patent Documents

1 and 2, the pressure sensitive sensor is merely used in an auxiliary manner in order to reliably detect that a finger or the like has touched the touch panel. For this reason, even if it is the touch panel which applied the technique disclosed by

patent document

1 and 2, operation itself is the same as that of the touch panel which does not have a conventional pressure-sensitive function, and the inconvenience of operation was not eliminated. . Moreover, since the operation using an external input device etc. is requested | required in the touchscreen which is not provided with a pressure sensor, it took time until the user became familiar with operation.

Also, with the technique disclosed in Patent Document 3, enlarged images of different layers can be displayed according to the distance from the screen to the finger when the finger is close to the screen. However, even if the display device disclosed in Patent Document 3 is used, it is difficult to appropriately select a target layer. In addition, when the display device disclosed in Patent Document 3 is mounted on a vehicle and used for inputting instructions to the car navigation device, for example, when the vehicle shakes because the finger is away from the screen. The operation was easy to make mistakes.

The present invention has been made in view of such a situation, and an object thereof is to make it possible to easily select a specific layer from a plurality of layers.

A user interface device according to the present invention includes a display panel that displays an object, a display control unit that performs control to display an object on the display panel according to control information, a touch panel that performs a touch operation using an instruction medium, and a touch operation that is performed. A coordinate detector that detects the coordinates of the touch position of the touch panel and outputs coordinate detection information; a pressure sensor that outputs a sensor value that changes according to the pressing force applied to the touch panel by the pointing medium; and a sensor value , A pressure sensitive detection unit that detects that a push-in operation in which the touch panel is pushed by the instruction medium is performed and outputs pressure sensitive detection information, a touch operation determined based on the coordinate detection information, and pressure sensitive Based on the gesture operation that combines the push operation determined based on the detection information, Outputs control information for displaying one layer selected from multiple layers related to the display panel to the display control unit, and determines the touch operation performed on the object through the one layer displayed on the display panel A control unit.
An electronic apparatus according to the present invention includes the above-described user interface device and an electronic apparatus main body. The electronic device main body performs a predetermined process based on content instructed by a touch operation or a gesture operation input from the control unit, and outputs an object on which the predetermined process has been performed to the control unit of the user interface device.

According to the present invention, a user can appropriately change a layer by performing an intuitive gesture operation that combines a touch operation and a push-in operation.
Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.

It is explanatory drawing which shows a state when the driver's seat and front passenger seat of the vehicle by which the navigation apparatus which concerns on the 1st Embodiment of this invention is mounted are seen toward the front from the back of the advancing direction. It is a block diagram which shows the internal structural example of the user interface apparatus which concerns on the 1st Embodiment of this invention. 1 is a schematic configuration diagram of a user interface device according to a first embodiment of the present invention. It is explanatory drawing of the operation principle of the pressure-sensitive sensor which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the example of operation which selects the conventional menu item. It is a flowchart which shows the example of operation which selects the menu item which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the example of the conventional layer switching operation. It is a flowchart which shows the example of the layer switching operation which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the example of the conventional shortcut icon selection operation. It is a flowchart which shows the example of the shortcut icon selection operation which concerns on the 3rd Embodiment of this invention.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same function or configuration are denoted by the same reference numerals, and redundant description is omitted.

[First Embodiment]
FIG. 1 is an explanatory diagram showing a state when a driver seat and a passenger seat of a vehicle on which the navigation device 1 is mounted are viewed from the rear in the traveling direction toward the front.
The navigation device 1 (an example of an electronic device) is installed at a position sandwiched between the dashboard 5 and the meter panel 6 and visible to a user who holds the steering wheel 7. A shift lever 8 is provided below the navigation device 1.

The navigation device 1 includes a navigation device body 2 that performs processing necessary for navigation, and a user interface device 3. The navigation device body 2 is fitted in a recess formed in the dashboard 5 and cannot be directly recognized by the user. The user interface device 3 is disposed at a position where the user can visually recognize, and outputs an instruction input by the user to the navigation device main body 2 and indicates a processing result by the navigation device main body 2 to the user.

The user interface device 3 is configured to have a sense of unity with the interior shape from the dashboard 5, the meter panel 6 and the shift lever 8 to the base of the windshield 4. The user interface device 3 displays information (a map, various icons, etc.) necessary for navigation processing and the like output from the navigation device body 2. The user touches an instruction medium such as a user's finger or stylus pen on the touch panel 20 (see FIG. 2 to be described later) to move an icon displayed on the user interface device 3 or to enlarge or reduce a map or the like. It is possible to perform gesture operations.

In the following description, it is assumed that the instruction medium touching the touch panel 20 is a user's finger. In addition, an operation performed by the user moving his / her finger while touching the touch panel 20 is referred to as a “touch operation”, and an operation in which the user presses the touch panel 20 with a finger is referred to as a “pressing operation”. An operation performed by combining the touch operation and the pressing operation is referred to as a “gesture operation”. Note that the conventional gesture operation is an operation performed only by a touch operation.

FIG. 2 is a block diagram illustrating an internal configuration example of the user interface device 3.
Before describing the internal configuration of the user interface device 3, the operation of the navigation device body 2 will be described. The navigation device main body 2 (an example of the electronic device main body) performs predetermined processing based on the instructed content by a touch operation or a gesture operation input from the control unit 10 of the user interface device 3. Then, the navigation device body 2 outputs the object after performing the predetermined processing based on the instruction to the control unit 10 of the user interface device 3.

Objects that are output from the navigation device body 2 to the user interface device 3 include, for example, maps, character strings, icons, images, and the like. The navigation device body 2 performs navigation processing based on the gesture operation performed on the user interface device 3, outputs a map for display by the user interface device 3, and receives a character string input from the user interface device 3. Edit it.

The user interface device 3 includes a control unit 10, a storage medium control unit 14, a storage medium 15, a communication control unit 16, a coordinate detection unit 17, a pressure sensitive detection unit 18, and a display control unit 19 connected by a bus B. The user interface device 3 also includes a touch panel 20 connected to the coordinate detection unit 17, a pressure sensor 30 connected to the pressure detection unit 18, and a display panel 40 connected to the display control unit 19.

The control unit 10 controls the operation of each unit in the user interface device 3. The control unit 10 determines that a touch operation has been performed based on the coordinate detection information input from the coordinate detection unit 17, and outputs information input from the touch position to the navigation device body 2. Further, the control unit 10 determines that the pressing operation in which the touch panel 20 is pressed with a finger is performed based on the pressure-sensitive detection information input from the pressure-sensitive detection unit 18. In addition, the control unit 10 outputs control information for causing the display panel 40 to display the object output from the navigation device body 2 to the user interface device 3 to the display control unit 19. Then, the control unit 10 displays control information for displaying one layer selected from the plurality of layers related to the object on the display panel 40 based on the gesture operation combining the touch operation and the push-in operation. 19 output. Further, the control unit 10 determines a touch operation (such as a finger movement direction and a touch position) performed on the object through one layer displayed on the display panel 40.

The control unit 10 includes a CPU 11, a RAM 12, and a ROM 13, and the CPU 11, the RAM 12, and the ROM 13 work together to realize the function of the control unit 10.
The CPU (Central Processing Unit) 11 is an example of a computer that controls the operation of each unit in the user interface device 3. For example, the CPU 11 executes a program read from the ROM 13 and performs processing related to the gesture operation according to the present embodiment.
A RAM (Random Access Memory) 12 stores temporary data such as a program executed by the CPU 11.

ROM (Read Only Memory) 13 stores a program read by the CPU 11 and the like. The ROM 13 is used as an example of a computer-readable non-transitory recording medium that stores a program executed by the CPU 11. For this reason, this program is permanently stored in the ROM 13. Note that the computer-readable non-transitory recording medium storing the program executed by the CPU 11 may be a recording medium such as a CD-ROM or a DVD-ROM.

The storage medium control unit 14 controls the storage medium 15. For example, the storage medium control unit 14 writes data input from the control unit 10 to the storage medium 15, or reads data stored in the storage medium 15 according to an instruction from the control unit 10 and outputs the data to the control unit 10. .
For example, the storage medium 15 is inserted into a slot or the like provided in the user interface device 3 and stores data written by the storage medium control unit 14 or data is read by the storage medium control unit 14. For example, the storage medium 15 stores a navigation program that operates in the navigation apparatus main body 2, upgrade data of a character editing program, and the like.
The communication control unit 16 controls data communication processing performed through the network N between the navigation device body 2 and the user interface device 3.

The coordinate detection unit 17 detects the coordinates of the touch position of the touch panel 20 where the touch operation is performed. The touch panel 20 is formed in a planar rectangular shape, and the position of the intersection of the X electrode and the Y electrode that intersect each other is coordinate information, and a value corresponding to the change in capacitance at this position is given to the coordinate detection unit 17. Is output. The coordinate detection unit 17 detects the coordinate of the location where the coordinate information input from the touch panel 20 has changed as a finger touch position, and outputs coordinate detection information including the coordinate of the touch position to the control unit 10.

The pressure sensitive detection unit 18 detects that the touch panel 20 is pressed with a finger and the pressure sensitive sensor 30 senses pressure. The pressure-sensitive sensor 30 is provided on the back surface of the touch panel 20 and outputs a sensor value that changes according to the pressing force applied to the touch panel 20 by a finger to the pressure-sensitive detection unit 18. Based on the sensor value input from the pressure-sensitive sensor 30, the pressure-sensitive detection unit 18 detects that a pressing operation for pressing the touch panel 20 with a finger is performed, and outputs pressure-sensitive detection information to the control unit 10. To do.

The display control unit 19 performs control to display, for example, an icon, a map, and the like necessary for navigation on the display panel 40 formed in a planar rectangular shape according to the control information input from the control unit 10.

FIG. 3 is a schematic configuration diagram of the user interface device 3.
In FIG. 3, the position of the pressure-sensitive sensor 30 installed on the touch panel 20 as viewed from above and the position of the frame of the housing 55 are indicated by broken lines. Six pressure-sensitive sensors 30 are provided on the back surface of the touch panel 20 on the frame of the housing 55 of the user interface device 3 including the touch panel 20. For this reason, the user does not see the pressure sensor 30 directly. As shown in FIG. 3, a plurality of pressure-sensitive sensors 30 are usually provided, but a plurality of pressure-sensitive sensors 30 are not necessarily provided, and may be one.

A cross-sectional view of the touch panel 20 and the pressure sensor 30 is shown below FIG.
The top plate 50 protects the surface of the touch panel 20. A transparent glass substrate, a film, or the like is used for the top plate 50. The surface of the top plate 50 is an input operation surface 51 on which a user contacts a finger in order to perform a touch operation.

The touch panel 20 is configured, for example, by laminating a transparent X electrode substrate 21, an adhesive layer 22, and a Y electrode substrate 23 in this order. The top plate 50 and the X electrode substrate 21 are bonded and fixed by an adhesive layer 52. Each of the X electrode substrate 21 and the Y electrode substrate 23 has a rectangular shape. The X electrode substrate 21 and the Y electrode substrate 23 are bonded by the adhesive layer 22. An area where the X direction detection electrode (not shown) formed on the X electrode substrate 21 and the Y direction detection electrode (not shown) formed on the Y electrode substrate 23 overlap each other in a plane is a coordinate detection area on the XY plane. Become. The pressure sensitive sensor 30 is disposed in a peripheral area (frame) outside the coordinate detection area on the XY plane of the touch panel 20.

The pressure-sensitive sensor 30 includes an elastic body 33 made of a dielectric material disposed between the touch panel 20 and the housing 55, and an upper electrode 31 and a lower electrode 35 that are disposed so as to sandwich the elastic body 33 and form a capacitor. Is provided. The pressure-sensitive sensor 30 further includes an adhesive layer 32 that bonds and fixes the elastic body 33 and the upper electrode 31, and an adhesive layer 34 that bonds and fixes the elastic body 33 and the lower electrode 35. In the present embodiment, the elastic bodies constituting the six pressure-sensitive sensors 30 are connected to form one frame-shaped elastic body 33, and the six pressure-sensitive sensors 30 form one elastic body 33. Sharing. By providing the elastic body 33 in a ring shape, it is possible to prevent foreign dust or the like from entering the gap 41 between the touch panel 20 and the housing 55, that is, between the touch panel 20 and the display panel 40. Further, the lower electrodes 35 constituting the six pressure sensors 30 are connected to constitute one frame-like lower electrode 35, and the six pressure sensors 30 share one lower electrode 35. The upper electrode 31 may also be formed in a frame shape like the lower electrode 35.

For the elastic body 33, for example, a material having a small residual strain and a high restoration rate (restoration speed) is used. Examples of the material used for the elastic body 33 include silicone rubber and urethane rubber. The elastic body 33 may be displaced about 10% at the maximum with respect to the height of the original elastic body 33, for example. For example, the elastic body 33 having a thickness of 0.5 mm used for the pressure-sensitive sensor 30 may be displaced by about 10 μm.

When the input operation surface 51 is pressed with a finger in a pressing direction (z-axis direction) perpendicular to the input operation surface 51, the elastic body 33 of the pressure sensor 30 is distorted so that the pressure sensor 30 is bonded and fixed. The top plate 50 and the touch panel 20 are moved in the pressing direction. Thus, when the pressure sensor 30 is pressed, its thickness is displaced in the pressing direction. Then, the back surface of the touch panel 20 approaches the front surface of the display panel 40 by the amount of displacement of the pressure sensor 30, so that a gap 41 is provided between the touch panel 20 and the display panel 40 in consideration of the movement of the touch panel 20. ing. However, the gap 41 is not provided when the touch panel 20 and the display panel 40 are bonded. The pressure-sensitive sensor 30 outputs a sensor value corresponding to the capacitance of the capacitor formed by the upper electrode 31 and the lower electrode 35 to the pressure-sensitive detection unit 18.

FIG. 4 is a diagram for explaining the operating principle of the pressure-sensitive sensor 30. Here, the description of the touch panel 20 is omitted.
An example of the pressure-sensitive sensor 30 that is not pressed with a finger is shown in the upper left of FIG. 4, and an example of the pressure-sensitive sensor 30 that is pressed with a finger is shown in the upper right of FIG.

As described above, when the touch panel 20 is pressed with a finger and a pressing force is applied to the pressure sensor 30, the elastic body 33 is distorted so that the thickness decreases. And the electrostatic capacitance of the pressure sensor 30 changes because the thickness of the pressed pressure sensor 30 changes with respect to the thickness of the pressure sensor 30 which is not pressed. For example, when the pressure sensor 30 is pressed with a finger and the thickness of the elastic body 33 is reduced by the displacement d, the capacitance between the upper electrode 31 and the lower electrode 35 changes. For this reason, the pressure-sensitive detection unit 18 uses the capacitance change rate between the upper electrode 31 and the lower electrode 35 due to the displacement d of the elastic body 33, the touch panel 20 is pressed, and the pressure-sensitive sensor 30 senses pressure. (Hereinafter referred to as “pressure detection”). The capacitance change rate is obtained based on sensor values output from the upper electrode 31 and the lower electrode 35 by the pressure-sensitive detection unit 18. Here, the sensor value is a voltage determined by the capacitance between the upper electrode 31 and the lower electrode 35. That is, the rate of change in capacitance is the static between the upper electrode 31 and the lower electrode 35 of the pressed pressure sensor 30 with respect to the capacitance between the upper electrode 31 and the lower electrode 35 of the pressure sensor 30 that is not pressed. It is obtained as a percentage of electric capacity.

4 is a graph showing the relationship between the capacitance change rate of the pressure sensor 30 and the pressing force applied to the pressure sensor 30. The lower graph in FIG. From this graph, it can be seen that the capacitance change rate of the pressure sensor 30 has a linear characteristic that is substantially proportional to the pressing force applied to the pressure sensor 30. The pressure-sensitive detection unit 18 according to the present embodiment obtains a change in capacitance between the upper electrode 31 and the lower electrode 35 based on a sensor value input from the pressure-sensitive sensor 30, that is, obtains a rate of change in capacitance. Is possible.

The pressure-sensitive detection unit 18 detects the sensor value detected by each pressure-sensitive sensor 30 disposed on the back surface of the touch panel 20 based on the graph showing the relationship between the pressing force at the bottom of FIG. It is converted into a pressing force when the touch panel 20 is pressed. Then, when the pressing force exceeds the pressing threshold, the pressure-sensitive detection unit 18 determines that the user has consciously pressed the touch panel 20 and outputs pressure-sensitive detection information to the control unit 10.

Note that the pressure-sensitive detection unit 18 may obtain the pressing force based on the total value of the respective capacitance change rates detected by the pressure-sensitive sensors 30. Thereby, it is possible to detect the pressing force with high accuracy without depending on only the touch position on the input operation surface 51. Note that the pressure-sensitive detection unit 18 may obtain the pressing force from an average value obtained by dividing the total value of the capacitance change rates by the number of the pressure-sensitive sensors 30, for example.

Further, the pressure-sensitive detection unit 18 may output pressure-sensitive detection information that varies depending on the magnitude of the pressing force to the control unit 10. For example, in the lower graph of FIG. 4, the pressing force at which the capacitance change rate is 2.0% is defined as a threshold th1 (an example of the first pressing threshold value), and the pressing force at which the capacitance change rate is 6.0%. Let the pressure be a threshold th2 (an example of a second pressing threshold). If the pressing force is less than the threshold th <b> 1, it is considered that the capacitance has only changed due to vibration applied to the user interface device 3 through the housing 55. That is, it is assumed that the user does not intentionally press the finger into the touch panel 20. In this case, the pressure-sensitive detection unit 18 does not determine that the user has pressed the finger into the touch panel 20, and therefore does not output pressure-sensitive detection information. However, if the pressing force is equal to or greater than the threshold th1, the pressure-sensitive detection unit 18 determines that the user has pressed the finger into the touch panel 20, and outputs first pressure-sensitive detection information. Furthermore, if the pressing force is greater than or equal to the threshold th2, the pressure-sensitive detection unit 18 determines that the user has pressed the finger strongly into the touch panel 20, and outputs second pressure-sensitive detection information.

As described above, the pressure-sensitive detection unit 18 uses the first pressure-sensitive detection information or the second pressure-sensitive information based on the pressing force obtained from the capacitance change rate that changes according to the pressing amount of the user pushing the finger into the touch panel 20. Detection information can be output to the control unit 10. As a result, the control unit 10 can perform different processes according to the first pressure detection information or the second pressure detection information input from the pressure detection unit 18. Note that the pressure-sensitive detection information may be only one of the first pressure-sensitive detection information and the second pressure-sensitive detection information. When the first pressure detection information or the second pressure detection information is not distinguished, it is referred to as “pressure detection information”.

The control unit 10 determines that the finger has been pushed into the touch panel 20 and the determination operation by the user has been performed when the pressure-sensitive detection information is input from the pressure-sensitive detection unit 18. At this time, the control unit 10 vibrates the housing 55 or displays a message on the display panel 40 in order to inform the user that it is in the pressed state. Further, a voice guide may be emitted from a speaker (not shown). Or the control part 10 can also display icons, such as a circle and a square, in the pressed touch position. In this case, the icon may be blinked, or the icon display color may be changed. The housing 55 can also generate a click sound or change the touch of the finger when the touch panel 20 is pushed.

Hereinafter, an operation example using the conventional user interface device 100 and an operation example using the user interface device 3 according to the first embodiment will be described with reference to FIGS. 5 and 6.
Each step of the conventional flowchart shown in FIG. 5 and the flowchart according to the first embodiment of the present invention shown in FIG. 6 includes

user interface devices

3 and 100 in order to explain specific contents of the gesture operation. A display example of the screen displayed on the display panel may be shown. In this display example, an instruction icon for a user to specify a menu item through a touch panel is represented by a black arrow.

<Problem of selecting menu items in the past>
The conventional user interface device includes a conventional touch panel or a mouse that can detect only the XY coordinates of the touch position. Then, the user may select a menu item from the main menu arranged on the menu bar using a conventional user interface device. At this time, after selecting the main menu with the instruction icon, the user selects a target menu item from a plurality of menu items belonging to the lower layer for the main menu. However, when the user moves the instruction icon to the desired menu item, if the instruction icon goes out of the menu item display area, the menu item is not displayed, and the menu item must be displayed again by selecting the main menu. I had to.

<Conventional operation>
Prior to describing the first embodiment of the present invention shown in FIG. 6, an example of an operation for selecting a conventional menu item will be described with reference to FIG.
FIG. 5 is a flowchart showing an example of an operation for selecting a conventional menu item.
First, a control unit (not shown) provided in the conventional user interface device 100 detects that a finger touches the touch panel provided in the user interface device 100 (S1). Hereinafter, a control unit of a conventional user interface device is simply referred to as a “control unit” without a symbol.

Next, the control unit determines whether or not the user has performed a menu operation for selecting the main menu from the menu bar (S2). When the control unit determines that the menu operation is not performed by the user (NO in S2), the operation performed on the touch panel is an operation of moving the instruction icon to a place other than the menu bar. For this reason, the control unit performs the operation of moving the instruction icon to move the instruction icon in accordance with the movement direction of the user's finger (S3), and then ends this process.

On the other hand, if it is determined in step S2 that the menu operation has been performed by the user (YES in S2), the menu item included in the lower layer of the main menu indicated by the instruction icon is displayed in the pull-down list in the first menu m1. (S4). In the screen added to step S4, as a result of the user selecting the FILE menu as the main menu from the menu bar at the upper left of the screen displayed on the conventional user interface device 100, the first menu in the lower layer of the FILE menu is displayed. A state in which the menu m1 and the second menu m2 are displayed in the pull-down list is shown. Both the first menu m1 and the second menu m2 are a group of a plurality of menu items. Menu items of the first menu m1 include, for example, “NEW”, “OPEN”, and the like, and menu items of the second menu m2 include, for example, “PRINT”. In the screen added in step S7, the second menu m2 is simultaneously displayed below the first menu m1, but when the display panel is small, a drop-down displayed below the first menu m1. The second menu m2 is not displayed unless the button is clicked or the screen is scrolled.

Next, the user determines whether or not to select the second menu m2 displayed in the pull-down list (S5). When the second menu m2 is not selected (NO in S5), the user selects a menu item of the first menu m1 (S6). When it is determined that the menu item of the first menu m1 is selected and the finger is removed from the touch panel, the control unit determines the selected menu item and ends the process.

On the other hand, in step S5, when the user selects the second menu m2 (YES in S5), the user moves the instruction icon and displays the second menu m2 (S7). The screen added in step S7 shows that the user has selected “PRINT” included in the second menu m2 from the FILE menu item.

Then, the user selects a menu item of the second menu m2 (S8). When the control unit determines that the menu item of the second menu m2 is selected and the finger is removed from the touch panel, the control unit determines the selected menu item (S8), and ends the present process.

Thus, conventionally, when the main menu is composed of a plurality of lower layer menus, the menu item displayed by the user is selected by selecting the lower layer menu in order to select a menu item finally required by the user. The operation to move the instruction icon to was performed. However, if the moved instruction icon deviates from the menu item, the selection of the main menu and the lower layer menu becomes invalid. Further, when the user returns the instruction icon to the main layer and selects another main menu, the instruction icon must be moved accurately. In order to select the desired menu item from the pull-down list containing many menu items, the user must move his / her finger greatly, and the finger is accidentally moved from the touch panel at a position different from the intended menu item. It was easy to make an operation mistake.

<Gesture operation of the first embodiment>
FIG. 6 is a flowchart illustrating an example of an operation for selecting a menu item according to the first embodiment. In the first embodiment, a target menu item can be selected from a layer related to the menu item by a simple operation using one finger. That is, the control unit 10 according to the first embodiment displays control information for displaying one layer from a plurality of layers including different menu items when the touch panel 20 is pressed by a finger. Can be output. The layers include a first layer and a second layer. The first layer includes a first menu m1 that is displayed when a menu operation is performed on the touch panel 20. The second layer includes a second menu m2 that is displayed when the touch panel 20 is pressed with a finger on the first menu m1.

In the first embodiment, the gesture operation is an operation in which the user presses the finger on the touch panel 20 on the first menu m1 to display the second menu m2, and selects an arbitrary menu item from the second menu m2. is there. In the first embodiment, one layer selected from a plurality of layers related to an object is displayed on the display panel 40. For example, one object (for example, a file, a graphic, or a character string) is displayed as one layer. When a plurality of lower layers (for example, the first menu m1 and the second menu m2) are included in the layer (for example, the main menu), one lower layer is selected from the plurality of lower layers, and this lower layer is selected. Is to display the menu items contained in the layer.

First, when the user's finger touches the touch panel 20 provided in the user interface device 3, the coordinate detection unit 17 detects that the touch has been made (S11), and detects the coordinates of the touch position.

Next, a menu operation for selecting the main menu from the menu bar is performed with the finger touched on the touch panel 20 by the user (S12). If the user does not perform the menu operation (NO in S12), the operation performed on the touch panel 20 is an operation for moving the instruction icon to a place other than the menu bar. For this reason, the control part 10 complete | finishes this process, after performing the movement operation etc. of the instruction | indication icon which moves an instruction | indication icon according to the moving direction of a user's finger | toe (S13).

On the other hand, if the user performs a menu operation (YES in S12), the control unit 10 confirms that the finger moved by the user has moved to the menu bar at the top of the screen based on the coordinate detection information input from the coordinate detection unit 17. judge. For example, when the finger moves to the FILE menu on the menu bar, the control unit 10 outputs control information for displaying only the first menu m1 on the display panel 40 to the display control unit 19 (S14). At this time, only the first menu m1 which is a lower layer of the main menu is displayed in the pull-down list. On the screen added in step S14, the user selects the FILE menu from the menu bar at the top left of the screen by touch operation, and only the menu items of the first menu m1 ("NEW", "OPEN", etc.) are displayed in the pull-down list. The state of being done is shown.

Next, the user selects an operation of pushing a finger into the touch panel 20. Based on the sensor value output from the pressure sensor 30, the pressure sensor 18 determines whether or not the pressure sensor 30 has detected pressure (S15). When it is determined that the pressure sensitive detection unit 18 has not detected pressure sensitive based on the sensor value (NO in S15), the control unit 10 selects the menu item of the first menu m1 and releases the finger from the touch panel 20. The selected menu item is confirmed (S16), and this process is terminated.

On the other hand, when it is determined that the pressure sensitive detection unit 18 has detected the pressure sensitive by the sensor value (YES in S15), the control unit 10 determines that the touch panel 20 has been pushed by the finger on the first menu m1. Then, the control unit 10 outputs to the display control unit 19 control information for displaying the second menu m2 in the vicinity of the touch position where the finger is pressed.

Thereby, the second menu m2 is displayed at a position overlapping the first menu m1 already displayed on the display panel 40 (S17). For this reason, the user can select the menu item of the second menu m2 with almost no finger moving from the position where the touch panel 20 is pressed (S18). Then, when the menu item of the second menu m2 is selected and the finger is removed from the touch panel 20, the control unit 10 determines the selected menu item and ends this process.

It is assumed that the user presses the finger on the touch panel 20 to display the second menu m2, but notices that the target menu item is included in a lower layer of another menu. In this case, the user performs an operation of releasing the finger from the second menu m2 while pressing the finger on the touch panel 20. Thereby, the display of the first menu m1 and the second menu m2 disappears, and the user can select the menu from the menu bar again.

In the user interface device 3 according to the first embodiment described above, the first menu m1 or the second menu m2 is selected by a simple gesture operation of pressing the touch panel 20 using one finger, You can select a menu item to do. For this reason, the user can handle the gesture operation according to the present embodiment sensibly and intuitively as compared with the operation of moving the instruction icon greatly in order to select a conventional menu item.

Also, since the second menu m2 is displayed over the first menu m1, the user's line-of-sight movement may be reduced. In addition, since the movement distance of the finger can be shortened and the instruction icon need not be moved, the user can quickly switch between a plurality of layers as well as reduce operation errors.

In addition, while the user touches the user interface device 3 with his / her finger, the finger is difficult to move from the touch position even if the running vehicle is shaking. Therefore, it can be operated more accurately than a conventional user interface device using a proximity touch panel. Note that the navigation device body 2 may output control information to the user interface device 3 so that it cannot be operated using the user interface device 3 while the vehicle is traveling. Conversely, control information that allows the user interface device 3 to be operated while the vehicle is stopped may be output to the user interface device 3.

Also in the image editing software, the image browsing software, etc., the first menu m1 and the second menu m2 may be displayed using the user interface device 3 according to the first embodiment.

Although the second menu m2 is a menu item after “PRINT”, it can be changed to an arbitrary menu item. It is also possible to set three or more lower layers in one menu. In this case, by pressing the touch panel 20 at the position where the user has selected the menu, the layers can be sequentially switched and displayed. For example, in a state where the first menu m1 is displayed, the second menu m2 is displayed if the finger pressing force on the touch panel 20 is greater than or equal to the threshold th1, and the second menu m2 is displayed if the finger pressing force is greater than or equal to the threshold th2. Another menu may be displayed instead of the menu m2. Therefore, the user can select a layer including a target menu item from a plurality of layers.

Further, the target layer may be selectable by the user using only the threshold th1. For example, it is assumed that the lower layer includes a third menu in addition to the first menu m1 and the second menu m2 described above. When the user presses the touch panel 20 with a pressing force equal to or greater than the threshold th1 while the first menu m1 is displayed, the first menu m1 is switched to the second menu m2 and displayed. Next, after the user pulls his / her finger so that the finger pressing force is less than the threshold th1 while touching the touch panel 20, the second menu m2 Is switched to the third menu and displayed. Further, after the user pulls his / her finger so that the pressing force of the finger is less than the threshold th1 while touching the touch panel 20, the third menu is displayed when the touch panel 20 is pressed again with a pressing force of the threshold th1 or more. It is switched to 1 menu m1 and displayed. Thus, whenever the user presses the finger on the touch panel 20, the first menu m1, the second menu m2, and the third menu can be cyclically displayed.

Further, a menu selection area where the user can select various menus may be displayed on any one side of the display panel 40. When the user touches and pushes in one menu selection area with a finger, menu items corresponding to the menu displayed in the menu selection area may be displayed on the display panel 40.

[Second Embodiment]
Next, an example of gesture operation of the user interface device 3 according to the second embodiment of the present invention will be described with reference to FIG. The gesture operation according to the second embodiment is performed to perform a touch operation for each layer.

<Problems of conventional layer switching operation>
In a conventional user interface device equipped with a touch panel that can detect only the XY coordinates of the touch position, in order for the user to perform different work for each layer, the target layer is selected from the menu item that lists the switching destination layers. Was selected.

Hereinafter, an operation example using the conventional user interface device 100 and an operation example using the user interface device 3 according to the first embodiment will be described with reference to FIGS. 7 and 8.
In the screen added to the steps of FIGS. 7 and 8, the screen of the

user interface device

3, 100 and the front view, the bottom view, and the left side view of the user interface device 3100 at a certain moment are simultaneously displayed within a rectangular broken line. ing. A white arrow in the screen indicates the moving direction of the finger.

<Conventional gesture operation>
Prior to describing the second embodiment of the present invention shown in FIG. 8, an example of a conventional layer switching operation will be described with reference to FIG.
FIG. 7 is a flowchart showing an example of a conventional layer switching operation.
Note that the processing in steps S21 and S22 in FIG. 7 is the same as the processing in steps S1 and S2 in FIG. 5 in the first embodiment described above, and thus detailed description thereof is omitted.

If it is determined in step S22 that the menu operation has been performed by the user (YES in S22), the control unit displays a menu item for switching the layer at the position touched by the user's finger (S23). The screen added to step S23 shows that the user selects the layer switching menu from the menu bar at the upper left of the screen, and the name of the switching destination layer included in the layer switching menu is displayed as a menu item in the pull-down list. Has been. For example, “A” displayed in the center of the screen indicates that the name of the currently displayed layer is “Layer A”. Here, the menu items displayed in the pull-down list are the three items of layers A, B, and C.

Next, the user selects a menu item for the layer to be switched to (S24). The control unit determines that the switching destination layer has been selected from the menu items displayed in the pull-down list. The screen added to step S24 shows a state where the user moves the finger along the pull-down list and selects the menu item of layer B.

Next, the control unit switches to the menu item layer selected by the user (S25). Then, when the user removes his / her finger from the touch panel, the control unit determines and displays the switched layer (S26), and ends this process. The screen added in step S26 shows how layer B is displayed when the user lifts his / her finger from the touch panel.

Thus, conventionally, it was necessary for the user to display a layer menu item and select a layer to be switched from this menu item. However, the layer switching operation is complicated in an operation that requires frequent layer switching.

<Gesture operation of the second embodiment>
FIG. 8 is a flowchart illustrating an example of a layer switching operation according to the second embodiment. Also in the second embodiment, the layers can be switched by a simple operation using one finger. That is, when the touch panel 20 is pushed by a finger, the control unit 10 switches the display information to the display control unit 19 so that the display panel 40 displays control information for switching an object from one layer to a single operable layer. Output.

In the second embodiment, the gesture operation is an operation in which the user presses the finger on the touch panel 20 to switch the layer and releases the touch panel 20 to confirm the switched layer. In the second embodiment, displaying one layer selected from a plurality of layers related to an object on the display panel 40 means that when there are different layers A, B, C, for example, a plurality of layers A , B, and C, one layer B is selected, and the object is displayed in the layer B so as to be editable. Note that layers A, B, and C are all layers related to the object to be edited.

First, when the user's finger touches the touch panel 20 provided in the user interface device 3, the coordinate detection unit 17 detects that the touch has been made (S31), and detects the coordinates of the touch position. The screen added in step S31 shows a state in which the user touches the left side of the screen with one finger. At this time, layer A is displayed on the user interface device 3.

Next, the user selects an operation of pushing a finger into the touch panel 20 (S32). The screen added in step S32 shows a state in which the user touches the upper left of the screen with one finger and further presses the touch panel 20. Then, the fact that the touch panel 20 has been pressed with a finger is indicated by the finger moving direction represented by the downward arrow with respect to the touch panel 20.

Next, the pressure-sensitive detection unit 18 determines whether or not the pressure-sensitive sensor 30 has detected pressure based on the sensor value output from the pressure-sensitive sensor 30 (S33). When the pressure detection unit 18 determines that no pressure is detected based on the sensor value (NO in S33), the control unit 10 ends this process.

On the other hand, when it is determined that the pressure sensitive detection unit 18 has detected the pressure sensitive based on the sensor value (YES in S33), the control unit 10 switches the layer and displays control information for displaying the switched layer on the display panel 40. It outputs to the display control part 19 (S34). The screen added in step S34 shows a state where the screen is switched from layer A to layer B when the user presses the finger on the touch panel 20.

Then, when the user removes his / her finger from the touch panel 20, the layer displayed by switching is fixed and displayed (S35). The screen added in step S35 shows a state in which layer B is determined and displayed when the user removes his / her finger from touch panel 20. Thereafter, when the user presses the finger again on the touch panel 20, the layer C switched from the layer B is displayed on the user interface device 3, and the user can determine the layer C.

In the user interface device 3 according to the second embodiment described above, it is possible to switch and display one layer from a plurality of layers by a simple gesture operation of pressing the touch panel 20 using one finger. it can. For this reason, conventionally, the layer switching menu is selected from the menu bar and the menu item of the layer is selected, but the layer can be switched by slightly moving a finger. In addition, since you do not have to move your finger almost, you can not only reduce operational errors, but also quickly switch between multiple layers.

For example, there is image editing software that can draw characters, figures, etc. by handwriting on photos. This software can edit images using photo layers and image editing layers. When the image editing layer is displayed, the user presses the touch panel 20 to change the image editing layer to the photo layer, thereby changing the display position of the photo, changing the orientation of the photo, or scaling the photo. Is possible. For this reason, layers can be switched by an intuitive operation without selecting a target layer from the layer list as in the prior art.

Note that the layer to be switched when the touch panel 20 is pressed may be changed. For example, first, when the image editing layer is displayed, when the user presses the touch panel 20 with a finger, the display is switched to the photo layer. Next, when the photo layer is displayed, when the user presses the touch panel 20 with a finger, it may be switched to the image editing layer and displayed.

In addition, when there are a plurality of layers, the control unit 10 displays control information for sequentially switching the plurality of layers and displaying them on the display panel 40 in accordance with the duration for which the touch panel 20 is pressed by a finger. 19 may be output. The order of the layers to be switched and displayed at this time is cyclic, for example, layers A, B, C, A, B, C,. As a result, for example, even if an unintended layer is displayed, the user can display the target layer because the layers are switched in order only by keeping the finger pressed.

In addition, when there are a plurality of layers, the layers may be switched according to the amount of finger pressing into the touch panel 20 by the user. For example, when the image editing layer is displayed and the finger pressing force on the touch panel 20 is equal to or greater than the threshold th1, the photo layer is displayed, and when the finger pressing force is equal to or greater than the threshold th2, another menu (for example, (Background layer) may be displayed. Therefore, the user can select a layer including a target menu item from a plurality of layers.

Also, for example, a gesture operation may be assigned to the slide show function. In this case, when the user presses the touch panel 20 with a finger, the next slide may be displayed. Accordingly, the user can smoothly execute the slide show without searching for a button for displaying the next slide.

[Third Embodiment]
Next, an example of a gesture operation of the user interface device 3 according to the third embodiment of the present invention will be described with reference to FIG. The gesture operation according to the third embodiment is performed to select a shortcut icon.

<Problems of conventional shortcut icon selection operation>
In a conventional user interface device having a touch panel that can detect only the XY coordinates of the touch position, it is necessary to select a menu that is frequently used by touching a menu icon displayed on the display panel. For this reason, when using menu items that are not always displayed on the screen, the user must switch the layer that includes the menu item or touch the menu icon that is included in one of the layers. It was complicated.

<Conventional gesture operation>
Prior to describing the third embodiment of the present invention shown in FIG. 10, an example of a conventional shortcut icon selection operation will be described with reference to FIG.
FIG. 9 is a flowchart showing an example of a conventional shortcut icon selection operation.
First, the control unit included in the conventional user interface device 100 detects that a finger touches the touch panel included in the user interface device 100 (S41). The screen added in step S41 shows a state in which the user touches the left side of the screen with one finger.

Next, the control unit determines that the map display selection icon has been selected by the user (S42). The screen added to step S42 shows how the map is displayed by selecting the map display selection icon displayed on the upper right of the screen with a finger.

Next, the control unit determines that the destination selection icon has been selected by the user (S43). The destination selection icon is an icon for displaying a function-specific icon used for the user to select and input a destination of the vehicle. A map is displayed on the screen added to step S43, and a state in which the user selects a destination selection icon displayed on the upper left of the screen with a finger is shown.

Next, the control unit determines that the home icon has been selected by the user (S44). The screen added to step S44 shows an example in which a plurality of function-specific icons are displayed as the destination selection icon. These function-specific icons have a shortcut function for realizing a target function with a simple operation (for example, one click), and are displayed in a rectangular frame at the lower right of the destination selection icon. The The function-specific icons displayed on the destination selection icon are a list icon (upper right of the frame) indicating that a plurality of destinations registered in advance are displayed as a list, and a search icon indicating that a new destination is to be searched. (Bottom left of the frame), including a home icon (bottom right of the frame) indicating that the user's home address is determined as the destination. For example, when the user determines the home icon as the destination, the home address is automatically determined as the destination without inputting the home address using a software keyboard or the like.

Next, the control unit determines that the selection of the home icon has been determined by the user (S45). On the screen added to step S45, a YES button and a NO button for selecting whether or not the home icon selected by the user can be determined are displayed, and the user selects the YES button with a finger. When the user selects the YES button, a preset home address is determined as the destination.

Conventionally, when a user designates a home address as a destination, (1) a map display screen is selected, (2) a destination selection icon is selected, (3) a home icon is selected, and (4) a home address is selected. An operation to determine the destination was performed. In this way, the user must touch the touch panel at least four times before determining the destination. In addition, since the display positions of icons and the like are not constant and the sizes thereof vary, the user has to check the displayed icons and the like every time, and the operation is complicated.

<Gesture operation of the third embodiment>
FIG. 10 is a flowchart illustrating an example of a shortcut icon selection operation according to the third embodiment. Also in the third embodiment, a necessary function can be selected by a simple operation using one finger. That is, when the touch panel 20 is pressed with a finger while a map or the like (an example of the first layer) is displayed, the control unit 10 includes a shortcut icon (second layer) including a shortcut menu to which a predetermined function is assigned. The control information for displaying (example) is output to the display control unit 19. And the control part 10 performs the function allocated to the shortcut menu selected with the finger in the state in which the touch panel 20 was pushed by the finger.

In the third embodiment, the gesture operation is an operation in which a user presses a finger on the touch panel 20 to display a shortcut icon, and selects the shortcut icon while pressing the finger on the touch panel 20. In the third embodiment, displaying one layer selected from a plurality of layers related to an object on the display panel 40 is, for example, a shortcut icon for the first layer displaying a map (object). Is to display the second layer.
Note that the processing in steps S51 to S53 in FIG. 10 is the same as the processing in steps S31 to S33 in FIG. 8 in the second embodiment described above, and detailed description thereof will be omitted.

When it is determined in step S53 that the pressure-sensitive detection unit 18 has detected pressure sensitivity based on the sensor value (YES in S53), the control unit 10 displays control information for displaying a shortcut icon on the display panel 40. (S54). On the screen added in step S54, when the user presses the finger on the touch panel 20, shortcut icons having four types of shortcut functions are arranged and displayed in a cross shape with the finger touch position at the center. The situation is shown. This shortcut icon represents a home icon, a menu icon, a setting icon, and a telephone icon clockwise from the left. The home icon has a function to set the home address as the destination, the menu icon has a function to display various menus, the setting icon has a function to make arbitrary settings, and the telephone icon is set to the registered telephone number. Has a function to make a phone call.

Then, after the user moves a finger while pressing the touch panel 20 to one of the shortcut icons, the selection of the shortcut icon is completed by releasing the finger from the touch panel 20 (S55). The screen added in step S55 shows a state where the home icon is selected in a state where the user's finger is pushed into the touch panel 20. Thereby, the control part 10 performs the shortcut function corresponding to the shortcut icon selected by the user. For this reason, the home address is set as the destination.

In the user interface device 3 according to the third embodiment described above, a simple shortcut icon is displayed by a simple gesture operation of pressing the touch panel 20 with one finger. Then, the user can select a shortcut icon by moving the finger pressed into the touch panel 20. For this reason, it is possible to quickly execute a target function without performing a plurality of touch operations as in the prior art. Moreover, since this gesture operation is intuitive and simple, it is easy to select a shortcut icon.

In addition, when there are a plurality of shortcut icons, the control unit 10 displays control information for sequentially switching the plurality of shortcut icons and displaying them on the display panel 40 according to the duration for which the touch panel 20 is pressed by a finger. You may output to the control part 19. The order of the shortcut icons displayed by switching at this time is cyclic, for example, a home icon, a menu icon, a setting icon, a telephone icon, a home icon,. For this reason, for example, even if an unintended shortcut icon is displayed, the user simply switches on the shortcut icon (for example, every second) simply by keeping the finger pressed, so that the desired shortcut icon is selected. It is possible.

Further, after the user presses the finger on the touch panel 20 for a predetermined time or more, the shortcut icon may be continuously displayed. For example, when it is detected by the pressure-sensitive detection unit 18 that a predetermined time has elapsed for the finger pressing force to be equal to or greater than the threshold th1, the control unit 10 displays control information for displaying the shortcut icon on the display panel 40. The data is output to the display control unit 19. Then, the control unit 10 performs control so that the shortcut icon is continuously displayed on the display panel 40 even when the finger pressing force detected by the pressure-sensitive detection unit 18 by the user pulling the finger is less than the threshold th1. To do. For this reason, the user can remove the finger from the touch panel 20 and touch an arbitrary shortcut icon to select it. However, when the user touches a location other than the shortcut icon, the control unit 10 performs control to hide the shortcut icon from the display panel 40. For this reason, the user can easily select another operation during the operation of selecting the shortcut icon.

Also, each time the user repeats the pressing operation, the shortcut icons may be sequentially switched and displayed, so that the target shortcut icon can be selected. For example, after a certain shortcut icon is displayed, when the user presses the finger again, the pressure-sensitive detection unit 18 detects that a predetermined time has elapsed for the finger pressing force to be equal to or greater than the threshold th1. Then, the control unit 10 displays another shortcut icon on the display panel 40. Thereafter, each time the user presses the finger on the touch panel 20 and repeats the operation of pulling the finger, the control unit 10 sequentially switches and displays different shortcut icons on the display panel 40. As a shortcut icon displayed on the display panel 40, one shortcut icon is cyclically selected from a plurality of shortcut icons.

Further, a plurality of icons having a shortcut function may be displayed in order according to the strength with which the user presses the touch panel 20 with a finger. For example, in the state where the map is displayed, a home icon may be displayed if the finger pressing force on the touch panel 20 is greater than or equal to the threshold th1, and a menu icon may be displayed if the finger pressing force is greater than or equal to the threshold th2. . For this reason, the user can select a target icon from a plurality of icons without moving the finger pressed into the touch panel 20.

[Modification]
The user interface device 3 according to each embodiment described above may be applied to devices other than the navigation device. For example, operability can be improved by applying the user interface device 3 to a touch panel portion of a mobile terminal, a tablet terminal, or the like. In this way, the user interface device 3 according to the present embodiment can be combined with various electronic devices that require a touch panel.

In the block diagram shown in FIG. 2, the user interface device 3 includes the control unit 10, but the navigation device body 2 may include the control unit 10.

Further, the touch panel 20 may have a configuration capable of detecting a touch operation by a method other than the capacitance method. Further, the pressure sensor 30 may detect that the touch panel 20 is pushed in by a press switch or the like provided below the touch panel 20.

In addition to the car navigation, the operation combined with the pressure sensitive function in the user interface device 3 may be used for, for example, navigation of a person or a bicycle. Further, the user interface device 3 may be used for the operation of the image editing software as described above, or may be used for the operation of other application software.

In each embodiment described above, the navigation device body 2 and the user interface device 3 are combined. However, since the user interface device 3 itself has a navigation function, only the user interface device 3 may be used as the navigation device.

Further, the pressure-sensitive sensor 30 may be configured not to include the elastic body 33. For example, even if the elastic body 33 is removed from the pressure sensor 30, if a pressing force is applied to the pressure sensor 30 in a state where the upper electrode 31 and the lower electrode 35 are separated from each other with a constant distance, the upper electrode 31 is applied. The lower electrode 35 approaches and the electrostatic capacity between the upper electrode 31 and the lower electrode 35 decreases. For this reason, the pressure sensitive detection unit 18 can obtain the capacitance change rate based on the sensor values output from the upper electrode 31 and the lower electrode 35.

The present invention is not limited to the above-described embodiments, and various other application examples and modifications can be taken without departing from the gist of the present invention described in the claims.
For example, in the above-described embodiment, the configuration of the apparatus is described in detail and specifically in order to explain the present invention in an easy-to-understand manner, and is not necessarily limited to the configuration having all the configurations described. Further, it is possible to replace a part of the configuration of the embodiment described here with the configuration of another embodiment, and further, the configuration of another embodiment is replaced with the configuration of another embodiment. It is also possible to add. Moreover, it is also possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.
Further, the control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.

DESCRIPTION OF SYMBOLS 1 ... Navigation apparatus, 2 ... Navigation apparatus main body, 3 ... User interface apparatus, 10 ... Control part, 17 ... Coordinate detection part, 18 ... Pressure detection part, 19 ... Display control part, 20 ... Touch panel, 30 ... Pressure sensor 40 ... Display panel

Claims

A display panel that displays objects,
A display control unit that performs control to display the object on the display panel according to control information;
A touch panel on which a touch operation is performed by an instruction medium;
A coordinate detection unit that detects the coordinates of the touch position of the touch panel on which the touch operation has been performed and outputs coordinate detection information;
A pressure-sensitive sensor that outputs a sensor value that changes according to a pressing force applied to the touch panel by the indicating medium;
Based on the sensor value, a pressure-sensitive detection unit that detects that a push-in operation in which the touch panel is pushed by the instruction medium is performed and outputs pressure-sensitive detection information;
One selected from a plurality of layers related to the object based on a gesture operation that combines the touch operation determined based on the coordinate detection information and the push operation determined based on the pressure-sensitive detection information. A control unit for outputting the control information for displaying the layer on the display panel to the display control unit, and determining the touch operation performed on the object through the one layer displayed on the display panel; , Comprising a user interface device.
The control unit outputs the control information for displaying one of the plurality of layers including different menu items to the display control unit when the touch panel is pushed by the instruction medium. The user interface device according to 1.
The layer includes a first layer including a first menu displayed when a menu operation is performed on the touch panel, and a display when the touch panel is pushed by the instruction medium on the first menu. And a second layer containing a second menu,
The control unit outputs the control information for displaying the second menu in the vicinity of the touch position to the display control unit when the touch panel is pushed by the instruction medium on the first menu. The user interface device according to claim 2.
When the touch panel is pushed by the instruction medium, the control unit switches the control information from a plurality of the layers to the one operable layer and displays the control information on the display panel. The user interface device according to any one of claims 1 to 3, wherein the user interface device outputs to a display control unit.
The control unit outputs the control information for sequentially switching a plurality of the layers to be displayed on the display panel according to a duration time or a pressing amount of the touch panel being pressed by the instruction medium, to the display control unit. The user interface device according to claim 4.
The control unit displays the control information for displaying a second layer including a shortcut icon to which a predetermined function is assigned when the touch panel is pressed by the instruction medium while the first layer is displayed. The output to the display control unit, and the function assigned to the shortcut icon selected by the instruction medium is executed in a state where the touch panel is pushed by the instruction medium. The described user interface device.
The control unit outputs the control information for sequentially switching the shortcut icons to be displayed on the display panel in accordance with a duration time or a pressing amount by which the touch panel is pressed by the instruction medium, to the display control unit. The user interface device according to claim 6.
A user interface device and an electronic device body,
The user interface device includes:
A display panel that displays objects,
A display control unit that performs control to display the object on the display panel according to control information;
A touch panel on which a touch operation is performed by an instruction medium;
A coordinate detection unit that detects the coordinates of the touch position of the touch panel on which the touch operation has been performed and outputs coordinate detection information;
A pressure-sensitive sensor that outputs a sensor value that changes according to a pressing force applied to the touch panel by the indicating medium;
Based on the sensor value, a pressure-sensitive detection unit that detects that a push-in operation in which the touch panel is pushed by the instruction medium is performed and outputs pressure-sensitive detection information;
One selected from a plurality of layers related to the object based on a gesture operation that combines the touch operation determined based on the coordinate detection information and the push operation determined based on the pressure-sensitive detection information. A control unit configured to output the control information for displaying the layer on the display panel to the display control unit, and to determine the touch operation performed on the object through the one layer displayed on the display panel; Prepared,
The electronic device body is
An electronic device that performs a predetermined process based on content instructed by the touch operation or the gesture operation input from the control unit, and outputs the object that has undergone the predetermined process to the control unit of the user interface device .