JP5464684B2 - Input device and input operation auxiliary panel - Google Patents

Description

  The present invention relates to an input device having a touch panel and an input operation assisting panel for assisting an input operation on the touch panel.

  In JP-A-11-110111, a flexible auxiliary sheet holding a protrusion is placed on a touch panel sheet, and when the protrusion is pressed, the touch panel is pressed by the protrusion and corresponds to a key or button of a virtual keyboard. A touch panel auxiliary device in which a signal to be detected is detected is described.

JP-A-11-110111

  However, since the auxiliary sheet is flexible in the conventional apparatus, it is difficult to hold the auxiliary sheet on the touch panel. For this reason, the auxiliary sheet is likely to move on the touch panel during the input operation, and the input operability may be deteriorated.

  The present invention has been made in view of the above circumstances, and it is an object of the present invention to provide an input device and an input operation auxiliary panel that have good input operability and can maintain the operability during an input operation. And

  The input device of the present invention includes a device main body and an input operation auxiliary panel.

  The apparatus main body includes display means, input detection means, and process execution means. The display means has a panel display surface. The input detection means detects a pressing operation on the panel display surface and detects a position where the pressing operation is performed. The process execution means sets a plurality of operation input positions on the panel display surface, and executes a process preset in correspondence with the operation input position when the input detection means detects a pressing operation at the operation input position.

  The input operation auxiliary panel includes a cover portion and a plurality of protrusions. The cover portion is a hard thin plate that is held by the apparatus main body at a use position that covers the panel display surface. The protrusion is provided integrally with the cover part, and faces each of the plurality of operation input positions in a state where the cover part is held at the use position, and protrudes from the surface of the cover part toward the opposite side of the panel display surface. To do.

  According to the present invention, the input operability is good, and the operability can be maintained during the input operation.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. Each embodiment is an exemplification of the present invention, does not limit the present invention, and can be arbitrarily changed within the scope of the present invention.

[Embodiment 1]
As shown in FIG. 1, the input device according to the first embodiment of the present invention includes a portable terminal device 1 as a device body and an input operation auxiliary panel 2 that is detachably attached to the terminal device 1. .

(1) Configuration <External configuration of terminal device>
The terminal device 1 has a rectangular plate shape and includes a panel display surface 3 on the front surface. In addition, the terminal device 1 includes a speaker 15 and a microphone 16 (shown in FIG. 2), an infrared port (not shown), a USB terminal, an external memory housing unit, a charging terminal, a power switch, and the like. The external memory accommodating portion accommodates an external memory 21 (shown in FIG. 2) such as a memory stick or a memory card.

  In each of the four side surfaces of the terminal device 1, elongated engagement grooves 4 for holding the input operation auxiliary panel 2 are formed.

<System configuration of terminal device>
The system configuration of the terminal device 1 will be described with reference to FIG. FIG. 2 is a block diagram illustrating an example of a schematic system configuration of a main part of the terminal device 1.

  The terminal device 1 includes a control unit 11, an output interface 12, an input interface 13, a backlight 14, the speaker 15, the microphone 16, a storage unit 17, a GPS unit 18, a wireless unit 19, an external input terminal interface 20, and the like. Yes.

  The storage unit 17 includes a main memory including a RAM (Random Access Memory) and a ROM (Read Only Memory).

  The control unit 11 includes a main control unit including a central processing unit (CPU) and peripheral devices thereof, and an image control unit including an image processing unit (GPU: Graphic Processing Unit) that performs drawing in a frame buffer. And a sound control unit including a sound processing unit (SPU) that generates musical sounds, sound effects, and the like.

  The main control unit includes a CPU and a peripheral device control unit that performs interrupt control, direct memory access (DMA) transfer control, and the like.

  The voice control unit includes an SPU that generates musical sounds, sound effects, and the like under the control of the main control unit, and a sound buffer in which waveform data and the like are recorded by the SPU. Is output from the speaker 15. For example, the SPU reproduces waveform data stored in the sound buffer and ADPCM decoding function that reproduces audio data that has been adaptively predicted encoded (ADPCM) using 16-bit audio data as a 4-bit differential signal. Thus, a reproduction function for generating sound effects and the like, a modulation function for modulating and reproducing waveform data stored in the sound buffer, and the like are provided. The SPU also has a function of supplying audio data supplied from the microphone 16 to the CPU. When external sound is input, the microphone 16 performs A / D conversion or the like based on a predetermined sampling frequency and the number of quantization bits, and supplies audio data to the SPU.

  The image control unit includes a geometry transfer engine (GTE), a GPU, a frame buffer, and an image decoder. The GTE includes, for example, a parallel operation mechanism that executes a plurality of operations in parallel, and performs operations such as coordinate conversion, light source calculation, matrix, or vector at high speed in response to a calculation request from the CPU. Then, the main control unit defines a three-dimensional model as a combination of basic unit graphics (polygons) such as a triangle and a quadrangle based on a calculation result by GTE, and assigns each polygon for drawing a three-dimensional image. The corresponding drawing command is sent to the GPU. The GPU performs drawing of a polygon (polygon) or the like on the frame buffer in accordance with a drawing command from the main control unit. The frame buffer stores an image drawn by the GPU. The frame buffer is formed of a so-called dual port RAM, and can perform drawing from the GPU or transfer from the main memory of the storage unit 17 and reading for display at the same time. In addition to the display area output as video output, the frame buffer stores a CLUT area in which a color look-up table (CLUT) referred to when the GPU performs drawing of polygons and the like is stored. In addition, a texture area is provided in which a material (texture) to be inserted (mapped) into a polygon or the like that is coordinate-converted at the time of drawing and drawn by the GPU is stored. These CLUT area and texture area are dynamically changed according to the change of the display area. Under the control of the main control unit, the image decoder decodes still image data or moving image image data stored in the main memory of the storage unit 17 and compressed and encoded by orthogonal transformation such as discrete cosine transform into the main memory. Remember.

  The ROM of the storage unit 17 stores a program such as an operating system for controlling each unit of the terminal device 1. The CPU of the control unit 11 reads the operating system stored in the ROM into the main memory of the storage unit 17 and controls the entire terminal device 1 by executing the read operating system. Further, the ROM has a control program for controlling each part of the terminal device 1 and various peripheral devices connected to the terminal device 1, a video playback program for playing back video content, and a function for playing games in the CPU. Various programs such as a game program to be realized are stored.

  The main memory of the storage unit 17 stores various data such as a program read from the ROM by the CPU and data used when executing various programs.

  The GPS unit 18 receives a radio wave transmitted by the artificial satellite under the control of the control unit 11, obtains position information (latitude, longitude, altitude, etc.) of the terminal device 1 using this and outputs it to the control unit 11. .

  The wireless communication unit 19 performs wireless communication with other terminal devices via the infrared port under the control of the control unit 11.

  The external input terminal interface 20 includes a USB terminal and a USB controller, and USB connection is performed with an external device via the USB terminal.

  The external memory 21 accommodated in the external memory accommodating unit is connected to the control unit 11 via a parallel I / O interface (PIO) and a serial I / O interface (SIO) (not shown).

The output interface 12, a liquid crystal display device: and a (LCD Liquid Crystal Display) 22 and a LCD controller 23. The LCD 22 is obtained by modularizing an LCD panel 26 (shown in FIG. 10 ), a driver circuit, and the like. The LCD controller 23 has a built-in RAM that temporarily stores the image data output from the frame buffer of the control unit 11, and the image data in the RAM is stored at a predetermined timing under the control of the control unit (main control unit) 11. Is read out and output to the LCD 22.

  The input interface 13 includes a resistive touch panel 24 and a touch panel controller 25.

  The touch panel 24 has a structure in which a plurality of electrode sheets on which transparent electrodes are formed are arranged at predetermined intervals with the electrode surfaces facing each other, and is arranged on the display screen of the LCD 22 (LCD panel 26). (See FIG. 10). The surface (outer surface) 24a of the touch panel 24 constitutes a panel display surface 3 that receives a pressing operation from a user's finger, pen, or the like, and the panel display surface 3 is pressed (pressed by the user's finger, pen, or the like). ) And the electrode sheets of the touch panel 24 come into contact with each other, and the resistance value on each electrode sheet changes. The touch panel controller 25 detects a pressed position (operation input position) as a coordinate value by detecting a resistance change on each electrode sheet, and the control unit 11 uses the coordinate value as operation input position information (operation signal). Output to. That is, the input interface 13 functions as an input detection unit that detects a pressing operation from the user's finger on the panel display surface 3 and detects a position where the pressing operation is performed. The input interface 13 (touch panel 24) is a so-called multi-touch panel (multi-touch screen) that can detect pressing operations at a plurality of positions on the panel display surface 3 at the same time. By pressing the display surface 3, input operations can be performed simultaneously on a plurality of input operation positions.

  The touch panel 24 has a transparent thin plate shape, and is closely arranged on the display screen of the LCD 22. For this reason, the image on the display screen of the LCD 22 is easily visible from the panel display surface 3 through the touch panel 24, and the LCD 22 and the touch panel 24 constitute display means. Further, the position of the image on the LCD 22 (apparent position) seen on the panel display surface 3 via the touch panel 24 and the position of the image on the display screen of the LCD 22 (actual position) coincide with each other with almost no deviation. .

  The input interface 13 is not limited to the resistive touch panel 24, and has a function of detecting a pressing operation from the user's finger on the panel display surface and detecting a position of the pressing operation. If it is good. For example, instead of the resistive film method, various types of input interfaces such as a capacitance method, an image recognition method, and an optical method can be used. In the capacitance method, an operation input position is detected by forming a low-voltage electric field on the entire surface of the touch panel and detecting a change in surface charge when a finger touches the touch panel. In the image recognition method, an image such as a finger that contacts the LCD display screen is captured by a plurality of image sensors arranged in the vicinity of the LCD display screen, and an operation input position is detected by analyzing the captured image. In the optical system, a light emitter is arranged on one of the vertical walls and one of the horizontal walls of the peripheral wall surrounding the LCD display screen, and a light receiving unit is arranged on the other of the vertical walls and the other of the horizontal walls. The operation input position is detected by detecting the vertical and horizontal positions of the light blocked by the touching finger. That is, in the image recognition method and the optical method, it is not necessary to provide a touch panel, and the image display surface of the LCD is a panel display surface that receives a pressing operation from the user.

  The backlight 14 is disposed on the back side of the LCD 22 (LCD panel 26), and irradiates light from the back side of the LCD 22 toward the front side under the control of the control unit 11. Note that the backlight 14 may emit light in accordance with control from the LCD controller 23.

<Software configuration of terminal device>
With reference to FIG. 3, the software configuration of the terminal device 1 will be described. FIG. 3 is a block diagram illustrating an example of a schematic software configuration of a main part of the terminal device 1.

  In the software configuration of the device terminal 1, a device driver layer, a framework layer, a device middleware layer, and an application layer are defined from the lower side.

  The device driver layer is software for operating the control unit 11 and hardware connected to the control unit 11. For example, a device driver for operating the audio conversion module, an LCD driver for operating the LCD, a driver for operating the backlight driver, and the like are included as appropriate.

  The framework layer is software that provides general-purpose functions to application programs and manages various resources operated by a device driver. For example, the framework layer transmits a command generated by any application program executed in a middleware layer or an application layer described later to the device driver. The framework layer is commonly used by many application software, such as input / output of data to / from the storage unit 17 and the external memory 21 and management of input / output functions such as operation input from the touch panel 24 and screen output to the LCD 22. Provides the basic functions used and manages the entire system.

  The middleware layer is configured by middleware that operates on the framework and provides application programs with higher-level and specific functions than the framework. Here, as middleware, a voice synthesis middleware for providing a basic function of a technique for synthesizing an output voice from the speaker 15 and a basic function of a technique for recognizing a voice input from the microphone 16 are provided. Voice recognition middleware, multi-touch detection middleware for providing a basic function of technology for detecting operation input from the touch panel 24, and video output middleware for providing a basic function of technology for outputting video to the LCD 22 Etc. are prepared.

  Various application programs are executed in the uppermost application layer. In the terminal device 1, for example, communication application, web browser, file exchange application, audio player, music search application, music streaming, recording tool, photo viewer (Photo Viewer), text editor (Text Editor), game application, etc. In addition to these applications, menu display tools, setting tools, etc., an application manager for managing these application software and a development environment are provided.

<Functional configuration of terminal device>
A configuration relating to an operation input management process realized by executing the input operation management program by the control unit 11 of the terminal device 1 having the above system configuration and software configuration will be described. The input operation management program may be stored in the storage unit 17 as a single application, or may be stored in the storage unit 17 or the external memory 21 in a state of being included in an individual application such as a game application. Good. When the input operation management program is stored as a single application, the input operation management program may be executed under the management of another application. In the following, unless otherwise specified, the process executed by the control unit 11 in accordance with the operation input management process is referred to as a main process.

  In the operation input management process, the control unit 11 specifies one input display pattern from among a plurality of input display patterns stored in advance, and a plurality of input positions indicating input operation positions according to the specified input display pattern. The display icon 30 is displayed at a predetermined position on the panel display surface 3. Examples of the plurality of input display patterns include a game button display pattern suitable for game execution (shown in FIG. 1), a keyboard display pattern suitable for character input with both hands (shown in FIG. 4), music data A keyboard display pattern suitable for input (shown in FIG. 5) and a mobile phone type display pattern suitable for character input with one hand and both hands (shown in FIG. 6) are set.

  An area of the panel display surface 3 where the input position display icon 30 is not displayed is a main display area 37 (for example, a display area of a game screen in the case of a game application) where an output image by the main process is displayed. Since the size and vertical direction of the main display area 37 differ depending on the input display pattern, the control unit 11 appropriately changes the direction and size of the image displayed on the main display area 37 according to the specified input display pattern.

  In the game button display pattern, as shown in FIG. 1, an up key icon 31U, a down key icon 31D, and a left key icon 31L are displayed on the left area of the panel display surface 3 in a state where the terminal device 1 is arranged horizontally. , And the right direction key icon 31R are displayed as the input position display icon 30 in the right region of the panel display surface 3, the O button icon 32A, the Δ button icon 32B, the □ button icon 32C, and the X button icon 32D. Each button icon 31U, 31D, 31L, 31R, 32A, 32B, 32C, 32D is combined with a mark for identifying the button (for example, the up arrow for the up direction key icon 31U and the circle for the ○ button icon 32A). Is displayed.

  In the keyboard display pattern, as shown in FIG. 4, a plurality of key icons 33 arranged according to the QWERTY arrangement are displayed in the lower area of the panel display surface 3 in a state where the terminal device 1 is arranged horizontally long. Is displayed. Each key icon 33 includes assigned characters and the like.

  In the keyboard display pattern, as shown in FIG. 5, a key icon 34 imitating a piano keyboard is displayed as an input position display icon 30 in the central area of the panel display surface 3 in a state where the terminal device 1 is arranged horizontally. The

  In the mobile phone type display pattern, as shown in FIG. 6, a plurality of key icons 35 arranged in accordance with the key arrangement of the mobile phone are provided in the lower area of the panel display surface 3 in a state where the terminal device 1 is arranged vertically. It is displayed as an input position display icon 30. Each key icon 35 includes assigned characters and the like.

  In the case of a keyboard display pattern or a mobile phone display pattern, characters corresponding to a plurality of types of languages and their arrangements are stored in advance as language-specific character arrangements, and characters included in the input position display icon 30 are stored in a predetermined language. You may decide according to another character arrangement. For example, a correspondence relationship between the position of the terminal device 1 and the language may be set in advance, and a language-specific character array corresponding to the position information acquired by the GPS unit 18 may be displayed based on this correspondence relationship. Alternatively, the user may select a desired language in advance and display a language-specific character arrangement corresponding to the selected language.

  The control unit 11 may specify a preset input display pattern immediately after the start of the operation input management process, and may specify one input display pattern according to the subsequent operation input from the user. A predetermined input display pattern may be specified according to (for example, a game application).

  Moreover, the control part 11 restrict | limits the input display pattern which a user can select according to the main process to perform. For example, if the main process to be executed does not require input of music data and the game application requires a large area as the main display area 37, selection of the keyboard display pattern is prohibited.

  When the control unit 11 receives the operation input position information from the input interface 13 in a state where a certain input display pattern is displayed, the coordinate position indicated by the operation input position information corresponds to the position corresponding to the display area of the input position display icon 30 ( The control signal is determined to be a predetermined input operation from the user and is associated with the input position display icon 30 in advance. Are supplied to the main process. That is, the control unit 11 sets a plurality of operation input positions on the panel display surface 3 and, when the input interface 13 detects a pressing operation at the operation input position, performs a process set in advance corresponding to the operation input position. It functions as a process execution means to be executed. The range of the operation input position may be the entire display area of the input position display icon 30 or a part thereof.

  In addition, when receiving the operation input position information from the input interface 13, the control unit 11 performs a panel determination process described later.

<Configuration of input operation support panel>
As shown in FIG. 1, the input operation auxiliary panel 2 includes a cover portion 40, a peripheral wall 41, and a plurality of protrusions 42, which are integrally formed of a hard resin material. In addition, at least the cover 40 of the input operation auxiliary panel 2 has high light transmittance and is almost transparent.

  The cover part 40 is a thin flat plate having a size and shape slightly larger than the panel display surface 3. The peripheral wall 41 extends substantially perpendicularly to the cover portion 40 from the entire periphery of the back surface 40 b of the cover portion 40. Two grooves 43 are formed in each of the straight portions between the corners of the peripheral wall 41, and the region between the grooves 43 of each straight portion constitutes a locking piece 44 that is easily elastically deformed. That is, the peripheral wall 41 has four locking pieces 44 respectively corresponding to the four sides of the cover portion 40. A locking projection 44 a that protrudes inward is integrally formed at the tip of each locking piece 44. As shown in FIG. 7, when the input operation auxiliary panel 2 is brought closer to the terminal device 1 with the back surface 40 b of the cover portion 40 facing the panel display surface 3, each locking projection 44 a is a side surface of the terminal device 1. When each of the diameter stop pieces 44 bends outward, each locking projection 44a slides on the side surface of the terminal device 1, and the back surface 40b of the cover portion 40 approaches or comes into contact with the panel display surface 3, Each locking projection 44 a engages with each engaging groove 4. By the engagement of the locking projection 44a and the engagement groove 4, the cover portion 40 is held by the apparatus main body 1 at a use position that covers the panel display surface 3, whereby the input operation auxiliary panel 2 is shown in FIG. Is attached to the terminal device 1 as described above. That is, the peripheral wall 41 of the input operation assisting panel 2 serves as guide means for guiding the cover unit 40 to the use position when the input operation assisting panel 2 moves relative to the terminal device 1 so that the cover unit 40 is directed to the use position. Function. Moreover, since the cover part 40 is substantially transparent, the user can easily visually recognize the image on the panel display surface 3 from the surface 40a side of the cover part 40.

  As shown in FIG. 10, each protrusion 42 bulges from the front surface 40 a and the back surface 40 b of the cover portion 40. The number, arrangement, size, and shape of the protrusions 42 differ depending on the input display pattern displayed on the panel display surface 3, and the input displayed on the panel display surface 3 with the cover portion 40 held at the use position. It is set to face the position display icon 30 (operation input position).

  For example, the input operation auxiliary panel 2A for games used in the game button display pattern has direction key protrusions corresponding to the direction key icons 31U, 31D, 31L, and 31R, as shown in FIG. Button protrusions 46A, 46B, 46C, and 46D corresponding to 45U, 45D, 45L, and 45R, respectively, are provided as the protrusions 42.

  As shown in FIG. 11, a plurality of key protrusions 47 respectively corresponding to the key icons 33 protrude from the keyboard input operation auxiliary panel 2B used in the keyboard display pattern (see FIG. 4). 42 is provided.

  As shown in FIG. 12, a plurality of key projections 48 respectively corresponding to the key icons 34 are projected on the keyboard input operation auxiliary panel 2C used in the keyboard display pattern (see FIG. 5). 42 is provided. In the case of the keyboard display pattern, since the key icons 34 are adjacent to each other, the key protrusions 48 are set smaller than the display area of the key icons 34 in order to separate the key protrusions 48 from each other. .

  As shown in FIG. 13, a plurality of key protrusions respectively corresponding to the key icons 35 are provided on the cell phone type input operation auxiliary panel 2D used for the cell phone type display pattern (see FIG. 6). 49 is provided as the protrusion 42.

  In addition, since each protrusion 42 is substantially transparent like the cover part 40, the user visually recognizes the input position display icon 30 on the panel display surface 3 through the protrusion 42 from the surface 40a side of the cover part 40. Can do. When the input interface 13 is a capacitive touch panel, each protrusion 42 is made of a conductive material.

  On the back surface 40b of the cover portion 40 of the input operation auxiliary panels 2A to 2D, type determination projections 50 are integrally projected. The type determination projection 50 includes at least one of the three projections 50a, 50b, and 50c, and is set so that each combination of the three projections 50a, 50b, and 50c corresponds to each type of the input operation auxiliary panel 2. ing. That is, the same combination type determination projections 50 are set for the same type of input operation auxiliary panel 2. For example, the input operation auxiliary panel 2A for games is provided with two protrusions 50a and 50c as shown in FIG. 1, and the input operation auxiliary panel 2B for keyboard has all the projections as shown in FIG. As shown in FIG. 12, one protrusion 50b is provided on the keyboard input operation auxiliary panel 2C, and the cellular phone type input operation auxiliary panel 2D is shown in FIG. As shown, two protrusions 50a and 50b are provided. In addition, the protrusions 50a, 50b, and 50c are arranged at the same position of the cover portion 40 in any input operation auxiliary panel 2.

<Functional configuration related to panel determination processing>
When receiving the operation input position information from the input interface 13 at the start or execution of the operation input management process, the control unit 11 executes the following panel determination process.

  In the panel determination process, it is determined whether or not the coordinate position indicated by the received operation input position information is included in the type recognition areas 36a, 36b, and 36c of the panel display surface 3. The type recognition areas 36a, 36b, and 36c are areas of the panel display surface 3 that face the type determination protrusions 50 (protrusions 50a, 50b, and 50c) in a state where the cover portion 40 is held at the use position.

When the coordinate position indicated by the received operation input position information is included in the type recognition areas 36a, 36b, and 36c of the panel display surface 3, the control unit 11 includes the operation input positions included in any type recognition areas 36a, 36b, and 36c. The type of the attached input operation auxiliary panel 2 is determined according to whether it is information. For example, when the operation input position information included in the type recognition areas 36a and 36c is received and the operation input position information included in the type recognition area 36b is not received, the input operation auxiliary panel 2A is used for the game. If all the operation input position information included in the type recognition areas 36a to 36c is received, it is determined that the input operation auxiliary panel 2B is for the keyboard, and the operation input included in the type recognition area 36b is determined. When the position information is received and the operation input position information included in the type recognition areas 36a and 36c is not received, it is determined that the input operation auxiliary panel 2C is for the keyboard, and the type recognition areas 36a and 36b If the included receives operation input position information is not received the operation input position information and included in the type recognizing region 36c may be a cellular phone type Determines that the input operation support panel 2D of.

  On the other hand, when the coordinate position indicated by the received operation input position information is not included in any of the type recognition areas 36a, 36b, 36c of the panel display surface 3, the control unit 11 includes the input operation auxiliary panel 2 in the terminal device 1. It is determined that it is not installed. If the coordinate position indicated by the received operation input position information is included in at least one of the type recognition areas 36a, 36b, 36c of the panel display surface 3, but does not correspond to any of the above combinations, the control unit 11 Determines that the attached input operation auxiliary panel 2 is an inappropriate input operation auxiliary panel 2 that does not correspond to the terminal device 1.

  As described above, the type determination protrusion 50 functions as a type identification unit that indicates the type of the input operation auxiliary panel 2 that is classified according to the arrangement of the plurality of protrusions 42. Further, the control unit 11 detects a cover holding determination unit that determines whether or not the cover unit 40 of the input operation auxiliary panel 2 appropriate for the terminal device 1 is held at the use position, and the type determination protrusion 50. And function as type recognition means for recognizing the type of the input operation auxiliary panel 2.

  When recognizing the type of the input operation auxiliary panel 2 attached, the control unit 11 determines whether or not the type of the input operation auxiliary panel 2 is suitable for the main processing (the input corresponding to the input display pattern selectable by the user). Whether or not it is the operation auxiliary panel 2) is determined.

  If it determines with the type of the input operation assistance panel 2 being the nonconforming state which is not adapted to the main process, the control part 11 will alert | report to a user that it is a nonconforming state. For notification to the user, for example, a text such as “input operation auxiliary panel 2 is incompatible” is displayed on the panel display surface 3, a predetermined part of the panel display surface 3 is flashed, and a warning sound is emitted from the speaker 15. Various methods can be used, such as outputting or vibrating the terminal device 1 if it is a terminal device 1 having a vibration function.

  On the other hand, when determining that the type of the input operation auxiliary panel 2 is suitable for the main processing, the control unit 11 specifies an input display pattern corresponding to the type of the input operation auxiliary panel 2 and installs the input operation auxiliary panel. An input position display icon 30 corresponding to the panel 2 is displayed on the panel display surface 3. In other words, the control unit 11 sets the operation input position at a position facing the protrusion 42 of the input operation auxiliary panel 2 based on the recognized type of the input operation auxiliary panel 2, and displays the input position at the operation input position. Icon 30 is displayed.

  Further, when the input position display icon 30 is displayed, the control unit 11 corrects the shape of the input position display icon 30 in a direction opposite to the light refraction direction when passing through the protrusion 42. For example, when the protrusion 42 has a characteristic of displaying the input position display icon 30 in an enlarged manner, the input position display icon 30 that is smaller than the input operation auxiliary panel 2 is displayed.

  In this way, the control unit 11 functions as a cover suitability determining unit that determines whether or not the type of the attached input operation auxiliary panel 2 is adapted to the main process. Further, the panel display surface 3 and the speaker 15 can function as a notification unit that notifies the user of the non-conforming state when it is determined that the type of the input operation auxiliary panel 2 is a non-conforming state that is not suitable for the main processing.

  In this embodiment, since the input interface 13 is a resistance film type touch panel 24 that detects pressure, the type of the input operation auxiliary panel 2 is determined by the type determination protrusion 50 and the touch panel 24. When this method is used, the type of the input operation auxiliary panel 2 may be determined by a different method. For example, in the case of the electrostatic capacity method, a charged object such as an electret may be provided instead of the type determination protrusion 50. In the case of an image recognition method or an optical method, an obstacle that blocks light may be provided in place of the type determination projection 50. Further, the input operation auxiliary panel 2 includes an IC chip and an electromagnetic induction type sensor for identifying the IC chip and the input operation auxiliary panel 2 and the apparatus main body 1, or an object having a different external shape and an image sensor for imaging the object. And the apparatus main body 1 respectively, the type of the input operation auxiliary panel 2 can be discriminated by any method.

(2) Operation Next, the operation of the present embodiment will be described.

  A user who does not use the input operation auxiliary panel 2 can input an operation to the terminal device 1 by pressing the input position display icon 30 displayed on the panel display surface 3 with a finger.

  On the other hand, a user who uses the input operation auxiliary panel 2 can perform an operation input to the terminal device 1 by pressing down the protrusion 42 of the input operation auxiliary panel 2 attached to the terminal device 1 with a finger. For example, when using the input operation assisting panel 2A for a game, as shown in FIG. 14, the terminal device 1 to which the input operation assisting panel 2A is attached is gripped by the left and right hands, and the left and right thumbs are arbitrarily projected. The desired protrusion 42 is pushed down while moving the thumb appropriately as necessary. At this time, it is possible to input an operation while always recognizing the position (operation input position) of each protrusion 42 protruding to the surface 40a side of the cover part 40 by the touch of the finger skin. Therefore, compared with the case where the panel display surface 3 is directly pressed with a finger without using the input operation auxiliary panel 2, a quick and accurate input operation can be easily performed.

  When a different input display pattern is displayed on the panel display surface 3 (when the input operation position is different), the input operation auxiliary panel 2 corresponding to the input display pattern is appropriately used to perform a quick and accurate input operation. It can be done easily.

  When the terminal device 1 is not used, the panel display surface 3 of the terminal device 1 can be protected by mounting the input operation auxiliary panel 2.

  The peripheral wall 41 of the input operation auxiliary panel 2 guides the cover unit 40 to the use position when the input operation auxiliary panel 2 moves relative to the terminal device 1 so that the cover unit 40 is directed to the use position. Furthermore, the cover part 40 can be set to the use position. Further, since the hard cover portion 40 is held by the apparatus main body 1 at the use position due to the engagement between the locking projection 44a and the engagement groove 4, the cover portion 40 moves relative to the terminal device 1 during operation input. Therefore, it is possible to reliably maintain good input operability.

  Since each protrusion 42 protrudes also to the back surface 40b side of the cover part 40, the pressing range with respect to the panel display surface 3 is restrict | limited to an appropriate operation input position. Therefore, more accurate operation input can be performed as compared with the case where the panel display surface 3 is directly pressed with a finger.

  When the type of the attached input operation auxiliary panel 2 is not adapted to the main process, the terminal device 1 notifies that the terminal device 1 is in a non-conforming state by displaying on the panel display surface 3 or the like. Therefore, the user wearing the incompatible input operation auxiliary panel 2 cannot properly perform the input operation to the terminal device 1, not the failure of the terminal device 1 or the like, but the type of the input operation auxiliary panel 2 that is installed. Can be easily recognized, and the input operation panel 2 that is not compatible can be removed to perform an appropriate input operation.

  Further, when the input operation auxiliary panel 2 of the type suitable for the main processing is mounted, the input position display icon 30 is displayed in an input display pattern corresponding to the input operation auxiliary panel 2 (the input operation position is set). ) Accordingly, when the input operation auxiliary panel 2 is mounted, the user does not need to perform an input operation for selecting an input display pattern suitable for the type of the input operation auxiliary panel 2 and can easily input an input operation of a desired type. Panel 2 can be used.

[Modification 1]
When the input interface 13 detects a pressing operation in the type recognition areas 36a, 36b, 36c on the panel display surface 3, the input interface 13 detects the pressing pressure, and the input is valid only when the detected pressing pressure is equal to or higher than a predetermined pressure. As such, the operation input position information may be output to the control unit 11.

  Thereby, for example, even if the user's finger or the like accidentally touches the type recognition areas 36a, 36b, 36c in a state where the input operation auxiliary panel 2 is not attached, the type recognition areas 36a, 36b, 36c Operation input position information indicating the pressing operation is not output to the control unit 11. Therefore, in the panel determination process, it is not erroneously determined that the unmounted input operation auxiliary panel 2 is mounted, and the input operation auxiliary panel 2 is based on the type of the unmounted input operation auxiliary panel 2. It is possible to surely prevent the notification that the type is a non-conforming state that is not adapted to the main process, the change of the display position of the input position display icon 30, and the like.

  The input interface 13 outputs the operation input position information only when the pressing operation is detected continuously for a predetermined time or more when the pressing operation in the type recognition areas 36a, 36b, 36c on the panel display surface 3 is detected. May be.

  In this case, for example, even if the user's finger or the like accidentally touches the type recognition areas 36a, 36b, 36c for a short time in a state where the input operation assisting panel 2 is not attached, the type recognition areas 36a, 36b, 36c The operation input position information indicating the pressing operation is not output to the control unit 11.

  Furthermore, the input interface 13 may output the operation input position information only when the pressing pressure equal to or higher than the predetermined pressure is continuously detected for the predetermined time or longer.

[Modification 2]
In addition, the function for preventing erroneous determination in the first modification may be included in the control unit 11 instead of the input interface 13. For example, when the input is validated when the pressing pressure is equal to or higher than a predetermined pressure, the input interface 13 detects the pressing pressure in the type recognition areas 36a, 36b, 36c on the panel display surface 3, and detects the detected pressing The pressure is included in the operation input position information and output to the control unit 11, and the control unit 11 includes the coordinate position indicated by the received operation input position information in the type recognition areas 36a, 36b, and 36c of the panel display surface 3, and When the pressing pressure indicated by the received operation input position information is equal to or higher than a predetermined pressure, the type of the attached input operation auxiliary panel 2 is determined. Further, when the input is validated when the pressing operation continues for a predetermined time or more, the input interface 13 detects the pressing pressure in the type recognition areas 36a, 36b, 36c on the panel display surface 3 to input the operation. The position information is output to the control unit 11, and the control unit 11 includes the coordinate position indicated by the received operation input position information in the type recognition areas 36 a, 36 b, and 36 c of the panel display surface 3, and displays the operation input position information. When receiving continuously for a predetermined time or longer, the type of the attached input operation auxiliary panel 2 is determined. Further, when the input operation is validated when a pressing operation over a predetermined pressure continues for a predetermined time or longer, the input interface 13 detects the pressing pressure in the type recognition areas 36a, 36b, 36c of the panel display surface 3. Then, the detected pressing pressure is included in the operation input position information and output to the control unit 11, and the control unit 11 indicates that the coordinate position indicated by the received operation input position information is the type recognition area 36a, 36b, 36c on the panel display surface 3. And the operation input position information indicating that the pressing pressure is equal to or higher than the predetermined pressure is continuously received for a predetermined time or longer, the type of the input operation auxiliary panel 2 attached is determined.

[Embodiment 2]
Next, a second embodiment of the present invention will be described. Note that, in each of the following embodiments, description of portions common to the first embodiment will be omitted.

  In the first embodiment, the control unit 11 determines whether or not the type of the input operation auxiliary panel 2 is adapted to the main process, and if it is determined that the type of the input operation auxiliary panel 2 is not adapted, it is in a non-conforming state. This is notified to the user. That is, priority is given to the main process to be executed, and the user is requested to stop using the incompatible type input operation auxiliary panel 2.

  On the other hand, in this embodiment, the control part 11 discriminate | determines the type of the input operation assistance panel 2, and performs the main process adapted to the mounted input operation assistance panel 2. FIG. That is, priority is given to the type of the input operation auxiliary panel 2 attached, and the main process to be executed is determined according to the type of the input operation auxiliary panel 2. When a plurality of processes can be selected as the main process adapted to the type of the input operation auxiliary panel 2, the main process that is frequently used is preferentially executed, the main process executed most recently, The main process to be preferentially executed may be set in advance, such as setting the main process to be prioritized.

  According to the above configuration, for example, in the terminal device 1, a predetermined game application is set as a main process to be executed with priority over the game input operation auxiliary panel 2A, and the keyboard input operation auxiliary panel 2B. When a predetermined character input application is set as the main process to be executed with priority, the user can switch and use a desired application simply by replacing the input operation auxiliary panel 2. In addition, when a game selection application for displaying a game selection screen as a main process to be executed with priority on the game input operation auxiliary panel 2A and shifting to a game application designated by the user is set. The user can select and execute a desired game application only by mounting the input operation assisting panel 2A for the game.

[Embodiment 3]
Next, a third embodiment of the present invention will be described with reference to FIG.

  In the present embodiment, the marks, characters, and the like of the corresponding input position display icons 30 are displayed in advance as the identification display 51 on each protrusion 42 of the input operation auxiliary panel 2 by printing or the like.

  The control unit 11 does not display the input position display icon 30 on the panel display surface 3 when determining that the cover unit 40 of the input operation auxiliary panel 2 appropriate for the terminal device 1 is held at the use position.

  According to the above configuration, the user can easily distinguish each protrusion 42 by the identification display 51. Further, when the input operation auxiliary panel 2 is used, display control of the input position display icon 30 can be omitted.

[Embodiment 4]
Next, a fourth embodiment of the present invention will be described with reference to FIG.

  In this embodiment, each protrusion 42 of the input operation assisting panel 2 is configured by a plate-like curved portion 52 that bulges to the front surface 40a side of the cover portion 40 and a filling portion 53 that is fixed to the back surface 40b side. Yes. The plate-like bending portion 52 is bent continuously and continuously from the cover portion 40. The filling portion 53 is formed of a material that is softer than the cover portion 40.

  According to the above configuration, the user who presses down the protrusion 42 with a finger can obtain a click feeling due to the flexibility of the protrusion filling portion 53, and the operability is improved.

[Embodiment 5]
Next, a fifth embodiment of the present invention will be described with reference to FIGS.

  This embodiment is different from the first embodiment in the mounting method of the input operation auxiliary panel 60. The input operation auxiliary panel 60 of the present embodiment is formed in a substantially thin plate shape as a whole, and almost the entire area forms the cover portion 40. The apparatus body 1 has three substantially L-shaped guide wall portions 64, 65, and 66 that define and form guide grooves 61, 62, and 63, respectively, on one side of the outer peripheral edge of the rectangular panel display surface 3 ( Projecting from three sides (two long sides and one short side) except for the short side.

  When the input operation auxiliary panel 60 is attached to the terminal device 1, two corners 71 and 72 on one short side of the input operation auxiliary panel 60 are inserted from the open ends of the guide grooves 61 and 62, thereby assisting in the input operation. The panel 60 is moved along the panel display surface 3. At this time, the edges 67 and 68 slide in the guide grooves 61 and 62, thereby restricting the movement direction of the input operation auxiliary panel 60, and the edge 69 between the corners 71 and 72 is accommodated in the guide groove 63. In this state, the input operation auxiliary panel 60 (cover unit 40) is mounted at the use position. That is, the guide grooves 61 and 62 function as guide means for guiding the cover unit 40 to the use position when the input operation auxiliary panel 60 moves relative to the terminal device 1 so that the cover unit 40 is directed to the use position. Although not particularly illustrated, one and the other of the terminal device 1 and the input operation auxiliary panel 60 are engaged when the input operation auxiliary panel 60 reaches the use position to move the input operation auxiliary panel 60. A locking protrusion and an engaging recess for blocking are provided.

  According to the above configuration, the input operation auxiliary panel 60 can be reduced in size.

[Embodiment 6]
Next, a sixth embodiment of the present invention will be described with reference to FIGS.

In the first and fifth embodiments, the input operation auxiliary panels 2 and 60 separated from the terminal device 1 are attached to the terminal device 1. On the other hand, in this embodiment, the first and second input operation auxiliary panels 80 and 81 having different types are connected to the terminal device 1 via the first and second links 82 and 83.
The first and second input operation assisting panels 80 and 81 are each formed in a substantially thin plate shape as a whole, and almost all of the first and second input operation assisting panels 80 and 81 constitute the respective cover portions 40. One end 82 a of the first link 82 is rotatably connected to the side wall of the terminal device 1, and the other end 82 b is rotatably connected to the edge of the first input operation auxiliary panel 80. Similarly, one end 83 a of the second link 83 is rotatably connected to the other side wall of the terminal device 1, and the other end 83 b is rotatably connected to the edge of the second input operation auxiliary panel 81. Yes. Due to the first link 82, the first input operation auxiliary panel 80 (cover portion 40) is opposed to the housing position (shown in FIGS. 19 and 21) facing the back surface of the terminal device 1 and the panel display surface 3. It can move freely between positions (shown in FIG. 20). Similarly, by the second link 83, the second input operation auxiliary panel 81 (cover unit 40) and the panel display surface 3 are positioned in the housing position (shown in FIGS. 19 and 20) facing the back surface of the terminal device 1. It can move freely between opposing use positions (shown in FIG. 21). That is, the first and second links 82 and 83 guide the cover unit 40 to the use position when the input operation assisting panels 80 and 81 move relative to the terminal device 1 so that the cover unit 40 moves to the use position. It functions as a guiding means.

  The user can use the first and second input operation auxiliary panels 80 and 81 by moving them from the accommodation position to the use position. Although not particularly illustrated, one terminal of the terminal device 1 and the input operation auxiliary panels 80 and 81 are engaged with each other at the use position and the storage position to prevent the input operation auxiliary panels 80 and 81 from moving. A locking projection and an engaging recess are provided respectively.

  According to the above configuration, since the first and second input operation auxiliary panels 80 and 81 and the terminal device 1 are connected, both can be handled as a unitized device, which is suitable for carrying. is there.

  It should be noted that one end 82a, 83a or the other end 82b, 83b of the link 82, 83 is configured to be detachable from the terminal device 1 or the input operation auxiliary panel 80, 81, so that the input operation auxiliary panel 80, 81 can be changed. This type of input operation auxiliary panel can be easily replaced.

  In each of the above-described embodiments, the portable terminal device 1 has been described as an example. However, the present invention is not limited to this and can be widely applied to various devices having a touch panel.

  That is, the description of each embodiment described above is an example of the present invention, and the present invention is not limited to the above-described embodiment, and the above-described embodiment is within the scope of the technical idea of the present invention. It goes without saying that various modifications can be made in other than the embodiment.

  The present invention is applicable to an input device having a touch panel.

It is a perspective view which shows the state which isolate | separated the terminal device which concerns on the 1st Embodiment of this invention, and the input operation assistance panel for games. It is a block diagram which shows an example of the schematic system configuration | structure of the principal part of a terminal device. It is a block diagram which shows an example of the schematic software structure of the principal part of a terminal device. It is a top view of the terminal device by which the keyboard display pattern was displayed. It is a top view of the terminal device by which the keyboard display pattern was displayed. It is a top view of the terminal device by which the mobile telephone type display pattern was displayed. It is sectional drawing which shows the state which isolate | separated the terminal device and the input operation assistance panel. It is sectional drawing which shows the state which mounted | wore with the input operation auxiliary | assistant panel in the terminal device. It is a perspective view which shows the state which mounted | wore the input operation auxiliary | assistant panel with the terminal device. It is sectional drawing which shows the state which set the cover part to the use position on a panel display surface. It is a top view of the input operation assistance panel for keyboards. It is a top view of the input operation assistance panel for keyboards. It is a top view of the input operation auxiliary panel for cellular phones. It is a perspective view which shows the use condition of the input operation assistance panel for games. It is a perspective view which shows 3rd Embodiment. It is sectional drawing which shows 4th Embodiment. It is a perspective view which shows the state which mounted | wore the terminal device with the input operation assistance panel for games which concerns on 5th Embodiment. It is a perspective view which shows the state which isolate | separated the input operation assistance panel of FIG. 17 from the terminal device. It is a side view which shows the non-use state (accommodation state) of the 1st and 2nd input operation assistance panel which concerns on 6th Embodiment. It is a side view which shows the use condition of the 1st input operation assistance panel of FIG. FIG. 10 is a side view showing a usage state of the second input operation auxiliary panel of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Terminal device, 2, 2A, 2B, 2C, 2D, 60, 80, 81 ... Input operation auxiliary panel, 3 ... Panel display surface, 11 ... Control part, 12 ... Output Interface, 13 ... Input interface, 22 ... LED, 24 ... Touch panel,
31U, 31D, 31L, 31R ... direction key icons, 32A, 32B, 32C, 32D ... button icons, 33, 34, 35 ... key icons, protrusions 42
Directional key projections 45U, 45D, 45L, 45R respectively corresponding to

Claims (9)

Display means having a panel display surface;
An input detecting means for detecting a pressing operation on the panel display surface and detecting a position of the pressing operation;
A process execution unit that sets a plurality of operation input positions on the panel display surface, and executes a process set in advance corresponding to the operation input position when the input detection unit detects a pressing operation at the operation input position. An apparatus body having
A hard thin plate-like cover portion that is held by the apparatus main body at a use position that covers the panel display surface, and the cover portion is provided integrally with the plurality of pieces in a state where the cover portion is held at the use position. An input operation auxiliary panel having a plurality of protrusions that face each of the operation input positions and protrude from the surface of the cover portion toward the opposite side of the panel display surface,
The input operation auxiliary panel has type identifying means indicating the type of the input operation auxiliary panel classified according to the arrangement of the plurality of protrusions,
The apparatus main body has type recognition means for recognizing the type of the input operation auxiliary panel by detecting the type identification means in a state where the cover portion is held at the use position.
The process execution means sets the operation input position according to the type of the input operation auxiliary panel recognized by the type recognition means, and executes a process adapted to the recognized type of input operation auxiliary panel.
When a plurality of processes adapted to the recognized input operation auxiliary panel type are preset, the process execution means selects and executes a predetermined priority process from the plurality of processes ,
The process adapted to the recognized type of the input operation auxiliary panel includes a selection application that displays a selection screen on the display means and allows a transition to a process designated by the user among the plurality of processes. ,
The input device , wherein the selection application can be set as the predetermined priority process . The input device according to claim 1,
Wherein as the predetermined priority processing, the most frequently used process in the plurality of processing, or most input apparatus characterized by processing used in the most recently can be set. The input device according to claim 1 or 2,
An input device comprising: guide means for guiding the cover portion to the use position when the input operation auxiliary panel moves relative to the apparatus main body so that the cover portion faces the use position. The input device according to claim 1 or 2,
The processing execution means sets the operation input position at a position facing the protrusion of the input operation auxiliary panel based on the type of the input operation auxiliary panel recognized by the type recognition means. . The input device according to claim 4,
The protrusion has light transmittance,
The apparatus main body includes display control means for displaying a predetermined icon indicating the operation input position on the display means,
When the type recognizing unit recognizes the type of the input operation auxiliary panel, the display control unit corrects the shape of the predetermined icon in a direction opposite to the light refraction direction when passing through the protrusion. An input device characterized by displaying. The input device according to claim 1 or 2,
The apparatus main body is
Cover suitability determining means for determining whether or not the type of the input operation assisting panel recognized by the type recognizing means is adapted to the process executed by the process executing means;
An input means comprising: a notification means for notifying a user of the non-conformance state when the cover suitability determination means determines that the type of the input operation auxiliary panel is a non-conformity state not suitable for the processing. apparatus. The input device according to claim 1 or 2,
The apparatus main body is
Display control means for displaying a predetermined icon indicating the operation input position on the display means;
Cover holding determination means for determining whether or not the cover portion is held at the use position,
A predetermined identification display is displayed in advance on the protrusion,
The input device, wherein the display control unit does not display the predetermined icon when the cover holding determination unit determines that the cover is held at the use position. The input device according to claim 1 or 2,
The input device, wherein the protrusion is made of a softer material than the cover. When a plurality of operation input positions with respect to the panel display surface are set and a pressing operation at the operation input position is detected, an input operation assist is attached to the apparatus main body that executes a process set in advance corresponding to the operation input position. A panel,
A hard thin plate-like cover portion held against the apparatus main body at a use position covering the panel display surface;
The cover portion is provided integrally with the cover portion so as to face the plurality of operation input positions in a state where the cover portion is held at the use position, and from the surface of the cover portion to the opposite side of the panel display surface. A plurality of protrusions that protrude
Guiding means for guiding the cover portion to the use position when the input operation auxiliary panel moves relative to the apparatus main body so that the cover portion is directed to the use position;
A type identifying means for indicating the type of the input operation auxiliary panel classified by the arrangement of the plurality of protrusions,
The type identifying means is detected by the apparatus main body with the cover portion held at the use position, whereby the type of the input operation auxiliary panel is recognized by the apparatus main body, and the recognized input operation is performed. The operation input position is set in accordance with the type of the auxiliary panel, a process adapted to the type of the recognized input operation auxiliary panel is executed, and a process adapted to the type of the recognized input operation auxiliary panel is performed. When a plurality of settings are set in advance, a predetermined priority process is selected from the plurality of processes and executed .
For the process adapted to the recognized input operation auxiliary panel type, a selection screen is displayed on the panel display surface, and a transition to a process designated by the user among the plurality of processes is possible. Application included,
The input operation auxiliary panel , wherein the selection application can be set as the predetermined priority process .

Images