JP5213033B2 - Software input key display method, program, and information processing terminal - Google Patents

Description

  The present invention relates to a software input key for performing input corresponding to a key in a keyboard displayed on the display device by selecting with a mouse, a pen, or the like, and in particular, software displayed on a display device having a touch screen. Regarding input keys.

  In recent years, a small information terminal such as a PDA having a function of inputting information by displaying a software input key on a touch screen and touching a display has come to be generally used.

  A conventional software input key will be described with reference to FIG. This figure shows the screen when the software input key is displayed from the icon display of the files in a folder. At this time, the software input key is displayed in the lower half of the screen. The icons displayed in the lower half of the screen before the software input key is displayed are not displayed on the screen.

  As described above, the conventional software input key hides other elements to be displayed on the screen at the time of display. In particular, an input component such as an edit box to be input using a software input key or data such as real-time information to be referred to at the time of input may be hidden, so that the operability and viewability are impaired.

  Patent Document 1 proposes to display a transparent software keyboard on the screen. According to the software input key system having such a configuration, although the viewability can be improved as compared with the conventional system, when the software keyboard is displayed on an input component such as an edit box, the user temporarily enters the input. It is necessary to move the software keyboard and the operability is not improved.

JP2007-048300

  The present invention has been made in view of such a situation, and the problem to be solved by the present invention is to perform the same operation as when the software input key is not displayed even when the software input key is displayed. It is to provide a technology having the ability to browse and view.

  In order to solve the above-described problems, the present invention provides the following software input key display method, program, and information processing terminal.

  That is, in the method of displaying the software input key on the display of the information processing apparatus, the reduction process of reducing the first display image having a predetermined size by the processing apparatus of the information processing apparatus and the reduction A synthesis stage in which a processing device generates a second display image in which the first display image and a predetermined software input key image are synthesized so as not to overlap each other; and a second display A software input key display method comprising: a display step of executing a process of outputting an image on a display by a processing device.

  A program for displaying a software input key on a display of a computer, a reduction means for reducing a first display image having a predetermined size, a reduced first display image, and a predetermined first display image Provided is a synthesizing unit that generates a second display image by synthesizing the software input key image so as not to overlap each other, and a program for causing the computer to function as a display unit that outputs the second display image to a display. To do.

  Further, in an information processing terminal for displaying a software input key on a display, a reduction means for reducing a first display image having a predetermined size, a reduced first display image, and a predetermined software input key There is provided an information processing terminal comprising: a combining unit that generates a second display image that is combined with an image so as not to overlap each other; and a display unit that outputs the second display image to a display.

  According to the present invention, even when the software input key is displayed on the screen, that is, when the second display image is displayed, the software input key is not displayed on the screen, that is, the first The entire display image can be displayed without being hidden by the software input key.

  An embodiment of the present invention will be described. In the present embodiment, when displaying the software input key on the display of the information processing apparatus, a process of reducing the first display image having a predetermined size (reduction process), the reduced first display image, A process of generating a second display image synthesized so as not to overlap with a predetermined software input key image (synthesizing process), a process of outputting the second display image to the display (display process), It is executed by a programmable processing device provided in the information processing device or a dedicated processing device.

  The method further includes a process (selection process) for selecting one of the first and second display images, and when the first display image is selected in the selection process, the first display image is displayed on the display in the display process. It is good also as outputting. In this way, either the first display image or the second display image can be selected and displayed.

  The information processing apparatus includes a touch screen that outputs touch position information as an electrical signal corresponding to a position touched on the screen of the display. When the display is displaying the second display image, the second display image is displayed. When the touch screen outputs touch position information corresponding to the first display image, a position information conversion step of generating virtual position information by executing a predetermined conversion process on the touch position information by the processing device It is good also as including. In this way, the touched position in the reduced first display image can be acquired.

  As a preferred arrangement of the software input keys, when the second display image is displayed on the display, each key constituting the software input key is arranged along the outer edge of the display, and the reduced first display image is: It is conceivable to be placed inside the software input key on the display.

  A small information terminal 100 according to an embodiment of the present invention will be described. Referring to FIG. 1, the small information terminal 100 includes a display 110, a touch screen 120, an operating system (OS) 130, and an application software group 140.

  The display 110 includes a DAC (Digital to Analog Converter) 111 that converts a digital signal into an analog signal, a monitor 112 that receives the signal from the DAC 111 and displays image data, and a frame that stores image data to be displayed on the monitor 112. The display unit 114 includes a buffer 113, a function for reading and writing image data to and from the frame buffer 113, and a function for transferring the image data to the DAC 111.

  The touch screen 120 includes a screen 121 and a touch screen controller 122 that acquires position information touched by the user from the screen 121.

  The OS 130 is software executed by the CPU of the small information terminal 100, and includes hardware drivers that control each hardware element such as the display driver 131 and the touch screen driver 132, a graphic processing module 133, and event processing. It is composed of a number of intermediate processing modules such as the module 134 and an application interface 135 serving as an interface with application software. Although not explicitly shown in FIG. 1, many software elements in the OS 130 can access each other.

  The display driver 131 receives data from the graphic processing module 133, transfers the data to the display controller 114 and displays the data on the display, and displays image data on the monitor 112 in response to a request from the graphic processing module 133. The function to acquire via 114 is equipped.

  The touch screen driver 132 has a function of acquiring a position touched by the user. When the user touches the touch screen, an H / W interrupt is generated, and the OS 130 detects the H / W interrupt and notifies the touch screen driver 132 of it. Thereby, the touch screen driver 122 can request and acquire the touch position from the touch screen controller 122 in substantially real time.

  The graphic processing module 133 has functions such as image processing, display of image data on the display 110, and acquisition of image data from the display 110.

  The event processing module 134 is a software element that receives an event issue request from an arbitrary software element and arbitrary application software in the OS 130 and issues an event. The event is a means for communicating between software elements in the OS 130 and each application software. Each software element has means for making an event issuance request to the event processing module and detecting event issuance. Since an event is issued by designating an event type, an event in the software element can be notified to other software elements. In addition, since data or an address of data can be designated when issuing an event, it is also possible to transfer data between software elements.

  The application interface 135 has a function of accepting and processing access to software elements in the OS 130 from the application software, and a function of sending responses and notifications from the software elements in the OS 130 to the application software.

  The application software group 140 means the whole of one or more application software being executed on the CPU of the small information terminal 100 and the OS 130.

  The software input key module 141 is a kind of application software, and has a function of displaying a software input key corresponding to a software keyboard on the display 110 and detecting a touch of the input key by the user.

  In the present embodiment, all the above components except the display driver 131, the touch screen driver 132, and the software input key module 141 perform the same processing as that of a general small information terminal.

  Next, operations of the display driver 131, the touch screen driver 132, and the software input key module 141 will be described in more detail with reference to FIG.

  The software input key module 141 notifies the display driver 131 and the touch screen driver 132 of the activation status of the software input key module 141 via routes R201 and R202 at the time of activation and termination.

  When the software input key module 141 is not activated, the display driver 131 transfers the image diagram requested by the graphic processing module 133 to the display 110 via the routes R303, R304, and R306, and causes the display 110 to display the image. The software switch 201 in the display driver 131 plays a role of selecting image data of either the root R305 or the root R304 and transmitting it to the display driver. The software switch 201 selects data of the route R304 when the software input key module 141 is not activated, and selects data of the route R305 when the software input key module 141 is activated.

  The image data of the route R304 is an image diagram received directly from the graphic processing module 133 via the route R303. On the other hand, the image data of the route R305 combines the reduced image diagram obtained by reducing the image data received from the graphic processing module 133 by the reduction processing unit 202 and the image diagram of the software input key via the routes R307 and R308. It is the image figure data that was made.

  The image diagram that the graphic processing module 133 transfers to the display driver 131 via the route R303 depends on the state of the OS 130 and the application, and is not constant. An example of an image diagram in the routes R303 and R304 is shown as an OS display image diagram 300 in FIG. The OS display image diagram 300 corresponds to the first display image described above, and is displayed using the entire screen of the monitor 112.

  On the other hand, the image of the software input key via the routes R307 and R308 is basically independent of the state of the OS 130 and the application and is constant. FIG. 4 shows a software input key image 400. Data of the software input key image 400 is stored in the storage device 203 of the terminal.

  The OS display image diagram 300a obtained by reducing the OS display image diagram 300 and the software input key image 400 are synthesized by the synthesis processing unit 204 and input to the software switch 201 via the route R305. FIG. 5 shows a composite image diagram 500 that is a composite image diagram. The composite image diagram 500 corresponds to the second display image described above. Since the OS display image diagram 300a is a reduction of the entire OS display image 400, when displayed on the monitor 112 as it is, a margin is generated on the outer periphery of the monitor 112. When the composite image diagram 500 is displayed on the monitor 112, the software input key image 400 is displayed on the outer periphery corresponding to the margin.

  The correspondence between the position on the OS display image diagram 300 and the position on the composite image diagram 500 will be described with reference to FIG. The length and height of the screen are A and B, respectively. Therefore, the points (0, 0), (A-1, 0), (0, B-1), and (A-1, B-1) are the upper left pixel (origin), the upper right pixel, It represents the bottom left pixel, the bottom right pixel. Also, in the figure, when the software input key is displayed on the display, only a part of the screen is hidden behind the software input key, but the C × D rectangular square in the center is not hidden. Therefore, when the software input key is displayed, the reduction ratio at which the display driver 131 reduces the display image diagram from the graphic processing module 133 is C / A on the horizontal axis and B / D on the vertical axis.

  The touch screen driver 132 grasps the activation status of the software input key module 141 based on the notification from the software input module 141, and performs different processing on the touch position information according to the activation status. The touch position information is coordinates indicating the position of the touch actually detected on the screen 120.

  When the software input key module 141 is not activated and the user touches the touch screen, the touch screen driver 132 notifies the event processing module 134 via the route R309 to generate a touch event. At that time, the touch position information is notified to the event processing module 134 as event information together with the touch event. Routes through which the touch position information passes are R310, R311, and R313.

  On the other hand, when the software input key module 141 is activated, the operation of the touch screen driver 132 differs depending on whether or not the coordinates of the touch position information are within the drawing area of the software input key.

  When the software input key module 141 is activated and the touch position is not within the drawing area of the software input key, the touch screen driver 132 passes the route R309 to the event processing module 134 so as to generate a touch event. Notice. At that time, the touch screen driver 132 converts the touch position information into virtual position information by the position conversion unit 205 and notifies the event processing module 134 of the converted information. At this time, the route through which the touch position information or the virtual position information passes is R310, R314, R315, R312 and R313. The virtual position information is calculated by the position conversion unit 205 from the touch position information only when the actual touch position is in a central C × D square area.

  Here, a method for calculating the virtual position information based on the touch position information will be described with reference to FIG. Assuming that the touch position information when displaying the software input key is coordinates (M, N), the coordinates (P, Q) of the virtual position are expressed by Equations 1 and 2, respectively. If the calculation result is a decimal number, it is rounded off to an integer to P and Q.

  Further, when the software input key module 141 is activated and the touch position is within the drawing area of the software input key, the touch screen driver 132 does not request the event processing module 134 to generate a touch event. Instead, the touch screen driver 132 requests the event processing module 134 to generate a key input event. The key input event is an event registered in advance in the event processing module 134 by the software input key module 141. When requesting the occurrence of a key input event, the touch screen driver 132 notifies the event processing module 134 of touch position information.

  In this way, the software input key module 141 detects the occurrence of a key input event and acquires touch position information. Based on the acquired touch position information and the image diagram data 203 of the software input key, the software input key module 141 determines which key of the software input key is touched, that is, the key value.

  When the touched key is determined, the software input key module 141 requests the event processing module 134 to generate a key event. A key event is an event generated by the event processing module 134 in response to detection of a key press on a hardware keyboard or software keyboard. When a key event occurs, the event processing module 134 notifies the other components or application software 142 to 145 of the OS 130 of the key value together with the notification of the event occurrence. Here, the key value determined by the software input key module 141 is notified.

  According to the above-described embodiment, the screen when the software input key is not displayed is reduced and displayed at the center of the screen, and the software input key is displayed side by side along the periphery of the touch display. Accordingly, the entire screen when the software input key is not displayed can be displayed on the touch display even when the software input key is displayed. Since part of the screen is not hidden behind the software input key unlike conventional software input keys, touch operations on display objects other than software input keys can be performed when the software input key is displayed. There is no loss of operability. For example, in order to touch a display object other than the software input key, it is not necessary to perform an operation for hiding the software input key or an operation for moving the display position of the software input key.

  While the present invention has been described with reference to the embodiment and examples, the present invention is not limited to this. For example, the graphic processing module 133 and the event processing module 134 operate in the same manner as in the prior art, while the software input key module 141, the display driver 131, and the touch screen driver 132 perform characteristic operations, so that the software input key of the present invention can be used. Although implemented, it will be apparent to those skilled in the art that other implementations are possible.

  That is, instead of executing characteristic processing by the display driver 131, it may be executed by a graphic processing module. The graphic processing module may perform display display image reduction processing, composite processing of the reduced display display image and software input key image, and switching processing of the composite image and the display display image. Similarly, processing such as conversion of touch position information into virtual position information, which has been performed by the touch screen driver 132, may be performed by the event processing module.

  Further, instead of mounting the software input key module 141 as an application program, the same function may be mounted as an OS component.

  The present invention is particularly suitable for software input keys displayed on a display device having a touch screen function. However, the present invention is not limited to this, and the display is performed on a display device having no touch screen function. It may be a software input key. Even in this case, the software input key can be displayed without hiding the display image.

It is a block diagram for demonstrating the small information terminal 100 which is Example 1 of this invention. 2 is a block diagram for explaining an OS 130. FIG. It is a figure for demonstrating OS display image figure 300. FIG. 5 is a diagram for explaining a software input key image 400. FIG. It is a figure for demonstrating the composite image figure. 6 is a diagram for explaining a correspondence relationship between a position on an OS display image diagram 300 and a position on a composite image diagram 500. FIG. It is a figure for demonstrating the screen which displayed the conventional software input key.

Explanation of symbols

100 Small information terminal 110 Display 111 DAC
112 Monitor 113 Frame buffer 114 Display controller 120 Touch screen 121 Screen 122 Touch screen controller 130 OS
131 Display Driver 132 Touch Screen Driver 133 Graphic Processing Module 134 Event Processing Module 135 Application Interface 140 Application Software Group 141 Software Input Key Modules 142 to 145 Application Software 201 Software Switch 202 Reduction Processing Unit 203 Software Input Key Image Diagram Data 204 Composition Processing Unit 205 Position conversion processing unit 300 OS display image diagram 400 Software input key image 500 Composite image diagram

Claims (6)

In a method of displaying a software input key for touch input on a display of an information processing device,
The information processing apparatus includes a touch screen that outputs touch position information as an electrical signal corresponding to a position touched on the screen of the display,
A reduction stage in which the processing device of the information processing apparatus executes processing for reducing the entire first display image having a predetermined size;
The respective keys constituting the software input key are arranged along the outer edge of the display so that the reduced first display image and the predetermined software input key image do not overlap each other. A composition stage in which the processing device executes a process of generating a second display image obtained by placing the reduced first display image inside the software input key and combining the two;
A display step of executing a process of outputting the second display image to the display in the processing device;
When the display is displaying the second display image and the touch screen outputs touch position information indicating a position outside the area for displaying the software input key, the touch position information is predetermined. A position information conversion stage for generating virtual position information by executing the conversion processing in the processing device;
The processing device processing a touch event based on the virtual position information,
The length and height of the display are A and B, respectively, and the length and height of the area for displaying the first display image reduced in the second display image are C and D, respectively. When the touch position information when displaying is the coordinates (M, N), the conversion process is to obtain the coordinates (P, Q) of the virtual position information based on the following equations 1 and 2. Characteristic software input key display method.

The software input key display method according to claim 1,
And a selection step of executing, in the processing device, processing for selecting one of the first and second display images,
When the first display image is selected in the selection step, the first display image is output to a display in the display step. A program for displaying software input keys for touch input on a display having a touch screen that outputs touch position information to the computer as an electrical signal corresponding to the position touched on the screen. There,
Reduction means for reducing the entirety of the first display image having a predetermined size;
The respective keys constituting the software input key are arranged along the outer edge of the display so that the reduced first display image and the predetermined software input key image do not overlap each other. Synthesizing means for generating a second display image obtained by arranging the reduced first display image inside the software input key and synthesizing the first display image;
Display means for outputting the second display image to the display;
When the display is displaying the second display image and the touch screen outputs touch position information indicating a position outside the area where the software input key is displayed, a predetermined value is set for the touch position information. Position information conversion means for generating virtual position information by executing conversion processing; and
A program for causing the processing device to function as a means for processing a touch event based on the virtual position information ,
The length and height of the display are A and B, respectively, and the length and height of the area for displaying the first display image reduced in the second display image are C and D, respectively. When the touch position information when displaying is the coordinates (M, N), the conversion processing is to obtain the coordinates (P, Q) of the virtual position information based on the following equations 3 and 4. A featured program.

In the program according to claim 3 ,
Furthermore, a program for causing a computer to function as selection means for selecting one of the first and second display images,
When the selection means selects the first display image, the display means outputs the first display image to a display. In an information processing terminal that displays a software input key for touch input on a display,
Reduction means for reducing the entirety of the first display image having a predetermined size;
The respective keys constituting the software input key are arranged along the outer edge of the display so that the reduced first display image and the predetermined software input key image do not overlap each other. Synthesizing means for generating a second display image obtained by arranging the reduced first display image inside the software input key and synthesizing the first display image;
Display means for outputting the second display image to the display;
The display is a touch screen that outputs touch position information to the computer as an electrical signal according to the position touched on the screen,
When the display is displaying the second display image and the touch screen outputs touch position information indicating a position outside the area where the software input key is displayed, a predetermined value is set for the touch position information. Position information conversion means for generating virtual position information by executing conversion processing; and
The processing device comprises means for processing a touch event based on the virtual position information;
The length and height of the display are A and B, respectively, and the length and height of the area for displaying the first display image reduced in the second display image are C and D, respectively. When the touch position information when displaying is the coordinates (M, N), the conversion processing is to obtain the coordinates (P, Q) of the virtual position information based on the following formulas 5 and 6. Characteristic information processing terminal.

The information processing terminal according to claim 5 ,
And further comprising selection means for selecting one of the first and second display images,
An information processing terminal, wherein when the first display image is selected by the selection means, the display means outputs the first display image to a display.

Images