JP2017072955A - Information processing apparatus, information processing method, information processing program, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily draw a diagram without requiring a special pointing device.SOLUTION: An information processing apparatus (10) comprises: an input device (20) including a plurality of pressure sensors (21) that are arranged in matrix and detects pressing forces at pointing positions input to the plurality of pressure sensors (21); and a display device (40) that displays the colors of display positions associated in advance with the pointing positions as a gradation associated in advance with the strength of the pressing forces at the pointing positions.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus, an information processing method, an information processing program, and a recording medium.

  In recent years, tablet terminals having a function of detecting pen input on a liquid crystal display and displaying characters or drawing illustrations based on the movement path of the pen input have become widespread. Is called LCD pen tablet. Some LCD pen tablets have been put to practical use that can detect pen pressure and pen tip tilt and faithfully reproduce the thickness of the handwriting and the blurring of characters according to the pen pressure and tip tilt. ing. By using such a liquid crystal pen tablet, an intuitive operation can be performed as compared with a mouse, and a drawing operation can be realized on a computer with an operation feeling similar to that of drawing with an actual writing tool or drawing tool such as a paint brush or pastel. Against the background of such technical trends, interest in liquid crystal pen tablets is increasing. For example, in Patent Document 1, in response to a pen input operation to a liquid crystal display panel having display pixels arranged in a matrix, A liquid crystal display device that displays a drawn image in color has been proposed. In Patent Document 2, the pressure applied to the ball of the mouse is detected, and the movement trajectory of the mouse is displayed on the display in shades of gray corresponding to the detected pressure, so that the thickness of the line is softened according to the writing pressure. A method for displaying the condition has been proposed. Patent Document 3 proposes a method of detecting the pressure applied to the pointing device and displaying the movement locus of the pointing device on the display with a line width corresponding to the detected pressure. Further, Patent Document 4 proposes a method of continuously changing the thickness, shape, shading, etc. of the movement locus of the pen tip based on the contact pressure or contact angle of the pen tip with respect to the tablet. Patent Document 5 proposes a method for enlarging or reducing the drawing pattern in accordance with the writing pressure of the tablet pen. Patent Document 6 proposes a tablet terminal that reproduces a drawing texture of an oil painting by expressing unevenness by a shaded outline in a brush pattern. Further, in Patent Document 7, the pen pressure operated by the user is displayed on the screen so that the user can confirm the pen input with the pen pressure while visually checking the pen pressure. Tablet devices have been proposed.

JP 2006-209783 A JP 09-062441 JP 05-173706 A Japanese Patent Laid-Open No. 06-149468 JP 2004-139411 A JP 2007-257655 A JP 09-091076 A

  However, since the conventional tablet terminal is configured to draw a diagram using a dedicated pointing device such as a stylus pen or a mouse, the diagram cannot be drawn with a fingertip or the like, for example. In addition, when only one dedicated pointing device is prepared, it is impossible to simultaneously specify a plurality of pointing positions and draw a plurality of diagrams at the same time. For example, if it is possible to draw a diagram by freely specifying the pointing position with a fingertip or the like without using a dedicated pointing device, the operability of the tablet terminal is improved and the dedicated pointing device is carried. It is thought that convenience is also improved.

  Accordingly, an object of the present invention is to easily realize drawing of a diagram without requiring a dedicated pointing device.

  In order to solve the above-described problem, an information processing apparatus according to the present invention includes a plurality of pressure sensors arranged in a matrix, and an input device that detects a pressing force at a pointing position input to the plurality of pressure sensors. And a display device that displays the color of the display position previously associated with the pointing position in a gradation that is previously associated with the strength of the pressing force at the pointing position.

It is a block diagram which shows the structure of the information processing apparatus which concerns on this embodiment. It is explanatory drawing of the 1st correspondence table which concerns on this embodiment. It is explanatory drawing of the 2nd corresponding | compatible table which concerns on this embodiment. It is explanatory drawing of the strength of the pressing force which the pressure sensor which concerns on this embodiment detects. It is explanatory drawing of the color tone of the pixel which concerns on this embodiment. It is explanatory drawing which shows an example of the shade change of the movement locus | trajectory of the pointing position which concerns on this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to FIGS. 1 to 6. Here, the same code | symbol shall show the same element, and the overlapping description is abbreviate | omitted.
FIG. 1 is a block diagram illustrating a configuration of an information processing apparatus 10 according to the present embodiment. The information processing apparatus 10 is a computer system that includes an input device 20, a storage resource 30, a display device 40, a sound output device 50, and a processor 60. The information processing apparatus 10 is, for example, a portable information terminal such as a tablet terminal or a multi-function mobile phone terminal equipped with a function for drawing a diagram by a pressure-sensitive method. The input device 20 provides an input interface that accepts designation of a pointing position from a user. For example, the input device 20 is called a pressure sensor sheet in which fine pressure sensors 21 are arranged in a high-density matrix. As this type of pressure sensor sheet, for example, a known flexible organic thin film transistor array in which a pressure-sensitive conductive rubber sheet is formed on the surface of an organic transistor of about 1 mm square can be used. The pressure-sensitive conductive rubber sheet changes its resistance value when deformed by a pressing force. Therefore, the strength of the pressing force is determined based on the change in drain current flowing from the power supply terminal to the organic thin film transistor through the pressure-sensitive conductive rubber sheet. Can be detected.

The storage resource 30 is a logical device provided by a storage area of a physical device (for example, a computer-readable recording medium such as a disk drive or a semiconductor memory). The storage resource 30 stores an information processing program 31 for drawing a diagram based on the movement locus of the pointing position input to the input device 20. The information processing program 31 includes a plurality of software modules that are called and executed in the main program. Such a software module is a subprogram modularized to detect a pointing position input to the input device 20 and execute a series of processes for drawing a diagram from the movement locus of the pointing position. For example, it is created using a procedure, subroutine, method, function, data structure, or the like. As such a software module, the information processing program 31 is described so as to display the color of the display position previously associated with the pointing position with the gradation previously associated with the strength of the pressing force at the pointing position. A display module 32 comprising subprograms is provided. For example, as shown in FIG. 2, the storage resource 30 includes the intensity of the pressing force divided into N stages (P ₁ , P ₂ , P ₃ ,..., P _N ) and the N-level color tone (C ₁ , A first correspondence table 34 in which C ₂ , C ₃ ,..., C _N ) are associated with each other is stored. Here, N is an integer of 2 or more, and specifically indicates the number of shades of color and brightness.

  The display device 40 is stored in a display 43 for displaying an image, a video random access memory (VRAM) 42 for storing data of an image displayed on the display 43, and a video random access memory 42. A video display processor (DSP (Video Display Processor)) 41 that reads out the displayed image data at a frame period and displays the image data on the display 43 is provided. The display 43 is, for example, a liquid crystal display or an organic electroluminescence display. The input device 20 may be provided so as to overlap the display 43, or the input device 20 and the display 43 may be provided separately. By providing the input device 20 so as to overlap the display 43, the input device 20 can function as a touch sensor that detects a pointing position input on the display 43. The processor 60 includes an arithmetic and logic unit for processing arithmetic operations, logical operations, bit operations, various registers (program counter, data register, instruction register, general-purpose register, etc.), input device 20, storage resource 30, and display device. 40, and an interface connected to the sound output device 50, detects the pointing position input to the input device 20, interprets and executes the information processing program 31 stored in the storage resource 30, and A diagram is drawn based on the movement trajectory and displayed on the display 43.

Next, details of the drawing process of the diagram will be described with reference to FIGS. 4 and 5. In FIG. 4, P ₁ , P ₂ , and P ₃ indicate the strength of the pressing force input to the 13 pressure sensors 21 by one pointing operation, for example, and are arranged at the pointing position 101, for example. The strength of the pressing force detected by the pressure sensor 21 is P ₁ , and the strength of the pressing force detected by the pressure sensor 21 disposed at the pointing position 102 is P ₂ and is disposed at the pointing position 103. pressing force strength which is the pressure sensor 21 detects is P _3. In FIG. 5, reference numeral 44 indicates a pixel of the display 43, and C ₁ , C ₂ , and C ₃ indicate the color tone of the display position (display pixel) that is associated with the pointing position in advance. Here, for convenience of explanation, it is assumed that the resolution of the display 43 and the resolution of the input device 20 are the same, and the intensity of the pressing force detected by one pressure sensor 21 and the color tone of one pixel 44 are calculated. An example of one-to-one correspondence is shown. For example, the display positions 201, 202, and 203 are assumed to be associated with the pointing positions 101, 102, and 103 in advance. The processor 60 reads signals indicating the strengths P ₁ , P ₂ , and P ₃ of the pressing force input to the pointing positions 101, 102, and 103 from the respective pressure sensors 21, and refers to the first correspondence table 34, The color tone of the display position 201 on the display 43 that is previously associated with the pointing position 101 on the input device 20 is set to C ₁ , and the display 43 that is previously associated with the pointing position 102 on the input device 20 is displayed. The color tone of the display position 202 is set to C ₂ , and the color tone of the display position 203 on the display 43 previously associated with the pointing position 103 on the input device 20 is set to C _3. The image data is written in the video random access memory 42 based on the color tone. As a result, the display position 201 is displayed with the color tone C ₁ , the display position 202 is displayed with the color tone C ₂ , and the display position 203 is displayed with the color tone C ₃ . For example, as shown in FIG. 6, as the pressing force is stronger, color display is performed with a darker gradation, so that a change in light and shade according to the strength of the pressing force can be reproduced. In the figure, dark and light portions indicate portions where the pressing force is strong, and thin portions indicate portions where the pressing force is weak.

For convenience of explanation, it is assumed that the resolution of the display 43 and the resolution of the input device 20 are the same, and an example in which one pressure sensor 21 is associated with one pixel 44 has been shown. The strength of the pressing force detected by 21 and the color tone of the plurality of pixels 44 may be associated one-to-one. Further, the information on the color tone C ₁ , C ₂ , C ₃ may be associated with the information on the display positions 201, 202, 203 and stored in the storage resource 30 as the image file 36. The information processing program 31 may include an image processing module including a subprogram that is described so as to refer to, process, or edit the image file 36.

The information processing program 31 not only draws a diagram in response to a pointing input to the input device 20, but also, for example, a height (sound frequency) previously associated with the strength of the pressing force at the pointing position. , A sound output module 33 including a subprogram described so as to output sound signals in loudness (sound loudness) or tone color (combined wave of fundamental and overtones). For example, as shown in FIG. 3, the storage resource 30 includes the intensity of the pressing force (P ₁ , P ₂ , P ₃ ,..., P _M ) divided into M stages and M types of acoustic parameters (S ₁ , A _second correspondence table 35 in which S ₂ , S ₃ ,..., S _M ) are associated with each other is stored. Here, M is an integer of 2 or more. This acoustic parameter specifies the height, magnitude, or tone of the acoustic signal. The acoustic output device 50 includes a programmable sound generator (PSG (Programmable Sound Generator)) 51 that generates an acoustic signal by performing amplitude modulation, frequency modulation, or the like by calculation from waveform data for a certain period. The processor 60 interprets and executes the sound output module 33, reads the sound parameter previously associated with the strength of the pressing force at the pointing position with reference to the second correspondence table 35, and is designated by the sound parameter. An acoustic signal having a height, size, or tone color is output from the programmable sound generator 51. The acoustic signal output in this way may be stored in the storage resource 30 as the acoustic file 37. The information processing program 31 may include an acoustic processing module including a subprogram that is described so as to reproduce, process, or edit the acoustic file 37.

According to the present embodiment, a dedicated pointing device such as a stylus pen or a mouse is used by using the input device 20 having a plurality of pressure sensors 21 arranged in a matrix as an input interface that receives designation of a pointing position from a user. For example, a pointing position can be designated with a fingertip, and a diagram can be drawn as if writing a memo. In addition, since a pointing position can be designated on the input device 20 using a familiar object, it is excellent in convenience. In addition, since a plurality of pointing positions can be simultaneously specified and a plurality of diagrams can be drawn at the same time, the operability is excellent. The colors of the display positions 201, 202, and 203 previously associated with the pointing positions 101, 102, and 103 input to the plurality of pressure sensors 21 arranged in a matrix are changed to the pressures of the pointing positions 101, 102, and 103, respectively. By displaying the gradations C ₁ , C ₂ , and C ₃ that are associated with the strength in advance, it is possible to faithfully reproduce the change in shade according to the strength of the pressing force. In addition, by outputting an acoustic signal with a height, size, or tone color that is previously associated with the strength of the pressing force at the pointing position, it is possible to simultaneously create a music while drawing a diagram.

  Each embodiment described above is for facilitating the understanding of the present invention, and is not intended to limit the present invention. The present invention can be changed / improved without departing from the gist thereof, and the present invention includes equivalents thereof. In other words, those obtained by appropriately modifying the design of each embodiment by those skilled in the art are also included in the scope of the present invention as long as they include the features of the present invention. For example, each element included in each embodiment and its arrangement, material, condition, shape, size, and the like are not limited to those illustrated, and can be changed as appropriate. Further, the positional relationship such as up, down, left and right is not limited to the illustrated ratio unless otherwise specified. In addition, each element included in each embodiment can be combined as much as technically possible, and combinations thereof are included in the scope of the present invention as long as they include the features of the present invention.

DESCRIPTION OF SYMBOLS 10 ... Information processing apparatus 20 ... Input device 21 ... Pressure sensor 30 ... Storage resource 31 ... Information processing program 32 ... Display module 33 ... Sound output module 34 ... First correspondence table 35 ... Second correspondence table 36 ... Image file 37 ... acoustic file 40 ... display device 41 ... video display processor 42 ... video random access memory 43 ... display 44 ... pixel 50 ... acoustic output device 51 ... programmable sound generator 60 ... processors 101, 102, 103 ... pointing positions 201, 202, 203 … Display position

Claims (5)

An input device having a plurality of pressure sensors arranged in a matrix, and detecting a pressing force of a pointing position input to the plurality of pressure sensors;
A display device that displays the color of the display position previously associated with the pointing position in a gradation pre-associated with the strength of the pressing force at the pointing position;
An information processing apparatus comprising: The information processing apparatus according to claim 1,
An information processing apparatus, further comprising: an acoustic output device that outputs an acoustic signal with a height, a size, or a timbre associated with the strength of the pressing force at the pointing position. Computer
Reading a signal indicating a pressing force at a pointing position input to a plurality of pressure sensors arranged in a matrix from the plurality of pressure sensors;
Displaying the color of the display position previously associated with the pointing position in a gradation previously associated with the strength of the pressing force at the pointing position;
Information processing method to execute. On the computer,
Reading a signal indicating a pressing force at a pointing position input to a plurality of pressure sensors arranged in a matrix from the plurality of pressure sensors;
Displaying the color of the display position previously associated with the pointing position in a gradation previously associated with the strength of the pressing force at the pointing position;
Information processing program that executes On the computer,
Reading a signal indicating a pressing force at a pointing position input to a plurality of pressure sensors arranged in a matrix from the plurality of pressure sensors;
Displaying the color of the display position previously associated with the pointing position in a gradation previously associated with the strength of the pressing force at the pointing position;
The computer-readable recording medium which recorded the information processing program which performs this.

Images