JP6197559B2 - Object operation system, object operation control program, and object operation control method - Google Patents

Description

  The present invention relates to an object operation system, an object operation control program, and an object operation control method, and more particularly to an object operation system capable of displaying and operating an object, and an object enlargement / reduction (enlargement / reduction) operation and deformation operation in the system. The present invention relates to an object operation control program and an object operation control method.

  In recent years, an electronic conference or the like that uses a display screen (referred to as a shared screen) that can be used by a plurality of users and writes and discusses display elements (hereinafter referred to as objects) such as characters, graphics, and images on the shared screen. Has been done. In such a shared screen, a plurality of users can write various objects, and the written objects can be moved to an arbitrary place in the shared screen, scaled, or deformed.

  As a technique related to the operation of the object, for example, in Patent Document 1 below, a trajectory detecting unit capable of detecting trajectories of a plurality of designated positions that can be moved simultaneously, and a trajectory of a plurality of designated positions detected by the trajectory detecting unit. There is disclosed an operating device comprising: an instruction interpreting means for interpreting an instruction represented by the combination; and an operating means for performing an operation based on the instruction interpreted by the instruction interpreting means.

  In this publication, the instruction interpretation unit includes a distance measurement unit that measures a distance between the plurality of indication positions, a distance change acquisition unit that acquires a change in the distance measured by the distance measurement unit, and the distance change. Distance change interpretation means for interpreting an instruction based on the distance change acquired by the acquisition means, wherein the distance change acquisition means acquires the measured distance change amount, and the distance change interpretation means acquires It is described that it is interpreted as an instruction to reduce or enlarge the magnification corresponding to the changed amount.

JP 2001-290585 A

  As in the above-mentioned Patent Document 1, the object can be enlarged or reduced or deformed by a so-called pinch operation in which a plurality of points on the object are touched and a plurality of touch positions are moved. However, when the instructable area on the object is small, it is difficult to place and operate multiple fingers on the object, and it is difficult to easily scale and deform the object. It was. In addition, even if a plurality of fingers can be placed on the object, it is difficult to secure a moving stroke of the touch position, and it is difficult to scale the object to a desired size or to deform it. was there.

  The present invention has been made in view of the above problems, and a main object thereof is an object operation system, an object operation control program, and an object operation control capable of easily and appropriately performing an object enlargement / reduction operation or deformation operation. It is to provide a method.

According to one aspect of the present invention, an object operation system includes a touch panel that displays an object so as to be operable, and a control unit that controls the touch panel. The control unit includes one or more touches on a predetermined object. An operation determination unit that determines that a first operation for instructing enlargement / reduction or deformation of the predetermined object is performed when detecting one or more touches outside the predetermined object; A processing unit that enlarges / reduces or deforms the predetermined object based on the touch position on the predetermined object and the touch position outside the predetermined object when it is determined that one operation has been performed. When, wherein the processing unit, based on the touch position on the predetermined object, the touch position outside the predetermined object In, it characterized that you expand or deform the predetermined object.

One aspect of the present invention is an object operation control program that operates on a control unit that controls a touch panel that displays an object in an operable manner, and the control unit includes one or more touches on a predetermined object, and the predetermined A first process for determining that a first operation for instructing enlargement / reduction or deformation of the predetermined object is performed when one or a plurality of touches outside the object is detected; When it is determined that the predetermined object has been performed, a second process for enlarging / reducing or deforming the predetermined object based on the touch position on the predetermined object and the touch position outside the predetermined object is executed. It is, in the second processing, based on the touch position on the predetermined object, to the touch position outside the predetermined object, To expand or deform the serial predetermined object and said Rukoto.

One aspect of the present invention is an object operation control method in a system including a touch panel that displays an object in an operable manner and a control unit that controls the touch panel, and one or more touches on a predetermined object; A first process for determining that a first operation for instructing enlargement / reduction or deformation of the predetermined object is performed when one or more touches outside the predetermined object are detected; A second process for enlarging / reducing or deforming the predetermined object based on the touch position on the predetermined object and the touch position outside the predetermined object, when it is determined that the operation is performed If, is executed, and the second process, based on the touch position on the predetermined object, the predetermined object To the touch position, and wherein to expand or deform the predetermined object.

  According to the object operation system, the object operation control program, and the object operation control method of the present invention, an object enlargement / reduction operation and deformation operation can be performed easily and appropriately.

  The reason is that in a system including a touch panel that displays and operates an object and a control unit that controls the touch panel, the control unit includes one or more touches on the predetermined object and one or more outside the predetermined object. This is because the predetermined object is enlarged / reduced or deformed based on the touch position on the predetermined object and the touch position outside the predetermined object.

It is a figure which shows typically the external appearance structure of the object operation system which concerns on one Example of this invention. It is a figure which shows typically the other external appearance structure of the object operation system which concerns on one Example of this invention. It is a block diagram which shows the structure of the object operation system which concerns on one Example of this invention. It is a flowchart figure which shows the process of the object operation system which concerns on one Example of this invention. It is a flowchart figure which shows the process of the object operation system which concerns on one Example of this invention. It is an example of the management table which concerns on one Example of this invention. It is a figure which shows typically the expansion / contraction process of the object which concerns on one Example of this invention. It is a figure which shows typically the other example of the expansion / contraction process of the object which concerns on one Example of this invention. It is a figure which shows typically the other example of the expansion / contraction process of the object which concerns on one Example of this invention. It is a figure which shows typically the other example of the expansion / contraction process of the object which concerns on one Example of this invention. It is a figure which shows typically the other example of the expansion / contraction process of the object which concerns on one Example of this invention. It is a figure which shows typically the other example of the expansion / contraction process of the object which concerns on one Example of this invention. It is a figure which shows typically the other example of the expansion / contraction process of the object which concerns on one Example of this invention. It is a figure which shows typically the other example of the expansion / contraction process of the object which concerns on one Example of this invention. It is a figure which shows typically the other example of the expansion / contraction process of the object which concerns on one Example of this invention. It is a figure which shows typically the other example of the expansion / contraction process of the object which concerns on one Example of this invention.

  As described in the background art, when a discussion is performed by operating an object displayed on a shared screen, various operations are performed on the object, such as moving, scaling, or deforming the object. Here, when the size of the object is large, the object can be scaled or deformed by performing a pinch operation or the like by touching the object with a plurality of fingers.

  However, when the size of the object is small, when the shape of the object is complex, when the objects partially overlap each other, when multiple objects are densely packed, etc. However, it is difficult to touch a plurality of fingers on the object, and it is difficult to easily enlarge / reduce or deform the object. Even if a plurality of fingers can be placed on the object, it is difficult to secure a moving stroke of the touch position (particularly, when instructing to reduce the object, the fingers are brought closer together). There is a problem that it is difficult to scale and deform an object to a desired size.

  Therefore, in one embodiment of the present invention, when one or more touches on a predetermined object and one or more touches outside the predetermined object are detected, an enlargement / reduction operation or deformation operation is performed on the predetermined object. Based on the touch position on the object and the touch position outside the object, the enlargement / reduction process or deformation process of the object is performed. Also, in the scaling process or deformation process, the scaling factor or deformation factor is set according to the amount of change in the interval between the touch position on the object and the touch position outside the object, or multiple touches on the object are detected. The magnification of the enlargement / reduction or deformation is changed depending on whether the touch on or outside the object is detected.

  As described above, according to the present invention, even when it is difficult to place a plurality of fingers on an object, the instructable area on the object is small, and scaling is performed based on two touch positions on the object and outside the object. Since operations and deformation operations can be performed, the operability of the object can be significantly improved. Even when a plurality of fingers can be placed on the object, the amount of change in the distance between the two touch positions can be increased by placing one of the touch positions outside the object. Since the object can be scaled or deformed at a magnification, the operability of the object can be greatly improved.

  In order to describe the above-described embodiment of the present invention in more detail, an object operation system, an object operation control program, and an object operation control method according to an embodiment of the present invention will be described with reference to FIGS. . 1 and 2 are diagrams schematically showing the configuration of the object operation system of this embodiment, and FIG. 3 is a block diagram showing the configuration of the object operation system. FIG. 4 is a flowchart showing processing of the object operation system according to the present embodiment, and FIG. 5 is an example of a management table referred to in the processing. FIGS. 6 to 15 are schematic diagrams showing specific examples of object enlargement / reduction processing.

  The present invention is applicable to both cases where there is one operator and a plurality of operators. In this embodiment, a system having a shared work area that can be operated by a plurality of operators will be described. There are two possible forms of this system. As shown in FIG. 1, the first form includes a touch panel having a display unit 40 that displays an object and an operation unit 50 that operates the object, and a control unit 20 that controls the display unit 40 and the operation unit 50. It is the form comprised with the apparatus united. In the second embodiment, as shown in FIG. 2, a touch panel having a display unit 40 and an operation unit 50 and a control unit 20 that controls the display unit 40 and the operation unit 50 are configured separately, and these are wired. Or it is a form connected by radio | wireless. Hereinafter, in order to simplify the description, the description will be made on the premise of the first embodiment of FIG.

  The object operation system 10 of this embodiment is a display panel, an electronic blackboard or the like having a calculation function. As shown in FIG. 3A, the control unit 20, the storage unit 30, the display unit 40, the operation unit 50, and the like Consists of.

  The control unit 20 includes a CPU (Central Processing Unit) 21 and a memory such as a ROM (Read Only Memory) 22 and a RAM (Random Access Memory) 23. The CPU 21 receives a control program from the ROM 22 and the storage unit 30. The entire operation of the object operation system 10 is controlled by calling and developing the program in the RAM 23 and executing it. Further, as shown in FIG. 3B, the control unit 20 also functions as a processing unit 20a, an operation determination unit 20b, and a management unit 20c.

  The processing unit 20a causes the display unit 40 to display an object according to the content of the operation determined by the operation determining unit 20b. In addition, when the operation determination unit 20b determines that the object enlargement / reduction operation or deformation operation has been performed, the processing unit 20a changes the amount of change between the touch position on the object and the touch position outside the object, or the change amount. Based on the magnification obtained by multiplying the enlargement / reduction ratio set by the operation determination unit 20b or the touch positions on and outside the object, the enlargement / reduction process or deformation process of the object is performed. Note that the enlargement / reduction in this embodiment means that the size is increased or decreased while keeping the aspect ratio of the object constant (that is, in a similar shape), and the size is changed by changing the aspect ratio of the object. It does not include making it larger or smaller.

  The operation determination unit 20b determines an operation performed by the user based on a signal from the operation unit 50. For example, when two points on a predetermined object are touched and the interval between the two touch positions changes, it is determined that a normal enlargement / reduction operation or deformation operation (normal pinch operation) has been performed. In addition, when touching at one or a plurality of points on a predetermined object and touching at one or a plurality of points outside the object (may be on another object), a specific scaling operation or deformation It is determined that an operation has been performed. If necessary, the position or time interval between the touch on the object and the touch outside the object is compared with a predetermined threshold, and if the position or time interval is less than the threshold, a specific scaling operation or It is determined that a deformation operation has been performed. When touched at a plurality of points on or outside the object, the interval between the positions can be obtained with reference to the center position of the plurality of points or the position of one point selected from the plurality of points. .

  When the operation determination unit 20b determines that the normal enlargement / reduction operation or deformation operation has been performed, the change amount of the interval between the two touch positions on the object (the increase / decrease amount of the distance between the two touch positions or Distance ratio) or a magnification obtained by multiplying the change amount of the interval by an enlargement / reduction ratio β described later, and notifies the processing unit 20a. If it is determined that the specific enlargement / reduction operation or deformation operation has been performed, the amount of change in the distance between the touch position on the object and the touch position outside the object (distance increase / decrease amount or distance ratio), or A scaling factor obtained by multiplying the change amount of the interval by a scaling factor α (a scaling factor having a value different from the scaling factor β for a normal scaling operation or deformation operation) described later is set and notified to the processing unit 20a.

  For each object displayed on the display unit 40, the management unit 20c associates a number (object number) for identifying the object, a position (coordinate) where the object is displayed, and the size of the object. A table (an object management table described later) is generated and stored in the storage unit 30. When the operation determination unit 20b detects a touch, the time (time) when the touch is detected, a number (finger number) for identifying the touch order, the touch position (coordinates), and whether or not the touch is on the object A management table (a touch management table to be described later) that associates the determination result, the instruction target object, and the distance between the touch position on the object and the touch position outside the object (distance between fingers) Store in the storage unit 30.

  The processing unit 20a, the operation determination unit 20b, and the management unit 20c may be configured as hardware, or the control unit 20 may be configured as the processing unit 20a and the operation determination unit 20b (further, if necessary, the management unit 20c). It may be configured as software (operation control program) that functions as the CPU 21 and the CPU 21 may execute the operation control program.

  The storage unit 30 is configured by a memory, an HDD (Hard Disk Drive), an SSD (Solid State Drive), or the like, and stores information on the contents of operations performed on the operation unit 50 and objects displayed on the display unit 40. In addition, the object management table, the touch management table, and the like are stored.

  The display unit 40 includes an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) display, and the like, and provides a shared work area where a plurality of operators can operate the object. The operation unit 50 includes a touch sensor composed of grid-like electrodes arranged on the display unit 40, hard keys, and the like, and accepts user operations. And the display part 40 and the operation part 50 comprise a touch panel, and the signal according to the touch operation on a touch panel is output to the operation determination part 20b.

  Hereinafter, an object operation control method using the object operation system 10 configured as described above will be described. The CPU 21 executes the processing shown in the flowcharts of FIGS. 4A and 4B by developing the operation control program stored in the ROM 22 or the storage unit 30 in the RAM 23 and executing it. 4 (a) and 4 (b) are diagrams showing a series of processes, which are separated for the sake of drawing. In the following flow, a plurality of objects are displayed in advance on the display unit 40 (touch panel), and the user operates the objects on the touch panel using two fingers. In addition, it is assumed that information on the object displayed on the display unit 40 (touch panel) is registered in advance in the object management table.

  First, when the operation determination unit 20b detects the touch of the first finger based on the signal from the operation unit 50 (S101), the first finger attribute (time when the touch is detected, finger number, touch the finger) (S102), the management unit 20c registers the specified finger attribute in the touch management table. Next, the operation determination unit 20b, based on the object management table stored in advance in the storage unit 30, information on each object displayed on the display unit 40 (object number, position (coordinate), size, etc.). Is acquired (S103). Then, the operation determination unit 20b determines whether the touch position of the first finger is on any object based on the position and size of the object and the touch position of the first finger (S104). . If the touch position of the first finger is not on the object, it is not necessary to operate the object, and the process ends.

  On the other hand, when the touch position of the first finger is on any object, the management unit 20c registers the object in the touch management table. Next, when the operation determination unit 20b detects the touch of the second finger based on the signal from the operation unit 50 (S105), the operation determination unit 20b determines the attribute of the second finger (time when the touch is detected, finger number, finger). The touched position (coordinates, etc.) is specified (S106), and the management unit 20c registers the specified finger attribute in the touch management table.

  Next, the operation determination unit 20b calculates the interval between fingers (distance between the touch position of the first finger and the touch position of the second finger) based on the identified finger attribute, and the interval between the fingers is calculated. It is determined whether or not it is equal to or greater than a predetermined threshold (S107), and the management unit 20c registers the calculated interval between fingers in the touch management table. When the interval between the fingers is less than the threshold, the operation determination unit 20b calculates the time interval (the difference between the times when the first and second fingers are detected) at which the finger is detected based on the specified finger attribute, It is determined whether the time interval at which the finger is detected is equal to or greater than a predetermined threshold (S108).

  Note that the interval between fingers or the time interval at which a finger is detected is compared with a threshold value, for example, when a plurality of users operating an object on the touch panel touch the touch panel. This is to prevent erroneous determination that the operation is an enlargement / reduction operation or deformation operation on a predetermined object. In addition, even when one user operates an object on the touch panel, for example, when a hand opposite to the hand operating the object touches the touch panel without intention, the touch is predetermined. This is to prevent erroneous determination that the operation is an enlargement / reduction operation or deformation operation on the object.

  When the interval between fingers is equal to or greater than the threshold (Yes in S107) or the time interval when the finger is detected is equal to or greater than the threshold (Yes in S108), the operation determination unit 20b is not an enlargement / reduction operation or a deformation operation by the same person ( It is determined that the second finger touch is a touch of another user or a touch not intended by the user (S115), and the management unit 20c registers the determination result in the touch management table. Then, the processing unit 20a performs processing for one finger (processing such as movement and deletion of an object touched by the first finger) (S116), and ends a series of processing.

  On the other hand, when the interval between fingers is less than the threshold (No in S107) and the time interval when the finger is detected is less than the threshold (No in S108), the operation determination unit 20b performs an appropriate scaling operation or deformation by the same person. It is determined that the operation is performed (S109), and the management unit 20c registers the determination result in the touch management table. Then, the operation determination unit 20b determines whether the touch of the second finger is on the object touched by the first finger (S110). If the touch of the second finger is not on the object, the operation determination unit 20b determines that only one finger is in contact with the object (specific expansion / contraction operation or deformation operation), and the expansion / contraction rate is determined. α is applied (S111), and if the touch of the second finger is on the object, it is determined that a plurality of fingers are in contact with the object (normal scaling operation or deformation operation), and the scaling ratio As a result, β different from α is applied (S112). The magnitude relationship between α and β will be described later. Further, when the magnification is not changed between the normal enlargement / reduction operation or deformation operation and the specific enlargement / reduction operation or deformation operation, the steps of S110 to S112 can be omitted.

  Thereafter, when the operation determining unit 20b detects a change in the interval between two fingers (S113), the operation determining unit 20b notifies the processing unit 20a of the change amount and the enlargement / reduction ratio, and the processing unit 20a determines the interval between the two fingers. The magnification calculated based on the change amount (distance increase / decrease amount or distance ratio), or the magnification calculated based on the change amount of the interval between the two fingers is multiplied by the scaling factor α or β. The enlargement / reduction processing or deformation processing of the instruction target object is performed at the magnification (S114), and the series of processing ends.

  FIG. 5 shows a case where, in the above flow, the operation determination unit 20b determines whether or not the finger touch is on the object, or whether or not the interval between fingers or the time interval at which the finger is detected is equal to or greater than a threshold value. It is an example of the management table referred when determining. As shown in FIG. 5A, when the predetermined position on the screen of the display unit 40 is the origin (here, the lower left of the screen is the origin), the object is identified in the object management table shown in FIG. 5B. The object number, the position (coordinates) on the screen of each object, and the vertical and horizontal sizes of each object are stored in association with each other. As shown in FIG. 5B, the object 1 (the object “A” in the figure) has coordinates (here, the coordinates at the lower left of the object) of (20, 40), and the size is 10 × in the vertical and horizontal directions. It turns out that it is ten. In addition, although the unit of a position and a magnitude | size is arbitrary, it is mm, for example.

  In addition, the touch management table shown in FIG. 5C includes a time when a finger is detected, a finger number for managing the detected finger in time series, and a position (coordinates) on the screen where the finger is detected. The determination result of whether or not the finger is on the object, the specified object for identifying the object on which the finger is placed, and the interval between the finger on the object and the finger outside the object are stored in association with each other Is done. FIG. 5C shows that the first finger touches the object 1 and then the second and third fingers touch outside the object.

  Using the detected time interval and finger interval stored in the touch management table, the operation determination unit 20b determines whether the object 1 is an enlargement / reduction operation or a deformation operation. For example, if the detected time interval threshold is 5 seconds, the time interval between finger 1 and finger 2 is 3 seconds, and the time interval between finger 1 and finger 3 is 6 seconds. It is determined that an enlargement / reduction operation or deformation operation for the object 1 is instructed, and it is determined that the finger 3 is not involved in the expansion / reduction operation or deformation operation for the object 1. Further, when the threshold between fingers is set to 50 mm, the interval between fingers 1 and 2 is 21 mm, the interval between fingers 1 and 3 is 76 mm, and the interval between fingers 2 and 3 is 60 mm. And the finger 2 determine that the enlargement / reduction operation or deformation operation for the object 1 is instructed, and it is determined that the finger 3 is not involved in the expansion / contraction operation or deformation operation for the object 1.

  As described above, when one finger is placed on the object and another finger is placed outside the object, when the interval between the fingers or the detected time interval is less than the threshold value, Since it is determined that the operation is a deformation operation and a different enlargement / reduction ratio is set than when two fingers are placed on the object, the object enlargement / reduction process or deformation process can be performed easily and appropriately. The object operation control method according to this embodiment will be described below with a specific example.

  FIG. 6 shows an operation for enlarging the “A” object when one object (an object described as “A”) is displayed on the screen. When a plurality of fingers (here, two thumbs and an index finger) are touched on the screen, the operation determination unit 20b determines whether the interval between the fingers is equal to or greater than a threshold or whether the time interval at which the finger is detected is equal to or greater than the threshold. If the interval between the fingers and the time interval when the fingers are detected are less than the threshold, it is determined that the object operation is appropriate by the same person. Then, the operation determination unit 20b determines whether one of the two fingers is on the object and the other one is outside the object (upper center in the figure), and whether the two fingers are on the object ( (Lower center in the figure) is determined, and the enlargement / reduction ratio is set to α or β according to the determination result. The values of α and β can be set as appropriate according to the size of the object, the size of the touch panel, and the like.

  Thereafter, the processing unit 20a performs an enlargement / reduction process (here, enlargement process) of the object “a” with a change amount calculated based on the change amount of the interval between two fingers or the change amount and the enlargement / reduction ratio. . For example, if one is on the object and the other is outside the object, it is magnified by multiplying the amount of change in the distance between fingers by the scaling factor α (upper right in the figure). Is on the object, it is enlarged at a magnification obtained by multiplying the change amount of the interval between fingers by the enlargement / reduction ratio β (lower right in the figure).

  Note that when changing the interval between two fingers, the finger touch position outside the object is usually moved, but the finger touch position on the object is moved without moving the finger touch position outside the object. Alternatively, both the finger touch position on the object and the finger touch position outside the object may be moved. The reference position for enlarging the object is arbitrary. For example, the object may be enlarged (enlarged so that the center or corner does not move) based on the center or one corner of the object, The object may be enlarged so that the absolute position (for example, the distance from the lower left corner of the object) with the predetermined position (center and corner of the object) is kept constant, or the finger on the object and the object The object may be enlarged so that the relative positional relationship with the predetermined position (the center or corner of the object) (for example, the ratio of the length from the lower left corner of the object to the length of the diagonal line) is kept constant (hereinafter, This also applies to the specific example of FIG.

  In addition, regarding the magnitude relationship between α and β, considering the case of enlarging an object, when two fingers are placed on the object (normal scaling operation), the interval between the two fingers in the initial state becomes small, Since the distance and distance ratio of the finger can be increased, the object can be greatly enlarged. On the other hand, when one is placed on the object and the other is placed outside the object (specific enlargement / reduction operation), the distance between the two fingers in the initial state increases, and the movement distance and distance of the finger Since the ratio is relatively small, it is difficult to enlarge the object greatly. Accordingly, it can be said that α is preferably larger than β (α> β) so that the object can be greatly enlarged even in a specific enlargement / reduction operation.

  FIG. 7 shows an operation for reducing the “A” object when one object (“A” object) is displayed on the screen, as in FIG. 6. When a plurality of fingers (similarly, two thumbs and an index finger) are touched on the screen, the operation determination unit 20b determines whether the interval between the fingers is equal to or greater than a threshold or whether the time interval at which the finger is detected is equal to or greater than the threshold. If the interval between the fingers and the time interval when the fingers are detected are less than the threshold, it is determined that the object operation is appropriate by the same person. Then, the operation determination unit 20b determines whether one of the two fingers is on the object and the other one is outside the object (upper center in the figure), and whether the two fingers are on the object ( (Lower center in the figure) is determined, and the enlargement / reduction ratio is set to α or β according to the determination result.

  Thereafter, the processing unit 20a performs an enlargement / reduction process (here, reduction process) of the object “a” with a change amount calculated based on the change amount of the interval between two fingers or the change amount and the enlargement / reduction ratio. . For example, if one is on the object and the other is outside the object, it scales down by multiplying the amount of change in the distance between fingers by the scaling factor α (upper right in the figure). Is on the object, it is reduced at a magnification obtained by multiplying the change amount of the interval between fingers by the enlargement / reduction ratio β (lower right in the figure).

  Similarly to the above, when changing the interval between two fingers, the touch position of the finger outside the object may be moved, the touch position of the finger on the object may be moved, or both may be moved. . In addition, the reference position when the object is reduced is also arbitrary. For example, the object may be reduced with reference to the center or one corner of the object, or a predetermined position between the finger on the object and the object (center or angle of the object). The object may be reduced so that the absolute position of the object is constant, and the object is adjusted so that the relative positional relationship between the finger on the object and the predetermined position of the object (the center or corner of the object) is constant. You may reduce (it is the same also in the following specific examples).

  Also, regarding the magnitude relationship between α and β, when the object is reduced, it differs depending on whether the change amount of the distance between fingers is considered as the increase / decrease amount of the distance or the ratio of the distance. When the amount of change in the distance is considered as the amount of increase or decrease in distance, when one is placed on the object and the other is placed outside the object (specific scaling operation), the distance between the two fingers in the initial state increases. Since the movement distance of the finger can be increased, the object can be reduced in size. On the other hand, when two fingers are placed on the object (normal scaling operation), the distance between the two fingers in the initial state is small, and the finger movement distance is relatively small. It becomes difficult to reduce the size. Therefore, in order to enable the object to be reduced in a normal enlargement / reduction operation, it is preferable that β is larger than α (α <β). On the other hand, when the amount of change in the distance between fingers is considered as a ratio of distance, when one is placed on the object and the other is placed outside the object (specific scaling operation), the two fingers in the initial state Since the interval becomes large and the ratio of the distance can be changed gradually, the object size can be easily adjusted. On the other hand, when two fingers are placed on an object (normal scaling operation), the distance between the two fingers in the initial state is small, and if the distance between the two fingers is closer than the initial state, the distance Since the ratio of the change rapidly changes, it is difficult to adjust the size of the object. Accordingly, it is preferable that β is smaller than α (α> β) so that the object can be appropriately reduced even in a normal enlargement / reduction operation.

  As shown in FIGS. 6 and 7, when there is only one object on the screen or when the objects are not dense, even if a plurality of fingers (for example, two fingers, the thumb and the index finger) are touched at the same time, If you touch the thumb and the index finger in the order, or touch the index finger and the thumb, the control of the operation will not change, but if there are multiple objects on the screen and the multiple objects are dense, It may be difficult to place one finger on the desired object and the other finger so as not to overlap all objects. In such a case, the operation can be controlled based on the touch order.

  FIG. 8 shows three objects (objects described as “A”, “I”, and “U”) displayed on the screen, and shows an operation for enlarging the object “A”. First, when the first finger (here, the thumb) is touched on the “A” object, this object is selected as an operation target object (upper right in the figure). After that, the second finger (in this case, the index finger) is touched outside the “A” object (lower left in the figure). Here, the second finger touches the “yes” object, but the setting is made so that the object is not selected by the touch of the second finger. Thereafter, when the second finger (or the first finger) is moved, it is determined that the “a” object is enlarged, and the “a” object is enlarged (lower right in the figure). The same applies when the object is reduced. In this way, by setting only the object touched by the first finger as an operation target, even when a plurality of objects are densely packed, only a desired object can be enlarged and reduced, thereby improving operability. Can be made.

  6 to 8 described the case where the object to be operated is touched with one finger and the outside of the object is touched with one finger. However, the object is touched on and outside the object. The number of fingers is arbitrary. For example, as shown in FIG. 9, one finger (here, thumb) is touched on the object, and a plurality of fingers (here, the index finger and two middle fingers) are touched outside the object, The object can also be enlarged or reduced (the object is enlarged in the figure) by moving the finger (or the finger on the object). In addition, as shown in FIG. 10, a plurality of fingers (here, the index finger and the middle finger) are touched on the object, and one finger (here, the thumb) is touched outside the object. The object can also be enlarged or reduced (the object is enlarged in the figure) by moving the finger (or the finger on the object).

  When touching a plurality of fingers on or outside the object, the position for calculating the interval between the fingers in the touch management table may be the center position (center of gravity position) of the plurality of fingers, The position of any one of the fingers may be set. Further, in FIG. 9, a plurality of fingers are touched outside the object, and in FIG. 10, a plurality of fingers are touched on the object. However, even if a plurality of fingers are touched both on and outside the object, Good. In this way, by performing the enlargement / reduction operation using one or more fingers on the object and one or more fingers outside the object, it becomes possible to use the user's favorite fingers, and freedom of operation. The degree can be increased.

  Note that in a specific enlargement / reduction operation in which the object is touched on and outside the object, the value of the enlargement / reduction ratio α can be changed according to the number of fingers touching the object. For example, by setting the scaling factor α when there are multiple fingers touching the object to a relatively large value, the size of the object can be greatly changed by touching the multiple fingers on the object. And the degree of freedom of operation can be increased.

  6 to 10 illustrate the case where the enlargement / reduction operation is performed using a plurality of fingers of one hand, the enlargement / reduction operation may be performed using a plurality of fingers of two hands. For example, as shown in FIG. 11, one or more fingers (here, one forefinger of the left hand) are touched on the object, and one or more fingers (here, one for the index finger of the right hand) are touched outside the object. ), And the touch position of a finger outside the object (or a finger on the object) can also be moved to enlarge or reduce the object (in the figure, the object is enlarged). In this way, by enabling the enlargement / reduction operation using two hands, the degree of freedom of operation can be increased.

  6 to 11 describe the case where the enlargement / reduction operation is performed using a finger, the enlargement / reduction operation may be performed using means that can be detected by a touch panel such as a stylus pen. For example, as shown in FIG. 12, one or more fingers (here, one of the left index finger) are touched on the object, the stylus pen tip is touched outside the object, and the pen tip (or object top The object can also be scaled (the object is enlarged in the figure) by moving the finger. As described above, the degree of freedom of operation can also be increased by enabling an enlargement / reduction operation using a stylus pen or the like.

  6 to 12, the enlargement / reduction operation is performed by moving the touch position outside the object. However, the operation determination unit 20b determines the enlargement / reduction operation for a finger outside the object (or a finger on the object). If possible, the touch may be continued. For example, as shown in FIG. 13, one or more fingers (here, one thumb) are touched on the object, and one or more fingers (here, one index finger) are touched outside the object. Even when an operation of moving a finger outside the object (or a finger on the object) to release it from the screen, the object can be enlarged or reduced. In this case, the magnification can be set in consideration of the change speed of the interval between fingers instead of the change amount of the interval between fingers or in addition to the change amount of the interval between fingers. In this way, the degree of freedom of operation can be increased by performing the scaling operation even when the finger is moved.

  6 to 12, the object is scaled according to the amount of change in the interval between the touch position on the object and the touch position outside the object, or the magnification calculated based on the amount of change in the interval and the scaling ratio. The object may be scaled based on the position (coordinates) of the finger. For example, as shown in FIG. 14, one or more fingers (here, one thumb) are touched on the object, and one or more fingers (here, one index finger) are touched outside the object. In this case, the object can be enlarged to the touch position outside the object. Thus, by enlarging the object based on the touch position outside the object, the object can be made to have a desired size, and operability can be improved.

  6 to 14 describe the case where the object is enlarged or reduced while maintaining the aspect ratio of the object, the object may be deformed based on the moving direction of the finger outside the object. For example, as shown in the upper side of FIG. 15, one or more fingers (here, one of the thumbs) are touched on the object, and one or more fingers (here) Then, when one of the index fingers is touched and the finger outside the object is moved in the vertical direction of the object, the object can be deformed in the vertical direction.

  Similarly, as shown in the lower side of FIG. 15, one or more fingers (here, one of the thumbs) are touched on the object, and one or more fingers are placed on the right outside (or outside the left) of the object. When touching (here, one index finger) and moving a finger outside the object in the left-right direction of the object, the object can be deformed in the horizontal direction. In this way, by deforming the object in that direction based on the moving direction of the touch position outside the object, the object can be formed into a desired shape, and operability can be improved.

  6 to 15 show the states before and after the enlargement / reduction and deformation of the object, the processing unit 20a also displays the state during the enlargement / reduction or deformation of the object on the display unit 40 (animation display). You may do it. In this way, by displaying the state during the enlargement / reduction or deformation of the object, it is possible to notify the user other than the operator of the object that the object is being operated, and when a plurality of users operate the object at the same time. It is possible to prevent complicated operation.

  In addition, this invention is not limited to the said Example, The structure and control can be changed suitably, unless it deviates from the meaning of this invention.

  For example, in the above embodiment, the object enlargement / reduction operation and the deformation operation are described. However, the control of the present invention can be applied to other operations such as an operation of rotating the object.

  Moreover, although the said Example demonstrated on the premise of the shared screen in which several users can operate an object simultaneously, the object operation system of this invention should just be an apparatus which has a touch panel, for example, has a touch panel. The present invention can be similarly applied to personal computers, portable terminals such as tablet terminals and smartphones, and the like.

  In the above embodiment, the object is described as a rectangular figure, but the form of the object is arbitrary, and the present invention is similarly applied to a figure, image, photograph, text, etc. of any shape. Can do.

  The present invention relates to a system capable of operating objects such as characters and graphics, in particular, a system in a system capable of joint operation by a plurality of operators, an operation control program that operates in the system, and a recording in which the operation control program is recorded The present invention can be used for a medium and an operation control method for controlling an operation of an object in the system.

DESCRIPTION OF SYMBOLS 10 Object operation system 20 Control part 20a Processing part 20b Operation determination part 20c Management part 21 CPU
22 ROM
23 RAM
30 storage unit 40 display unit 50 operation unit

Claims (24)

A touch panel that displays objects operably,
A control unit for controlling the touch panel,
The controller is
When one or more touches on the predetermined object and one or more touches outside the predetermined object are detected, a first operation for instructing enlargement / reduction or deformation of the predetermined object is performed. An operation determination unit that determines that
When it is determined that the first operation has been performed, the predetermined object is enlarged / reduced or deformed based on the touch position on the predetermined object and the touch position outside the predetermined object. A processing unit ,
Wherein the processing unit, based on the touch position on the predetermined object, to the touch position outside the predetermined object, expand or deform the predetermined object,
An object operation system characterized by that. A touch panel that displays objects operably,
A control unit for controlling the touch panel,
The controller is
When one or more touches on the predetermined object and one or more touches outside the predetermined object are detected, a first operation for instructing enlargement / reduction or deformation of the predetermined object is performed. An operation determination unit that detects a change in an interval between the touch position on the predetermined object and the touch position outside the predetermined object;
When it is determined that the first operation has been performed, the predetermined object is enlarged based on a change amount of an interval between the touch position on the predetermined object and the touch position outside the predetermined object. A processing unit that reduces or deforms,
The operation determination unit determines that a second operation for instructing enlargement / reduction or deformation of the predetermined object is performed when a plurality of touches on the predetermined object are detected, and the first operation is performed. A ratio for enlarging / reducing or deforming the predetermined object is set to a different value between the operation and the second operation,
The processing unit enlarges / reduces or deforms the predetermined object based on the change amount of the interval and the ratio.
An object operation system characterized by that . Wherein the processing unit, as incurred in the destination position of the destination and / or touch position outside the predetermined object touch position on the predetermined object, enlarging / reducing or deforming the predetermined object ,
The object operation system according to claim 2, wherein: The operation determination unit sets the ratio of the first operation to a value larger than the ratio of the second operation when enlarging the predetermined object.
The object operation system according to claim 2 or 3 , wherein In the case where the operation determining unit reduces the predetermined object, when the change amount of the interval is set as a decrease amount of the distance, the ratio of the first operation is set to a value smaller than the ratio of the second operation. And when the amount of change in the interval is a distance ratio, the ratio of the first operation is set to a value larger than the ratio of the second operation.
The object operation system according to claim 2 or 3, wherein The operation determination unit compares an interval between a touch position on the predetermined object and a touch position outside the predetermined object with a predetermined threshold,
The processing unit enlarges / reduces or deforms the predetermined object when the interval is less than the threshold.
The object operation system according to claim 1 , wherein the object operation system is an object operation system. The operation determination unit compares a time interval between a touch time on the predetermined object and a touch time outside the predetermined object with a predetermined threshold,
The processing unit enlarges / reduces or deforms the predetermined object when the time interval is less than the threshold.
The object operation system according to any one of claims 1 to 6, wherein The processing unit displays a state on the touch panel while enlarging / reducing or deforming the predetermined object.
The object operation system according to claim 1, wherein the object operation system is an object operation system.   An object operation control program that operates in a control unit that controls a touch panel that displays objects in an operable manner,
  In the control unit,
  When one or more touches on the predetermined object and one or more touches outside the predetermined object are detected, a first operation for instructing enlargement / reduction or deformation of the predetermined object is performed. A first process for determining that
  When it is determined that the first operation has been performed, the predetermined object is enlarged / reduced or deformed based on the touch position on the predetermined object and the touch position outside the predetermined object. Execute the second process,
  In the second process, the predetermined object is enlarged or deformed to a touch position outside the predetermined object with reference to the touch position on the predetermined object.
  An object operation control program characterized by the above.   An object operation control program that operates in a control unit that controls a touch panel that displays objects in an operable manner,
  In the control unit,
  When one or more touches on the predetermined object and one or more touches outside the predetermined object are detected, a first operation for instructing enlargement / reduction or deformation of the predetermined object is performed. A first process for detecting a change in an interval between a touch position on the predetermined object and a touch position outside the predetermined object;
  When it is determined that the first operation has been performed, the predetermined object is enlarged based on a change amount of an interval between the touch position on the predetermined object and the touch position outside the predetermined object. / Perform the second process to reduce or deform,
  In the first process, when a plurality of touches on the predetermined object are detected, it is determined that a second operation for instructing enlargement / reduction or deformation of the predetermined object is performed, and the first operation is performed. A ratio for enlarging / reducing or deforming the predetermined object is set to a different value between the operation and the second operation,
  In the second process, the predetermined object is enlarged / reduced or deformed based on the change amount of the interval and the ratio,
  An object operation control program characterized by the above. In the second process, the predetermined object is enlarged / reduced or deformed so as to cover the position of the touch position on the predetermined object and / or the position of the touch position outside the predetermined object. To
The object operation control program according to claim 10 . In the first process, when the predetermined object is enlarged, the ratio of the first operation is set to a value larger than the ratio of the second operation.
The object operation control program according to claim 10 or 11, characterized in that In the first process, when the predetermined object is reduced, the ratio of the first operation is set to a value smaller than the ratio of the second operation when the change amount of the interval is set as a decrease amount of the distance. And when the amount of change in the interval is a distance ratio, the ratio of the first operation is set to a value larger than the ratio of the second operation.
The object operation control program according to claim 10 or 11 , characterized in that In the first process, an interval between the touch position on the predetermined object and the touch position outside the predetermined object is compared with a predetermined threshold value,
In the second process, when the interval is less than the threshold value, the predetermined object is enlarged / reduced or deformed,
14. The object operation control program according to claim 9 , wherein the object operation control program is any one of claims 9 to 13 . In the first process, a time interval between a touch time on the predetermined object and a touch time outside the predetermined object is compared with a predetermined threshold value,
In the second process, when the time interval is less than the threshold, the predetermined object is enlarged / reduced or deformed,
15. The object operation control program according to claim 9 , wherein the object operation control program is any one of claims 9 to 14 . In the second process, a state in the middle of enlarging / reducing or deforming the predetermined object is displayed on the touch panel.
16. The object operation control program according to claim 9 , wherein the object operation control program is any one of claims 9 to 15 .   An object operation control method in a system comprising a touch panel that displays an object in an operable manner and a control unit that controls the touch panel,
  When one or more touches on the predetermined object and one or more touches outside the predetermined object are detected, a first operation for instructing enlargement / reduction or deformation of the predetermined object is performed. A first process for determining that the
  When it is determined that the first operation has been performed, the predetermined object is enlarged / reduced or deformed based on the touch position on the predetermined object and the touch position outside the predetermined object. Executing a second process;
  In the second process, the predetermined object is enlarged or deformed to a touch position outside the predetermined object with reference to the touch position on the predetermined object.
  An object operation control method characterized by the above.   An object operation control method in a system comprising a touch panel that displays an object in an operable manner and a control unit that controls the touch panel,
  When one or more touches on the predetermined object and one or more touches outside the predetermined object are detected, a first operation for instructing enlargement / reduction or deformation of the predetermined object is performed. A first process for detecting a change in an interval between a touch position on the predetermined object and a touch position outside the predetermined object;
  When it is determined that the first operation has been performed, the predetermined object is enlarged based on a change amount of an interval between the touch position on the predetermined object and the touch position outside the predetermined object. Executing a second process that reduces or deforms,
  In the first process, when a plurality of touches on the predetermined object are detected, it is determined that a second operation for instructing enlargement / reduction or deformation of the predetermined object is performed, and the first operation is performed. A ratio for enlarging / reducing or deforming the predetermined object is set to a different value between the operation and the second operation,
  In the second process, the predetermined object is enlarged / reduced or deformed based on the change amount of the interval and the ratio,
  An object operation control method characterized by the above.   In the second process, the predetermined object is enlarged / reduced or deformed so as to cover the position of the touch position on the predetermined object and / or the position of the touch position outside the predetermined object. To
  The object operation control method according to claim 18, wherein:   In the first process, when the predetermined object is enlarged, the ratio of the first operation is set to a value larger than the ratio of the second operation.
  20. The object operation control method according to claim 18 or 19, wherein: In the first process, when the predetermined object is reduced, the ratio of the first operation is set to a value smaller than the ratio of the second operation when the change amount of the interval is set as a decrease amount of the distance. And when the amount of change in the interval is a distance ratio, the ratio of the first operation is set to a value larger than the ratio of the second operation.
20. The object operation control method according to claim 18 or 19, wherein: In the first process, an interval between the touch position on the predetermined object and the touch position outside the predetermined object is compared with a predetermined threshold value,
In the second process, when the interval is less than the threshold value, the predetermined object is enlarged / reduced or deformed,
The object operation control method according to any one of claims 17 to 21, wherein: In the first process, a time interval between a touch time on the predetermined object and a touch time outside the predetermined object is compared with a predetermined threshold value,
In the second process, when the time interval is less than the threshold, the predetermined object is enlarged / reduced or deformed,
The object operation control method according to any one of claims 17 to 22, wherein the object operation control method is performed. In the second process, a state in the middle of enlarging / reducing or deforming the predetermined object is displayed on the touch panel.
The object operation control method according to any one of claims 17 to 23, wherein:

Images