JP6141290B2 - Interaction by acceleration of multi-pointer indirect input device - Google Patents

Description

  One embodiment of the present invention relates to interaction by acceleration of a multi-pointer indirect input device.

  Manual input devices used for computing system navigation and spatial control have a significant impact on the functionality of the computer system and the overall user experience. There are multiple types of manual input devices. The most common personal computers include a single pointer indirect interaction type device such as a mouse and a touch pad, and a direct interaction type device such as a touch screen.

The single pointer indirect interaction type device sensor detects user interaction with the sensor and associates this interaction with a position on the display. One way to make the input point correspond to the display is to display the sensor extents display extents.
of the display), this is called absolute correspondence. An example of an apparatus that uses absolute correspondence is a pen touch type digitizer. Another method involves correspondence of the device sensor coordinates to the movable parts of the display, which is called relative correspondence.

  Examples of devices that use relative correspondence include mice and devices that emulate mice, such as trackpads. The mouse detects movement based on the detected interaction with the device and moves the virtual start point by a certain distance. The trackpad is generally used in the same way as a mouse. The movement of the contact to the trackpad is detected, and the detected movement is processed in the same way as mouse input.

  Direct interaction devices allow interaction with devices that are virtually aligned with the display. The direct interaction type device associates the position on the touch detection surface with the position on the display of the same size by using absolute correspondence. For example, when a user touches a point on the touch screen, an input event triggers an application response, such as command activation, at a location in the user interface corresponding to the point on the display touched by the user.

  The absolute and relative mapping of spatial input from multi-pointer input to the display includes physical attributes of the input and display devices, system capabilities, nature and layout of the application user interface, and tasks performed by the user There are advantages and disadvantages depending on the type and various ergonomic factors.

  For example, in the relative mapping mode, the input device sensor extends over only a portion of the target display coordinate space. Therefore, navigation from one display position to another display position can include multiple strokes unless movement of the input point is detected and some form of acceleration of that point is used. Conversely, some form of deceleration at that point can be used to achieve pixel-level, point-to-point target accuracy. Such acceleration and deceleration may be referred to as “pointer trajectory”. As another example, in the absolute mapping mode, the input sensor may have a much lower resolution and a significantly different aspect ratio relative to the display coordinate space. Therefore, achieving accuracy in pixel-level point-to-point navigation is difficult without some form of positive and / or negative acceleration.

  In this section, some of the concepts described in detail in the detailed description of the invention will be selected and briefly described. This section does not identify key features or essential features of the claimed subject matter, nor does it limit the scope of the claimed subject matter.

An indirect interaction type input device includes one or more input sensors. Each sensor can detect and provide a plurality of input points. Various multi-point input sensing techniques are known in the art, including but not limited to capacitive, resistive, and pressure touch sensors, optical sensors, and motion video skeletal tracking systems. The calculations applied to the mapping of sensor input points to outputs such as displays can be found in how the sensor determines input points (other than discrete positions in a two-dimensional coordinate space) and how the input points are detected. Do not depend. For example, a touch sensitive sensor can provide data indicating two or more locations where a user in the coordinate space is touching the sensor. Such a sensor may have a square shape, but may have other shapes. The sensor looks like a trackpad, but does not track the movement of a single point, but detects multiple points touched by the user. These multiple points are associated with multiple points on an output device such as a display.

  However, multiple input points make it difficult to manage the application of the pointer trajectory and the resolution difference between the input sensor and the target display. For this reason, the characteristics of a plurality of points are specified and used to adjust the correspondence between the points. For example, one way to solve this problem is to identify the input point that has the least displacement from the previous frame, from the previous position, or from the reference point. This displacement is used to adjust the correspondence of a set of input points from the sensor to the corresponding display coordinates.

  Accordingly, in one aspect, information indicating an input point on a multi-pointer indirect input type device sensor is received in a memory. The input point is associated with a position in the display coordinate space for display. Determine the displacement of the input point between the two time points. The input point association is corrected according to the determined displacement. A plurality of points are displayed on the display by the corrected association of the input points.

  In the following description, reference is made to the accompanying drawings, which illustrate, by way of illustration, specific examples of the present technique that form part of the present technique. Needless to say, other embodiments may be used and structural changes may be made without departing from the scope of the present disclosure.

It is a block diagram which shows the system using a multipointer indirect input device. 6 is a flowchart illustrating one embodiment of a viewport arrangement. It is a flowchart which shows one Embodiment of input matching. It is a flowchart which shows other one Embodiment of input matching. It is a flowchart which shows one Embodiment of input acceleration. It is a flowchart which shows one Embodiment of span adjustment. FIG. 6 is a block diagram illustrating an example computing device that can implement such a system.

  The following section describes an example operating environment in which a multi-pointer, indirect input device can be used.

  Referring to FIG. 1, a computer system 100 includes a multi-pointer indirect input device 102 having sensors connected to a computer platform 104 (an example of which will be described in detail later). Such computer systems can be personal computers, home entertainment systems, projectors, kiosk applications, small personal electronics, and the like. The computer platform has an operating system that manages the interaction between one or more applications 108 and the resources of the computer platform 104 (peripheral devices including the multi-pointer indirect input device of the computer platform 104).

  In the operating system, data describing a plurality of detected input points 110 is received from a sensor of the multi-pointer indirect input device 102. These input points are processed and associated with points on the display 120.

  This mapping process determines the initial mapping of the device coordinate system to the display coordinate system, which may be relative or absolute, and then maps each point from the device coordinate system to the display coordinate system. To decide. Such initial association is performed at the beginning of each input session.

  The input session is from the time when the first input is detected by the sensor to the time when the last input disappears from the sensor. The input points are easy to move during the input session. The input point is associated from the new position in the sensor coordinate system to the corresponding new position in the display coordinate system. This motion association can take into account problems such as bounding and acceleration.

As shown in FIG. 1, at the beginning of the input session, a plurality of points 110 are input to the viewport selection module 130. The viewport selection module provides the viewport size and position 132 in the display coordinate system as its output. The viewport determines an area in the display coordinate space to which the sensor coordinate space is mapped. In configurations where multiple device sensors are connected to the system, each sensor has its own viewport. The viewport may have a shape that corresponds to the shape of the input device sensor. However, in some implementations, the viewport may have a different aspect ratio and direction than the sensor, and even a different shape. For example, an elliptical sensor may be associated with a rectangular viewport. The shape of the viewport is generally determined by the host system, but may be determined by the device or the user. The size and position of the viewport is calculated when user input is detected by the sensor. If no user input is detected by the sensor, the size and position of the viewport is not fixed. Viewports are generally not displayed to the user. Overall, the shape, size and position of the viewport represent the correspondence of the sensor coordinate system to the display coordinate system. The setting 134, which will be described in detail later, determines how to perform this association by relative or absolute association.

  The plurality of points 110 are input to the input association module 140 by an input session. The input association module provides a plurality of points 142 in the display coordinate system as its output. The setting 134, which will be described in detail later, by interpreting the relative input position, determining the reference position of the device and display, etc. to apply the input motion acceleration, span adjustment, and constraints, etc. Determine how each point is associated.

  The plurality of points 142 can be displayed on the display when associated with the display coordinate system. Each point is similar to a single point, for example, for selecting a displayed item, or from a direct touch input sensor that performs zooming, rotation, or movement of an element in a host system user interface, for example. As with multiple points, it can be processed by operating system 106 and / or application 108. The possible range of use of multipoints associated with a display does not limit the invention.

  In this case, with reference to FIG. 2, FIG. 3 and FIG. 4, an embodiment of associating multiple points with a display will be described in more detail.

  In FIG. 2, the flow chart describes an embodiment of how the viewport size and position can be selected by the viewport selection module and how multiple points can be associated.

  It should be noted that the following embodiments are based on design decisions regarding the desired user experience. For example, assume that the relative position of each physical point to another physical point is retained when projected onto the display. Also assume that the distance between all inputs is scaled symmetrically.

  Another aspect of the user experience is the type of association between the input device and the display. There are relative and absolute mappings, and each axis may be independent. For example, relative association may be applied to the y axis, and absolute association may be applied to the x axis, or vice versa. Also, different relative mappings can be used for both axes. Also, the association may be based on logical coordinates or based on the physical dimensions of the input device and the display. When the association is based on the physical dimensions of the device, it increases the spatial accuracy and provides a more intuitive and recognition efficient interface. These decisions regarding the type of association may be arbitrary settings in the system.

  Another aspect of the user experience is a constraint policy. Specifically, device input can be conditional on the system's display constraint policy. For example, all device inputs may be forced to remain in the display, or only one device input may be forced to remain in the display. In another embodiment, no constraint policy is used. These decisions regarding constraint policies may be optional settings in the system.

  The viewport size and position are determined at the beginning of each input session. For example, if one or more input points are detected by the sensor after a period of no user input, the start of an input session is detected (200). The dimensions of the viewport for each axis can be determined by the input device, host system, or user. This dimension is expressed as a percentage of the target display device or in physical distance units. When using physical distance units, the physical and logical (coordinate) ranges of both the input sensor and the display are provided, for example, by device, user input, or other means. The position of the output locator in the display coordinate space is read (201). In this embodiment, the location of the output locator is global for the user session (beginning with user login and ending with user logoff). The output locator position is shared and updated between a plurality of single pointer input devices and multi-pointer input devices connected to the system. The output locator may be a location saved in a previous input session. If there is no prior input session, the center of the display device, the final position of the mouse or other device, or another default display position is used as the output locator position.

  Next, given the known parameters of the display and input devices, i.e. coordinates and boundaries, the scaling factor for each axis is determined (202). These parameters are typically stored in memory. In the case of a display device, the parameters can be read using the system API. In the case of an input device, the parameters can be read by device interrogation. If there are coordinates and bounds between the display device and the input device, the scaling factor is determined. When absolute mapping is used, calculations based on physical ranges are not necessary. The x-axis and y-axis scale factors are based on a one-to-one ratio of the device and display coordinate ranges. When using relative mapping, the x-axis and y-axis scale factors are determined by the ratio of device dimensions to viewport dimensions in display coordinates. The scale factor is calculated once, stored in memory, and read out as needed.

  The viewport range in the display coordinate space, i.e., the x and y coordinates of the vertices, is determined using the determined scale factor (203). The viewport range is first determined for the input session using the saved output locator before the new output locator is calculated as follows.

For viewports scaled using the pixel density of the display, the scale factor SV is non-zero, a positive value between 0 and 1, and the viewport range is
Rv =
{LV0x-SVx / [2 * extent (RDx)],
LV0x + SVx / [2 * extent (RDx)],
LV0y-SVy / [2 * extent (RDy)],
LV0y + SVy / [2 * extent (RDy)]},
Where LV0 is the initial viewport locator, typically the center of the target display, SV is the scale factor, and the range (RD) is the x and y coordinate range of the display, ie pixel width and height. Yes, the subscripts x and y indicate values on the x-axis and the y-axis.

For viewports that use physical dimensions, the desired size SV is non-zero, positive, not larger than the physical range of the target display, and the pixel density D of the display can be determined by hardware query, The range of
Rv =
{[LV0x-SVx / [2 * extent (RDx)]] * Dx + RDx. left,
[LV0x + [SVx / [2 * extent (RDx)]] * Dx + RDx. left,
[LV0y- [SVy / [2 * extent (RDy)]] * Dy + RDy. top,
[LV0y + SVy / [2 * extent (RDy)]] * Dy + RDy. top}.

  Given the initial range of the viewport, a sensor locator is initially determined in the device coordinate system (204). There are many ways to select a sensor locator, and the method is selected according to the desired user interaction. For example, when one input is detected by the sensor, the sensor locator may be the coordinates of this one input. If there are multiple inputs, the sensor locator may be the location of one “primary” input, or it may be a point related to other inputs, for example the geometric center of all points. If no input point is detected, the sensor locator is not established and does not persist between input sessions.

  When using the position of a primary input as a sensor locator, the input can be selected and assigned as the primary using various methods. In general, a “primary” input is an input point selected by any method. For example, the primary input may be the first or last input detected in the session. This method has the disadvantage of having to force a random selection when there are multiple inputs at the same time. The solution is to select the primary input by some form of geometric order, for example by the highest order input by a geometric sorting equation. For example, the sorting equation can sort the angle formed by each input point with respect to the origin at the geometric center of all inputs and reference points. The reference point can be, for example, a vertical line having an angle measured based on the user's dominant hand.

  Regardless of the method, the determination of the sensor locator is affected by the arrival and departure times of the inputs. As a protection against situations where the user wants to touch or release multiple inputs at the same time but touches or releases at slightly different times, a short time window (eg, 10-60 ms) may be used to delay the calculation of the sensor locator. it can.

  Next, a sensor locator is associated from the device coordinates to the display coordinates (205). The result is the new output locator position of the frame. This position can be calculated by the formula [LS / extent (RS) * extent (RV)] + RV0. Where LS is the x or y coordinate of the sensor locator, extent (RS) is the width or height of the sensor coordinate space, extent (RV) is the width or height of the viewport, and RV0 is the initial view The width or height of the port. This new output locator is constrained within the boundaries of the display.

  Given a new output locator, the viewport is placed in the display coordinate space by obtaining the viewport locator (206). For the first frame of the session, the viewport position is determined. In subsequent frames, the position is read from memory. The position of the viewport is determined logically. That is, whether or not to display the viewport is arbitrary. In fact, in most embodiments it would be preferable not to display the viewport.

As described above, the viewport is a projection of the input sensor coordinate space on the display, and the viewport locator position is the geometric center of the viewport in display coordinates. As described above, unlike the output locator, the viewport is not determined unless the input is detected by a sensor. The viewport is associated with a device instance (not global to the user session) and its position is updated when the user first enters on the sensor. When an input session begins, the viewport is stationary between frames until the input session ends. If the frame indicates the continuation of the input session (the list of inputs for both previous and current frames is not empty), the viewport locator is read from memory. If the frame is the beginning of a new input session, the viewport locator determines the offset between the sensor locator (determined in step 205) and the output locator position (determined in step 201) by can get.
ΔLD = LD-LD0
LV = [LS / extent (RS) * extent (RV)] + LV0 + ΔLD
The LV is constrained to the target display boundary and the determined viewport range is recalculated using the new viewport locator.

  After calculating the sensor locator, the viewport locator, and the output locator for the frame, the sensor input for that frame is mapped to display coordinates (208), as will be described in more detail below. As determined at step 210, when the input session ends, information about the input session (such as the last output locator) is saved (212). If the input session has not ended and an updated sensor input position (determined in step 214) has been received, the process transfers these new inputs to the display from step 204 to determine the sensor locator for that frame. Steps up to step 208 for association are repeated. However, if the frame is part of an ongoing session, the viewport locator is not determined at step 206 and is read from memory.

  Figure 3 shows how a sensor input is mapped to a point in the viewport given the size and position of the viewport, and the boundary conditions on a single display (when the associated mapping is made) It is shown including the compulsory. FIG. 3 shows the case where all inputs are constrained to be in the display.

  The system receives a list of input points from the device (300). Each input point has coordinates in the device coordinate space. Next, the input point is associated with a corresponding point in the display coordinate space (302). For example, the coordinate CD in the display coordinate space of the device coordinate space midpoint CS can be calculated by [CS / extent (RS) * extent (RV)] + RV.

A bounding box including the input point is determined (304). The corners of the bounding box are matched to the visible range of the display and compared (306) . Corners of the bounding box on the outside of the area overlooking the de Isupurei is when there is no one input correspondence is maintained (310). Otherwise, determine the offset to move the bounding box within the visible range of the display (312). In calculating the minimum relief offset, the displacement vector or individual input between each non-conforming angle in the input bounding box and the current frame establishes the path and the intersection of its visible display boundaries. The relief offset is the displacement between the origin of the path and the intersection. This offset is applied to the input point to re-associate it with a new position in the visible area of the display.

  In another embodiment, at least one input point from the device is constrained to remain displayed. In FIG. 4, the system receives a list of input points from the device (400). Each input point has coordinates in the device coordinate space. Next, the input point is associated with a corresponding point in the display coordinate space (402). A bounding box including the input point is determined (404). The bounding box corners are compared (406) to the visible range of the display. If at least one corner of the bounding box is in the visible area of the display, the input association is maintained (410). Otherwise, a relief offset that moves at least one point of the bounding box within the visible range of the display is determined (412). Next, the input offset closest to the included corner is determined and applied to the relief offset (414). This updated offset is applied to the input point to re-associate it with a new position in the visible area of the display.

  The process is similar for multiple monitor displays. There is a regular display topology where the intersection of the visible areas of the display is a single square “virtual” display with no gaps inside. For regular display topologies, restricting multiple inputs to the boundaries of the virtual display surface is the same as for a single display. There may also be irregular display topologies where the intersection of the visible areas of the display is a linear virtual display with a convex or concave internal clearance. A relief offset can be calculated and applied to these display topologies using the method described above.

  However, another unsuccessful case is to calculate a relief offset by calculating a bounding box that contains only points outside the visible area of the display if the point is in one of the convex or concave internal gaps. Can be used for. In this case, the bounding box is calculated to include input points that are not associated with the visible area of the display. Here, this is called a non-conforming bounding box. Calculate the minimum relief offset that ensures that at least one corner of the non-conforming bounding box is contained within the visible portion of the display. This relief offset is applied to device / display conversion for all inputs.

  More specific embodiments of boundary conditions in the case of multiple monitors will now be described.

  In this example, the target boundary display (RD, target) is determined as follows for each input. First, it is determined whether or not the input position CD is included in the visible region of the virtual display surface. If not included, the display coordinates RD0 of the input of the previous frame are read out. For the frame representing the new session, replace these coordinates with the coordinates of the display containing the output locator position LD. Next, it is determined whether the input CD is constrained by RD0 on either the x-axis or the y-axis. When performing a position test on either axis, the target boundary display is display RD0. Otherwise, the input is beyond the border of display RD0. For this input, a displacement vector ΔSS: ΔSS = CS−CS0 of sensor coordinates is determined. The sensor range extent (RS) is read out. Determine the main axis of displacement. If | ΔSSx / extent (RSx) |> = | ΔSSy / extent (RSy) |, the X-axis is dominant. Otherwise, the Y axis is dominant.

The target boundary display is determined using the main axis of input displacement. If the X axis is dominant, the target boundary display RD is a display that satisfies the following conditions:
1. Input falls within the horizontal range of the display;
2. 2. The target display is the primary direction of movement of the input and shares its boundary with the last display; The last input position is within the vertical range of the display.
If the Y axis is dominant, the target boundary display RD satisfies the following conditions:
1. Input falls within the vertical range of the display;
2. 2. The target display is the primary direction of movement of the input and shares its boundary with the last display; The last input position is within the horizontal range of the display.

  If the target boundary display cannot be determined using the main direction, the search is performed in the non-main direction. If the target boundary display is not yet found, the target display is the display before the input.

  Given a single input target boundary display, the input is fixed to that display and a fixed offset is calculated and stored. A fixed offset is applied to all inputs and the relative distance between the inputs is maintained. After adjusting the input in this way, test everything again to see if it is in the visible part of the display.

  In some interaction modes, there is only a short time to realize the user's intention to make multiple inputs simultaneously with the sensor. When there is an initial input for the session, a timer is started, the input is marked as inactive, sensor locator determination is delayed until the timer expires or is terminated when there is no input. Similarly, the user may make a plurality of inputs simultaneously. A timer can also be used to realize this intention without affecting the position of the sensor locator. A timer is started and the inputs are continuously included in the sensor locator calculation until the timer expires.

  In the above description, multiple input points are directly associated with display coordinates in both relative and absolute association modes. However, in the relative association mode, the input device extends only to a part of the target display coordinate space. Therefore, navigation from one display position to another display position can include multiple strokes if movement of the input point is detected and some form of acceleration of that point is not applied. . Conversely, some form of deceleration at that point can be used to achieve pixel-level, point-to-point target accuracy. Such acceleration and deceleration may be called “pointer trajectory”, but can be applied to a multi-input indirect input device as follows. The displacement of the input points in the input device is taken into account in the mapping of the input points from the device coordinate space to the display coordinate space, and depending on the case, the movement of those points on the display is accelerated or decelerated. In general, a measure of the displacement of the input point is determined. This displacement is an input to a function that determines how to change the association of the input device points to the corresponding display coordinates based on the displacement.

  In one embodiment, the displacement of each input point is determined. The physical displacement at the input sensor pixel with the smallest displacement vector is accelerated curve transformed to produce a single accelerated display displacement. This applies to the output locator and the display displacement of all points. The input of the acceleration function can be either the magnitude of the vector or the value of each axis, and can be input to two different acceleration functions. This embodiment will now be described with reference to FIG.

  First, an input point on an input sensor is received from first and second time points (500). Note that the method of uniquely identifying and tracking a moving or stationary input, known in the art as “input recognition and tracking”, depends on the device and sensor. The present invention is not limited to a particular input recognition and tracking technique. Any recognition and tracking technique deemed appropriate in the art can be used.

  The displacement in device coordinates (ie, pixels) in each dimension of each input within a time is determined (502). If the time is known to be constant, only the displacement can be used. Otherwise, use that time to calculate the speed.

  For each time or “frame” of input, a minimum displacement or speed is identified (504). The input with the smallest magnitude (not the average or maximum) is selected so that the stationary input at the input sensor remains stationary when associated with the display.

  The identified input displacement can be converted from displacement at the pixel to physical displacement using the pixel density of the sensor. Using the displacement value as an input to the acceleration function, the value is converted to an accelerated displacement (506). The present invention is not limited by the particular acceleration equation used. The rational method currently used in this technical field can be used like it is used for acceleration of a mouse pointer. The present invention is generally applicable to acceleration equations that allow independent acceleration of each coordinate axis (x, y, or z). A suitable transformation can be performed using a linear function for each part that maps the displacement value to the accelerated displacement value. The accelerated displacement value can be converted back to pixel coordinates if based on physical dimensions.

  The accelerated displacement is converted to an accelerated displacement in the display coordinate space (508). For example, the conversion can be expressed by the following equation: DCD = DCS / extent (RS) * extent (RV)] + RV. Each input position associated with the display coordinates is adjusted (510) by the accelerated displacement.

  For absolute associated dimensions, a similar method called span adjustment can be used, as described with reference to FIG. In FIG. 6, the displacement of each input from each sensor locator is determined in units of pixels in the device coordinate space (600). A minimum displacement is selected (602). This minimum displacement value is converted to physical dimensions using the pixel density of the device (604). The minimum displacement value in the physical dimension is converted to a span adjustment value using any suitable conversion (606). A suitable transformation may be similar to an acceleration transformation such as a linear function for each part that maps the displacement value to the span adjustment value. This span adjustment value is converted back to a pixel value (608). Similar to acceleration, span adjustment values are converted to display pixel values (610), and each input point is adjusted using that value (612).

  Note that the acceleration and span adjustments to the input points are done before applying boundary conditions that allow the points to remain in the display area where they can be seen.

  Having described the embodiments, a computing environment designed to operate such a system will be described. The following description is a brief general description of a suitable computing environment in which this system can be implemented. The system can be implemented with numerous general purpose or special purpose computing hardware configurations. Examples of suitable well-known computing devices include, but are not limited to, personal computers, server computers, handheld or laptop devices (eg, media players, notebook computers, cellular phones, personal digital assistants, voice recorders), multiprocessors Systems, microprocessor-based systems, set-top boxes, game consoles, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, and the like.

  FIG. 7 illustrates an example of a suitable computing environment. The above computing system environment is merely one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of such a computing environment. No computing environment should be construed as depending on or required by any one or combination of components illustrated in the operating environment above.

  With reference to FIG. 7, an exemplary computing environment includes a computing machine, such as computing machine 700. In its most basic configuration, computing machine 700 includes at least one processing unit 702 and memory 704. The computing device includes a plurality of processing units and / or co-processing units such as additional graphics processing units 720. Depending on the configuration and type of computing device, the memory 704 may be volatile (such as RAM), non-volatile (such as ROM or flash memory), or a combination thereof. . This most basic configuration is indicated by a broken line 706 in FIG. In addition, the computing machine 700 may have additional features and functions. For example, the computing machine 700 may also include additional storage (removable and / or non-removable), including but not limited to magnetic or optical disks or tapes and the like. Such additional storage is illustrated in FIG. 7 by removable storage 708 and non-removable storage 710. Computer storage media includes volatile and nonvolatile, removable or non-removable media implemented in any method or technique for storing information such as computer program instructions, data structures, program modules and other data. . Memory 704, removable storage 708, and non-removable storage 710 are all examples of computer storage media. Computer storage media include RAM, ROM, EEPROM, flash memory and other memory technologies, CD-ROM, digital versatile disk (DVD) and other optical disk storage media, magnetic cassettes, magnetic tape, magnetic disk storage and other magnetic storage devices, or Other, but not limited to, any medium that can be used to store desired information and that can be accessed by computing machine 700. Such computer storage media may be part of computing machine 700.

  The computing machine 700 may also include communication connections 712 that allow the device to communicate with other devices. Communication connection 712 is an example of a communication medium. Communication media typically carry modulated data signals such as carrier waves and computer program instructions, data structures, program modules and other data in other transmission mechanisms and include any information delivery media. The term “modulated data signal” means a signal that has the characteristics set or changed to encode information in the signal, and that changes the structure or state of the device that receives the signal. By way of example, and not limitation, communication media includes wired media such as a priority network and direct priority connection, and wireless media such as acoustic, RF, infrared and other wireless media.

  The computing machine 700 has various input devices 714 such as a keyboard, a mouse, a pen, a camera, and a touch input device. An output device 716 such as a display speaker or a printer may be included. All these devices are well known in the art and need not be described further.

  The system may also be implemented in the general context of software, including computer-executable instructions and / or computer interpreter instructions, such as program modules, being processed by a computing machine. Generally, a program module includes a routine, program, object, component, or data that, when processed by the processing unit, instructs the processing unit to perform a task or implement an abstract data type. Structure etc. are included. The system can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules can be located in both local and remote computer storage media including memory storage devices.

  The terms “product”, “method”, “machine”, and “substance composition” of the preamble of the appended claims refer to the claims and the protection defined by the use of these terms in 35 USC 101. It is limited to be within the scope of the subject matter.

The embodiments described herein can be combined as needed to form additional hybrid embodiments. Needless to say, the subject matter defined in the appended claims is not necessarily limited to the specific embodiments described above. The specific embodiments described above are disclosed by way of example only.

Claims (9)

A computer-implemented method comprising:
For a plurality of frames, receiving information indicating a plurality of input points from a multi-pointer indirect input device into a memory, each input point having a position in a sensor coordinate system; and
Associating the plurality of input points of one frame of the plurality of frames from a position in the sensor coordinate system with a plurality of positions in a display coordinate space of a display;
Determining a displacement of each of the plurality of input points in the one frame of the plurality of frames relative to one or more other points in the other frame of the plurality of frames;
Modifying a plurality of positions in the display coordinate space of the plurality of input points in the one frame of the plurality of frames by the determined displacement;
Selecting a point having the smallest displacement among the plurality of points;
Determining an offset from the smallest displacement;
Adding the offset to the associated position for each input point;
Displaying a plurality of points representing the plurality of input points on the display according to a corrected position of the input point in the display coordinate space. The step of correcting the association includes
Selecting a point having the smallest displacement among the plurality of points;
Applying an offset to a reference point for the plurality of input points with the smallest displacement;
The method according to claim 1, further comprising: determining the position of each input point by an offset from the reference point. The other point of the other frame is the position of the input point in the other frame.
The method of claim 1. The other point in the other frame is a sensor locator of the other frame;
The method of claim 1.   The method of claim 1, wherein the correspondence is adjusted so that a small displacement reduces the displacement of a point from one frame to the next.   The method of claim 1, wherein the correspondence is adjusted so that a large displacement increases the displacement of a point from one frame to the next. The step of modifying the association applies a different acceleration function for each axis;
The method of claim 1. The step of modifying the correspondence applies acceleration according to the magnitude of the displacement;
The method of claim 1. On the computer,
For a plurality of frames, receiving information indicating a plurality of input points from a multi-pointer indirect input device into a memory, each input point having a position in a sensor coordinate system; and
Associating the plurality of input points of one frame of the plurality of frames from a position in the sensor coordinate system with a plurality of positions in a display coordinate space of a display;
Determining a displacement of each of the plurality of input points in the one frame of the plurality of frames relative to one or more other points in the other frame of the plurality of frames;
Modifying a plurality of positions in the display coordinate space of the plurality of input points in the one frame of the plurality of frames by the determined displacement;
Selecting a point having the smallest displacement among the plurality of points;
Determining an offset from the smallest displacement;
Adding the offset to the associated position for each input point;
And displaying a plurality of points representing the plurality of input points on the display according to the corrected positions of the input points in the display coordinate space.

Images