EP0377558A4

EP0377558A4 - Touch screen input system

Info

Publication number: EP0377558A4
Application number: EP19870905859
Authority: EP
Inventors: Langdon R. Wales; H.W. Crowley
Original assignee: Individual
Current assignee: CROWLEY, H.W.; Wales Ruth W Executrix Of Estate Of Wales L
Priority date: 1986-01-03
Filing date: 1987-08-17
Publication date: 1991-11-13
Also published as: EP0377558A1; WO1989001677A1

Abstract

A touch screen input system (10) for use with a display screen (12) having a photo-active display surface including a controllable sweeping beam. The system includes at least one photo-detector (20) in combination with detection circuitry for continuously registering the position of the beam in the display surface. A pointer (26) is adapted to reflect light from the beam to the photo-detector to provide a latch signal which is used to hold a signal identifying display screen location corresponding to pointer means location.

Description

TOUCH SCREEN INPUT SYSTEM

Background of the Invention

The present invention relates in general to a touch screen input system. More particularly, the invention relates to a novel technique for detecting the location of an object and in particular, a pointer or possibly the human finger as associated with a display device such as a cathode ray tube (CRT).

It is highly desirable to be able to automatically locate the pointer reference on a CRT for a man-machine interface. There are various existing techniques described for carrying this out. These techniques include special forms of tablets, many of which employ resistive or capacitive forms of sensing. The various techniques that are described in the literature use technology that is quite cumbersome. Furthermore, the systems are subject to wear and generally have resolution limitations.

Accordingly, it is an object of the present invention to provide an approved touch screen input system which provides an extremely simple form of interface with the display and any associated computer.

Another object of the present invention is to provide an improved touch screen input system which employs a minimum number of components and yet provides good detection resolution.

Still a further object of the present invention is to provide an improved touch screen input system that is not subject to deterioration with normal use.

Still another object of the present invention is to provide a touch screen input system in which there is no requirement for any special purpose pen or pointer. In accordance with the invention, even a standard graphite pencil may be used as a pointer.

Summary of the Invention To accomplish the foregoing and other objects, features and advantages of the invention, there is provided a touch screen input system for use with a display screen having a photo-active display surface including a controllable sweeping beam. In accordance with the invention, a preferred display is a CRT display which employs the standard type of raster scan. In accordance with the invention there is at least one photo-detector means and means for mounting this photo-detector means adjacent the photo-active display surface, but in non-interfering view of the photo-active display surface. The photo-detector means is adapted for placement so as to receive light from the region immediately adjacent the display surface. A pointer means is provided which may actually be the operator's finger, or some type of selection pen. This is adapted to reflect light from the beam to the photo-detector means so as to provide a latch signal. The detection circuitry includes means for continuously registering the position of the beam in the display surface, which circuitry is responsive to the latch signal, and means for continuously registering, for holding, a signal that, identifies the display screen location corresponding to the pointer means location. In accordance with the preferred embodiment of the invention, rather than a single photo-detector means, there are preferably provided, multiple photo-cells, such as four photo-cells, one at each corner of the CRT display directed all converging toward the CRT display. The photo-detectors are preferably connected in parallel to the input of a high-gain AC-coupled amplifier. Also, in accordance with the preferred embodiment of the invention, the means for continuously registering position may comprise a set of counters which have counts coincidental with the X and Y locations of the beam on the CRT. At the moment of detecting an impulse of light from the pointer means, the output values of the counters are held, with the X and Y coordinates thereof indicative of pointer means position on the display surface.

Also, in accordance with the present invention, there is provided a method of detection of a pointer means location on a display screen such as a CRT screen. This method comprises the steps of providing photo detection means adapted to detect the reflection of light from the pointer means, providing a continuous registration of location of the sweeping beam on the CRT surface and, upon detection of the light impulse at the photo-detector, holding the registered values corresponding to pointer means location.

Brief Description of the Drawings Numerous other objects, features and advantages of the invention should now become apparent upon a reading of the following detailed description taken in conjunction with the accompanying drawing, in which:

FIG. 1 illustrates a CRT display with associated scan line signal; FIG.2 illustrates the CRT display also and the associated placement of the photo-detectors;

FIG. 3 is a perspective view of a photo-cell or photo-detector as used in FIG. 2;

FIG. 4 is a side elevation view showing the placement of the photo-cell relative to the CRT surface and also illustrating the selection pen;

FIG. 5 is a block diagram of a part of the detection circuit of the present invention including the muixipie photo-detectors and amplifier; and

FIG. 6 is a block diagram illustrating the remainder of the detection circuitry for providing X and Y position locations of the selection pen.

Detailed Description

The system of the present invention as illustrated in FIGS. 1-6 describes a new technique for detecting the location of an object such as a pointer, selection pen, or even a finger of the human hand on a display screen such as a cathode ray tube (CRT) display.

A finger or any other object, preferably a light colored object, such as a selection pen, when touched to a CRT display surface, is illuminated by that portion of the screen that is excited by the beam as it travels past. In a raster display, the beam traces a distinctive pattern from the top to the bottom of the screen, sweeping all of the screen area. The beam is typically intensity-modulated to produce different characters or images on the screen. Now, if the finger or selection pen is placed on top of or adjacent to the characters or images, a portion of the tip of the finger or of the selection pen is illuminated whenever the beam excites those characters or images. In accordance with the invention, the illumination is detected by one or more photo-detectors on the edges of the screen. Preferably there are provided multiple detectors that ensure that every part of the screen area is seen by one or more detectors. Typically, as illustrated in the drawings, four such photo-detectors are used, one at each corner of the screen.

Now, FIG. 1 simply illustrates a cathode ray tube 10 with its display screen or face 12. On the tube face, there are illustrated a series of scan lines 14 and also illustrated in FIG. 1 is a scan signal 16. The segment of the line 14 illustrated in FIG. 1 corresponds to the length of the pulse illustrated in connection with the scan line signal 16. As indicated previously, in a standard CRT display, the sweeping electron beam operates on the basis of a raster scan in which horizontal sweeps occur at a predetermined rate. When a horizontal sweep is completed, then the beam retraces and commences again with a subsequent horizontal sweep at a slightly lower vertical position. This horizontal sweeping action continues until the entire screen has been swept.

Reference is now made to FIG. 2 which also illustrates the CRT screen 12 and illustrates the further principle in accordance with the present invention of employing photo-cells. In FIG.2 there are shown four photo-cells 20, each properly supported at a corner of the screen. FIG. 3 shows a simple perspective view of one of the photo-cells 20. FIG. 4 illustrates a bezel support 22 which is used to support each of the photo-cells at a corner of the CRT screen 12. Various types of support may be provided for the photo-cell. The photo-cell 20 is to be arranged so that its viewing area 21 is directed toward the center of the CRT screen and so that its field of view is substantially 90°. In the actual version of the photocell shown in FIG. 3, there is found a photocell, plastic support housing and photocell lens.

Now, with regard to FIG. 2 it is noted that there are illustrated on the face of the screen, a series of dots 24 which may represent points on the screen that are to be selected by the selection pen 26. One of the desirable features of the present invention is that the pen 26 need not be of any special design. No wires are coupled from the pen. The pen is used only for the purpose of providing a reflecting surface so that light at the dot 24A in FIG. 2 is reflected by the selection pen 26 in the direction of the dotted lines 25 illustrated in FIG. 2. These dotted lines 25 simply illustrate a direction of light as it is reflected toward each of the photo-cells 20. As indicated previously, a plurality of photo-cells are preferably used to ensure that the field of view is not totally blocked and that the entire screen is covered. However, it is understood that the principles of the invention are applied in a most simplified version in connection with the use of only a single photo-cell.

It is to be understood in connection with FIGS. 2-4 that the light that progresses along the paths 25 occurs only at the predetermined point in the raster scan where the dot 24A is illuminated. Now, to the human eye, the dot 24A appears to be always illuminated , but in actuality, it is illuminated at a fast repetition rate and during a single complete screen scan. It is illuminated only when the beam is at the X and Y coordinate corresponding to the dot 24A position. It is furthermore stated that although multiple photo-cells are employed, it is understood that the detection signal should be received at each of the photo-cells during the time when the image is illuminated by the beam.

Now, reference is made to FIG. 5 which shows the four photo-cells 20 illustrated in block form in FIG. 5. All of these photo-cells are connected in parallel to the common line 30 and from there by way of AC-coupling capacitor 32 to the high gain amplifier 34. The output of the amplifier 34 is referred to as the scan signal, also referred to hereinafter in connection with the circuitry of FIG. 6. The purpose of the amplifier 34 is to amplify the signal from the photo-detectors. The signal from the photo-detectors is typically a few milli-volts and the amplifier 34 amplifies the signal to a digital logic level, typically say, 5 volts for the "on" condition.

The purpose of the AC coupling by means of the illustrated capacitor 32 is to reject ambient stray light and to take advantage of the fact that the beam is scanning across the CRT at a known frequency, and therefore, the response of the amplifier can be matched to optimize the signal with respect to noise. Amplifier 34 may also provide other signal processing operations, such as signal clipping, pulse shaping and threshold detection.

Reference is now made to FIG. 6 which shows the counting circuitry associated with the CRT display. In FIG. 6 there is shown a horizontal counter 40 and a vertical counter 42. Associated with the horizontal counter 40 is a data latch 44. Similarly, associated with the vertical counter 42 is a data latch 46. At the output of the latch 44 there is shown an output line 48 that gives the X position on the CRT screen. There is also associated with the latch 46, an output at 50 which gives the Y position of the CRT screen. It is also noted that there is an input to each of these data latches emanating from the line 52. This is the scan signal and is the output taken from the amplifier 34 illustrated in FIG. 5.

With regard to the diagram of FIG. 6 it is noted that the horizontal counter 40 has a clock input at 41 and a reset input at line 43. This clock signal at line 41 is the horizontal character clock signal that provides increments of the horizontal scan, on a character basis with the output of the counter 40 being a binary signal representative of the particular horizontal position along a particular scan line. This allows you to be synchronized with the characters selected by the pointer means. The output of the counter 40 is continuously fed to the latch 44, but the latch 44 operates to latch a particular count only when the signal on line 52 occurs. The signal on line 52 is a detection signal that comes from the photo-detectors as illustrated in FIG. 5.

As indicated in FIG. 6, the horizontal sync signal couples by way of line 43 for resetting the horizontal counter. This signal also couples as a clock input to the vertical counter 42. The vertical counter 42 is reset from the vertical sync signal coupled to the vertical counter at line 45. As with the horizontal counter, the vertical counter 42 also couples to the data latch 46 and the output signals from the vertical counter 42 are binary signals representative of one of the particular scan lines that is presently being scanned by the beam. The latch 46 continuously receives the binary output from the vertical counter, but an output is latched at line 50 only when the detection occurs by way of the signal on line 62 to the data latch.

Thus, the pair of counters shown in FIG. 6 have at any one period of time, corresponding binary signals associated therewith that correspond with X and Y locations on the CRT screen. Now, when the photo-detectors detect a signal, this scan signal causes the particular X and Y location signals to be latched in the respective data latches 44 and 46. At the moment of detecting an impulse of light, the output values of the counters are thus essentially frozen. In this connection, there may be associated with the circuit of FIG. 6 an associated computer that would control the resetting of the latches 44 and 46. The software in the computer would use the X and Y locations in conjunction with other internal software logic to interpret the commands that are input by a user pointing to certain symbols or words on the CRT display. In this connection, refer again to the particular symbol 24A in FIG. 2 that has been pointed to by the selection pen 26.

Thus, as the beam scans the CRT screen in the usual raster scan form, synchronous with this scanning are the horizontal and vertical counters that give output signal representating the position of the beam at any point in time in its transit. Now, when the raster scan reaches the point 24A in FIG. 2 where the selection pen 26 is located, it is at that point that the photo-cells provide a detection signal and it is only at that point that the latches 44 and 46 are latched so as to retain the horizontal and vertical counts. These horizontal and vertical counts correspond to the position on the CRT screen at which the dot or point 24A is located. Therefore, there is provided in accordance with the present invention, a relatively simple and effective means by which dot or point selection can be readily determined in connection with particular characters or images on a display screen that are to be selected by a pointer means or the like.

It will be understood that at a plurality of points in an image of finite size the conditions for latching the counters may exist. The first such point to deliver sufficient light to trigger the latches will do so, thus giving to the computer as input a single position indication that ϊffϋs within the area of the illuminated image.

Having now described a limited number of embodiments of the present invention, it should now be apparent to those skilled in the art that numerous other embodiments and modifications thereof are contemplated as falling within the scope of the present invention as defined by the appended claims.

What is claimed is:

Claims

1. A touch screen input system for use with a display screen having a photo-active display surface including a controllable sweeping beam, said system comprising: at least one photo-detector means, means for mounting the photo-detector means adjacent the photo-active display surface but in non-interfering view of the photo-active display surface, in combination with detection means including means for continuously registering the position of the beam in the display surface, pointer means adapted to reflect light from the beam to said photo-detector means to provide a latch signal, and means responsive to said latch signal and said means for continuously registering for holding a signal identifying display screen location corresponding to pointer means location.

2. A touch screen input system as set forth in claim 1 comprising a plurality of photo-detector means.

3. A touch screen input system as set forth in claim 1 wherein said display screen comprises a CRT having a raster beam scan and wherein said photo-detector means comprises a plurality of separately mounted photo-cells.

4. A touch screen input system as set forth in claim 4 wherein there are provided four photo-cells, one at each corner of the CRT.

5. A touch screen input system as set forth in claim 1 wherein said means for continuously registering the position of the beam in the display surface comprises a horizontal counter means and a vertical counter means.

6. A touch screen input system as set forth in claim 5 further including a data latch associated with each respective counter.

7. A touch screen input system as set forth in claim 6 wherein the said latch signal operates said data latch to hold a signal identifying display screen location corresponding to pointer means location.

8. A touch screen input system as set forth in claim 1 wherein said pointer means comprises a selection pen.

9. A touch screen input system as set forth in claim 1 wherein said means for continuously registering the position of the beam comprises horizontal an vertical counter means and said means for holding a signal identifying display screen location comprises latch means, one latch associated with said horizontal counter and a second latch associated with said vertical counter, both of said latches receiving a detection signal from said photo-detector means.

10. A method of detecting the position of a pointer means on a display screen having a photo-active display surface including a controllable sweeping beam, said system comprising steps of photo-electrically detecting reflected light from the beam reflected from the pointer means, continuously registering the position of the beam in the display surface, and holding a signal identifying display screen location corresponding to pointer means location upon detection of said photo-electric signal.

11. A touch screen input system for use with a display screen having a photo-active display surface including a controllable sweeping beam, said system comprising; at least one photo-detector means disposed adjacent the photo-active display surface, in cpmbination with detection means and pointer means, said pointer means adapted to reflect light from the beam to said photo-detector means to provide a detection signal, said detection means responsive to said latch signal for providing a position signal identifying display screen location corresponding to pointer means location.