JP2007299134A - Electronic pen and display system using the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic pen which enables the accumulated conditions of data to be easily obtained, and is user-friendly even in radio communication and to provide a display system using the same. <P>SOLUTION: The electronic pen is provided with: a radio communication circuit for receiving image data by operating radio communication with a first display device; a storage means for storing image data; a first display part; and a control part for receiving the image data designated by a pen operation from the first display device through a radio communication circuit, and for causing a storage means to store the image data, and for causing the first display part to perform display showing the capture degree of the image data. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an electronic pen capable of capturing image data of an image displayed on a display device, and a display system using the same.

In recent years, digitization of image data has progressed, and it has been required to easily copy or scrape digitized image data. As one of them, it has been proposed to capture image data of an image displayed on a display device into an electronic pen. For example, in Patent Document 1, by inserting an electronic pen into a pen adapter of a first display device, data is written in a storage device in the pen, and by inserting an electronic pen into a pen adapter of a second display device, It is disclosed that data written to a storage device in a pen is read and written to a second display device. Japanese Patent Application Laid-Open No. 2004-228688 discloses data capturing and pasting with an electronic pen using wireless communication.
JP 5-181582 (Hitachi, Ltd.) JP-A-6-282375 (Casio Computer)

  However, copying or scraping image data using an electronic pen is not yet common, and the actual situation is that it has not been sufficiently studied especially from the viewpoint of operability.

  For example, in the above-mentioned Patent Document 1, the electronic pen must be inserted into the pen adapter of the display device every time data is written to the electronic pen and data is read from the electronic pen, which is very inconvenient. There is a problem.

  Further, the above-mentioned Patent Document 2 describes a wireless type electronic pen, which is slightly improved in usability, but does not take into consideration establishment of a communication state or communication abnormality, etc., when performing wireless communication. There is a risk of failing to import data into the electronic pen. Further, in Patent Document 2, no consideration has been given to copying data from a display device that has memory characteristics and is in a sleep state during standby.

  As described above, it has been known that image data is captured by the electronic pen and the captured data is written to another display device. However, when the electronic pen is wireless, communication establishment and data transmission / reception are completed. Actually, it was not taken into account that there was a possibility that the time taken and communication could be interrupted unintentionally and the data could be taken in or pasted.

  In view of such a problem, the present invention provides an electronic pen that can clearly grasp a data accumulation state and does not impair operability even in wireless communication, and a display system using the same. The task is to do.

The above object of the present invention can be achieved by the following means.
1.
An electronic pen for capturing an image displayed on a screen of a first display device by a user's pen operation,
A wireless communication circuit for performing wireless communication with the first display device to receive image data;
Storage means for storing image data;
A first display unit;
Image data designated by a pen operation is received from the first display device through the wireless communication circuit and stored in the storage means, and a display indicating the degree of image data capture is performed on the first display unit. A control unit that performs control so as to
An electronic pen comprising:
2.
2. The electronic pen according to 1, wherein the storage means has a storage area for a plurality of image data.
3.
The control unit transmits the image data stored in the storage means to the second display device through the wireless communication circuit, and displays the image data at a position on the screen of the second display device designated by the pen operation. 3. The electronic pen according to 1 or 2, wherein the electronic pen is controlled to perform control so that the first display unit performs display indicating a discharge degree of image data.
4).
4. The electronic pen according to 3, wherein the electronic pen has a second display unit for indicating a progress stage of at least one of image data capture and image data discharge.
5).
5. The electronic pen according to any one of 1 to 4, further comprising an operation unit for a user to operate.
6).
The control unit stores at least a state in a stage before performing the last operation in each stage in a series of operations from image data capture to image data discharge, and in accordance with an instruction from the user, The electronic pen according to any one of 1 to 5, wherein control is performed so as to return to step (1).
7).
A display system comprising: the electronic pen according to claim 1; and a display device, the display device having a wireless communication circuit for wirelessly communicating with the electronic pen to transmit image data.
8).
8. The display system according to 7, wherein the display device has a memory property.
9.
The display system according to 7 or 8, wherein the display device performs display indicating a region to be captured into the electronic pen designated by the electronic pen.
10.
3. The electronic pen according to 3 or 4, and first and second display devices including a wireless communication circuit for wirelessly communicating with the electronic pen, wherein the control unit of the electronic pen controls image data capture from image data capture A state at least before the last operation is stored in each stage in the series of data discharge operations, and the electronic pen and the first and second display devices are moved one stage forward according to an instruction from the user. The display system according to any one of 7 to 9, wherein control is performed so as to return to the state.

  According to the electronic pen of the present invention, it is possible to clearly grasp the state of data accumulation, and the operability is not impaired even in wireless communication. Even in the case of a memory-type display device, the data accumulation can be confirmed in real time.

  Hereinafter, embodiments of the electronic pen of the present invention and a display system using the same will be described.

[Example 1]
<Display system>
In Embodiment 1 of the present invention, electronic paper, which is a display device having memory characteristics, is used as a copy source display device, image data is sucked from the display device into an electronic pen, and the sucked data is discharged from the electronic pen and pasted. This is a display system that is pasted on a second electronic paper as a destination display device.

  The display system according to the first embodiment includes an electronic pen and at least one display device. As a typical example, as shown in FIG. 1, a magazine type display device 1 of a type in which a plurality of flexible sheet-like display portions are bound and a magazine type display device 1 which is smaller than a magazine type display device 1 A notebook type display device 2 having an appearance and a mobile display device 3 that is smaller than the notebook type display device 2 and can draw out a display unit. All of the three display devices employ display panels having a memory property, and in particular, the magazine type display device 1 and the mobile display device 2 employ flexible display elements employing resin substrates.

In this display system, new publication data such as magazines, weekly magazines, and newspapers are periodically distributed to the magazine-type display device 1, and a notebook-type computer is used to scrap a part of the book information from the magazine-type display device 1. The display device 2 and the mobile display device 3 can be copied and moved. At that time, data is copied or moved via an electronic pen. The user can freely copy and move information between the display devices by using the electronic pen.
<Electronic pen>
As illustrated in FIG. 2, the electronic pen 4 according to the first embodiment includes a housing including a grip portion 41 that is gripped by a user. The housing includes a top 40, a display unit, and an operation unit 42 operated by a user. The operation unit 42 includes an execution key 421 for instructing execution of an operation such as copying, and a cancel key 423 for instructing cancellation of the operation. The display unit is a first unit for indicating a data transfer progress state or an image data storage state in the electronic pen when the image data is taken into the electronic pen or the image data in the electronic pen is transferred. It includes a display unit 43 and a second display unit 44 for indicating which stage from data fetching to data pasting.

  As shown in FIG. 2, the first display unit 43 displays empty when the image data is not stored in the electronic pen 4 (FIG. 2A), and the image is displayed in the electronic pen 4. When data is stored, a full display is displayed (FIG. 2C). Further, during the capture of the image data, as shown in FIG. 2B, the display is dynamically performed so as to gradually approach the full state from the empty state. On the contrary, during the reading of the image data, the display is dynamically performed so as to approach full to empty.

  The second display unit 44 is used to indicate to which stage the operation has progressed, such as when an image area to be captured is confirmed, when data capture is completed, and the user uses the cancel key 423. It can be used as a guide when canceling the operation. The 1st display part 43 and the 2nd display part 44 are comprised by display elements, such as LED and LCD.

  As shown in FIG. 4, the information to be copied on the display device is enclosed, and data is started to be taken into the electronic pen 4 by operating the operation unit 42 in a part of the enclosed area. Accordingly, the display on the first display unit 43 of the electronic pen 4 gradually changes from empty to full, and the first display unit 43 displays full when the image data capture is completed (see FIG. 4 (a)).

  The data stored in the electronic pen 4 can be pasted on other display devices as will be described later. In this case, the display on the first display unit 43 of the electronic pen gradually changes from full to empty after instructing the pasting, and when the pasting is completed, the empty is displayed (FIG. 4B). ).

  As shown in FIG. 4, the second display unit displays the time when the enclosure with the electronic pen is completed, the time when the data is taken into the electronic pen, the time when the image data pasting position is determined, and the pasting of the image data. When each is completed, it lights up to indicate which stage the series of operations are in.

  In this way, the electronic pen that can capture the image displayed on the screen of the display device is provided with a display unit that visualizes data capture and discharge, so that the user can grasp the data capture and discharge, These operations can be executed reliably.

As shown in FIG. 3, the circuit block of the electronic pen is arranged on the operation unit 42 including the first display unit 43 and the second display unit 44 described above, an execution key 421 and a cancel key 423 for receiving an operation instruction from the user. In addition, a wireless interface for communicating with an external display device, a FlashROM for storing a program for performing control in accordance with an instruction from the user, work data for operating the program, and image data for communication SDRAM and a central processing unit (CPU) that performs overall control.
<Magazine type display device 1>
FIG. 5 is an external view of the magazine type display device 1 and a partial cross-sectional view of each display sheet 11. As shown in FIG. 5, the display device is a type in which a plurality of flexible display sheets 11 having memory properties are bound. Each display sheet 11 is thin and flexible and can be turned like a book. Each display sheet 11 has display layers on the front and back, and can display both sides. The binding unit 12 incorporates a drive circuit, and the display content of each display sheet 11 is rewritten by the drive circuit. The binding unit 12 is also provided with a position recognition mechanism (touch panel) for recognizing the coordinate position indicated by the electronic pen 4 and a wireless communication module for communicating with the electronic pen 4.

In FIG. 5, as an example, each display sheet 11 is configured by a flexible display panel in which a display panel having a display medium 136 sandwiched between a pair of resin substrates 130 with transparent electrodes 135 is attached to the front and back. An example is shown. As shown in the partial enlarged cross-sectional view of FIG. 5, each display panel is provided with a spherical spacer 131, a columnar adhesive body 132, and an alignment film 133, and two bonded together via an adhesive layer 134. .
<Notebook display device>
FIG. 6 is an external view of the notebook type display device 2. The notebook-type display device 2 is smaller than the magazine-type display device 1 and is a display device having an appearance like a system notebook as shown in FIG. The display panel 21 has a memory property, and the same display panel as described in FIG. 5 can be used. When the cover is opened, the display panel 21 is fixed on one side by a binder portion 22, and a holder 23 for accommodating the electronic pen 4 and operation keys 24 are provided on the other side. A touch panel is installed on the display panel 21. A wireless communication circuit for communicating with the electronic pen 4 is provided in the binder unit 22.
<Mobile display device>
FIG. 7 is an external view of the mobile display device 3. The mobile display device 3 is smaller than the notebook-type display device 2, and is a small electronic device from which the display panel 31 can be pulled out as shown in FIG. A part of the outer shape of the housing 30 is slidable (sliding portion 32), and a size larger than the housing 30 can be obtained by pulling out the display panel 31 by sliding a finger against the non-slip portion 33 of the sliding portion. The screen can be realized. The drawer-type display panel is a flexible display having a memory property. One end of the display panel 31 is fixed to the rotation shaft in the housing 30 and is wound around the rotation shaft in the accommodated state. The rotation shaft is biased so as to rotate in the opposite direction to the side where the display panel 31 is pulled out. The display panel 31 is pulled out by the user pulling the other end side of the display panel 31. The display panel 31 is accommodated in the housing 30 by releasing the other end side. The display device 3 is also provided with a position recognition mechanism for the electronic pen 4 and a wireless communication circuit for communicating with the electronic pen 4. A display unit 34 for displaying additional information such as time is provided in the housing 30.
<Circuit block of each display device>
FIG. 8 is a circuit block diagram of each display device. As shown in FIG. 8, each display device includes a display panel for displaying image data, a controller for controlling the display panel, an SDRAM for display panel for storing image data displayed on the display panel, an electronic device Transparent touch panel sensor, touch panel controller, wireless interface for communication with electronic pen, and display device as a whole that detect pen input by pressure sensitive, capacitive, electromagnetic induction, ultrasonic, etc. FlashROM for storing a program for controlling the program, SDRAM for storing work data when the program is running, a central processing unit (CPU) for controlling, and an operation unit for receiving operation instructions from the user <Copy operation>
FIG. 9 is an explanatory diagram of the copy operation (sucking to the electronic pen), and FIG. 10 is an explanatory diagram of the copy operation (discharge from the electronic pen).

  As shown in FIG. 9, a desired image portion displayed on the display device 1 as a copy source is surrounded by the electronic pen 4 (FIG. 9A). When enclosing, the frame A is displayed on the display device (FIG. 9B). Since the user is freehand, the display device 1 automatically approximates an appropriate straight line and displays the frame. For example, when the user's box is uneven, a frame that is straightened with respect to the outside is displayed, and when it is surrounded diagonally, a frame that includes a bend is displayed within a range in which no image data is lost.

  The image data in the enclosed area is transferred to the electronic pen 4 by touching the enclosed area with the electronic pen 4 (or by operating the operation unit 42 while the electronic pen 4 is touched in the enclosed area). (FIG. 9 (c)). At this time, in order to indicate that the data is being sucked up by the electronic pen 4, a display is made such that the scale gradually increases on the display unit of the electronic pen 4 (FIG. 9D).

  When the data transfer to the electronic pen 4 is completed, a full display is performed on the display unit 43 of the electronic pen 4. In addition, the surrounding area of the display device is rewritten to a low contrast state (FIG. 9E).

  In this way, another display device 2 is touched with the electronic pen 4 storing the data to paste the data (FIG. 10A).

  Then, the data is transferred to the copy destination display device 2 by operating the operation unit 42. At this time, a display is made on the display unit 43 of the electronic pen 4 so that the scale gradually decreases (FIG. 10B).

When the data transfer to the display device 2 is completed, an empty is displayed on the display unit 42 of the electronic pen 4. In addition, the screen is updated with the transferred data pasted (FIG. 10C).
<Image pasting position>
When pasting the image captured by the electronic pen 4 to the display device 2, the pasting position is designated by bringing the pen tip of the electronic pen 4 into contact with an arbitrary position of the pasting display device 2. In this example, the frame line B is displayed at the pasting destination so that the position where the electronic pen 4 is touched is the center (center of gravity position). The frame line corresponds to the size of the image data captured by the electronic pen (see FIG. 11A).

  When a position at which a part of the image protrudes from the display device 2 is specified on the screen of the paste destination display device 2, the frame B is shifted and displayed so that the image fits on the display device 2 (FIG. 11 (b)). In FIG. 11B, a dotted line is a virtual line shown for easy understanding, and shows an outline of the image when the pen tip is at the center.

  Instead of determining the pasting position around the contact position of the pen tip, the contact position may be made to coincide with any of the four corners of the cutout region. You may enable it to select either a gravity center or four corners so that it may become the operation method according to a user's liking.

  In this example, since the selected area is displayed with a frame line, the user can surely grasp the area, and an error is unlikely to occur in the copying operation. However, it is also possible to adopt a method in which the enclosed area is not specified. In this case, since it is not necessary to display a frame line, the number of times of drawing on the display device is reduced, and power consumption can be reduced. Further, it can be confirmed that the target area is specified by the display of the second display unit 44. A sound effect may be generated from the display device 2 or the electronic pen 4 so that the user can indirectly grasp the region determination.

In this example, after pasting the image data, the image data is dragged by moving it to the place where the pen tip is to be moved. However, in this example, since the pasting destination display device 2 has a memory property and it is difficult to move the image in real time, it is difficult to move the image in real time. It is only necessary to perform drawing. Partial rewriting may be performed in a short time every a few seconds to a few seconds, and finally the entire screen may be redrawn after the movement stops.
<Auto size adjustment>
Depending on the screen size of the paste destination display device 2, there is a possibility that the image size of the copy source will stick out of the screen, so in this example, the size of the paste image is automatically adjusted. Specifically, as shown in FIG. 12, when the pasting area is enclosed with a size corresponding to the size of the display device 3 to be pasted, the calculation is performed from the size of the surrounding area C and the image size of the copy source. Then, the size is automatically converted, image data is created so as to fit in the enclosed area, and drawing is executed with the created new data.

  When it is determined that both the size and resolution of the display panel of the display device are sufficiently larger than the display panel of the transmission source, enlarged display is performed.

If the aspect ratio of the surrounding area C to be pasted does not coincide with the aspect ratio of the cut-out image, the portion that protrudes or shrinks to either the vertical or horizontal direction may be cut according to the user's preference. Alternatively, the image data itself may be deformed by converting the aspect ratio.
<Undo function>
13 and 14 are explanatory diagrams of the undo function. As shown in FIGS. 13 and 14, there may be a situation where the user wants to cancel the operation after the image data is stored in the electronic pen 4 or the image data is pasted from the electronic pen 4 to the display device 2. In this example, the display system including the electronic pen 4 has an undo function.

  When the pasting of data is completed (FIG. 13A), if it is desired to cancel the pasting, the pasted data is again taken into the electronic pen by operating the cancel key, and a frame indicating the pasting position The line D is displayed, and the process returns to the stage before the data is pasted (FIG. 13B). At this stage, the frame line D can be dragged by bringing the electronic pen 4 into contact with the display device 2 (FIG. 13C). If necessary, the position of the frame line D is changed, and then the image is again displayed from the electronic pen 4. It is also possible to send data and paste images. By operating the cancel key of the electronic pen 4 from the state of FIG. 13B or FIG. 13C, it is possible to return to the previous state, that is, the state before the attachment position is determined.

  Further, as shown in FIG. 14A, when the copying of data from the copy source display device 1 is completed, the electronic pen is brought close to the copy source display device 1 and the cancel key is operated to copy. The displayed image is returned to the original display, and the frame line E indicating the cut-out target area is displayed, and the image area to be copied is fixed (FIG. 14B). Further, by operating the cancel key of the electronic pen 4, the state before determining the area to be copied is restored.

Next, as another example of the pasting operation, an example of enlargement / reduction based on the pasting destination box size will be described. FIG. 15 is an explanatory diagram showing another example of the pasting operation. As shown in FIG. 15, on the display device 2 to be pasted, the electronic pen 4 is used to enclose the pasting target area F, and the data is matched to the size at the position where the enclosing operation is performed. You may make it stick. In this way, it is difficult for the image to protrude from the display device at the pasting destination, and the image is pasted in a size suitable for the user's intention by appropriately changing the surrounding size. be able to.
<Copy operation flowchart>
A flowchart executed by the electronic pen 4, the copy source display device, and the copy destination display device when scraping data using the electronic pen 4 in this display system will be described.

  FIG. 16 shows a flow of processing (S1 to S21) executed by the display device that is the copy source and the electronic pen 4 when data is taken into the electronic pen (S1 to S53) and a flow of user operations (S51 to S53). . When the user brings the electronic pen 4 into contact with the touch panel of the copy source display device in order to cut out the image displayed on the display device, the operation of the electronic pen 4 is detected by the touch panel controller and an interrupt notification is sent to the CPU. Start up and wake up the copy source display device. Next, wireless communication is established with the electronic pen 4 and mutual authentication is performed. Then, when the user presses the execution key to start the enclosing operation for designating the copy area, a command is transmitted from the electronic pen 4. When the display device receives a command from the electronic pen 4, analyzes the received command and recognizes the content of the instruction, the CPU of the display device starts reading coordinate data indicating the position of the electronic pen 4.

  While the user traces the display device with the electronic pen 4 and surrounds the area to be cut out with a frame, the display device monitors the position information of the electronic pen, and based on the obtained position information (for example, the frame line is Whenever a predetermined length is reached, the display device is driven to draw a frame. Here, in consideration of the fact that the display device has a memory property, drawing is not performed in real time every 1/30, but at intervals of about once every several seconds to several seconds. And respecting the characteristics of the memory-type display device, the user is informed that the target area is being gradually specified.

  When the display device determines that the enclosure of the target area by the electronic pen 4 has been completed based on the position information of the electronic pen 4, the electronic pen 4 is notified of the completion of the enclosure. When the electronic pen 4 receives the enclosure completion notification from the display device, the electronic pen 4 permits the electronic pen 4 to suck data next. Note that when the enclosure completion command is received, the electronic pen 4 may perform light emission display, generate an alarm sound, or generate vibration. In this way, it is possible to reliably notify the user of the completion of the enclosure.

  After the enclosure is completed, the display device performs calculation based on the movement trajectory of the electronic pen 4 to identify the coordinate data of the enclosed area, and stores this information in the specified area of the memory.

  Next, when the user presses the blot button of the electronic pen 4, a data blot command is issued from the electronic pen 4. When the display device receives this command, the image information of the area corresponding to the coordinate data stored earlier is displayed. The data is read from the SDRAM and temporarily stored in the SDRAM as new image data. Thereafter, in order to reliably transmit and receive data, the communication state is reconfirmed between the display device and the electronic pen 4. Specifically, the electronic pen 4 is inquired of whether or not image data can be transmitted from the display device, and if the status information of the electronic pen 4 indicates that image data can be transmitted to the electronic pen 4, the communication state can be secured. The data transmission from the display device to the electronic pen 4 is started.

  On the other hand, the electronic pen 4 sequentially updates the display on the display unit in accordance with the ratio of the current reception amount with respect to all transmitted data. As a result, as data reception progresses, the display is performed as if the data is stored in the electronic pen 4, and the user can feel the data sucking.

  When the enclosing area is determined, it is also possible to start capturing image data without pressing the execution key by bringing the electronic pen 4 into contact with a point in the enclosing area.

  Check whether a communication error occurs during image data transmission / reception. For example, when the status information cannot be transmitted to the electronic pen, the sleep state is entered. At that time, a warning sound may be generated or an error may be displayed.

  When the data transmission is completed, the display device notifies that the transmission is complete. After receiving the completion notification, the electronic pen 4 displays a message indicating that all data has been received (here, the fourth LED is lit). On the other hand, the display device performs reversal processing, contrast reduction processing, and the like on the image data in the cutout area, draws in the cutout area, and updates the display contents. After the series of operations is completed, the display device enters the sleep state again.

  FIG. 17 shows the flow of processing (S31 to S50) executed by the electronic pen and the display device that is the paste destination when pasting data from the electronic pen 4, and the flow of user operations (S61 to S64). ing. In the following description, it is assumed that automatic size adjustment is performed at the pasting destination.

  When the user brings the electronic pen 4 into contact with the touch panel of the display device, the display device of the pasting destination in the sleep state is woken up. Next, wireless communication is established with the electronic pen 4 and mutual authentication is performed. Then, when the user presses the start button to start the enclosing operation for designating the pasting area, the command is transmitted from the electronic pen 4. When the display device receives the command, analyzes the received command and recognizes the content of the instruction, the CPU of the display device starts reading coordinate data indicating the position of the electronic pen.

  While the user traces the display device with the electronic pen 4 and surrounds the pasting target area with a frame, the display device monitors the position information of the electronic pen 4 and based on the obtained position information (for example, the frame Whenever the line reaches a predetermined length, the display device is driven to draw the frame line.

  When the display device determines that the enclosure of the target area by the electronic pen 4 has been completed based on the position information of the electronic pen 4, the electronic pen 4 is notified of the completion of the enclosure. When the electronic pen 4 receives the enclosure completion notification from the display device, the electronic pen 4 permits the next data ejection by the electronic pen 4. Note that when the enclosure completion command is received, the electronic pen may perform light emission display, generate an alarm sound, or generate vibration.

  After the enclosure is completed, the display device performs calculation based on the movement trajectory of the electronic pen 4 to identify the coordinate data of the enclosed area, and stores this information in the specified area of the memory.

  Next, when the user presses the suck button of the electronic pen 4, a discharge command is issued from the electronic pen 4, and when the display device receives this command, the image information of the area corresponding to the coordinate data stored earlier is displayed. The data is read from the panel SDRAM and temporarily stored in the SDRAM as new image data. Thereafter, in order to reliably transmit and receive data, the communication state is reconfirmed between the display device and the electronic pen 4. Specifically, if the electronic pen 4 inquires the display device whether or not image data can be transmitted, and the status information of the display device indicates that image data can be received from the electronic pen, the communication state can be secured. Determination is made and data transmission from the electronic pen 4 to the display device is started. At that time, the amount of electronic data to be transmitted is first transmitted to the display device.

  On the other hand, the electronic pen 4 sequentially updates the display on the display unit according to the ratio of the current transmission amount to all data to be transmitted. Thereby, the display is performed so that the data decreases from the electronic pen 4 as the data reception progresses, and the user can feel the discharge of the data.

As described above, since it is electronic paper, it is difficult to display a frame or the like in real time. In order to take advantage of the memory performance, the computer normally sleeps and saves power. Therefore, it may not be able to start up immediately and may fail to download data. From such a point of view, it is very beneficial to display the electronic pen 4 so that the data movement status can be visually recognized.
[Example 2]
The second embodiment of the present invention is an electronic pen having a dropper shape instead of the electronic pen 4 of the first embodiment.
<Electronic pen>
The electronic pen according to the present embodiment has a shape imitating a dropper, and sucks and discharges image data as if the liquid is sucked and discharged by the dropper. Specifically, as shown in FIGS. 18 and 19, the electronic pen 5 has a head 51 that is gripped by a user and imitates a dropper knob portion, and a tip that is thin and imitates a dropper tube portion. And a rod-like portion 52. The head 51 is provided with an elastic pressing part 52 operated by a user and a dial part 53 used when selecting a data stock destination. A linear display portion 54 is provided in the tube portion, and a plurality of ring-shaped display portions 55 are provided at the root portion of the head portion 51. Each display unit is configured by arranging a plurality of LEDs.

  In the electronic pen of this embodiment, image data is taken in and discharged by the operation of grasping the elastic pressing portion 52 of the head 51, and the display of the linear display portion 54 changes in real time according to this operation. As shown in FIG. 19, when data is taken from the copy source display device, the LED at the tip of the linear display portion 54 is gradually turned on, and when data is pasted to the paste destination display device, a linear display is made. The LED on the head 51 base side of the unit 54 is gradually turned off. In other words, image data can be sucked and discharged as if liquid is sucked or discharged. Thus, by adopting the shape of a dropper and transferring image data in a manner similar to the operation of a dropper, the user can intuitively understand the operation of the electronic pen 5.

  The electronic pen 5 of the present embodiment has a plurality of storage areas for storing image data. The ring-shaped display unit 55 is for indicating how many image data are stocked, and includes a plurality of display bodies. The user can know how many data are stocked in the electronic pen 5 by the lighting state of the ring-shaped display unit 55.

  The dial unit 53 includes a first dial 56 for switching between suction and discharge, and a second dial 57 for designating a storage area number. The second dial 57 has a number such as “1”, “2”, “3” indicating the storage area, “ALL” for selecting all the storage areas, and “SQE” for sequentially selecting each storage area. Is included.

  FIG. 20 is an enlarged view of the first dial 56 unit, and the user can switch between loading, discharging and deleting image data by operating the dial. When the first dial 56 is “▼”, the image data is fetched if there is no image data in the storage area of the number designated by the second dial 57, and the discharge of the image data is designated if there is image data. . When the first dial 56 is “▲”, image data erasure from the storage area of the number designated by the second dial 57 is designated.

  When “SQE” is designated by the second dial 57 when the first dial 56 is “▼”, it is designated that image data is sequentially taken into each storage area when there is no image data in the storage area. If there is already image data in the storage area, the image data is read in order from each storage area.

It should be noted that the entire screen of one page of the copy-source display device such as the magazine-like display device 1 may be blotted together by the electronic pen 5. For example, after the first dial 56 is set to “▼” and the second dial 57 is set to “ALL”, the pen 51 is placed at an appropriate position on the display device without performing any enclosing operation. The image of the entire page is taken into the electronic pen 5 by pressing the elastic pressing portion 52.
<Display on the electronic pen display>
When the image data is taken into the electronic pen 5, as shown in (1) to (3) of FIG. 21 (a), the blinking portion gradually moves from the tip of the pen to the head 51, followed by the tip blinking portion. The normal light part is displayed as if it has a tail. When the tip blinking part reaches the base of the head 51, a display is made so as to draw a ring on the ring-shaped display part of the head 51 as shown in FIG. When the blinking part goes around the ring-shaped display part, the blinking part disappears from the ring-shaped display part 55 and only the normal light part is provided. Thereafter, as shown in (4) to (6) of FIG. 21 (a), the linear display unit 54 displays so that the normal lamp is sucked into the head 51, and finally the image data. Is completed, the display of the linear display unit 54 is turned off, and only the ring-shaped display unit 55 is always lit.

  At the time of data discharge, as shown in (1) to (3) of FIG. 21B, the blinking portion gradually moves from the head 51 root side of the linear display portion 54 to the pen tip. Following the tip flashing part, the normal light part is displayed so as to have a tail. When the tip flashing part reaches the pen tip, the flashing part disappears and only the normal light part is displayed. The rear end of the normal light part is displayed in the reverse order of FIG. 21C, and the rear end of the normal light part is a ring. When the image display unit 55 moves from the line display unit 55 to the line display unit 54 and finally the ejection of the image data is completed, no light is emitted.

In order to display that a communication error has occurred, the ring-shaped display portion 55 of the electronic pen 5 may be lit for several seconds with a conspicuous color (red or the like) different from normal.
<Erase data from electronic pen>
Set the first dial 56 to “▲” and the second dial 57 to the number of the storage area that stores the image data that you want to delete, and press the elastic pressing part at a position away from the display device. Can be erased. When “ALL” is designated by the second dial 57 when the first dial 56 is “▲”, it is designated to erase the image data from all the storage areas at once. When “SEQ” is designated by the second dial 57 when the first dial 56 is “▲”, the image data is sequentially deleted from each storage area each time the elastic pressing portion 52 is pressed.
<Paste image data>
In this example, since a plurality of image data can be captured by the electronic pen 5, when pasting a plurality of images captured by the electronic pen 5, each image is pasted in a designated position in order. You can also paste them together under certain rules. For example, after the image data is taken into each storage area, the first dial 56 is set to “▼” and the second dial 57 is set to “ALL”, and the pen tip is placed at a desired position of the display device to which the image is pasted. When the elastic pressing portion 52 of the head 51 is pressed, (1) if the image data is displayed on the same page of the display device as the copy source, it is pasted while maintaining the positional relationship on the page. (2) When an image sticks out at the time of pasting when the positional relationship is completely maintained, position correction is performed so that only one of the protruding position is not maintained while only one of the vertical position and the horizontal position is maintained. For example, the data may be aligned and pasted.
Example 3
In the third embodiment, the form of the data stock display area of the electronic pen 5 of the second embodiment is changed.
<Configuration of electronic pen>
As shown in FIG. 22, the electronic pen 5 of this example is configured such that the display unit 58 indicating data stock is displayed in a plurality of dots instead of in a ring. The display mode of the display unit at the time of data acquisition in this example is the movement of the blinking part and the subsequent normal lamp display as described in FIG. 21, but the normal light part has no rear end and the flashing part. Even after reaching the root of the head 51, the linear display unit 52 continues the normal light. The dot-like display portion 58 of the head 51 starts blinking when the blinking portion reaches the root of the head 51, continues to blink until the image data capture is completed, and then becomes a normal light (FIG. 23 (a)). reference). On the other hand, the display mode of the display unit at the time of discharging the image data in this example is substantially the same as that described in FIG. 21, but the dot-like display unit 58 continues to blink until the discharge of the image data is completed. Is different.

As described above, in the second embodiment, the data is displayed so as to be sucked from the tip of the pen to the head, whereas in this example, the display is closer to the dropper and matches the shape of the electronic pen 5. Display.
Example 4
Next, as a fourth embodiment, an example in which the display device is not electronic paper will be described. As shown in FIG. 24, when a display device 6 that does not have memory characteristics and is refresh-driven, such as a plasma TV, a TFT liquid crystal monitor, or an organic EL panel, is a target for image data capture or pasting, By dynamically displaying the liquid flow on the display device 6, it is possible to more visually represent the capture and discharge of image data. FIG. 24A shows an example in which a spiral display indicating that image data is captured is performed on the display device, and FIG. 24B shows image data being ejected from the electronic pen 5. This shows an example in which another display device 7 displays such that liquid spills and spreads.

It is a figure which shows Example 1 of an electronic pen and a display system using the same. 1 is an external view of an electronic pen according to a first embodiment. It is a circuit block diagram of an electronic pen. It is explanatory drawing of the basic operation | movement of an electronic pen. It is the external view of the magazine type display apparatus 1, and a partial expanded sectional view. It is an external view of a notebook type display device. It is an external view of a mobile display apparatus. It is a circuit block diagram of each display device. It is explanatory drawing of copy operation | movement (taking in to an electronic pen). It is explanatory drawing of copy operation | movement (discharge from an electronic pen). It is explanatory drawing of a sticking position. It is explanatory drawing of an automatic size adjustment function. It is explanatory drawing of an undo function. It is explanatory drawing of an undo function. It is explanatory drawing which shows the other example of a sticking operation | movement. 6 is a flowchart executed by a copy source display device and an electronic pen when image data is taken into the electronic pen. It is a flowchart which an electronic pen and a sticking destination display apparatus perform when sticking an image on a display apparatus with an electronic pen. It is an external view of Example 2 of an electronic pen. It is a figure which shows the mode of a display of an electronic pen. It is an enlarged view of the dial part of an electronic pen. It is a figure which shows the display mode of an electronic pen. It is a schematic diagram which shows the display part of Example 3 of an electronic pen. FIG. 10 is an explanatory diagram of a display example of a display unit in Example 3. It is explanatory drawing which shows the mode of a display of the display apparatus in Example 4 of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Magazine type display apparatus 2 Notebook type display apparatus 3 Mobile display apparatus 4 Electronic pen 41 Holding part 42 Operation part 43 1st display part 44 2nd display part 11 Display sheet 12 Binding part 13 Display layer 130 Resin substrate 131 Spherical spacer 132 Adhesion Body 133 Hardened film 134 Adhesive layer 136 Display medium 21 Display panel 22 Binder part 23 Holder 24 Operation key 30 Housing 31 Display panel 32 Slide part 33 Non-slip part 34 Display part 5 Electronic pen 51 Head 52 Rod-like part 53 Elastic pressing Section 54 Dial section 55 Line display section 56 Ring display section 57 First dial 58 Second dial

Claims (10)

An electronic pen for capturing an image displayed on a screen of a first display device by a user's pen operation,
A wireless communication circuit for performing wireless communication with the first display device to receive image data;
Storage means for storing image data;
A first display unit;
Image data designated by a pen operation is received from the first display device through the wireless communication circuit and stored in the storage means, and a display indicating the degree of image data capture is performed on the first display unit. A control unit that performs control so as to
An electronic pen comprising: The electronic pen according to claim 1, wherein the storage unit has a storage area for a plurality of image data. The control unit transmits the image data stored in the storage means to the second display device through the wireless communication circuit, and displays the image data at a position on the screen of the second display device designated by the pen operation. 3. The electronic pen according to claim 1, wherein the electronic pen is controlled so as to cause the first display unit to perform display indicating a discharge degree of image data. 4. The electronic pen according to claim 3, further comprising a second display unit for indicating a progressing stage of at least one of image data capture and image data discharge. The electronic pen according to any one of claims 1 to 4, further comprising an operation unit for a user to operate. The control unit stores at least a state in a stage before performing the last operation in each stage in a series of operations from image data capture to image data discharge, and in accordance with an instruction from the user, The electronic pen according to claim 1, wherein the electronic pen is controlled so as to return to the position. A display system comprising the electronic pen according to claim 1 and a display device, the display device having a wireless communication circuit for wirelessly communicating with the electronic pen to transmit image data. The display system according to claim 7, wherein the display device has a memory property. The display system according to claim 7 or 8, wherein the display device displays a target area to be taken into the electronic pen designated by the electronic pen. 5. The electronic pen according to claim 3, and first and second display devices including a wireless communication circuit for wirelessly communicating with the electronic pen, wherein the control unit of the electronic pen captures image data The state at least before the last operation is stored in each stage in the series of operations of discharging image data from the electronic pen, and the electronic pen and the first and second display devices are set to 1 according to instructions from the user. The display system according to any one of claims 7 to 9, wherein control is performed so as to return to a state before the stage.

Images