JP4314502B2 - Information processing apparatus and information processing method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
  The present invention relates to an information processing apparatus.as well asInformation processingTo the lawFor example, it is suitable for application to a personal computer.
[0002]
[Prior art]
Conventionally, a personal computer (hereinafter referred to as a computer device) manages the entire system based on an OS (Operating System) such as Windows 98 (trademark) stored in an internal hard disk, and via the OS. Thus, desired processing is executed by starting application software (hereinafter referred to as an application).
[0003]
In the OS of such a computer device, various user interfaces have been developed to improve the user-friendliness. For example, file extensions (.COM and .DOC that store predetermined information and programs) are developed. Etc.) is associated with an application necessary for referring to the file, so that data and application are linked in units of files, and data is embedded in the application.
[0004]
Recently, an application partially including a program called a character string extraction system (Japanese Patent Application No. 09-305351) has been proposed. When this application is used, a desired character in the text data in the file is proposed. When a string (for example, an English word) is specified by the cursor on the screen, the part between the preceding and following spaces and periods is extracted as the specified English word, and the meaning of the English word is determined by the dictionary application. Searching and displaying in the vicinity of the cursor is performed.
[0005]
[Problems to be solved by the invention]
By the way, in the computer device having such a configuration, it is possible to perform cooperation between data and applications in units of files, but the type of information (for example, an address) represented by a specified character string among text data constituting the file. Therefore, it is difficult to link the application and the character string information associated with each type of information.
[0006]
For example, as shown in FIG. 18, when the cursor is over the character string “Phone: 03-5448- ○ △△ ×” on the application screen, the normal pop-up menu PM1 is displayed even if the mouse is right-clicked. In order to link the application related to the phone number, which is the type of character string, with the character string information, a complicated operation has to be performed.
[0007]
That is, in the computer apparatus, the part where the cursor is superimposed is recognized not as a telephone number but merely as a character string. When the telephone number which is information on the character string is used in another application, the OS copy function After saving the phone number data to the clipboard using, start the application that uses the phone number and execute the cut-and-paste operation to paste the phone number data at the appropriate location. There was a problem that it was complicated and troublesome.
[0008]
In addition, in a computer device equipped with an application partially including a character string extraction system, English words are extracted as character strings from the text data constituting the file, and the extracted character strings are associated in advance. The dictionary application can be linked to search for the meaning of English words, but the type of information represented by the character string cannot be determined. For this reason, in a computer device, when a character string is, for example, an address, a telephone number, an e-mail address, or the like, an application (for example, an application for displaying a location on a map corresponding to an address, a call is made) It has been difficult to link character string information with an application for transmitting an e-mail).
[0009]
  The present invention has been made in consideration of the above points, and is an information processing apparatus that is more excellent in operability and can analyze a character string and execute a desired process with only a simple operation by a user.as well asInformation processingThe lawIt is what we are going to propose.
[0010]
[Means for Solving the Problems]
  In order to solve this problem, in the present invention, the information processing apparatusStorage means for storing multiple applications and taking imagesBy imaging meansObtainedimageGet to get dataMeans,Identification to identify the character string and the application corresponding to the character string from the image dataExtract informationExtractionMeans,ExtractionBy meansExtractedStringTogether with image dataDisplay control means for displaying on a predetermined display means;, Referring to the storage means, starting the application based on the specific information corresponding to the character string selected from the character strings displayed on the display means, and for the character string extracted by the extracting means Application processing means for executing processing;ProvideLike that.
  As a result, the image was picked up by the image pickup means.imageFromStringAnd after extracting the specific information for specifying the application corresponding to the character string, and letting the user visually confirm what character string was extracted from the image by displaying this character string, When an arbitrary character string is selected by the user, an application corresponding to the specific information can be activated to execute a predetermined process on the character string. A simple operation that simply selects a column automatically executes a series of processes from selecting a character string from an image to performing predetermined application processing on that character string.can do.
[0011]
  In the present invention, the information processing method includes:Taking an imageBy imaging meansObtainedimageAcquiring data by acquisition meansSteps,Extraction means for identifying specific information for identifying character strings and applications corresponding to character strings from image dataExtractExtractionSteps,ExtractionBy meansExtractedStringTogether with image data by display control meansA display control step for displaying on a predetermined display means;The character string extracted by the extraction means by referring to the storage means by the application processing means, starting the application based on the specific information corresponding to the character string selected from the character strings displayed on the display means, And an application processing step for executing a predetermined process by the application.
  As a result, the image was picked up by the image pickup means.imageFromStringAnd after extracting the specific information for specifying the application corresponding to the character string, and letting the user visually confirm what character string was extracted from the image by displaying this character string, When an arbitrary character string is selected by the user, an application corresponding to the specific information can be activated to execute a predetermined process on the character string. A simple operation that simply selects a column automatically executes a series of processes from selecting a character string from an image to performing predetermined application processing on that character string.can do.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.
[0014]
(1) External configuration of computer device
In FIG. 1, reference numeral 1 denotes a portable personal computer device (hereinafter referred to as a computer device) that constitutes the information processing apparatus of the present invention as a whole. In this case, it is a portable personal computer of B5 size or less.
[0015]
The computer apparatus 1 includes a main body 2 and a display unit 3 attached to the main body 2 so as to be freely opened and closed. The main body 2 includes a plurality of operation keys 4 for inputting various characters, symbols, numbers, and the like on the upper surface, a stick-type pointing device 5 that is operated when a cursor displayed on the display unit 3 is moved, a built-in speaker 6, and a display unit A shutter button 7 is provided which is operated when an image is captured by a CCD (Charge Coupled Device) camera 23 provided in 3.
[0016]
A liquid crystal display 21 composed of an LCD (Liquid Crystal Display) is provided in front of the display unit 3, and an imaging unit 22 having a CCD camera 23 at the center upper end of the front is rotatable with respect to the display unit 3. Is attached.
[0017]
That is, the imaging unit 22 can be rotated and positioned at an arbitrary position within an angle range of 180 degrees between the front direction and the back direction of the display unit 3. Further, as shown in FIG. 2, the imaging unit 22 is provided with an adjustment ring 25 that performs focus adjustment of the CCD camera 23, and the adjustment operation of the adjustment ring 25 is performed to adjust the focus when the imaging target is imaged by the CCD camera 23. Easy to run by.
[0018]
Further, a microphone 24 is provided on the front side of the display unit 3 (FIG. 1) on the left side of the imaging unit 22, and sound can be collected from the back side of the display unit 3 (FIG. 5) via the microphone 24. It is made like that.
[0019]
Further, a power supply lamp PL made of LEDs (Light Emitting Diodes), a battery lamp BL, a message lamp ML, and other lamps corresponding to various uses are provided at the lower center of the front of the display unit 3.
[0020]
Further, a claw 13 is provided on the upper front end portion of the display unit 3 on the left side of the microphone 24, and a hole 8 is provided at a predetermined position of the main body 2 corresponding to the claw 13, so that the display unit 3 is connected to the main unit. In the state closed to 2, the claw 13 is fitted into the hole 8 and locked.
[0021]
As shown in FIG. 2, a slide lever 9 is provided on the front surface of the main body 2. By sliding the slide lever 9 along the front surface in the direction of the arrow, the claw 13 fitted in the hole 8 is provided. The display unit 3 can be unfolded with respect to the main body 2 by releasing the lock.
[0022]
On the front of the main body 2, a predetermined series of operations are automatically executed by starting up predetermined application software (hereinafter simply referred to as an application) from power-on with a single button operation. A programmable power key (PPK key) 10 is provided at the left end, and a plurality of intake holes 11 are provided at the right end.
[0023]
On the left side of the main body 2, as shown in FIG. 3, a slide type power switch 40, a 4-pin compatible IEEE (Institute of Electrical and Electronics Engineers) 1394 terminal 41, a USB (Universal Serial Bus) terminal 42, an input for a microphone A terminal 43, a headphone terminal 44, and an infrared port 45 compliant with IrDA (Infrared Data Association) are provided.
[0024]
As shown in FIG. 4, an exhaust hole 12 is provided on the right side of the main body 2. A PCMCIA (Personal Computer Memory Card International Association) card (hereinafter referred to as a PC card) is located on the right side of the exhaust hole 12. A PC card slot 13 is provided for inserting a PC card slot 13.
[0025]
Further, as shown in FIG. 5, a lid 26 for covering the opening 25 for attaching the additional memory is attached to the lower surface of the main body 2, and a pin insertion hole 48 for removing the locking claw of the lid 26 is provided. Is provided.
[0026]
(2) Circuit configuration of computer device
As shown in FIG. 6, in the main body 2, a PCI (Peripheral Component Interconnect) bus 51 of the activation sequence control unit 83 is connected to a CPU (Central Processing Unit) 52, a PC (Personal Computer) card slot 13, and a RAM (Random Access Memory). 54, an IEEE interface directly connected to an IEEE 1394 terminal 41 for connecting to a graphics processing circuit 55 for generating an image to be displayed on the liquid crystal display 21 of the display unit 3 and another computer device or an external device and capturing digital data 56 is connected.
[0027]
The CPU 52 is a controller that comprehensively controls various functions in the main body 2, and can execute various functions by executing various programs and applications loaded in the RAM 54.
[0028]
The PCI bus 51 is connected to an ISA (Industrial Standard Architecture) bus 59. The ISA bus 59 includes a hard disk drive 60, an I / O (In / Out) controller 61, a keyboard controller 62, a pointing device controller 63, a sound. A chip 64, an LCD controller 65, a modem 66, and a USB interface 67 are connected.
[0029]
Here, the keyboard controller 62 controls the input of a control signal in response to pressing of the operation key 4 (FIG. 1), and the pointing device controller 63 controls the input of the control signal by the stick type pointing device 5 (FIG. 1).
[0030]
The sound chip 64 takes in an audio input from the microphone 24 (FIG. 1) or supplies an audio signal to the built-in speaker 6 (FIG. 1). A modem 66 includes a public telephone line 90, an Internet service provider (hereinafter referred to as this). Is connected to a mail server 93 having the Internet 92 and a mail box 93A. The USB interface 67 is connected to the USB terminal 42 so as to connect peripheral devices such as a USB mouse and a floppy disk drive.
[0031]
The hard disk drive 60 includes a capture software 60A for capturing a still image via the CCD camera 23, a digital map software 60B for performing a map search, an OS (Operating System) 60C made up of Windows 98 (trademark), and various application software ( (Not shown) is stored, and is read by the CPU 52 and loaded into the RAM 54 as necessary.
[0032]
The I / O controller 61 includes an I / O interface 69, a CPU 70, a ROM (Read Only Memory) 71 composed of an EEPROM (Electrically Erasable and Programmable Read Only Memory), and a RAM 72, which are connected to each other. -Time Clock) 81, the current time is always supplied.
[0033]
The ROM 71 of the I / O controller 61 stores a BIOS (Basic Input / Output System) 73, a wake-up program 74, a key input monitoring program 75, and an LED control program 76, and the RAM 72 stores a key input status register 77, A set time register 78, an LED control register 79, and a key corresponding application register 80 are provided.
[0034]
The key input status register 77 stored in the RAM 72 can store an operation key flag, and the CPU 70 determines whether the PPK key 10 (FIG. 2) for one-touch operation is pressed based on the key input monitoring program 75. If the PPK key 10 is pressed, an operation key flag is stored in the key input status register 77.
[0035]
The set time register 78 can store time information such as a start time arbitrarily set by the user in advance. The CPU 70 arbitrarily sets the current time given from the RTC 81 based on the wakeup program 74. It is detected whether or not the start time is reached. When the start time is reached, a predetermined process is executed.
[0036]
Further, the key corresponding application register 80 stores a correspondence relationship between the PPK key 10 or the operation key 4 composed of a plurality of combinations and the application to be activated corresponding to the combination of the PPK key 10 or the preset operation key 4. When the PPK key 10 or a preset operation key 4 is pressed, the CPU 70 sends control data for starting up the corresponding application to the CPU 52 via the ISA bus 59 and the PCI bus 51 in sequence. Then, an application corresponding to the control data is started by the CPU 52.
[0037]
The LED control register 79 stores an end flag when the application stored in the key corresponding application register 80 is started and the operation ends. The CPU 70 stores an end flag in the LED control register 79 based on the LED control program 76. If it is detected, the message lamp ML is turned on.
[0038]
The LED control register 79 stores a power flag when the power switch 40 is pressed, and stores a battery flag when the main body 2 operates with a power supply voltage supplied from a battery. Therefore, when the CPU 70 detects that the power flag or the battery flag is stored based on the LED control program 76, the CPU 70 turns on the power lamp PL and the battery lamp BL.
[0039]
Here, since the backup battery 82 is connected to the I / O controller 61, the key input status of the RAM 72 can be obtained even when the power switch 40 of the main body 2 is off and power is not supplied from a power source (not shown). Each data of the register 77, the set time register 78, the LED control register 79, and the key corresponding application register 80 is held.
[0040]
The reversing switch 88 connected to the I / O controller 61 is turned on when the imaging unit 22 (FIG. 1) is rotated 180 degrees in the direction of imaging the opposite side of the liquid crystal display 21 of the display unit 3. The CPU 70 is notified. The PPK key 10 also notifies the CPU 70 of the state in the same manner as when the reverse switch 88 is pressed.
[0041]
Further, the half-press switch 86 is turned on when the shutter button 7 provided on the upper surface of the main body 2 is half-pressed, and notifies the CPU 70 of the I / O controller 61 of the state, and the full-press switch 87 is a shutter button. 7 is turned on when it is fully pressed, and the state is notified to the CPU 70 of the I / O controller 61.
[0042]
That is, the CPU 70 of the I / O controller 61 enters the still image mode and controls the CCD camera 23 when the shutter button 7 is pressed halfway by the user with the capture software 60A of the hard disk drive 60 started up. The freeze of the still image is executed, and when it is fully pressed, the frozen still image data is captured and sent to the data processing unit 85.
[0043]
On the other hand, when the CPU 70 of the I / O controller 61 enters the moving image mode without starting up the capture software 60A, it captures a moving image of up to about 60 seconds and sends it to the data processing unit 85.
[0044]
The I / O controller 61 controls the graphics processing circuit 55 connected to the PCI bus 51, and the image processing unit 85 converts the image data that is a still image or a moving image captured by the CCD camera 23 into the data processing unit 85. Then, the data is input to the graphics processing circuit 55 after predetermined data processing.
[0045]
The graphics processing circuit 55 stores the supplied image data in a built-in VRAM (Video Random Access Memory) 55A, reads it out as appropriate, sends it to the LCD controller 65, and stores it in the hard disk drive 60 as necessary.
[0046]
The LCD controller 65 controls the backlight 84 of the display unit 3 to illuminate from behind the liquid crystal display 21 and outputs the image data supplied from the graphics processing circuit 55 to the liquid crystal display 21 for display. ing.
[0047]
On the other hand, when the CPU 52 starts up the digital map software 60 </ b> B read from the hard disk drive 60 on the RAM 54, the CPU 52 sends map data from the digital map software 60 </ b> B to the graphics processing circuit 55.
[0048]
At this time, the graphics processing circuit 55 generates map image data to be displayed on the liquid crystal display 21 based on the supplied map data, stores it in the VRAM 55A, reads it out as appropriate, and sends it to the LCD controller 65.
[0049]
Accordingly, the LCD controller 65 displays a map image on the liquid crystal display 21 of the display unit 3 based on the map image data supplied from the graphics processing circuit 55.
[0050]
The PC card slot 13 connected to the PCI bus 51 is appropriately mounted via a PC card (not shown) when adding an optional function, and exchanges data with the CPU 52 via the PC card. Has been made. For example, when a PCMCIA-type GPS (Global Positioning System) card 57 is installed in the PC card slot 13, the GPS antenna 58 connected to the GPS card 57 receives radio waves from GPS satellites to obtain current position data. Has been made.
[0051]
As a result, the GPS card 57 sends the current position data (latitude data, longitude data, and altitude data) received via the GPS antenna 58 to the CPU 52 via the PCI bus 51.
[0052]
In this case, the CPU 52 sends the current position data to the graphics processing circuit 55 and generates an arrow icon indicating the current position based on the current position data by the graphics processing circuit 55, and then the liquid crystal display 21 via the LCD controller 65. The map image is displayed with an arrow icon superimposed on it.
[0053]
Thus, the liquid crystal display 21 can display the arrow icon while moving it on the map image based on the position data detected by the GPS card 57.
[0054]
(3) Configuration of application program operating on OS in the present invention
Here, the OS stored in the hard disk of the hard disk drive 60 and loaded into the RAM 54 at the time of startup includes an API (Application Program Interface) (not shown) composed of system functions for calling various system functions. By starting an application program (hereinafter simply referred to as an application) on the OS, an application screen is displayed on the liquid crystal display 21.
[0055]
In addition, a character string analysis cooperation system, which will be described later, is configured by various applications operating on the OS, and the character string analysis cooperation system has a character string analysis cooperation function when various applications exchange data and perform a cooperative operation. It is made like that.
[0056]
Accordingly, the CPU 52 performs processing according to various applications in the character string analysis cooperation system, thereby extracting the character string noted by the user, and the type of information represented by the extracted character string (for example, the extracted character string is an address, a telephone number) , The map code representing the zip code or latitude / longitude) and the information of the determined character string itself (address, telephone number, zip code or map code) is obtained, It is designed to link to applications related to types. Next, the configuration of this character string analysis cooperation system will be described.
[0057]
As shown in FIG. 7, in the character string analysis cooperation system 100, the character string reading unit 104, the character string capturing unit 101, the character string analysis unit 102, the analysis result display unit 103, the dispatch unit 105, and the cooperation processing unit 106 It is composed of various applications that operate in parallel.
[0058]
That is, here, for convenience, the modules for each application are described separately for the character string reading unit 104, the character string capturing unit 101 to the analysis result display unit 103, the dispatch unit 105, and the cooperation processing unit 106. The CPU 52 performs each process.
[0059]
Here, in the character string reading unit 104, the CPU 52 executes a character string reading process in accordance with an application called Cyberclip (trademark) 301 that reads a character string in an image as text data.
[0060]
Further, in the character string fetching unit 101 to the analysis result display unit 103 and the dispatch unit 105, the CPU 52 performs character string analysis and supply processing according to an application called an address catcher (trademark) 302 that performs character string analysis and supply processing. Execute.
[0061]
Further, in the cooperation processing unit 106, the CPU 52 executes point search processing according to an application (digital map software 60B) called Nabinyu (trademark) 302 that searches for and displays points on the map corresponding to the supplied character string data D2. To do.
[0062]
In practice, the character string reading unit 104 reads a character string in an image captured by the CCD camera 23.
[0063]
The character string fetching unit 101 monitors the read character string. When the cursor is positioned on the character string and designated, the character string fetching unit 101 fetches the character string as a character string D1 and sends it to the character string analyzing unit 102. To do. Here, a specific method for reading a character string by the character string reading unit 104 and a specific method for reading a character string by the character string taking unit 101 will be described later.
[0064]
The character string analysis unit 102 is connected to an analysis database 102A including, for example, an address database, a telephone number database, a postal code database, a map code database, and various other databases, and is supplied from the character string capturing unit 101. The read character string D1 is compared with the data read from the analysis database 102A.
[0065]
As a result, the character string analysis unit 102 determines the type of information (address, telephone number, postal code, or map code) represented by the supplied character string D1, generates a type ID corresponding to the type, Character string data D2 (address, telephone number, postal code, or map code data itself) that is the information itself represented by D1 is extracted, and the type ID and character string data D2 are sent to the analysis result display unit 103.
[0066]
The analysis result display unit 103 generates a predetermined analysis result screen (described later) including the type of information and the character string data D2 based on the type ID and character string data D2 supplied from the character string analysis unit 102. By displaying on the liquid crystal display 21, the user can recognize the type of information represented by the character string D1.
[0067]
Then, the analysis result display unit 103 sends the type ID and character string data D2 held to the dispatch unit 105 when a search execution button (described later) displayed in the analysis result screen is clicked by the user. To do.
[0068]
The dispatch unit 105 reads the digital map software 60B (Nabin Yu 303) related to the type ID supplied from the analysis result display unit 103 by the hard disk drive 60 and starts it on the RAM 54, and then the character string data D2 is converted into the digital map software. 60B is supplied.
[0069]
Since the character string data D2 is supplied to the digital map software 60B activated by the dispatch unit 105, the cooperation processing unit 106 links the digital map software 60B and the character string data D2.
[0070]
Thereby, the cooperation processing unit 106 searches for a point on the map corresponding to the character string data D2 (address, telephone number, postal code, or map code data) of the analysis result according to the digital map software 60B (Nabinyu 303). A map screen including the searched point is generated and displayed on the liquid crystal display 21.
[0071]
(3-1) Analysis processing of character string in image photographed by CCD camera and cooperation processing with application
In practice, as shown in FIG. 8, in the computer apparatus 1, for example, the business card 110 held in the user's hand and the CCD of the imaging unit 22 with the imaging unit 22 (FIG. 1) of the display unit 3 facing the back of the liquid crystal display 21. When the shutter button 7 is pressed while facing the camera 23 (not shown), the business card 110 is imaged. Here, the business card 110 is used, but anything may be used as long as characters such as a book or a postcard are entered.
[0072]
At this time, the computer apparatus 1 displays the image of the business card 110 captured by the CCD camera 23 in the application screen of the liquid crystal display 21 via the data processing unit 85 (FIG. 6), the graphics processing circuit 55 and the LCD controller 65. Is displayed as a clip screen 410 as shown in FIG.
[0073]
In this clip screen 410, a finder-shaped finder display area 411 showing the business card 110 being imaged by the CCD camera 23, and a reading history in which the character string D1 read through the CCD camera 23 is registered and displayed from the top in the new order. A column 412, an auto mode button 413 for switching the reading mode, and a manual mode button 414 are provided.
[0074]
On the clip screen 410, the user selects the auto mode with the auto mode button 413, and the character string desired to be read (“03-5448- ○ ΔΔ ×”) in the recognition frame 411A at the substantially center of the finder display area 411. , And focus adjustment is performed via the adjustment ring 25 (FIG. 2).
[0075]
At this time, the character string reading unit 104 of the information type corresponding system 100 converts, for example, an OCR (Optical Character Reader) device into a character string (“03-5448- ○ ΔΔ ×”) in the image set in the recognition frame 411A. Is read and registered in the reading history column 412 as a character string D1 and displayed.
[0076]
Further, the character string reading unit 104 registers and displays the read character string D1 (“03-5448- ○ ΔΔ ×”) in the uppermost row of the reading history column 412. Further, when the cursor 409 is positioned outside the clip screen 410, the character string reading unit 104 automatically moves the cursor 409 onto the character string D1 to match it. In this case, the cursor 409 is moved to the left of “0”, which is the first (leftmost) character of the character string D1, and is recognized as being superimposed on the character string D1 in this state.
[0077]
In the clip screen 410 of FIG. 9, when another character string D1 is read and added to the top row of the reading history column 412, the position of the cursor 409 does not move and the character string D1 ( “03-5448- ○ ΔΔ ×”) is displayed one step down from the top row, and the cursor 409 is positioned on another latest character string D1. That is, as a result, the cursor 409 has moved relative to the character string D1 (“03-5448- ◯ ΔΔ ×”) read immediately before.
[0078]
Incidentally, in the clip screen 410, the manual mode can be selected by the manual mode button 414. In this case, the size of the recognition frame 411A is changed by dragging the recognition frame 411A at the substantially center of the finder display area 411. Or the position of the recognition frame 411A can be changed.
[0079]
The user sets the character string D1 in the recognition frame 411A, performs focus adjustment, and clicks the lock button 415 in this state to fix the character string D1 to be recognized, and then clicks the clip button 416. As a result, the character string D1 can be read and registered and displayed in the uppermost row of the reading history column 412.
[0080]
When erasing the character string D1 displayed in the reading history column 412 of the clip screen 410, it is only necessary to place the cursor on the character string D1 to be erased and click the delete button 418, and copy the character string D1. In order to use, it is only necessary to place the cursor on the character string D1 to be copied and click the copy button 417.
[0081]
On the clip screen 410, when the cursor 409 is overlaid on the character string D1 displayed at the top of the reading history column 412 and a predetermined time (for example, 1 second) has elapsed, the character string analysis cooperation system 100 displays the character string capturing unit. All the character strings D1 on which the cursor 409 is overlapped by 101 are fetched and sent to the character string analysis unit 102. In the character string analysis collaboration system 100, the character string D1 is captured when the cursor 409 is superimposed on the character string D1 and one second or more elapses. However, the elapsed time is not limited to one second and is changed depending on the setting. obtain.
[0082]
Here, when the cursor 409 is overlaid on the character string, the OS performs re-display to prevent the character string D1 of the overlapped portion from being invisible with the cursor 409. The character string D1 supplied again is taken in by the character string fetching unit 101.
[0083]
The character string analysis unit 102 compares the character string D1 (“03-5448- ○ ΔΔ ×”) supplied from the character string fetch unit 101 with the format of the data read from the analysis database 102A. After identifying the type of information represented by the character string D1 (in this case, the type of the character string D1 is a telephone number) and generating a type ID, the character string data D2 corresponding to the telephone number (that is, “03 -5448- ○ ΔΔ × ”) is extracted, and the type ID and character string data D2 (“ 03-5448- ○ ΔΔ × ”) are sent to the analysis result display unit 103.
[0084]
As shown in FIG. 10, the analysis result display unit 103 generates a predetermined analysis result screen 420 including the type of information corresponding to the type ID and the character string data D2, and displays this in the vicinity of the character string D1 in the reading history column 412. To display.
[0085]
Here, in the analysis result screen 420, the analysis result “phone number 03-5448- ○ ΔΔ ×” is displayed in the recognition result display field 421, so that the type of information represented by the character string D 1 on which the cursor is superimposed is displayed. “Telephone number”, and the user recognizes that the telephone number itself is “03-5448- ○ ΔΔ ×”.
[0086]
In the analysis result screen 420, a recognition level bar 422 indicating the recognition level for the analysis result displayed in the recognition result display field 421 is displayed, and the more probable the analysis result is as the recognition level bar 422 moves to the right. The user can recognize the accuracy of the analysis result at a glance.
[0087]
Further, in the analysis result screen 420, a search execution button 423 is displayed in the upper part of the recognition level bar 422. When the search execution button 423 is clicked by the user, the analysis result display unit 103 clicks the search execution button 423. With the operation as a trigger, the type ID and the character string data D2 that are held are sent to the dispatch unit 105 (FIG. 7).
[0088]
When the application corresponding to the type ID is stored in the hard disk of the hard disk drive 60, the dispatch unit 105 starts up the corresponding digital map software 60B (Nabinyu 303) on the RAM 54, and at the same time the digital map software 60B. Is supplied with character string data D2.
[0089]
The linkage processing unit 106 links the launched digital map software 60B (Nabinyu 303) and character string data D2, and in accordance with the digital map software 60B (Nabinyou 303), character string data D2 (“03-5448- ○ Δ △ A point on the map corresponding to “x”) is searched, and a map screen 430 of an area including the searched point is generated and displayed on the liquid crystal display 21 as shown in FIG.
[0090]
On this map screen 430, the point on the map where the station number representative of “03-5448”, which is the analysis result of the character string D1, is displayed, and the analysis result screen 420 is displayed in an overlapping manner. However, the cooperation processing unit 106 collates the character string data D2 (“03-5448- ○ ΔΔ ×”) with the point database of the digital map software 60B, and if there is a completely matching building or facility, The point is displayed where the cursor crosses.
[0091]
Until the search execution button 423 on the analysis result screen 420 shown in FIG. 10 is clicked by the user, the dispatch unit 105 starts up the digital map software 60B (Nabin Yu 303) corresponding to the type ID and character string data. D2 is not supplied.
[0092]
Accordingly, when the user intends to link the analysis result of the character string D1 with the digital map software 60B, the user may click the search execution button 423 on the analysis result screen 420, and does not intend to link with the digital map software 60B. Sometimes, it is only necessary to shift to the analysis processing of the next character string D1 without clicking the search execution button 423.
[0093]
Next, a character string reading process procedure until the character string D1 is recognized and read from the image of the business card 110 photographed by the CCD camera 23 will be described. In this case, the CPU 52 executes the character string reading process of the flowchart shown in FIG. 12 according to the application of the cyber clip 301 in the character string reading unit 104.
[0094]
The CPU 52 first enters from the start step of the routine RT1 and proceeds to step SP1. When the CPU 52 in step SP1 enters the process of the character string reading unit 104, when the business card 110 is photographed by the CCD camera 23 by the user's operation of the shutter button 7, the process proceeds to the next step SP2.
[0095]
In step SP2, the CPU 52 executes the reading process of the character string D1 set in the recognition frame 411A of the finder display area 411 using the OCR device, and proceeds to the next step SP3.
[0096]
In step SP3, the CPU 52 determines whether the reading process of the character string D1 in step SP2 is successful. If a negative result is obtained here, this means that the character string D1 could not be read because it was out of focus or was not set correctly in the recognition frame 411A. At this time, the CPU 52 Returns to step SP1 and repeats the above process.
[0097]
On the other hand, if a positive result is obtained in step SP3, this indicates that the character string D1 set in the recognition frame 411A is successfully read from the image obtained by photographing the business card 110, and at this time, the CPU 52 Moves to the next step SP4.
[0098]
In step SP4, the CPU 52 registers and displays the read character string D1 in the top row of the reading history column 412 in the clip screen 410, and proceeds to the next step SP5.
[0099]
In step SP5, the CPU 52 moves the cursor 409 onto the character string D1 registered at the top of the reading history column 412, moves to the next step SP6, and ends the character string reading processing procedure.
[0100]
Subsequently, a character string analysis processing procedure until the character string D1 read by the character string reading processing procedure (FIG. 12) of the above-described routine RT1 is taken and analyzed will be described. In this case, the CPU 52 executes the character string analysis process of the flowchart shown in FIG. 13 according to the application of the address catcher 302 in the character string fetch unit 101 to the analysis result display unit 103.
[0101]
The CPU 52 first enters from the start step of the routine RT2, and proceeds to step SP11. In step SP11, when the CPU 52 enters the process in the character string capturing unit 101, whether or not a predetermined time or more has elapsed with the cursor 409 overlaid on the new character string D1 displayed in the reading history column 412 of the clip screen 410. Determine whether.
[0102]
If a negative result is obtained here, this means that the cursor 409 has already been moved without elapse of a predetermined time in a state where the cursor 409 is on the character string D1, and at this time, the CPU 52 returns to step SP11. .
[0103]
On the other hand, if a positive result is obtained in step SP11, this means that a predetermined time or more has passed with the cursor 409 overlaid on the character string D1 in the reading history column 412, that is, the character string on which the cursor 409 is overlaid. This indicates that the user intends to analyze D1, and at this time, the CPU 52 proceeds to the next step SP12.
[0104]
In step SP12, the CPU 52 takes in the character string D1 on which the cursor 409 is superimposed, and proceeds to the next step SP13.
[0105]
In step SP13, when the CPU 52 enters the processing of the character string analysis unit 102, by comparing and referring to the captured character string D1 with the data in the analysis database 102A, the type ID representing the type of information represented by the character string D1 is determined. The extraction process of the character string data D2 is executed, and the process proceeds to the next step SP14.
[0106]
In step SP14, the CPU 52 determines whether the type of information represented by the character string D1 has been determined. If a negative result is obtained here, this means that the character string D1 is neither an address, a telephone number, a postal code nor a map code, but is a type of information represented by the character string D1 as a result of comparison with the data of the analysis database 102A. The CPU 52 moves to step SP17 and ends the character string analysis process.
[0107]
On the other hand, if an affirmative result is obtained in step SP14, this indicates that the type of information represented by the character string D1 can be determined to be “telephone number”. At this time, the CPU 52 displays the analysis result. The process of the unit 103 is started and the process proceeds to the next step SP15.
[0108]
In step SP15, the CPU 52 holds the type ID of the character string D1 and the character string data D2, and proceeds to the next step SP16.
[0109]
In step SP16, the CPU 52 generates an analysis result screen 420 based on the type ID of the character string D1 and the character string data D2, and displays it in the vicinity of the character string D1 on the clip screen 410 (FIG. 10). Next step SP17 Then, the character string analysis processing procedure is finished.
[0110]
Subsequently, the character string data D2 obtained by the character string analysis processing procedure (FIG. 13) of the above-described routine RT2 is transferred to the digital map software 60B (Nabinyu 303) that performs point search using the character string data D2. The result supply processing procedure will be described. In this case, the CPU 52 executes the analysis result supply process of the flowchart shown in FIG. 14 according to the application of the address catcher 302 in the analysis result display unit 103 and the dispatch unit 105.
[0111]
The CPU 52 first enters the start step of the routine RT3 and proceeds to step SP21. In step SP21, when the CPU 52 starts processing in the analysis result display unit 103, the CPU 52 determines whether or not the search execution button 423 (FIG. 10) on the analysis result screen 420 has been clicked.
[0112]
If a negative result is obtained here, this indicates that the search execution button 423 on the analysis result screen 420 is not clicked, and the user has no intention to execute the search processing using the character string data D2. The CPU 52 moves to step SP26 and ends the analysis result supply process.
[0113]
On the other hand, if a positive result is obtained in step SP21, this means that the search execution button 423 on the analysis result screen 420 has been clicked by the user, so that the user is willing to execute the search process using the character string data D2. In this case, the CPU 52 proceeds to the next step SP22.
[0114]
In step SP22, the CPU 52 supplies the type ID and character string data D2 held in the analysis result display unit 103 to the dispatch unit 105 (FIG. 7), and proceeds to the next step SP23.
[0115]
In step SP23, when the CPU 52 enters processing in the dispatch unit 105, the hard disk drive 60 starts up the digital map software 60B (Nabin Yu 303), which is an application corresponding to the type ID, and proceeds to the next step SP24.
[0116]
In step SP24, the CPU 52 determines whether or not the digital map software 60B (Nabin Yu 303), which is an application corresponding to the type ID, has been activated. If a negative result is obtained here, this means that the digital map software 60B (Nabinyu 303) corresponding to the type ID does not exist and cannot be started. At this time, the CPU 52 proceeds to step SP26. The analysis result supply process ends.
[0117]
On the other hand, if an affirmative result is obtained in step SP24, this indicates that the digital map software 60B (Nabinyu 303) corresponding to the type ID could be started, and at this time, the CPU 52 proceeds to the next step SP25. Move.
[0118]
In step SP25, the CPU 52 supplies the character string data D2 (03-5448- ○ ΔΔ ×) to the digital map software 60B (Nabinyu 303) started in step SP24, and proceeds to the next step SP26 to supply analysis results. The processing procedure ends.
[0119]
Finally, a point on the map corresponding to the telephone number of the character string data D2 supplied in step SP25 of the analysis result supply processing procedure (FIG. 14) of the above-described routine RT3 is searched according to the digital map software 60B (Nabinyu 303). The application cooperation processing procedure until the map screen 430 corresponding to the search result is displayed will be described. In this case, the CPU 52 executes the application cooperation process of the flowchart shown in FIG. 15 according to the application of the Nabin You 303 in the cooperation processing unit 106.
[0120]
The CPU 52 first enters from the start step of the routine RT4 and proceeds to step SP31. In step SP31, when the CPU 52 starts processing in the cooperation processing unit 106, the CPU 52 determines whether or not the character string data D2 is supplied to the digital map software 60B of the application corresponding to the type ID. If a negative result is obtained here, this indicates that the character string data D2 has not been supplied. At this time, the CPU 52 proceeds to step SP39 and ends the application linkage processing.
[0121]
On the other hand, if a positive result is obtained in step SP31, this indicates that the character string data D2 has been supplied to the digital map software 60B. At this time, the CPU 52 performs steps SP32 to SP35. Move to one.
[0122]
In this case, since the CPU 52 recognizes that the character string data D2 (“03-5448- ○ ΔΔ ×”) of the telephone number has been supplied, the CPU 52 proceeds to step SP33. Incidentally, the CPU 52 proceeds to step SP32 when the character string data D2 of the zip code is supplied, and moves to step SP34 when the character string data D2 of the address is supplied, and the character string data D2 of the map code is supplied. If so, the process proceeds to step SP35.
[0123]
In step SP33, the CPU 52 retrieves and acquires the latitude / longitude corresponding to the telephone number of the character string data D2 from the telephone number-latitude / longitude table by the hard disk drive 60, and proceeds to the next step SP36.
[0124]
In step SP36, the CPU 52 determines whether or not the latitude and longitude corresponding to the telephone number (“03-5448- ◯ ΔΔ ×”) of the character string data D2 has been acquired. If a negative result is obtained here, this means that the latitude / longitude corresponding to the character string data D2 could not be obtained because it was not registered in the telephone number-latitude / longitude table. The process moves to step SP39 to end the application cooperation process.
[0125]
On the other hand, if a positive result is obtained in step SP36, this indicates that the latitude / longitude corresponding to the character string data D2 has been acquired. At this time, the CPU 52 proceeds to the next step SP37.
[0126]
In step SP37, the CPU 52 searches for a point on the map centered on the latitude and longitude corresponding to the character string data D2 (telephone number) according to the digital map software 60B (Nabinyu 303), and displays a map screen 430 of an area including the point. Generate and move to next step SP38.
[0127]
In step SP38, the CPU 52 displays the map screen 430 on the liquid crystal display 21, moves to the next step SP39, and ends the application cooperation processing procedure.
[0128]
(3-2) Analysis processing of character string on which cursor is superimposed on application screen and cooperation processing with application
Further, in the computer apparatus 1, when a cursor is superimposed on a character string by a user's mouse operation on the application screen of the liquid crystal display 21 and a predetermined time (for example, 1 second) or more elapses, the character string capturing unit 101 (FIG. 7) The character string D1 corresponding to several characters before and after the portion where “is overlaid” is captured and sent to the character string analysis unit 102.
[0129]
For example, as illustrated in FIG. 16, when the cursor 449 is overlaid on the character string “Phone: 03-5448- ○ ΔΔ ×” displayed on the application screen, the character string capturing unit 101 causes the cursor 449 to overlap. A character string D1 “Phone: 03-5448- ○ ΔΔ ×” corresponding to several characters before and after the current part is taken in and sent to the character string analysis unit 102. Here, the range of several characters before and after the character string D1 to be captured by the character string capturing unit 101 is set in advance, but can be arbitrarily changed.
[0130]
The character string analysis unit 102 compares and refers to the character string D1 (“Phone: 03-5448- ○ ΔΔ ×”) supplied from the character string capturing unit 101 and the format of the data read from the analysis database 102A. Thus, after determining the type of information represented by the character string D1 (in this case, the type of the character string D1 is a telephone number) and generating a type ID, the character string data D2 of the portion corresponding to the telephone number (ie, “03-5448- ○ ΔΔ ×”) is extracted, and the type ID and character string data D 2 (“03-5448- ○ ΔΔ ×”) are sent to the analysis result display unit 103.
[0131]
The analysis result display unit 103 generates a predetermined analysis result screen 450 including the type of information corresponding to the type ID and the character string data D2, and displays this in the vicinity of the character string D1 designated by the cursor 449.
[0132]
Here, in the analysis result screen 450, the analysis result “phone number 03-5448- ○ ΔΔ ×” is displayed in the recognition result display field 451 as in the analysis result screen 420 shown in FIG. The user recognizes that the type of information represented by the character string D1 in the part where “is overlaid” is “telephone number” and that the telephone number itself is “03-5448- ○ ΔΔx”.
[0133]
In the analysis result screen 450, similarly to the analysis result screen 420, a recognition level bar 452 indicating a recognition level for the analysis result is displayed in the recognition result display field 451. The analysis result is increased as the recognition level bar 452 moves to the right side. The accuracy of the analysis result is high, and the user can recognize the accuracy of the analysis result at a glance.
[0134]
Further, in the analysis result screen 450, similarly to the analysis result screen 420, a search execution button 453 is displayed above the recognition level bar 452, and when the search execution button 453 is clicked by the user, the analysis result display unit 103 is displayed. Sends the held type ID and character string data D2 to the dispatch unit 105 using the click operation of the search execution button 453 as a trigger.
[0135]
When an application corresponding to the type ID is stored in the hard disk of the hard disk drive 60, the dispatch unit 105 starts up the digital map software 60B (Nabinyu 303) of the corresponding application, and character string data D2 (“03-5448- ○ △△ × ”) is supplied to the digital map software 60B.
[0136]
Thereby, the cooperation processing unit 106 searches for a point on the map corresponding to the character string data D2 (“03-5448- ○ ΔΔ ×”) according to the digital map software 60B (Nabinyu 303), and includes the searched point. Is displayed on the liquid crystal display 21 as a map screen 430 (FIG. 11).
[0137]
Next, a description will be given of a capture and analysis processing procedure for capturing the character string D1 of the text document on which the cursor 449 is superimposed on the application screen and analyzing the character string D1. In this case, the CPU 52 executes the capture and analysis processing of the flowchart shown in FIG. 17 according to the application of the address catcher 302 in the character string capture unit 101 to the analysis result display unit 103.
[0138]
The CPU 52 first enters the start step of the routine RT5 and moves to step SP41. In step SP41, when the CPU 52 starts processing in the character string fetch unit 101, the CPU 52 determines whether or not the cursor 449 is overlaid on the character string of the text document displayed on the application screen.
[0139]
If a negative result is obtained here, this indicates that the cursor 449 is not overlaid on the character string, and at this time, the CPU 52 returns to step SP41 and waits until the cursor 449 is overlaid on the character string.
[0140]
On the other hand, if a positive result is obtained in step SP41, this indicates that the cursor 449 is superimposed on the character string, and at this time, the CPU 52 proceeds to the next step SP42.
[0141]
In step SP42, when the CPU 52 starts processing in the character string analysis unit 102, the CPU 52 determines whether or not a predetermined time or more has elapsed with the cursor 449 overlaid on the character string. If a negative result is obtained here, this indicates that the cursor 449 has already been moved without elapse of a predetermined time in a state where the cursor 449 is overlaid on the character string, and at this time, the CPU 52 performs step SP41. Return to and repeat the above process.
[0142]
On the other hand, if a positive result is obtained in step SP42, this indicates that a predetermined time or more has elapsed with the cursor 449 overlaid on the character string, and at this time, the CPU 52 proceeds to the next step SP43.
[0143]
In step SP43, as in step SP12 of the routine RT2 (FIG. 13), the CPU 52 takes in the character string of the portion where the cursor 449 is overlapped, and sends this as a character string D1 to the character string analysis unit 102. Next step Move on to SP44.
[0144]
In step SP44, when the CPU 52 starts processing in the character string analysis unit 102, as in step SP13 of the routine RT2, the CPU 52 determines the type ID of the information represented by the character string D1 and extracts the character string data D2, and the next step SP45. Move on.
[0145]
In step SP45, as in step SP14 of the routine RT2, the CPU 52 determines whether or not the type of information represented by the character string D1 has been determined. If a negative result is obtained here, this means that the type of information represented by the character string D1 could not be discriminated. At this time, the CPU 52 proceeds to step SP48 and performs character string capturing and analysis processing. finish.
[0146]
On the other hand, if an affirmative result is obtained in step SP45, this means that the type of information represented by the character string D1 can be determined. At this time, the CPU 52 determines the type ID and character string data of the character string D1. D2 is sent to the analysis result display unit 103, and the process proceeds to the next step SP46.
[0147]
In step SP46, when the CPU 52 enters the processing in the analysis result display unit 103, similarly to step SP15 of the routine RT2, the CPU 52 holds the type ID and character string data D2 of the character string D1, and proceeds to the next step SP47.
[0148]
In step SP47, as in step SP16 of the routine RT2, the CPU 52 generates an analysis result screen 420 based on the type ID and character string data D2, and displays this in the vicinity of the character string D1 on the clip screen 410 (FIG. 11). ), The process proceeds to the next step SP48, and the character string fetching and analysis processing procedure is terminated.
[0149]
(4) Operations and effects in the present embodiment
In the above configuration, the CPU 52 of the computer apparatus 1 captures the business card 110 with the CCD camera 23, and the character string D1 set in the recognition frame 411A of the finder display area 411 on the clip screen 410 (FIG. 9). When the focus is adjusted, the character string D1 is recognized and read in accordance with the application of the cyber clip 301, and then registered and displayed in the reading history column 412, and the cursor 409 is moved to the registered character string D1 to be adjusted.
[0150]
Then, the CPU 52 monitors whether or not a predetermined time or more has passed with the cursor 409 being superimposed on the character string D1 in the reading history column 412 according to the application of the address catcher 302. The character string D1 is captured.
[0151]
Subsequently, the CPU 52 determines the type of information represented by the captured character string D1 and extracts the character string data D2, and then generates an analysis result screen 420 by the analysis result display unit 103 and displays it on the liquid crystal display 21.
[0152]
In this way, the computer apparatus 1 displays the analysis result screen 420 on the liquid crystal display 21 so that the analysis result of the character string D1 of the business card 110 photographed by the CCD camera 23 is “phone number”, and the number is “03”. -5448- ○ ΔΔx ”can be recognized by the user, and the accuracy of the analysis result can be recognized at a glance by the recognition level bar 422.
[0153]
Subsequently, when the search execution button 423 on the analysis result screen 420 is clicked by the user, the CPU 52 activates the digital map software 60B (Nabinyu 303) corresponding to the type ID of the character string D1 according to the application of the address catcher 302, and The character string data D2 is supplied to the digital map software 60B (Nabinyu 303).
[0154]
At this time, in the CPU 52, until the search execution button 423 on the analysis result screen 420 is clicked by the user, the character string data D2 is supplied to the digital map software 60B (Nabinyu 303) so as not to cooperate. As a result, the collaborative operation can be executed only when the user intends to execute the search process corresponding to the character string data D2 after confirming the analysis result, thus preventing the execution of the process against the user's intention. Yes.
[0155]
When the digital map software 60B (Nabinyu 303) and the character string data D2 are linked, the CPU 52 obtains the latitude and longitude corresponding to the character string data D2 according to the digital map software 60B (Nabinyu 303), and centers the latitude and longitude. A point on the map is searched, and a map screen 430 corresponding to the search result is displayed on the liquid crystal display 21.
[0156]
That is, the user simply sets the character string D1 displayed on the clip screen 410 by the CCD camera 23 in the recognition frame 411A and adjusts the focus, obtains the analysis result screen 420 of the character string D1 and confirms the type of information. In addition, the map screen 430 including the point on the map corresponding to the character string D2 can be confirmed only by performing a click operation on the search execution button 423 on the analysis result screen 420.
[0157]
Similarly, when the cursor 449 is superimposed on a character string on the application screen displayed on the liquid crystal display 21 for a predetermined time or longer, the computer apparatus 1 displays the analysis result screen 420 by capturing the character string D1 and analyzing it. When the search execution button 423 on the analysis result screen 420 is clicked, a point search can be executed by linking the digital map software 60B and the character string data D2.
[0158]
That is, the user can check the type of information by obtaining the analysis result screen 450 (FIG. 16) of the character string D1 simply by performing a mouse operation to align the cursor 449 with the character string to be analyzed on the application screen. Further, the user can confirm the point on the map corresponding to the character string D2 via the map screen 430 (FIG. 11) simply by performing a click operation on the search execution button 453 on the analysis result screen 450.
[0159]
According to the above configuration, the computer device 1 reads and analyzes the character string D1 designated by the user from the image of the business card 110 taken by the CCD camera 23, and displays the analysis result screen 420 on the liquid crystal display 21. Thus, the user can recognize the type of information represented by the character string D1 and the character string data D2 via the analysis result screen 420, and the user causes the CCD camera 23 to photograph the business card 110 desired to be analyzed. The analysis result of the character string D1 can be recognized with a simple operation.
[0160]
In the computer apparatus 1, when the user confirms the analysis result screen 420 and agrees with the analysis result and clicks the search execution button 423, the digital map software 60B (Nabin Yu 303) corresponding to the type of information represented by the character string D1 is displayed. The user starts and links the character string data D2, searches for a point on the map corresponding to the character string data D2, and displays the map screen 430 including the area of the point on the liquid crystal display 21, so that the user can obtain the analysis result. The search result can be easily obtained by a simple operation of clicking the search execution button 423 when the user is satisfied and intends to execute the point search.
[0161]
(5) Other embodiments
In the above-described embodiment, the character string D1 set in the recognition frame 411A of the image photographed by the CCD camera 23 as the imaging means is subjected to OCR by the application of the CPU 52 and the cyber clip 301 as the character string reading means. Although the case where reading is performed using the apparatus has been described, the present invention is not limited to this, and the character string D1 in the image photographed by the CCD camera 23 by various methods other than the OCR apparatus is read. Also good.
[0162]
In the above-described embodiment, the case has been described in which the CPU 52 executes the character string analysis cooperation process according to the character string analysis cooperation system 100 configured to function by cooperatively operating various applications. The invention is not limited to this, package media such as floppy disks, CD-ROMs (Compact Disc-Read Only Memory), DVDs (Digital Video Discs), semiconductor memories and magnetic disks in which programs are temporarily or permanently stored, Furthermore, it is provided by providing media such as a local area network, the Internet, a wired or wireless communication medium such as digital satellite broadcasting, and various communication interfaces such as a router and a modem that transfer or receive a program provided via the communication medium. String solution included as part of the OS The CPU 52 may execute the character string analysis cooperation process according to the analysis cooperation system 100.
[0163]
Furthermore, in the above-described embodiment, the character string D1 is captured and analyzed by the application of the CPU 52 and the address catcher 302 as the character string capture analysis unit, and is displayed as the display unit by the application of the CPU 52 and the address catcher 302 as the display control unit. The analysis result screen 420 is displayed on the liquid crystal display 21 to allow the user to recognize that the type of information represented by the character string D1 is a telephone number, and depending on the application of the CPU 52 and the digital map software (Nabinyu 303) as linkage means. Although the case where the search corresponding to the telephone number of the character string data D2 is executed and the map screen 430 corresponding to the search result is displayed has been described, the present invention is not limited to this, and the character string D1 is Post the type of information you represent Number, address, latitude / longitude, map code representing the latitude / longitude, e-mail address, URL (Uniform Resource Locator), date / time, monetary unit, or general unit such as km, kg, cm, yard ... Zip code location search application that searches and shows the location on the map where the zip code is defined, address location search application that searches and shows the location on the map corresponding to the address, map corresponding to latitude and longitude Latitude / longitude search application for searching and showing the upper position, map code search application for searching and showing the position on the map corresponding to the map code, e-mail sending application for sending e-mail to the e-mail address, URL HTML (Hyper Text Markup Language) browser to open the homepage based on the calendar, calendar corresponding to the date and time Scheduler application that opens the calendar, monetary conversion application that automatically converts a predetermined amount into an amount according to another monetary unit, or an electronic computer application that performs various calculations using numerical values according to the unit, zip code, address The personal information search application for searching for personal information based on the latitude / longitude, the map code, the e-mail address or the URL and the character string data D2 may be linked to execute predetermined processing.
[0164]
Further, in the above-described embodiment, the case where a character string is read from an image captured by the CCD camera 23 in the camera-integrated computer apparatus 1 has been described. An image captured by a camera or the like may be fetched from the outside via the IEEE 1394 terminal 41, and a character string may be read from the image.
[0165]
【The invention's effect】
  As described above, according to the present invention,Imaged by imaging meansimageFromStringAnd after extracting the specific information for specifying the application corresponding to the character string, and letting the user visually confirm what character string was extracted from the image by displaying this character string, When an arbitrary character string is selected by the user, an application corresponding to the specific information can be activated to execute a predetermined process on the character string. A simple operation that simply selects a column automatically executes a series of processes from selecting a character string from an image to performing predetermined application processing on that character string.Thus, it is possible to realize an information processing apparatus with much higher operability that can analyze a character string and execute a desired process only with a simple operation by a user.
[0166]
  Also according to the invention,Imaged by imaging meansimageFromStringAnd after extracting the specific information for specifying the application corresponding to the character string, and letting the user visually confirm what character string was extracted from the image by displaying this character string, When an arbitrary character string is selected by the user, an application corresponding to the specific information can be activated to execute a predetermined process on the character string. A simple operation that simply selects a column automatically executes a series of processes from selecting a character string from an image to performing predetermined application processing on that character string.Thus, it is possible to realize an information processing method that can analyze a character string and execute a desired process with a simple operation by a user.
[Brief description of the drawings]
FIG. 1 is a schematic perspective view showing an overall configuration of a computer apparatus.
FIG. 2 is a schematic diagram illustrating a front configuration of a main body.
FIG. 3 is a schematic diagram illustrating a state in which a display unit is closed with respect to a main body.
FIG. 4 is a schematic diagram showing a state where the display unit is opened 180 degrees with respect to the main body.
FIG. 5 is a schematic diagram showing a lower surface configuration of a main body.
FIG. 6 is a block diagram illustrating a circuit configuration of a computer device.
FIG. 7 is a block diagram showing a configuration of a character string analysis cooperation system according to the present invention.
FIG. 8 is a schematic diagram showing a state of taking a business card by a CCD camera.
FIG. 9 is a schematic diagram illustrating a clip screen.
FIG. 10 is a schematic diagram illustrating a character string analysis result screen;
FIG. 11 is a schematic diagram illustrating a map screen of a search result.
FIG. 12 is a flowchart showing a reading processing procedure for reading a character string in an image photographed by a CCD camera.
FIG. 13 is a flowchart showing a character string analysis processing procedure.
FIG. 14 is a flowchart showing an analysis result supply processing procedure;
FIG. 15 is a flowchart illustrating an application cooperation processing procedure.
FIG. 16 is a schematic diagram showing an analysis result screen of a character string designated by a cursor.
FIG. 17 is a flowchart showing a procedure for taking in and analyzing a character string designated by a cursor on an application screen.
FIG. 18 is a schematic diagram showing a conventional normal pop-up menu.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Computer apparatus, 2 ... Main body, 3 ... Display part, 21 ... Liquid crystal display, 23 ... CCD camera, 52 ... CPU, 54 ... RAM, 60 ... Hard disk, 100 ... Character string analysis Linked system 101... Character string fetching section 102... Character string analyzing section 103... Analysis result display section 104... Character string reading section 105.

Claims (13)

Storage means for storing a plurality of applications;
Acquisition means for acquiring image data obtained by an imaging means for capturing an image;
Extraction means for extracting specific information for specifying a character string and an application corresponding to the character string from the image data;
Display control means for displaying the character string extracted by the extraction means together with the image data on a predetermined display means;
The character extracted by the extraction means by referring to the storage means, starting the application based on the specific information corresponding to the character string selected from the character strings displayed on the display means, An information processing apparatus comprising: an application processing unit that executes predetermined processing by the application on a column. The information processing apparatus according to claim 1, wherein the extraction unit recognizes and extracts the character string in the image using an OCR (Optical Character Reader) unit. The extraction means registers and displays the extracted character string in a predetermined list in the display screen of the display means, and moves the cursor to the latest character string displayed in the list to display the character string. The information processing apparatus according to claim 1, wherein the information processing apparatus is selected. The information processing apparatus according to claim 1, wherein the character string is a telephone number. The storage means stores position information corresponding to the postal code,
The extraction means extracts a zip code as the character string,
The information processing apparatus according to claim 1, wherein the application processing unit generates a map screen based on the position information corresponding to the zip code extracted by the extraction unit with reference to the storage unit. The storage means stores position information corresponding to the address,
The extraction means extracts an address as the character string,
The information processing apparatus according to claim 1, wherein the application processing unit generates a map screen based on the position information corresponding to the address extracted by the extraction unit with reference to the storage unit. The storage means stores position information corresponding to the map code,
The extraction means extracts a map code as the character string,
The information processing apparatus according to claim 1, wherein the application processing unit generates a map screen based on the position information corresponding to the map code address extracted by the extraction unit with reference to the storage unit. The extraction means extracts latitude and longitude as the character string,
The information processing apparatus according to claim 1, wherein the application processing unit generates a map screen based on the latitude and longitude extracted by the extraction unit with reference to the storage unit. The extraction means extracts an email address as the character string,
The application processing means refers to the storage means, reads out an e-mail application for transmitting an e-mail to the e-mail address extracted by the extraction means from the storage means, and activates the e-mail application. The information processing apparatus described. The extraction means extracts a URL (Uniform Resource Locator) as the character string,
The information processing apparatus according to claim 1, wherein the application processing unit reads the browser for opening a home page from the storage unit based on the URL extracted by the extraction unit with reference to the storage unit and activates the browser. The extraction means extracts date and time as the character string,
The information processing apparatus according to claim 1, wherein the application processing unit reads the scheduler application from the storage unit and starts the scheduler application based on the date and time extracted by the extraction unit with reference to the storage unit. The information processing apparatus according to claim 1, wherein the extraction unit extracts an amount of money as the character string. An acquisition step of acquiring image data obtained by an imaging means for capturing an image by an acquisition means;
An extraction step of extracting specific information for specifying a character string and an application corresponding to the character string from the image data by an extraction unit;
A display control step of displaying the character string extracted by the extraction means on a predetermined display means together with the image data by a display control means;
The application processing means refers to the storage means, starts the application based on the specific information corresponding to the character string selected from the character strings displayed on the display means, and uses the extraction means to And an application processing step for executing predetermined processing by the application on the extracted character string.

Images