JP3717920B2 - Mobile phone - Google Patents

Description

  The present invention relates to a mobile phone such as a digital camera or a camera-equipped mobile phone.

Technical background

  In addition to the function as a so-called telephone for transmitting and receiving radio waves, a recent mobile phone having a screen display device such as a liquid crystal panel and an input device using key input can enjoy a function for exchanging mail and a game. The trend toward multi-functionality is progressing.

  In recent years, with the development of small, low power consumption image sensors, it has become possible to incorporate a camera in a portable device such as a mobile phone, and immediately send images taken by the built-in camera via e-mail. It is possible to do it. These built-in cameras are prioritized to be small, and have a lower resolution than general digital cameras.

  Moreover, recent cellular phones have a function of connecting to the Internet. In order to connect to the Internet, it is necessary to input a Uniform Resource Locator (URL) from a key, and it has been troublesome to enter a long URL with a key of a mobile phone. Therefore, an attempt is made to manage the URL with a unique number and read the printed barcode corresponding to the number with a barcode reader, thereby saving the trouble of inputting the URL and improving the usability of the user. . In such an apparatus, it is necessary to separately connect a barcode reader to the mobile phone.

  Therefore, in a portable device with a built-in camera, if a barcode can be recognized with respect to a barcode image input by the built-in camera, such a service can be used without preparing a separate barcode reader.

  For example, Patent Document 1 discloses an information providing service in which a photo mode and a QR code (two-dimensional code) reading mode can be selected and set, and processing according to the setting mode is performed. Patent Document 2 describes a code reader that increases the reading accuracy by processing a one-dimensional code with a line CCD and processing a two-dimensional code with an area CCD. However, there is no description about the setting of the camera image capture area according to the barcode type.

  Patent Document 3 describes that a telephone number is replaced with a two-dimensional barcode and the two-dimensional barcode is read by a CCD scanner attached to the telephone.

  By the way, the resolution of the current built-in camera is lower than that of the image sensor used in the barcode reader, and it is difficult to recognize the barcode with high accuracy.

  Further, as a cause of difficulty in recognizing the barcode, the width of the bar photographed in the input image is not constant. This is because the distance relationship between the barcode and the camera changes each time an input is made. In a close-up type scanner, the bar code can always be entered in a certain size, so the bar width can be determined in advance, but when shooting a bar code with a camera held by hand, a certain bar The width cannot be determined in advance.

  A method has been proposed in which the width of a bar is determined from a barcode image input by an image scanner and the barcode is recognized. For example, in Patent Document 4, a barcode included in an image captured by a camera is recognized, and if the captured image is decodable, a speaker sound is generated, and the barcode data is stored and imaged for display. An apparatus for displaying the information is disclosed.

JP 2002-111909 A Japanese Patent Laid-Open No. 9-259215 JP 2001-197186 A JP 2002-176509 A

  However, such a conventional mobile terminal with a camera has the following problems.

  For example, since the physical size of a code to be read differs from that of a one-dimensional code or two-dimensional code, a camera used for a camera-equipped mobile phone having a relatively low resolution is more There was a problem that it was necessary to select a resolution.

  Also, a camera that is normally set to shoot people or landscapes is not supposed to shoot in macro mode like barcodes, and cannot shoot barcode images that are suitable for reading. There was a problem.

  Furthermore, since the angle of view of the camera is relatively narrow, there is a problem that it is difficult to fit the code to be read within the shooting range of the camera. In this case, it is necessary to perform close-up photography. At this time, there is a problem that a stable image cannot be obtained because it is easily affected by the shadow of the apparatus main body.

  The present invention has been made in view of such problems, and an object of the present invention is to provide a mobile phone capable of reading a code accurately with a simple operation.

  It is another object of the present invention to provide a mobile phone that can easily adjust a camera opening to a subject.

Mobile phone of the present invention includes an imaging means for capturing an image, and display means for displaying the image obtained by the imaging means, recognizing the code recognition means for code of the captured image, the code recognition means Starting and code recognition instruction means for instructing a user operation, and equipped with a photographing procedure switching means for switching a photographing target code in the user operation, the imaging unit to the rear panel, of the imaging unit comprising: a body front The display means is provided on the back side, and the display magnification is changed according to the readable code type after the photographing procedure switching means switches the photographing object to the code until the code recognition means is activated. The captured images are continuously displayed on the display means, and after the code recognition means is activated, the image pickup is performed at the display magnification and the frame rate necessary for the code recognition means. Performed continuously code recognition while displaying an image on the display means, it is characterized in that instead of the code recognition is successful in the captured image recognition results of the code displayed on the display means.

The cellular phone according to the present invention includes an imaging unit that captures an image, a display unit that displays an image obtained by the imaging unit, a code recognition unit that recognizes a code of the captured image, and a shooting target that can be operated by a user operation. A photographing procedure switching means for switching to a code, the imaging means on the back of the main body, and the display means on the back side of the imaging means on the back side of the imaging means. After switching, the display magnification is changed according to the readable code type, and the captured image is continuously displayed on the display unit at a frame rate necessary for the code recognition unit. When the code recognition is successful, the captured image is displayed. Instead, the code recognition result is displayed on the display means.

The imaging procedure switching means, it is more preferable to change the image capturing area in the image pickup means in accordance with the code type.

Before Kiko over de type may comprise a type of one-dimensional bar codes and two-dimensional bar code.
The image capturing area of the imaging unit may be reduced, and an image corresponding to the image capturing area may be displayed to change the display magnification and perform an enlarged display.

The code recognizing unit may recognize a one-dimensional barcode, and may change an image capturing area and a display magnification so that a long side of the one-dimensional barcode is within a horizontal direction of the imaging unit.

The photographing procedure switching means changes at least one of gradation characteristics, contrast, brightness, white balance, exposure, depth of focus, contour enhancement, and resolution when the photographing target is switched to a barcode. There may be.

If the code recognition unit recognizes it successfully, a notification unit that notifies the success may be provided.

The notification means may notify the recognition result by sound, voice, or message display on the display means.

The notification means may display a message indicating a recognition failure on the display means when the code cannot be recognized within a preset time .

  As described above in detail, according to the present invention, in a mobile phone such as a camera-equipped mobile phone, a code can be read accurately with a simple operation.

  In addition, it is possible to realize a mobile phone that can easily adjust the opening of the camera to the subject and improve the operability and usability of code reading.

Hereinafter, preferred embodiments of a mobile phone according to the present invention will be described in detail with reference to the accompanying drawings.
First, the basic concept of the present invention will be described. The case where the mobile phone according to the present invention is applied to a camera-equipped mobile phone is taken as an example.

  (1) This camera-equipped mobile phone incorporates a small light that can be turned on and off by a user operation. When reading a code such as a two-dimensional bar code, it is turned ON / OFF by a user operation. By turning on / off the light by the user's operation, even if the peripheral light amount due to the lens characteristics is reduced, even if the reading body has a shadow on the reading code, the code can be read stably. In the mode in which the light is always turned on at the time of reading the code, there is a case where an adverse effect is caused by specular reflection. Therefore, the light ON / OFF is switched while confirming the image being input by the camera on the LCD display unit.

  (2) When the mobile phone with the camera reads the code, the image of the code being photographed is displayed on the LCD display unit in real time. By displaying the image of the code being photographed in real time, the user can check whether the barcode is photographed correctly by the camera. As a result, it is possible to prevent the code from sticking out of the screen or to produce a greatly distorted image, and the operability is improved. Further, after reading, the reading result can be immediately displayed on the screen, so that the reading result can be instantly known. Further, when the reading is completed, the user can be notified by sounding a reading end sound “ping pong or chili ring”.

  (3) The reading operation is continuously performed for each continuously captured image and continues until the reading is completed. At this time, since the time required for the reading process is large, the image is captured at most about 2 FPS (frame per second) and the display is also about 2 FPS. This makes it difficult to align the code at an appropriate position while looking at the LCD display unit. Therefore, the mobile phone with camera does not execute the code reading process until the user gives an instruction, and displays a smooth moving image on the LCD display unit. As a result, the user can adjust the code to an appropriate position. When the code is in the proper position, operate the button to execute the reading process. At this time, the display drops to about 2 FPS, but since the code has already been photographed at an appropriate position, reading can be completed immediately and there is no problem.

  (4) In addition, with normal camera-equipped mobile phones, the colors are adjusted to be natural for the purpose of shooting people and landscapes, so they are not suitable for code reading applications. . Therefore, the camera-equipped mobile phone prepares and uses a code reading mode adjusted separately from the normal mode when reading the code. For example, the white balance and exposure are adjusted so that the contrast between light and dark in the code is emphasized, the correction coefficient is adjusted so that the contour (edge part) is more emphasized, and the resolution is adjusted. Prepare a barcode reading mode. When the user designates code reading, the bar code reading mode is automatically switched to.

  (5) There are types of codes to be read such as one-dimensional codes and two-dimensional codes. There is a difference in the size of printed code and the thickness of the line for each code type. Therefore, the mobile phone with the camera designates whether to read one-dimensional code or two-dimensional code, and switches the image capturing range of the camera according to the designation. Also, the magnification at the time of display is optimized.

  FIG. 1 is a diagram showing the appearance of a portable terminal device according to an embodiment of the present invention based on the above basic concept, FIG. 1 (A) is a front view thereof, and FIG. 1 (B) is a rear view thereof. . The portable terminal device of this embodiment is an example in which the code reader is applied to a camera-equipped cellular phone / PHS (Personal Handy-Phone System) portable communication terminal.

  In FIG. 1, reference numeral 10 denotes a camera-equipped mobile phone (mobile terminal device). A mobile phone 10 main body 10 a includes an antenna 11 for performing wireless communication, a camera built in the back of the main body 10 a and inputs target image information. 12 (imaging means), a small light 13 (illumination means) which is built in the back of the main body 10a and emits light by a user operation or the like when reading a barcode, a loudspeaker 14 for receiving a voice (a part of the notification means) LCD display section 15 (display means, part of notification means) for displaying information such as guidance and reception information for operation, image and text information, power key 16 for turning on / off power, incoming call, outgoing call, Telephone function keys 17 for switching telephone functions, determining operations, etc., mode keys 18 for switching various functions, and moving the selection target in the vertical and horizontal directions A cursor key 19, a shutter key 20 that is a shutter button for determining input of the camera 12, a light ON / OFF button 21 (illumination switching means) for turning on / off the light 13, a membrane key for dialing such as input of a telephone number ( Membrane key) and a microphone 23 for inputting voice.

  The camera 12 is a 340,000 pixel CCD (Charge Coupled Device) (area-type solid-state imaging device) camera built in the mobile phone 10, for example. The camera 12 has a single focus lens, and the depth of focus can be switched between normal shooting and barcode reading. The detailed configuration will be described later with reference to FIG.

  The LCD display unit 15 includes a dot matrix LCD display, a backlight PDP, EL, and drivers. The LCD display unit 15 displays image information input from the camera 12 at the time of shooting. When the code recognition is completed, a recognition result is displayed by a message such as a character or an icon. In addition, at the time of non-photographing, a number input from the dial key 22, various screens for a non-telephone function, icons indicating an operation state of the telephone function, and the like are displayed. Furthermore, the time is displayed during standby, and personal information, system status, and the like are displayed.

  The power key 16, the telephone function key 17, the mode key 18, the cursor key 19, the shutter key 20, the light ON / OFF button 21 and the dial key 22 are all manually operated, and the operated contents are controlled by the control unit 31 ( 2) as information. In the present embodiment, the shutter key 20 and the light ON / OFF button 21 are independent keys, but the function of these keys may be assigned to another key (for example, the mode key 18).

  FIG. 2 is a block diagram when the barcode reader is incorporated in a camera-equipped mobile phone.

  In FIG. 2, a mobile phone 10 is a portable information terminal such as a PDA (Personal Digital Assistants) or a PHS / mobile phone, and a control unit 31 (shooting procedure switching means, bar code recognition means) comprising a CPU for controlling the entire apparatus. , Information processing means, frame rate control means, timer setting means), ROM for storing control programs, fixed data, etc., semiconductor memory such as RAM which is a working storage area of the CPU, and hard disks, etc. received or input characters A storage memory 32 for storing information, image information, audio signals, a camera 33 (imaging means) for inputting target image information, a light 34 (illumination means) that emits light by a user operation when reading a barcode, character information, Display unit 35 for displaying image information to the user (display means, part of notification means), key operation information from the user A key input unit 36 for generating input, an antenna 37 for transmitting / receiving radio waves, a wireless unit 38 for controlling transmission / reception of wireless communication, a speaker 39 (part of notification means) for outputting audio signals, and a microphone 40 for inputting audio signals from a user It is configured with.

  The control unit 31 controls the entire mobile phone 10 and has a barcode reading function. Based on key operations, the controller 31 captures barcodes, displays image information, recognizes barcodes, and processes based on recognized contents. Perform.

  In particular, the control unit 31 includes a shooting procedure switching unit that switches a shooting procedure according to a subject such as a natural image or a barcode, and a code recognition unit that recognizes a barcode (code decoding) when switched to barcode shooting. And a function of notifying means for notifying the user of the recognized result and information processing means for performing a predetermined process based on the recognized content.

  Further, at the time of switching the bar code shooting, an image is displayed on the display unit 35 at a high frame rate obtained from the camera 33 until the code recognition unit is activated, and after the activation, the frame rate required for the code recognition unit is set. And has a function as a frame rate control means for displaying an image. The specific contents of each function will be described later with reference to the flow of FIG.

  The ROM is a read-only semiconductor memory that stores fixed data such as a program and communication control data required when the control unit 31 operates. The RAM is used as a so-called working memory that temporarily stores data relating to barcode recognition and communication, data used for calculation, calculation results, and the like. A program processed by the mobile phone 10 is developed and executed in this RAM. Further, a part of the RAM is composed of an electrically erasable programmable ROM (EEPROM) which is an electrically rewritable nonvolatile memory, and various specifications in the cellular phone 10 can be changed by changing a program written in the EEPROM. Can do. That is, recently, in order to avoid the time loss of changing the mask ROM for each debugging of the system development, the program ROM is a non-volatile memory, for example, EPROM, EEPROM, and the time for program development / modification time is greatly reduced. . Further, if the program is downloaded and the program contents of the EEPROM are rewritten, it is possible to easily upgrade functions or change functions.

  FIG. 3 is a diagram schematically showing the lens focal depth switching mechanism of the camera 12, and shows the focal depth switching mechanism between normal photographing and barcode reading.

  In FIG. 3, a camera module 50 comprising a solid-state imaging device such as a CCD and its signal output circuit, a lens unit 52 having a lens 51 therein and screwed onto the camera module 50, and an outer periphery of the lens unit 52 And a camera lever 53 that rotates the lens unit 52.

  The lens unit 52 is fitted to the camera module 50 with a screw. When the knob 53a of the camera lever 53 is moved in the direction A ← → B in FIG. Move in the Y direction. As a result, the focal length between the lens 51 mounted on the lens unit 52 and the camera module 50 is switched, and the focal depth at the time of normal photographing and barcode reading is switched. In the present embodiment, the camera lever 53 is slid by a drive unit (not shown) made of a solenoid or the like that receives a drive signal from the control unit 31 when the barcode is read, and the depth of focus is automatically switched. Yes. The camera body 10a (FIG. 1) may be provided with a slide knob that is linked to the knob 53a of the camera lever 53 so that the user can switch manually during macro shooting such as when reading a barcode.

The operation of the camera-equipped cellular phone configured as described above will be described below.
FIG. 4 is a flowchart showing the barcode reading operation of the mobile phone 10, and is executed by the control unit 31. In the figure, S indicates each step of the flow.

  FIG. 5 is a diagram showing a mode selection screen display example of the LCD display unit 15 of the mobile phone 10.

  When the user presses the mode key 18 in the standby state, a mode selection screen shown in FIG. 5A is displayed. In this state, when the “bar code” is selected by the cursor key 19 and the mode key 18 or the telephone function key 17 is pressed and determined, the bar code reading mode is entered and the code type selection screen shown in FIG. 5B is displayed. .

  The flow shown in FIG. 4 is started by the user's “barcode” selection operation. First, in step S1, the barcode reading mode is set. In this barcode reading mode setting, initial settings necessary for barcode reading are performed. In this initial setting, processing other than barcode reading processing, for example, proper shooting and camera storage, schedule management processing, etc., data storage, program activation necessary for barcode reading, barcode reading shown in FIG. Switch the focal depth switching mechanism at the time.

  In step S2, the code type is determined in response to a user instruction on the code type selection screen shown in FIG. 5B. If the code type is a one-dimensional code, the process proceeds to step S3. If the code type is a two-dimensional code, the process proceeds to step S3. .

  When the barcode reading mode is set, the user selects the type of code (one-dimensional code / 2-dimensional code). As described above, there are types of codes to be read such as one-dimensional codes and two-dimensional codes, and there are differences in the size of printed codes and the thickness of lines for each code type. Therefore, the user designates whether to read the one-dimensional code or the two-dimensional code, and the image capturing range of the camera and the magnification at the time of display are optimized according to the designation.

  In the case of a one-dimensional code, the camera and display settings are set to predetermined values (set value 1) in step S3.

  In the case of a two-dimensional code, a value different from the set value 1 (set value 2) is set in step S4.

  FIG. 6 is a diagram for explaining that the image capturing range and the magnification at the time of display differ between the one-dimensional code and the two-dimensional code.

  As shown in FIG. 6, in the case of a one-dimensional code, the shooting range of the camera is set to 640.times.480, and the display is set so that this camera image is an equal magnification. On the other hand, in the case of a two-dimensional code, the shooting range of the camera is set to 320 × 240 in the vertical direction, and the display is set so that the camera image is doubled in the vertical and horizontal directions. In other words, in the case of a one-dimensional code, a long barcode in a one-dimensional direction with a large amount of information is included in the horizontal photographing range of the camera, and in the case of a two-dimensional code, the photographing range of the camera (camera capture range) is set. The camera image is displayed in double the vertical and horizontal directions after being halved in the vertical and horizontal directions. In addition to this, common camera settings for the one-dimensional code and the two-dimensional code include settings such as edge component enhancement and contrast enhancement.

  Returning to the flow of FIG. 4, when the camera / display setting 1 in step S3 or the camera / display setting 2 in step S4 is performed, an event wait state is entered in step S5, and processing is switched depending on each event.

  The light ON / OFF operation event occurs when the user presses the light ON / OFF button 21, and when this event is read in step S5, the process proceeds to step S6, and the light 13 is turned ON / OFF according to the setting. .

  The reading start operation event occurs when the user presses a reading start button (for example, the telephone function key 17). When this event is read in step S5, the process proceeds to step S7, and a flag indicating the start of reading is set. To do. Further, as will be described later with reference to FIG. 10, in a configuration in which a mark indicating the position of the camera 12 is displayed on the LCD display unit 15, the mark may not be displayed after the reading is started.

  The frame capture event occurs when the camera 12 reads an image for one frame and the reading is completed. When this event is read in step S5, the process proceeds to step S8, and the read image is displayed on the LCD display unit 15 according to the setting. At this time, a mark 71 (see FIG. 10) indicating the position of the camera 12 may be displayed on the LCD display unit 15 at the same time.

  In step S9, it is determined whether or not to start the reading process. If the reading start flag is set (YES in step S9), the code reading process is started in step S10. If the reading fails, the process returns to reading the event in step S5.

  In step S11, it is determined whether or not the code reading is successful. If the code reading is successful (YES in step S11), the reading result is displayed on the LCD display unit 15 in step S12, and a confirmation sound is displayed on the speaker in step S13. 14 and the code reading by this flow is completed. The user's attention is alerted by the reproduction of the confirmation sound informing the completion of reading, and the user knows that the barcode reading has been completed.

  Before starting reading, the loop surrounded by the broken line in FIG. 4 is repeated. At this time, since code reading processing is not performed, smooth display can be performed at a high frame rate.

  FIG. 7 is a diagram showing a screen display example by the barcode reading process. FIG. 7A shows a shooting screen before reading, FIG. 7B shows a shooting screen during reading, and FIG. C) shows the screens of recognition results after the reading.

  Although an example in which the recognition target pattern is a two-dimensional code will be described, the recognition target image may be a character pattern in addition to a symbol pattern such as a one-dimensional / two-dimensional barcode.

  Since smooth display can be performed at a high frame rate before reading starts, for example, as shown in FIG. 7 (A), the user can see the code protruding from the screen (shooting area) on the screen. However, the camera 12 (the main body 10a of the mobile phone) can be easily operated so that the code fits within the screen. That is, since a delay in displaying the shooting screen before reading is very small, the user can operate the code so as to fit the code within the screen while looking at the screen.

  Then, as shown in FIG. 7B, the user performs a reading start operation when the code is placed on the screen, and then the reading result is displayed (see FIG. 7C).

  FIG. 8 is a diagram showing a screen display example by the barcode reading process. FIG. 8A shows a shooting screen before reading, FIG. 8B shows a shooting screen during reading, and FIG. C) shows the screens of recognition results after the reading.

  Further, as shown in FIG. 8A, when a part of the image is dark due to a shadow or the like, it is difficult to read the code. In the code reading, the camera 12 (the main body 10a of the mobile phone) is photographed by taking a close-up image of the reading code.

  In the present embodiment, the user can check the current input image by checking the screen, so if the code shown in FIG. 8A is shaded, the light ON / OFF button If the light 13 is turned on by operating 21, as shown in FIG. 8B, the influence of the shadow is eliminated and the reading succeeds (see FIG. 8C).

  9A and 9B are views showing the appearance of a mobile terminal device according to another embodiment, FIG. 9A is a front view thereof, and FIG. 9B is a rear view thereof. The same components as those in FIG. 1 are denoted by the same reference numerals.

  In FIG. 9, the camera-equipped mobile phone 60 (mobile terminal device) adds a mark 61 indicating the camera position to the back of the camera 12 on the back of the main body 10a (a position opposite to the opening of the camera 12) by sticker / printing or the like. Yes.

  Since the user cannot see the camera position when viewing the LCD display unit 15, the camera 12 is difficult to move to the subject. This was particularly noticeable in close-up photography such as barcode reading.

  In the present embodiment, since the mark 61 is attached directly behind the opening of the camera 12, the user can easily operate the mark 61 when the camera 12 is aligned with the code to be read that is the subject.

  Depending on the position of the camera 12, the mark may be displayed on the LCD display unit 15 (marker display means) as shown in FIG.

  In FIG. 10, the camera-equipped mobile phone 70 (mobile terminal device) displays a mark 71 indicating the camera position on the LCD display unit 15 directly behind the camera 12 on the back of the main body 10a (a place opposite to the opening of the camera 12). .

  When displaying on the LCD display unit 15, it is preferable to turn it off simultaneously with the shutter. In the case of this configuration, in the reading start operation event in step S7 of FIG. 4, the reading may not be displayed after the reading is started. When displaying the image read in step S8 of FIG. 4 on the LCD display unit 15, the mark 71 indicating the position of the camera 12 may be displayed at the same time.

  Thus, since the mark 71 is attached to the corresponding position of the camera 12 position, it becomes a guideline when the camera 12 is aligned with the code to be read, which is the subject, and the operation becomes easy.

  FIG. 11 shows an example as another embodiment. FIG. 11 is a flowchart showing another embodiment of the barcode reading operation. The same processing parts as those in FIG. 4 are denoted by the same reference numerals.

  In FIG. 11, step S7 and step S9 in FIG. 4 are omitted. In this case, after a frame capture event is read in step S5, an image is displayed in step S8, and then the process immediately proceeds to step S10 to execute a code reading process.

  In this embodiment, an image cannot be displayed at a high frame rate before the code reading is started, but a user operation such as pressing a reading start button (for example, the telephone function key 17) can be omitted. There is an advantage that the number of operations can be simplified.

  As another embodiment, an image captured from a camera is stored in a storage memory, and after the image is displayed, the user can select whether or not to stop the code reading process with the image after stopping the image. It may be. If the user selects to start code reading, code reading is performed, otherwise, the stored image is discarded and a new image is taken in again from the camera.

  This embodiment is effective when the mobile terminal has a remarkably low processing capability and the code reading process takes 1 second or more. By deciding whether to start the code reading process after carefully observing the captured image, the user can execute code reading for images that clearly fail to read (images are blurred due to camera shake, etc.). First, take a picture again. This is because the number of times of time-consuming code reading processing can be minimized.

  As described above, the camera-equipped mobile phone 10 according to the present embodiment displays the camera 12 that inputs target image information, the small light 13 that emits light by operating the ON / OFF button 21 when reading a barcode, and the information. An LCD display unit 15 and a control unit 31 including a CPU that controls the entire apparatus are provided. The control unit 31 switches a shooting procedure depending on a subject such as a natural image or a barcode, and when the barcode shooting is switched, the barcode is displayed. Is recognized, the user is notified of the recognized result, and predetermined processing is executed based on the recognized content, so that the barcode used by the camera-equipped mobile phone having a relatively low resolution is read. Automatically shifts to a barcode reading mode suitable for barcode shooting, and the code is accurately obtained with a simple operation. It is possible to take look.

  Further, at the time of switching the barcode shooting, an image is displayed on the display unit 35 at a high frame rate obtained from the camera 33 until the code recognition process is started, and after the start, the image is displayed at a frame rate necessary for the code recognition process. Therefore, the reading operation is continuously performed for each continuously captured image, a smooth moving image can be displayed on the LCD display unit 15, and the code can be adjusted to an appropriate position.

  The above description is an illustration of a preferred embodiment of the present invention, and the scope of the present invention is not limited to this.

  Although the above embodiment is an example applied to a mobile phone, any device equipped with a camera (internal / external) such as a personal digital assistant such as a PDA, an information processing device such as a personal computer, etc. It is also applicable to the device. The code to be read may be any code.

  Moreover, in the said embodiment, although the name portable terminal device was used, this is for convenience of explanation, and of course, a communication terminal device, an information reading device, an information reading method, etc. may be sufficient.

  In the above-described embodiment, examples of message display by characters or icons on the display unit 15 and notification by reading end sound by the speaker 14 as the notification unit have been described. However, any notification method may be used, for example, voice. Good. When notifying by voice, the mobile phone is provided with a voice output unit comprising a voice data generation chip, a D / A converter, an amplifier, a speaker, etc., and a message indicating that reading has been completed or has failed using the voice data generation chip. The content is synthesized and output by a speaker. It is also possible to display a message indicating that it is better to turn on the light 13 on the display unit 15 and a message indicating that the barcode type should be changed, or to notify by voice or sound in addition to the display.

  Further, the types, numbers, connection methods, and the like of each circuit unit, for example, the storage unit and the display unit that constitute the mobile terminal device are not limited to the above-described embodiments.

  The mobile terminal device described above is also realized by a program for causing these mobile terminal devices to function. This program is stored in a computer-readable recording medium. In the present invention, as the recording medium, the main memory itself of the control unit 31 shown in FIG. 2 may be a program medium, or a program reading device such as a CD-ROM drive is provided as an external storage device. Further, it may be a program medium such as a CD-ROM that can be read by inserting a recording medium therein. In any case, the stored program may be configured to be accessed and executed by the CPU of the control unit 31, or in any case, the program is read and the read program is not illustrated. The program may be downloaded to the program storage area and executed. This download program is assumed to be stored in advance in each device.

  Here, the program medium is a recording medium configured to be separable from the portable terminal device or the information processing device, and is a magnetic disk such as a magnetic tape or a cassette tape, a CD-ROM, a CD-R / RW, an MO, an MD. , DVD-ROM, DVD-RAM, DVD-RW and other optical disk systems, PC cards, compact flash cards (registered trademark), smart media (registered trademark), IC cards, SD cards (registered trademark), memory sticks (registered) It may be a medium carrying a fixed program including a semiconductor memory such as a card system such as a trademark) or a mask ROM, EPROM, EEPROM, flash ROM or the like.

  Further, the medium may be a medium that carries the program in a fluid manner so as to download the program from the communication network via a communication connection means that can be connected to an external communication network such as the Internet connection provider or the server terminal 400. . When the program is downloaded from the communication network as described above, the download program may be stored in advance or may be installed from another recording medium. The content stored in the recording medium is not limited to a program, and may be data.

It is a figure which shows the external appearance of the portable terminal device of embodiment of this invention. It is a block diagram at the time of incorporating the barcode reader of the portable terminal device of this Embodiment in the mobile phone with a camera. It is a figure which shows typically the lens focal depth switching mechanism of the camera of the portable terminal device of this Embodiment. It is a flowchart which shows barcode reading operation | movement of the portable terminal device of this Embodiment. It is a figure which shows the example of a mode selection screen display of the LCD display part of the portable terminal device of this Embodiment. It is a figure explaining the image taking-in range and the magnification at the time of display differing with the one-dimensional code / 2-dimensional code of the portable terminal device of this Embodiment. It is a figure which shows the example of a screen display by the barcode reading process of the portable terminal device of this Embodiment. It is a figure which shows the example of a screen display by the barcode reading process of the portable terminal device of this Embodiment. It is a figure which shows the external appearance of the portable terminal device of other embodiment. It is a figure which shows the external appearance of the portable terminal device of other embodiment. It is a flowchart which shows the barcode reading operation | movement of the portable terminal device of other embodiment.

Explanation of symbols

10 Mobile phone with camera (mobile terminal device)
10a Mobile phone body 11, 37 Antenna 12, 33 Camera (imaging means)
13, 34 Light (lighting means)
14,39 Speaker (part of the notification means)
15, 35 LCD display (part of display means and notification means)
16 Power key 17 Telephone function key 18 Mode key 19 Cursor key 20 Shutter key 21 Light ON / OFF button (lighting switching means)
22 Dial key 23, 40 Microphone 31 Control section (shooting procedure switching means, bar code recognition means, information processing means, frame rate control means, timer setting means)
32 Memory Memory 36 Key Input Unit 50 Camera Module 51 Lens 52 Lens Unit 53 Camera Lever

Claims (10)

Imaging means for capturing an image, and display means for displaying the image obtained by the imaging means, recognizing the code recognition means for code of the captured image, it instructs the activation of the code recognition means in the user operation comprising a code recognition instructing unit that, the photographing procedure switching means for switching a photographing target code in the user operation, and
The imaging means on the back of the main body, the display means is provided on the back side of the imaging means on the front side of the main body,
The display magnification is changed according to the readable code type and the captured image is continuously displayed on the display unit from when the shooting target is switched to the code by the shooting procedure switching unit until the code recognition unit is activated. And
After the code recognition means is activated, code recognition is continuously performed while displaying the captured image on the display means at the display magnification and the frame rate required for the code recognition means, and when the code recognition is successful, the captured image is displayed. Instead, a code recognition result is displayed on the display means . Image pickup means for picking up an image, display means for displaying an image obtained by the image pickup means, code recognition means for recognizing the code of the picked-up image, and shooting procedure switching means for switching a shooting target to a code by a user operation And comprising
The imaging means on the back of the main body, the display means is provided on the back side of the imaging means on the front side of the main body,
After the photographing procedure switching means switches the photographing object to the code, the display magnification is changed according to the readable code type, and the captured image is continuously displayed on the display means at the frame rate necessary for the code recognition means. Display
If the code recognition is successful, a code recognition result is displayed on the display means instead of the captured image. The imaging procedure switching means, the mobile phone according to claim 1 or 2, characterized in that to change the image capturing area in the image pickup means in accordance with the code type. Before Kiko over de type is a cellular phone according to any one of claims 1 to 3, characterized in that it comprises a type of one-dimensional bar codes and two-dimensional bar code. 5. The enlarged display is performed by changing the display magnification by reducing an image capturing area of the imaging unit and displaying an image corresponding to the image capturing area. The mobile phone described in 1. The code recognition means is capable of recognizing a one-dimensional barcode;
6. The mobile phone according to claim 1, wherein an image capturing area and a display magnification are changed so that a long side of the one-dimensional barcode is within a horizontal direction of the imaging unit. The imaging procedure switching means changes at least one of gradation characteristics, contrast, brightness, white balance, exposure, depth of focus, contour enhancement, or resolution when the imaging target is switched to a barcode. The mobile phone according to any one of claims 1 to 6 , characterized in that: The code the recognition by the recognition unit is successful, the mobile phone according to any one of claims 1 to 7, characterized in that it comprises a notifying means for notifying success. 9. The mobile phone according to claim 8 , wherein the notification means notifies the recognition result by sound, voice, or message display on the display means. Before Symbol notification means, when not able to recognize the code within a preset time, wherein the recognition failure in any one of claims 1 to 9, characterized in that the message displayed on the display means Mobile phone.

Images