JP6825254B2 - Image reader, image forming device, original image projection method and program - Google Patents

Description

The present invention relates to an image reader, an image forming apparatus, a document image projection method and a program.

Conventionally, there are various types of image reading devices that read an image of a document and perform electrical processing. In these image reading devices, the original is placed upward on a mounting table or the like, the original is illuminated from above the reading surface of the original, and the image is imaged to read the image, thereby facilitating the reading operation. There is an image reader with enhanced image reading. This type of device is also referred to as a top shot scanner, and for example, an image reading device described in Japanese Patent Application Laid-Open No. 2015-170907 (Patent Document 1) is known.

The technique described in Patent Document 1 includes a mounting means for mounting a plurality of objects, a camera that captures a plurality of objects mounted on the preceding mounting means to generate a camera image, and the preceding mounting means. In a scanner system including a projection means for projecting a predetermined measurement pattern or a user interface, a plurality of objects placed on the above-described placement means are combined and stored on one page according to an instruction for the user interface, or each of them is stored. A technique for setting a storage format indicating whether objects are separated and stored one page at a time is disclosed.

However, with the technique described in Patent Document 1, although it is possible to place an object in the projection area of an image, when printing shooting data on a shooting area, particularly on paper, is the shooting performed in a form that fits in the paper size? I do not understand. Therefore, it is of course unknown how large the photographed data will be printed on the paper. In the top shot scanner that uses the area sensor for document position detection and image scanning in this way, the user does not know where to place the document on the platen, and the image goes out of the scanning range when scanning the image. was there. In order to prevent this, the user only needs to be able to grasp the relationship between the document scanning area and the scanning result for the printing paper.

Therefore, an object to be solved by the present invention is to enable a user to grasp a document scanning area and a scanning result for printing paper.

In order to solve the above problems, one aspect of the present invention relates to an image reading device, which is located above a document and determines the size of the paper feed from the image pickup means for capturing the document and the input paper feed information. The paper feed paper size determining means, the frame image generating means for generating the determined paper size as a frame image with respect to the image signal output from the imaging means, and the image signal output from the imaging means. An image synthesizing means for synthesizing a frame image generated by the frame image generating means, a projection means for projecting an image synthesized by the image synthesizing means, and a document detecting means for detecting a placement position of the document are provided . The document detecting means determines whether or not the frame size, which is the size of the frame image obtained from the composite image projected by the projection means, matches the already generated frame image size information, and determines whether or not the frame size matches the already generated frame image size information. The image generation means is described when the frame size obtained from the composite image does not match the original frame image size information, or when the frame position related to the composite image does not match the original frame position information. It is characterized in that a new frame image whose position and size are corrected based on the frame size and the frame position of the frame image included in the captured image data acquired through the imaging means is generated .

According to one aspect of the present invention, the user can grasp the document scanning area and the scanning result for the printing paper. Issues, configurations and effects other than the above will be clarified in the following description of the embodiments.

It is a figure which shows the outline of the internal structure of the image forming apparatus provided with the image reading apparatus which concerns on one Embodiment of this invention. It is a figure which shows the detail of the document scanner in FIG. It is a block diagram which shows the hardware structure of the image forming apparatus of FIG. It is a figure which shows the operation image of the projection apparatus in FIG. FIG. 4 is a block diagram showing a functional configuration of a document scanner for projecting a frame showing a print area. It is a figure which shows the state of the calculated frame position. It is a flowchart which shows the control procedure executed by the document scanner shown in FIG. It is a figure which shows the relationship between the set state of the paper in the paper feed tray, and the frame display. FIG. 5 is a block diagram showing a functional configuration in which a document detection / frame detection unit is added to the configuration of FIG. 5 to detect a document position with respect to a frame image. It is explanatory drawing which shows the determination method of the document detection in the document detection / frame detection part. It is a figure which shows the projection example of the warning image which moves a document to the marking center of a platen. It is a flowchart which shows the control procedure executed by the document scanner shown in FIG. It is a block diagram which shows the functional structure which detects the projected frame image and the original, and performs the automatic enlargement / reduction processing to the size according to a printing paper. It is a figure which shows the relationship between the image by the photographed image data, and the image processed by the enlargement / reduction part. It is a flowchart which shows the control procedure executed by the document scanner shown in FIG. It is a figure which shows an example of the structure which distributes a program to a device such as a personal computer by a communication network such as the Internet.

The present invention operates an area sensor with a low-resolution moving image shooting function, calculates an image area to be printed with respect to the moving image shooting image data, and projects the printed image area and the image of the reading result from the image projection device. Is a feature. Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a diagram showing an outline of an internal configuration of an image forming apparatus including an image reading apparatus according to an embodiment of the present invention. In the figure, the image forming apparatus 100 is basically composed of a scanner 101, an image reading apparatus (hereinafter referred to as a document scanner) 102, a paper feeding unit 103, an image forming apparatus main body 104, and an operation unit 114.

A tandem image forming unit 105, a resist roller 108, an optical writing device 109, a fixing unit 110, and a double-sided tray 111 are provided in the image forming apparatus main body 104. The resist roller 108 is for supplying the recording paper from the paper feeding unit 103 to the image forming unit 105 via the transport path 107, and determines the timing between the image on the intermediate transfer belt 113 to be transferred and the image forming position of the recording paper. At the same time, the recording paper is conveyed to the image forming unit 105 side. In the image forming unit 105, four photoconductor drums 112 are arranged side by side corresponding to four colors of YMCK, and around each photoconductor drum 112, a charger, a developer 106, a transfer device, a cleaner, and a static eliminator are included. Image-making elements are arranged. Further, the intermediate transfer belt 113 stretched between the drive roller and the driven roller while being sandwiched between the nips of both is arranged between the transfer device and the photoconductor drum 112.

In the tandem image forming apparatus configured in this way, light is written on the photoconductor drum 112 corresponding to each color of each color of YMCK, developed for each toner of each color by the developing device 106, and on the intermediate transfer belt 113. For example, the primary transfer is performed in the order of Y, M, C, K. Then, the full-color primary transferred image in which four colors are superimposed is secondarily transferred from the paper feeding unit 103 to the recording paper conveyed via the conveying path 107, and then fixed by the fixing unit 110. The recording paper on which the image is fixed by the fixing unit 110 is conveyed by the conveying device of the fixing unit 110 and discharged onto the paper ejection tray. A full-color image is formed on the recording paper by such a series of operations.

2A and 2B are views showing the details of the document scanner in FIG. 1, FIG. 2A is a front view, and FIG. 2B is a view of the lighting device of the document scanner viewed from the direction of arrow A (lower surface side).

The document scanner 102 includes an area sensor (imaging device) 201, a lighting device 205 that illuminates the document, a document table 203 on which the document 250 is placed, a support portion 204 that supports the area sensor 201 and the lighting device 205, and a projection device 206. ing. In the area on which the originals of the platen 203 are placed, for example, as shown in FIG. 10 described later, a black-colored document placing area larger than the maximum original size is set. Although not particularly coded, a white cross line passing through the center is drawn in the document placement area, and the area is further divided into four.

In the example of FIG. 2, the document 250 is set upward with respect to the platen 203, and the document scan is performed using the area sensor 201 located above the document stand 203. Therefore, the area sensor 201 is located above the document and functions as an imaging means for capturing the document 250. In the document scanner 102 of such a form, reflection of indoor lighting and reflection of the photographer's own shadow (hereinafter, external influence) occur in the scanned image. Therefore, the document scanner 102 according to the present embodiment is equipped with a lighting device 205 that suppresses these external influences. In the present embodiment, the lighting device 205 has a plurality of LEDs 202 arranged in two rows parallel to each other in the longitudinal direction on both sides of the area sensor 201 to provide LED lighting. The lighting device 205 turns on and off according to the scan instruction of the user.

The user sets the document 250 on the document table 203, opens the page to be scanned, and presses the start button of the operation unit 114 to turn on the lighting device 205 and scan the document. After that, the user turns the page and repeatedly presses the start button of the operation unit 114 to realize continuous scanning. Further, by the selection operation from the operation unit 114, it is possible to execute paper output on the scanned image data after scanning, or to selectively execute data output to a storage device such as a USB memory (not shown). Further, the projection device 206 is arranged side by side on the front side of the area sensor 201, projects the result of the frame image which is the range of the printing paper or the image to be printed after reading on the platen 203 side, and the frame image and the reading are performed on the user. Present image information.

FIG. 3 is a block diagram showing a hardware configuration of the image forming apparatus of FIG. In the figure, the image forming apparatus is configured to include an image forming apparatus main body 104 and a document scanner 102.

The document scanner 102 includes a control device 301, a storage device 302, a control interface (hereinafter referred to as I / F) 303, an image I / F 304, an area sensor 201, a lighting device 205, and a projection device 206.

The control device 301 controls various devices such as the area sensor 201, the lighting device 205, and the projection device 206, and performs image processing. The storage device 302 is composed of a large-capacity memory such as an HDD (hard disk device) that holds a large-capacity data such as image data readable and writable. The control I / F 303 is an interface for exchanging control instructions with the image forming apparatus main body 104. The image I / F 304 is an interface for exchanging image data with the image forming apparatus main body 104.

The control device 301 includes modules of CPU 301a, ROM 301b, RAM 301c, and NV-RAM 301d. The ROM (Read Only Memory, the same applies hereinafter) 301b stores a program for managing data in the document scanner 102 and controlling peripheral modules. The CPU (Central Processing Unit, hereinafter the same) 301a executes a predetermined process according to the procedure of the program stored in the ROM 301b. The RAM (Random Access Memory, the same applies hereinafter) 301c is a work memory for processing by the CPU 301a, and is used as a buffer for temporarily storing data from the area sensor 201 and a memory for processing data stored in the buffer. Will be. The NV-RAM 301d is a non-volatile RAM for storing data to be retained even when the power is turned off.

The image forming apparatus main body 104 includes a main body control controller 210, an image processing device 220, and a main body control device 230. The main body control controller 210, the image processing device 220, and the main body control device 230 include CPU 210a, 220a, 230a, ROM 210b, 220b, 230c, RAM 210c, 220c, 220c, NV-RAM 210d, 220d, 230d, similarly to the control device 301. There is. The functions of each of these control elements are the same as those of the control device 301. The control device 301, the image processing device 220, and the main body control device 230 can be replaced with ASICs (application specific integrated circuits) as desired. Further, the main body control controller 210 includes a communication unit 211 for communicating with the outside.

The image forming apparatus main body 104 includes a printer engine 215 including image forming elements such as the image forming unit 105, and the image processing device 220 controls the printer engine 215 to form an image on a recording paper. Therefore, the engine I / F221 which is bus-connected to the CPU 220a is provided, a signal for controlling the printer engine 215 is transmitted via the engine I / F221, and information of each part necessary for image formation is received from the printer engine 215 side. Further, the HDD 222 is provided as a storage device for holding information and a program for image formation.

The image forming apparatus main body 104 is provided with an operation unit 114 and an operation display unit (simply referred to as a display unit in the figure) 232 as user I / F, and the main body is provided via the operation unit I / F 231 and the display unit I / F 233. It is communicatively connected to the control device 230.

FIG. 4 is a diagram showing an operation image of the projection device 206 in FIG. The projection device 206 projects the frame image 501a on the platen 203 based on the image data read by the area sensor 201, the paper installation information of the paper feed unit 103, and the user operation result of the operation unit 114. The frame image 501a is a print size frame of the paper feed paper calculated based on the installation information and the user operation result, or a print size frame of the read image data and the paper feed paper. By projecting the frame image 501a in this way, the user is notified of the print output state.

FIG. 5 is a block diagram showing a functional configuration of a document scanner for projecting a frame showing a print area in FIG.

The image forming apparatus main body 104 includes each functional unit of the manuscript paper indicating unit 509, the paper feed paper detecting unit 511, and the paper information generating unit 510. The paper feed paper detection unit 511 has a function of detecting the size and orientation of the paper mounted on the paper feed tray 103a of the paper feed unit 103. The paper information generation unit 510 generates paper information from the original paper size specified by the user from the original paper instruction unit 509 and the paper size and orientation detected by the paper feed paper detection unit 511, and sends the paper information to the document scanner 102 side. .. In addition, in the block of the figure, "part" is omitted (the same applies hereinafter).

Specifically, the manuscript paper instruction unit 509 determines the size of the paper such as "A4 landscape", "A4 portrait", or "A3" displayed on the liquid crystal screen in the operation unit 114 from the operation screen of the operation unit 114. Create paper size information for the manuscript by selecting it.

The paper feed paper detection unit 511 detects the positions of, for example, the end fence 511a and the side fence 511b installed in the paper feed tray 103a of the paper feed unit 103, and detects the paper size. Details will be described later with reference to FIG. The paper feed detection unit 511 installs, for example, a plurality of reflective sensors inside the paper feed tray 103a of the paper feed unit 103, and reflects the light of the sensor when the paper feed tray 103a is closed. It can also be configured to be detected by. In addition, the paper feed paper detection unit 511 functions as a paper feed paper size determining means for determining the size of the paper feed paper from the paper feed paper information input as a result of detecting the position.

The detected result is created by detecting information according to the number of paper feed trays 103a possessed by the image forming apparatus 100, such as "A4 vertical" for the first tray and "A4 horizontal" for the second tray.

When the user instructs the operation unit 114 to set the paper size to "A3", the manuscript paper instruction unit 509 inputs the information "A3" to the paper information generation unit 510. Further, the information of all the paper feed trays 103a is input from the paper feed paper detection unit 511 to the paper information generation unit 510. The information of all the input trays 103a is, for example, the first paper tray: "A4 portrait", the second paper tray: "A4 landscape", the third paper tray: "A3 landscape", the fourth. Paper tray: In the case of a 4-stage paper feed tray such as "A4 vertical", there are four pieces of information.

The paper information generation unit 510 generates the following two points of information for the information "A3" input from the manuscript paper instruction unit 509 and for the information input from the paper feed paper detection unit 511. , Is input to the document scanner 102 as paper feed information.
(1) Maximum paper feed tray information → 3rd paper feed tray: "A3 horizontal"
(2) Correspondence to the selected manuscript paper instruction Paper tray information → 3rd paper tray: "A3 landscape"
Here, when "A4 portrait" or the like is selected in the manuscript paper instruction unit 509, the information in (2) is changed.

The document scanner 102 includes an image projection unit 501, a projected image generation unit 502, a frame image generation unit 503, a frame position calculation unit 504, an image input unit 505, a format conversion unit 506, an image size information generation unit 507, and a frame size calculation unit 508. Includes each functional part of.

The image input unit 505 receives the image data input from the area sensor 201 and stores the image data in the storage device 302. The format conversion unit 506 converts the input image data into the RGB format when the format is other than the RGB format. As an example, a general calculation is performed on an image in the YCbCr422 format, and a calculation process is performed so as to convert the image data in the RGB888 format.

The image size information generation unit 507 generates image size information for the image data converted by the format conversion unit 506 together with the resolution of the area sensor 201. In the present embodiment, the case of fixed image size information will be described, but when the area sensor 201 has a zoom function or other enlargement / reduction function, or when the support portion 204 is movable (expands / contracts), etc. The image size changes. In such a case, the image size information generation unit 507 generates image size information according to the change in image size.

After receiving the paper information from the paper information generation unit 510, the document scanner 102 sends the paper information to the frame size calculation unit 508. The frame size calculation unit 508 receives the paper information received from the paper information generation unit 510 and the image size information generated by the image size information generation unit 507, and calculates the size of the frame used for projection.

Here, the document scanner 102 has the resolution and projection size information of the image projection unit 501. On the other hand, the frame size calculation unit 508 calculates the frame image size by comparing the information input from the paper information generation unit 510 with the image size information input from the image size information generation unit 507.

A case where the projection size is 1024 x 768 pixels and the width is 450 mm x the height is 300 mm with respect to the position of the platen 203, and the paper feed tray "A3 width" is described will be described.

Since the size information of the maximum paper feed is "A3 landscape"
A3 paper size → length 297 x width 420 (mm)
Projection size → length 300 x width 450 (mm)
Vertical ratio → 297/300 = 0.99 ≒ 0.9 (rounded down to the second decimal place to fit in the projection)
Horizontal ratio → 420/450 = 0.93 ≒ 0.9 (rounded down to the second decimal place to fit in the projection)
The smallest of the vertical and horizontal ratios → 0.9
From the above, the maximum projection size of the document is vertical: 768x0.9 = 690 (pixels).
Horizontal: 1024 x 0.9 = 920 (pixels)
Will be.

The size of the frame image is determined according to the maximum projection size of this document. Since the frame image is A3 horizontal, it is 690 vertical x 920 horizontal (pixels). Further, in the case of "A4 vertical", the horizontal width is halved, so that the frame image is 690 vertical x 460 horizontal (pixels).

After the frame image size is calculated by the frame size calculation unit 508, the size information is sent to the frame position calculation unit 504 and the frame image generation unit 503 as frame image size information.

The frame position calculation unit 504 calculates the frame position from the sent frame image size information as follows.

When the resolution of the projected image data is 768 vertical x 1024 horizontal (pixels) and the frame image size is 690 vertical x 920 horizontal (pixels), 1024-920 = 104 in the horizontal direction.
Is the part outside the frame image,
104/2 = 52
Is outside the frame image on one side. Therefore, the 52nd pixel is on the left side of the frame image 501a. Similarly, in the vertical direction, (768-690) / 2 = 39 is outside one side of the frame image 501a, and the 39th line is above the frame image 501a. Therefore, the frame position is calculated with the 39th line from the top and the 52nd pixel from the left as the upper left of the frame image 501a, and the frame position information is generated and sent to the frame image generation unit 503. This state is shown in FIG. FIG. 6 is a diagram showing a state of the calculated frame position.

The frame image generation unit 503 generates an image for projection from the frame image size information and the frame position information sent. In this embodiment, for image data of 768 vertical × 1024 horizontal pixels,
Upper left position: (vertical, horizontal) = (39, 52)
Lower right position: (vertical, horizontal) = (729, 972)
Draw a square frame as image data so that The line thickness at that time is changed according to the resolution and the projection size, but here, it will be described as one pixel. Further, the line color will be described here by taking red as an example.

As the image data, first, the background is drawn as black, which is the same as the color of the platen, and then a red line is drawn on the background in accordance with the above coordinates. Thereby, the frame image data can be generated.

The projection image generation unit 502 switches between the following two functions.
(1) Before scanning the original, the composite image data obtained by synthesizing the image data and the frame image data from the image input unit 505 is projected.
(2) After scanning the document (pressing the start key), the image data obtained by combining the frame image data and the printed image is projected. In this case, the operation unit 114 can be configured to be selectable by the user by a preview function or the like.

Therefore, the frame image generation unit 503 functions as a frame image generation means for generating the determined paper size as a frame image with respect to the image signal output from the imaging means. Further, the projection image generation unit 502 functions as an image composition means for synthesizing the frame image generated by the frame image generation means with the image signal output from the imaging means, and the image projection unit 501 is synthesized by the image composition means. It functions as a projection means for projecting an image.

The image projection unit 501 projects an image based on any of the composite image data thus generated by the projection image generation unit 502 toward the platen 203.

When the user gives a print start instruction such as a start key, the area sensor 201 acquires a print image. At that time, for the image projected from the image projection unit 501, the process of projecting only at the moment of shooting is stopped, and after shooting, the projection is performed again to prevent information other than the original from being reflected in the shot image. To do.

FIG. 7 is a flowchart showing a control procedure executed by the CPU 301a of the document scanner 102 shown in FIG.

After the power is turned on, the image forming apparatus 100 is in a state of waiting for user operation. When the user selects the document scanner mode for the operation unit 114, the operation of this flowchart is started. Other modes include a normal copy mode and a scanner mode, but since they are known technologies, they are omitted here.

In START, the image forming apparatus 100 is in a state of waiting for user operation after the power is turned on.

When the user selects the document scanner mode for the operation unit 114, the following processing is started (S101). Until then, it waits for the document scanner mode to be selected.

When the document scanner mode is selected, the area sensor 201 operates in the moving image mode in which images are periodically acquired (S102). The area sensor 201 is operated in a moving image mode (moving image shooting function) having a low resolution, and the read moving image data is periodically stored in the storage device 302 as captured image data (S103). At that time, the format conversion unit 506 performs format conversion of the image data.

The image size information generation unit 507 acquires image size information from the captured image data stored in the storage device 302 (S104). Then, it is confirmed whether or not the user has specified the document size for the operation unit 114 (S105). If the original size specification has not been completed, wait until the completion, and when the original size specification is completed, proceed to the next step.

The paper information generation unit 510 detects the size information of the original paper selected by the original paper instruction unit 509 and the paper information set in the paper feed tray 103a from the paper feed paper detection unit 511 to provide the size and orientation information of the original paper and the paper. Are acquired respectively, and paper information is generated (S106).

The frame size calculation unit 508 acquires paper information from the paper information generation unit 510, further acquires image size information from the image size information generation unit 507, calculates the size of the frame used for projection, and obtains the frame image size information. Generate (S107).

The frame position calculation unit 504 acquires frame image size information from the frame size calculation unit 508, further acquires image size information from the image size information generation unit 507, calculates the position of the frame used for projection, and frame position information. Is generated (S108).

The frame image generation unit 503 acquires frame image size information from the frame size calculation unit 508, further acquires frame position information from the frame position calculation unit 504, and generates frame image data to be used for projection (S109).

The projection image generation unit 502 acquires frame image data from the frame image generation unit 503, and further, the format conversion unit 506 acquires the captured image data stored in the storage device 302. Then, a composite image data in which the frame image data and the captured image data are combined is generated and sent to the image projection unit 501 (S110).

The image projection unit 501 projects an image (frame image) based on the received image data toward the platen 203 (S111). That is, the image projection unit 501 starts projecting the frame image. Next, it waits for the start key for starting printing or a key having the same meaning as the start key to be pressed (S112). Then, when the start key is pressed (S112: Yes), the operation unit 114 determines whether or not the print result preview display function is enabled (S113).

Based on this judgment, when the print result preview display function is enabled (S113: Yes), shooting for printing is performed, and the process performed at the time of printing by the control device 301 is performed on the input image data as projection data. create. Then, a frame image is added to the created image data, and an image obtained by combining the two is projected onto the platen 203 (S114).

In this state, wait for the user to press the start key again (S115). Here, a key such as OK may be mounted on the display to replace the start key. Then, when the start key is pressed (S115: Yes), printing is performed by the image forming apparatus main body 104. On the other hand, when the preview display function is not used in S113, printing is performed by pressing the start key once (S117).

FIG. 8 is a diagram showing the relationship between the set state of paper in the paper feed tray and the frame projection.

The paper feed paper detection unit 511 is installed in the paper feed tray 103a of the paper feed unit 103, and is a functional unit that detects the size and direction of the paper loaded on the paper feed tray 103a. The present embodiment has, for example, a function of detecting the positions of the end fence 511a and the side fence 511b and determining the paper size. For example, when A3 paper is loaded, the direction of the paper is fixed, so the end fence and the side fence are set according to the size of the paper as shown in FIG. 8A. In the case of A4 paper, since the paper can be loaded in two types, the horizontal direction and the vertical direction, the end fence 511a or the side fence 511b is shortened according to the direction, and the direction of the paper can be detected. FIG. 8B shows the case of A4 vertical, and FIG. 8C shows the case of A4 horizontal.

FIG. 8 includes a detection device (sensor) (not shown) for detecting the position of the end fence 511a and a detection device (sensor) (not shown) for detecting the position of the side fence 511b, and each position is detected by the detection device (sensor). Then, the frame image generation unit 503 generates a frame image 501a to be displayed based on the detection information. The position information of the side fence 511b is linked with the vertical length of the frame image 501a, and the position information of the end fence 511a is linked with the horizontal length of the frame image 501a. Further, when the position of the side fence 511b or the end fence 511a deviates from the standard document size with respect to the document size, there is a problem in the set state of the paper feed tray 103a, so that the image forming apparatus main body 104 is displayed. A warning such as an instruction to reload the paper setting in the paper feed tray 103a is displayed on the unit 232.

In FIG. 8, the vertical arrangement on the left side shows an example of the state of the paper feed tray 103a, the vertical arrangement in the center shows an example of projection of the frame image 501a, and the vertical arrangement on the right side shows an example of moving image projection.

FIG. 9 is a block diagram showing a functional configuration in which the document detection / frame detection unit 701 is added to the configuration of FIG. 5 to detect the position of the document with respect to the frame image.

The document detection / frame detection unit 701 detects the frame image that is projecting onto the captured image data input from the image input unit 305, determines the position of the document with respect to the frame image, and normally. This is a functional unit that determines whether or not the image is ready for printing. The document detection / frame detection unit 701 functions as a document detection means for detecting the placement position of the document. The document detection / frame detection unit 701 is set in the CPU 301a of the control device 301 by a program, and is a functional unit configured by software. In addition, since the functions of each part and each part are the same as those of each part of FIG. 5, overlapping description will be omitted.

FIG. 10 is an explanatory diagram showing a method for determining document detection in the document detection / frame detection unit 701. (A) is a diagram showing the area division of image data, (b) is a diagram showing a state without a document, (c) is a diagram showing a state of document deviation 1, and (d) is a diagram showing a document deviation 2. e) is a diagram showing the document OK determination 1, (f) is a diagram showing the document OK determination 2, and (g) is a diagram showing the document OK determination 3.

As shown in FIG. 10A, the document detection / frame detection unit 701 divides the image data to be displayed into four areas of the first area (1) to the fourth area (4) and performs image detection. Do. At that time, in the present embodiment, image detection is performed in the first region (1) to the fourth region (4) with the outside and the inside of the frame image 501a as separate regions. That is, the area is divided into eight, such as outside the first area (1), inside the first area (1), and so on.

First, with respect to the display image data, it is determined whether or not the color information is black for the pixels adjacent to the frame image 501a in the first region (1). When the color information of the pixels on the lower side ((1) -1) of the frame image 501a in the first area (1) is "black", it is determined that the document 250 is not on the upper side in the frame. Further, when the color information of the pixels on the left side ((1) -2) of the frame image 501a in the first area (1) is "black", it is determined that the document 250 is not on the right side in the frame. Note that "black" here is indicated by dark halftone dots in the drawing. The "black" area 305a is a document placement area previously provided on the document base 203 of the document scanner 102 as described above, and is included in the input image data from the image input unit 305 to determine the document position. Used for.

Similarly, the inside of the second area (2) is also judged, and it is judged whether or not the document 250 is on the upper side ((2) -1) and the left side ((2) -2), and the inside of the third area (3) is determined. Is about the right side ((3) -2) and the lower side ((3) -1), and in the fourth area (4) is about the left side ((4) -2) and the lower side ((4) -1). Judge each.

In the state of FIG. 10B, "black" is detected in the color information of the pixels in the determined region in the first region (1) to the fourth region (4). Therefore, in this state, it is determined that there is no document 250 around the frame image 501a.

When it is determined that there is no document 250 around the frame image 501a, it is continuously determined whether or not there is a document 250 in the center. Lower left ((1) -3) in the first area (1), lower right ((2) -3) in the second area (2), upper left ((3) -3) in the third area (3) ) -3), in the fourth area (4), each range of the upper right ((4) -4) is targeted. At that time, since erroneous detection may be performed by marking the platen 203 or the like, several pixels (here, in this case) from the boundary in each target range within the first region (1) to the fourth region (4). The range is separated (defined as 10 pixels), and the range is specified so that there is no marking on the platen 203. Since frame information or the like is projected on the marking of the platen 203, if the marking is also projected, erroneous detection due to the marking does not occur, so this measure is unnecessary.

The range ((1) -3, (2) -3, (3) -3, (4) -3) closer to the center in the first region (1) to the fourth region (4). It is determined whether or not the color information is "black" in the pixels of, and if it can be determined as "black", it is determined that the original 250 does not exist in the frame image 501a because there is no original 250 in the center. The color of the frame image 501a is set to, for example, red, and the frame image generation unit 503 is notified.

On the contrary, when the color information in the range ((1) -3, (2) -3, (3) -3, (4) -3) includes "other than black", the document 250 is in the frame image 501a. The color of the frame image 501a is set to, for example, blue, and the frame image generation unit 503 is notified. The original state at that time is shown in FIG. 10 (g).

When it is determined that the document 250 is around the frame image 501a, it is as follows.

Regions ((1) -1, (1) -2, (2) -1, (2) -2, adjacent to the frame image 501a in the first region (1) to the fourth region (4)) When the color information of the pixels of (3) -1, (3) -2, (4) -1, (4) -2) is detected as "other than black", it is determined that the original 250 is in that part. It is determined that the document 250 is in the frame image 501a.

At that time, the regions ((1) -1, (1) -2, (2) -1, (2) -2, (3) -1, (3) -2, (4) -1, (4) When the color information of all the pixels in -2) is detected as "other than black", it can be determined that the original 250 is contained in the frame image 501a. Therefore, the color of the frame image 501a is set to blue and the frame image is set to blue. Notify the generation unit 503. The document states at that time are shown in FIGS. 10 (e) and 10 (f).

In addition, the regions ((1) -1, (1) -2, (2) -1, (2) -2, (3) -1, (3) -2, (4) -1, (4)- When "black" is detected in the color information of the pixels in any of the regions of 2), the document 250 may be displaced outside the frame image 501a, so that the region outside the frame image 501a ( Pixels of (1) -4, (1) -5, (2) -4, (2) -5, (3) -4, (3) -5, (4) -4, (4) -5) It is determined whether or not the color information is "black".

An example of this judgment table is shown below.

Table 1 Manuscript detection judgment list (first area (1))
(1) -1 (1) -2 (1) -3 (1) -4 (1) -5 Judgment
Black Black Black − − No manuscript Black Black Other than black − − With manuscript Black Other than black Black Black Black Black * 1
Other than black black black black black * 1
Other than black Black Other than black Black Black With manuscript Black Other than black Black Other than black Black With manuscript Other than black Black Black Other than black Black * 1
Other than black Black Other than black black black * 1
Other than black Black Other than black Black other than black * 2
Other than black Other than black Black Other than black * 3
Other than black Other than black Black Other than black With manuscript Other than black Other than black Other than black Black Other than black Manuscript Yes Other than black Other than black Black Other than black Manuscript
Other than black Other than black Other than black There is an original * 1: Since there is a possibility of a small original, a warning to move the original to the marking center of the platen is displayed * 2: (3) -1, (3)- The judgment is made in consideration of the judgment information of 3 and (3) -4.
: When (3) -3 is "black" or (3) -3 is "other than black" and (3) -1 is "black" * 1
: (3) -1, (3) -3 There is a manuscript in the case of "other than black" * 3: Judgment by adding the judgment information of (2) -2, (2) -3, (2) -5 I do.
: When (2) -3 is "black" or (2) -3 is "other than black" and (2) -2 is "black" * 1
: (2) -2, (2) -3 If "other than black", there is a document. For detection results other than those listed in Table 1, it is assumed that the document table 203 is dusty or dirty, and the document table 203 is instructed to be cleaned. A warning is displayed on the display unit 232. In addition, information may be added to the projected frame and displayed.

Further, the determination as shown in Table 1 is also carried out for each region of the second region (2) to the fourth region (4).

However, in the case of the second area (2), when the determination result is * 2, the determination is made in consideration of the determination information of (4) -1, (4) -3, and (4) -4. When the judgment result is * 3, the judgment is performed by adding the judgment information of (1) -2, (1) -3, and (1) -5.

Further, in the case of the third region (3), when the determination result is * 2, the determination is performed by adding the determination information of (1) -1, (1) -3, and (1) -4. When the judgment result is * 3, the judgment is performed by adding the judgment information of (4) -2, (4) -3, and (4) -5.

Further, in the case of the fourth region (3), when the determination result is * 2, the determination is performed by adding the determination information of (2) -1, (2) -3, and (2) -4. When the judgment result is * 3, the judgment is performed by adding the judgment information of (3) -2, (3) -3, and (3) -5.

As an example, in FIGS. 10 (c), (d), and (e), the determination is as follows.

In the case of FIG. 10 (c), in the first region (1), (1) -1 is black, (1) -2 is other than black, (1) -3 is other than black, and (1) -4 is black. , (1) -5 is other than black, so the judgment result is * 3. That is, the determination of the first region (1) is performed again by adding the determination information of (2) -2, (2) -3, and (2) -5. Here, since (2) -2 is black and (2) -3 is other than black, the determination result of the first region (1) is * 1. Further, in the second region (2), since (2) -1 is black, (2) -2 is black, and (2) -3 is other than black, the determination result is the original. In the third region (3), (3) -1 is other than black, (3) -2 is other than black, (3) -3 is other than black, (3) -4 is other than black, (3). Since -5 is other than black, the result is manuscript. In the fourth region (4), (4) -1 is other than black, (4) -2 is black, (4) -3 is other than black, (4) -4 is other than black, and (4)-. Since 5 is black, the judgment result is * 2. That is, the determination of the fourth region (4) is performed again by adding the determination information of (2) -1, (2) -3, and (2) -4. Here, since (2) -1 is black and (2) -3 is other than black, the determination result of the fourth region (4) is * 1. Based on this result, a warning display for moving the document 250 to the marking center of the platen 203 is projected (FIG. 11).

In the case of FIG. 10D, in the first region (1), (1) -1 is black, (1) -2 is other than black, (1) -3 is other than black, and (1) -4 is black. , (1) -5 is other than black, so the judgment result is * 3. That is, the determination of the first region (1) is performed again by adding the determination information of (2) -2, (2) -3, and (2) -5. Here, since (2) -2 is black and (2) -3 is other than black, the determination result of the first region (1) is * 1. Further, in the second region (2), since (2) -1 is black, (2) -2 is black, and (2) -3 is other than black, the determination result is the original. In the third region (3), (3) -1 is other than black, (3) -2 is other than black, (3) -3 is other than black, (3) -4 is other than black, (3). Since -5 is other than black, the result is manuscript. In the fourth region (4), (4) -1 is other than black, (4) -2 is black, (4) -3 is other than black, (4) -4 is other than black, and (4)-. Since 5 is black, the judgment result is * 2. That is, the determination of the fourth region (4) is performed again by adding the determination information of (2) -1, (2) -3, and (2) -4. Here, since (2) -1 is black and (2) -3 is other than black, the determination result of the fourth region (4) is * 1. Based on this result, a warning display for moving the document 250 to the marking center of the platen 203 is projected (FIG. 11).

In the case of FIG. 10 (e), in the first region (1), (1) -1 is other than black, (1) -2 is other than black, (1) -3 is other than black, and (1) -4 is. Other than black, (1) -5 is other than black, so the judgment result is the original. In the second region (2), (2) -1 is other than black, (2) -2 is other than black, (2) -3 is other than black, (2) -4 is other than black, and (2) -5. Is other than black, so the judgment result is that there is a manuscript. In the third region (3), (3) -1 is other than black, (3) -2 is other than black, (3) -3 is other than black, (3) -4 is other than black, and (3) -5. Is other than black, so the judgment result is that there is a manuscript. In the fourth region (4), (4) -1 is other than black, (4) -2 is other than black, (4) -3 is other than black, (4) -4 is other than black, and (4) -5. Is other than black, so the judgment result is that there is a manuscript. Based on this result, it is determined that there is a manuscript, and the manuscript may be read in that state.

In the case of FIGS. 10 (e), (f), and (g), the document detection / frame detection unit 701 detects that the document (original image 250a) is inside the frame image 501a. The frame image generation unit 503 is notified to that effect and the fact that the color is to be changed, and the frame image generation unit 503 that receives the notification changes the projection information of the frame image 501a, here, the color information from red to blue. As a result, the user can confirm from the projected image from the image projection unit 501 that the placement position of the document 250 is within the reading range of the frame image 501a.

FIG. 11 is a diagram showing a projection example of a warning display for moving the document to the marking center of the platen. The warning image 550 by projection is projected from the image projection unit 501 as, for example, a message "The original is out of the paper (printing OK → start key)". In the warning image 550 by this projection, if the original 250 may be printed in a state of protruding from the paper, the user presses the start key to instruct the start of printing. If this is not the case, the position of the document 250 is corrected by looking at the projected image from the image projection unit 501.

FIG. 12 is a flowchart showing a control procedure executed by the CPU 301a of the document scanner 102 including the processing of frame detection and document detection. FIG. 12 is a control procedure in which frame detection and document detection processes are added after S111 in the flowchart of FIG. 7.

Since S101 to S111 are the same as the processing of the flowchart of FIG. 7, the description is omitted.

Further, in order to clarify the difference in the flowchart of FIG. 7, the next step of S111 will be described as S212.

After the projected image data is generated by S111, the frame image 501a is projected from the projection device 206, and then the frame size is calculated by the frame size calculation unit 508 and the frame position calculation unit 504 using the captured image data captured by the area sensor 201. It is determined whether or not it matches the calculated calculation result (S212). When the frame size of the captured image data matches the frame image size information, it is further determined whether the frame position of the captured image data matches the frame position information, and if they match, the process proceeds to S214. In S214, it is determined whether or not the document detection result is OK. That is, if the placement position of the document is in the state of FIGS. 10 (e), (f), and (g) and is within the frame image 501a, it is determined that the document is OK, and the process is exited. If the placement position of the original is deviated from the frame image 501a, a warning is displayed as shown in FIG. 11 (S215). This process is repeated until the placement position of the document is corrected according to this warning and the image is within the frame image 501a.

In S212, when the frame size of the captured image data does not match the frame image size information, or the frame size of the captured image data matches the frame image size information, but the frame position of the captured image data matches the frame position information. If not, the process proceeds to S213 in order to correct the frame image 501a to be projected. That is, if the frame size of the captured image data does not match the frame image size information, or if the frame position of the captured image data does not match the frame position information, the frame image 501a to be projected is corrected.

In S213, the frame image generation unit 503 executes a correction process for correcting the projection frame from the image data, returns to step 106, and repeats the subsequent processes. In the correction process of S213, information corresponding to the frame size information and the frame position information is created from the captured image data, and the frame size calculation unit 508 and the frame position calculation unit 504 compare and execute the correction process. The details will be described below.

As described above, in the present embodiment, for image data of 768 vertical × 1024 horizontal pixels,
Upper left position: (vertical, horizontal) = (39, 52)
Lower right position: (vertical, horizontal) = (729, 972)
A square frame is drawn as image data so as to be. Therefore, the frame is projected at the above position even in the captured image data.

Therefore, the pixels are confirmed in order from the first pixel of the captured image data in the main scanning direction, the pixels "other than black" are extracted, and the corresponding first pixel is found. Since the frame image 501a is red or blue, red or blue may be detected. Further, when the confirmation is completed in the main scanning direction, the pixels are shifted by one line in the sub-scanning direction, and the pixels are also confirmed in order in the main scanning direction. At that time, if a color "other than black" can be detected first at the upper left position (39, 52), the start point of the frame position is normal. If the first "non-black" color is detected from any other location, it is abnormal, so the coordinate information is saved in the upper left position of the frame position information at the time of shooting. In the same way, the search is performed to see if there is a "non-black" color up to the lower right, and after searching to the last pixel, the last pixel in which the "non-black" color pixel is detected is the lower right. It becomes the position, and that information is saved as the lower right position of the frame position information at the time of shooting.

In addition, for the horizontal line where the first "non-black" color is found, the number of consecutive "non-black" colors is added up. This is the information next to the frame size. If it is normal, the number of pixels is 920, and the value is saved as the width of the shooting frame size information, but if the number of pixels is other than that, it is saved as the width of the shooting frame size information as an abnormality. Similarly, since the next continuous "non-black" color can be searched for in the lower line of the frame, the number of pixels from the first line is calculated and saved as the frame size information at the time of shooting as the vertical width.

Regarding the various information that can be detected as described above, the frame size information at the time of shooting is input to the frame size calculation unit 508, and the frame position information at the time of shooting is input to the frame position calculation unit 504. The frame size calculation unit 508 and the frame position calculation unit 504 compare the input information with the originally held frame size information and frame position information, and perform correction processing.

For example, when the mounting portion of the area sensor 201 of the document scanner 102 is slightly tilted downward due to some external force acting on it, the frame of the input image becomes slightly larger. For example, the position and size of the calculation
Upper left position: (vertical, horizontal) = (39, 52)
Lower right position: (vertical, horizontal) = (729, 972)
Frame vertical length: 690 pixels Frame horizontal length: 920 pixels, and the actual position and size are
Upper left position: (vertical, horizontal) = (34, 47)
Lower right position: (vertical, horizontal) = (734,977)
Frame vertical length: 700 pixels When the frame horizontal length: 930 pixels, the actual position and size can be determined by extracting from the input image data, so this result is compared with the calculated value. In this example, the size is reduced by 10 pixels vertically and 10 pixels horizontally, and the position is shifted inward by 5 pixels. That is, the reduction process is performed at a magnification of 98.9%. The position and size after correction in this way are
Upper left position: (vertical, horizontal) = (44, 57)
Lower right position: (vertical, horizontal) = (724, 967)
Frame vertical length: 680 pixels Frame horizontal length: 910 pixels.

FIG. 13 is a block diagram showing a functional configuration in which a projected frame image and a document are detected and automatic enlargement / reduction processing is performed to a size suitable for printing paper.

The functional configuration shown in FIG. 13 is such that the enlargement / reduction unit 1101 is added to the document scanner 102 shown in FIG. Other configurations are the same as those of the document scanner 102 shown in FIG. The enlargement / reduction unit 1101 acquires the document size and position detection information of the document detection / frame detection unit 701 and the frame size information and frame position information of the frame size calculation unit 508 and the frame position calculation unit 504 to enlarge the document. Calculate the magnification or reduction magnification. The enlargement / reduction unit 1101 further performs enlargement / reduction processing on the captured image data based on the calculated enlargement / reduction magnification of the original, and then stores the captured image data in the storage device 302. The configurations and functions of the other parts are as described with reference to FIGS. 5 and 9.

FIG. 14 shows an image based on captured image data and an image processed by the enlargement / reduction unit 1101, FIG. 14A shows an image based on captured image data, and FIG. 14B shows a state of external shape detection of a document. FIG. ) Indicates the projected image after enlargement / reduction, respectively.

When it can be detected that the document 250 is inside the projected frame image 501a as shown in FIG. 14A, the enlargement / reduction determination is performed. After the flag that the document 250 is inside the frame image 501a is input from the document detection / frame detection unit 701, the enlargement / reduction unit 1101 determines whether or not to perform the enlargement / reduction process.

Here, with respect to the result of the document detection / frame detection unit 701 with the document, the determination of enlargement / reduction is as follows.

Enlargement: When any of (1) -3, (2) -3, (3) -3, and (4) -3 in FIG. 10 (a) is other than black Reduction: * -4 in FIG. 10 (a) , * -5 is other than black (* corresponds to (1) to (4))
That is, it is a condition that it can be determined that the document 250 does not protrude outside the frame image 501a at the time of enlargement, and that the document 250 can be determined that the document 250 does not protrude outside the frame image 501a at the time of reduction. After this judgment, enlargement or reduction processing is performed.

In the enlargement / reduction process, the outer shape of the document 250 is first detected. As a method for detecting the outer shape, a known technique is used in which the edge of the document 250 and the background is detected, the edge-detected portion is defined as a straight line, and the one forming the intersection of the straight lines is determined as the outer shape. Other known techniques may be used. However, when the document 250 has the maximum shooting area, the edge of the document 250 and the background cannot be detected. In that case, the maximum shooting area is detected as the outer shape. For the detected outer shape, the magnification is calculated by comparing with the frame size information and the frame position information.

As an example of performing magnification calculation, for example
Frame: Vertical 690 x Horizontal 920 (pixels)
Manuscript: Vertical 460 x Horizontal 690 (pixels) → If you calculate the vertical and horizontal magnification under the condition that it is equivalent to A4 horizontal,
Vertical: 690/460 = 1.5
Horizontal: 920/690 = 1.33
Therefore, in order to keep the aspect ratio constant, the magnification is 1.33 times. Assuming that this magnification is the size of the original 250 after enlargement, the size after enlargement is 611 vertical × 917 horizontal (pixels).

Therefore, the captured image data stored in the storage device 302 is enlarged at the calculated magnification and stored in the storage device 302. The projected image generation unit 502 generates image data obtained by synthesizing the enlarged captured image data and the frame image 501a generated by the frame image generation unit 503, and projects the image of the image data synthesized from the image projection unit 501. FIG. 14 (c) is a diagram showing a state when projected in the case of such enlargement processing. In the case of reduction, the vertical and horizontal magnifications are calculated from the frame and the outer shape of the original as in the case of enlargement, and the processing is performed.

FIG. 15 is a flowchart showing a control procedure of the CPU 301a of the document scanner 102 that involves enlargement / reduction processing.

In this processing procedure, first, a determination as to whether or not there is a document 250 is awaited (S301). Whether or not there is a document 250 is determined based on the result of the document detection process in the region division shown in FIG. When it is determined in S301 that there is a document, the outer shape of the document 250 is detected from the captured image data, and the document size is calculated (S302). Next, the magnification is calculated from the frame size information, the frame position information, and the original size calculated in S302 (S303).

With respect to the calculation result of the magnification of S303, when it is 1x, it cannot be enlarged / reduced, so when it is 1x, it ends as NO processing (S304). If there is room for enlargement / reduction, the captured image data is processed at the enlargement / reduction magnification calculated in S303, combined with the frame image 501a, and projected as an image (S305). After the projection, the operation unit 114 is notified that "Do you want to perform enlargement / reduction printing?" And waits for the user's instruction (S306).

If the user agrees and gives a print instruction, the process proceeds to S307, and the print process is performed using the captured image data that has been enlarged / reduced. On the other hand, when the user gives an instruction to print as it is, the process proceeds to S308, and the printing process is performed with the captured image data that is not enlarged / reduced.

In this way, the frame image 501a and the image data of the read image are combined, and the combined image data of the frame image 501a and the read image is projected onto the original 250 on the platen 203. The user can adjust the position of the document 250 while viewing the projected image and have the document image read.

As described above, in the present embodiment, the area sensor 201 is operated in the moving image mode having a low resolution, the image area to be printed is calculated from the image data captured by the moving image, and the printed image area is read from the projection device 206 toward the document 250. It is configured to project the resulting image. As a result, the document scanning area and the scanning result for the printing paper can be presented to the user. As a result, when printing the shooting data on the shooting area, particularly on the paper, the user can recognize that the shooting is performed in a form that fits in the paper size. In addition, it is possible to understand from the image projected from the projection device 206 how large the size of the paper will be printed. As a result, it has been possible to solve the problem that the installation position of the document 250 cannot be indicated by the top shot scanner in the past.

The processing of the image reading device according to the present embodiment described so far is executed by software as a function of each functional unit shown in FIGS. 5, 9 and 13. The software is stored as a program on a computer-readable recording medium, such as an HDD or ROM 301b, which is a storage device 302, and the procedure defined by the program while the CPU 301a of the control device 301 of the document scanner 102 uses the RAM 301c as a buffer and a work area. To execute. It is also possible to have a part of this processing method on the network and realize it through a communication line.

Further, as shown in FIG. 16, this program is distributed to devices (1) 141, (2) 142, (3) 143 such as a personal computer by a communication network 140 such as the Internet via the recording medium. Can be done. That is, this program can be provided, for example, in a pre-installed state on a hard disk as a recording medium built in a computer. In addition, this program can be provided as package software by temporarily or permanently storing it in a recording medium, incorporating it into a computer as a unit, or using it as a detachable recording medium.

As the recording medium, for example, a flexible disk, a CD-ROM, a MO disk, a DVD, a BD, a magnetic disk, a semiconductor memory, or the like can be used. The program can be transferred from the download site to a computer by wire or wirelessly via a network such as LAN (Local Area Network) or the Internet, and installed in a storage device such as an internal hard disk in the computer. ..

As described above, the present invention can be in the form of a program for being executed by a computer in addition to the form of an image reading device, or as a computer-readable recording medium in which the program is recorded.

As described above, if the present invention corresponds to the present embodiment, the following effects can be obtained. In the following description, each component in the claims and each part of the present embodiment correspond to each other, and when the terms of the two are different, the latter is shown in parentheses and the corresponding reference code is attached. The correspondence between the two was clarified.

(1) An imaging means (area sensor 201) that is located above the document 250 and images the document 250, and a paper feed paper size determining means (supply) that determines the size of the paper feed paper from the input paper feed paper information. The paper paper detection unit 511), the frame image generation means (frame image generation unit 503) that generates the determined paper size as a frame image with respect to the image signal output from the image pickup means, and the image pickup means output. An image synthesizing means (projection image generation unit 502) that synthesizes a frame image 501a generated by the frame image generation means with the image signal to be generated, and a projection means (image projection unit 501) that projects an image synthesized by the image synthesizing means. According to the image reading device (document scanner 102) according to the present embodiment including the projection device 206), it is possible to present the document reading area and the reading result for the printing paper to the user. This enables the user to grasp the relationship between the document scanning area and the scanning result on the printing paper, and the user looks at the projected image and prevents the image from going out of the scanning range when scanning the image. Can be read.

(2) Paper feed paper direction determining means for determining the direction of the paper feed paper from the input paper feed paper information (detecting device for detecting the position of the end fence 511a and detecting device for detecting the position of the side fence 511b). The frame image generation means (frame image generation unit 503) changes the projection information of the frame image according to the direction of the paper feed paper determined by the paper feed paper direction determination means (for example, from the red line to blue). According to the present embodiment (changed to a line), an image obtained by synthesizing the frame image 501a with the image signal of the image read by the imaging means is projected onto the original 250 placed on the platen 203. By looking at the projected image on the 250, the printing state of the original on the paper feed can be immediately determined.

(3) The document detecting means (manuscript detection / frame detecting unit 701) for detecting the placement position of the document 250 is provided, and the document detecting means determines whether or not the frame size of the captured image data matches the frame image size information. The frame image generation means (frame image generation unit 503) determines whether or not the frame size of the captured image data does not match the frame image size information, or the frame position of the captured image data is the frame position information. If they do not match (S212: No), the frame image is corrected (S213 → S106 ... S212). According to the present embodiment, when the placement of the document is inappropriate, the projection information is corrected and the document is read. be able to.

(4) A document detecting means (manuscript detection / frame detecting unit 701) for detecting the placement position of the document 250 is provided, and the document detecting means detects that the document 250 is outside the frame image 501a. In this case, according to the present embodiment in which the projection means (projection device 206) performs warning projection on the document to that effect, the user can be notified that the document placement position is inappropriate.

(5) According to the present embodiment in which the imaging means (area sensor 201) images the document 250 with a low-resolution moving image shooting function, the user uses the moving image shooting image data to obtain a document reading area for printing paper. It will be possible to present to. At that time, since it is operated by the moving image shooting function having a low resolution, the projection process can be performed quickly without imposing a burden on the control circuit.

(6) The size and position of the document 250 and the frame image 501a are detected from the image captured by the image pickup means (area sensor 201), the magnification of enlargement or reduction is calculated, and the document is matched with the frame image. According to the present embodiment provided with the enlargement / reduction means (enlargement / reduction unit 1101) for enlarging or reducing the image, the image can be enlarged or reduced based on the original size and printed at the optimum print size.

(7) The projection means (7) the image enlarged or reduced by the enlargement / reduction means (enlargement / reduction unit 1101) is matched with the frame image 501a generated by the frame image generation means (frame image generation unit 503). According to the present embodiment projected from the projection device 206), the user can confirm the print state by the image projected on the document 250.

(8) According to the image forming apparatus 100 according to the present embodiment provided with the image reading apparatus according to any one of the above (1) to (7), the effects of the above (1) to (7) can also be applied to the image forming apparatus. Can play.

(9) The step (S103) in which the image pickup means (area sensor 201) located above the document 250 images the document, and the paper feed paper size determination means (paper feed sheet detection unit 511) input the paper feed. The step (S106) of determining the size of the paper to be fed from the paper information and the frame image generation means (frame image generation unit 503) set the determined paper size as a frame image with respect to the image signal output from the imaging means. A step (S109) of generating as 501a, and a step (S110) in which the image synthesizing means (projected image generation unit 502) synthesizes a frame image generated by the frame image generating means with the image signal output from the imaging means. According to the manuscript image projection method according to the present embodiment, the projection means (image projection unit 501, projection device 206) projects the image synthesized by the image composition means (S111). The effects described in 1) can be achieved.

(10) The computer (CPU 301a) is supplied with the procedure (S103) of imaging the original by the imaging means (area sensor 201) located above the original 250 and the size of the paper to be fed from the input paper feed information. The procedure (S106) for determining by the paper paper size determining means (paper feed paper detecting unit 511) and the frame image generating means (frame image generating unit) for determining the determined paper size with respect to the image signal output from the imaging means. A procedure (S109) for generating the frame image 501a according to 503) and a procedure for synthesizing the frame image generated by the frame image generating means with the image signal output from the imaging means by the image synthesizing means (projected image generating unit 502). (S110) and the procedure (S111) for projecting the image synthesized by the image synthesizing means by the projection means (image projection unit 501, projection device 206) are installed, and the computer installs the program. By executing the above, the image reading process that achieves the effect described in (1) above can be performed.

The present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention, and all the technical matters included in the technical idea described in the claims are all. It is the subject of the present invention. Although the above-described embodiment shows a suitable example, those skilled in the art can realize various alternative examples, modified examples, modified examples or improved examples from the contents disclosed in the present specification. These are included in the technical scope described in the appended claims.

100 Image forming device 102 Document scanner (image reading device)
201 Area sensor (imaging means)
203 Document stand 206 Projector (projection means)
250 Manuscript 301a CPU (Computer)
501 image projection unit (projection means)
501a Frame image 502 Projection image generation unit (image composition means)
503 Frame image generation unit (frame image generation means)
511 Paper feed detector (paper feed paper size determination means)
701 Manuscript detection / frame detection unit (manuscript detection means)
1101 Enlargement / reduction part

Japanese Unexamined Patent Publication No. 2015-170907

Claims (9)

An imaging means that is located above the document and captures the document,
Paper feed paper size determination means that determines the size of paper feed from the input paper feed information, and
A frame image generating means that generates the determined paper size as a frame image with respect to the image signal output from the imaging means.
An image synthesizing means that synthesizes a frame image generated by the frame image generating means with an image signal output from the imaging means, and an image synthesizing means.
A projection means for projecting an image synthesized by the image composition means, and
A document detecting means for detecting the placement position of the document and
Equipped with a,
The document detecting means determines whether or not the frame size, which is the size of the frame image obtained from the composite image projected by the projection means, matches the already generated frame image size information.
When the frame size obtained from the composite image does not match the original frame image size information, or when the frame position related to the composite image does not match the original frame position information, the frame image generation means Generates a new frame image whose position and size are corrected based on the frame size and frame position of the frame image included in the captured image data acquired via the imaging means.
An image reader characterized by this . The image reading device according to claim 1.
A paper feed paper direction determining means for determining the direction of the paper feed paper from the input paper feed paper information is provided.
The frame image generating means is an image reading device that changes the projection information of the frame image according to the direction of the paper feed paper determined by the paper feed paper direction determining means. The image reading device according to claim 1 or 2 .
An image reading device that, when the document detecting means detects that the document is outside the frame image, projects a warning on the document from the projection means. The image reading device according to any one of claims 1 to 3 .
Image reading apparatus for imaging the document by the imaging unit Gado image shooting function. The image reading device according to any one of claims 1 to 4 .
An enlargement / reduction means for detecting the size and position of the original and the frame image from the image captured by the imaging means, calculating the magnification of enlargement or reduction, and enlarging or reducing the original image according to the frame image. Equipped with an image reader. The image reading device according to claim 5 .
An image reading device that projects an image enlarged or reduced by the scaling means from the projection means in accordance with the frame image generated by the frame image generating means. An image forming apparatus including the image reading device according to any one of claims 1 to 6 . An imaging step in which the imaging means images the document located above the document, and
The step of determining the size of the paper feed paper from the paper feed paper information input by the paper feed paper size determination means, and
The image signal output frame image generating means from said imaging means, a frame image generating step of generating the determination paper size as a frame image,
A step in which the image synthesizing means synthesizes a frame image generated by the frame image generating means with an image signal output from the imaging means, and
A projection step in which the projection means projects an image synthesized by the image synthesis means,
A document detection step that detects the placement position of the document, and
Equipped with a,
In the document detection step, it is determined whether or not the frame size, which is the size of the frame image obtained from the composite image projected in the projection step, matches the frame image size information that has already been generated.
In the frame image generation step, when the frame size obtained from the composite image does not match the original frame image size information, or when the frame position related to the composite image does not match the original frame position information. Generates a new frame image whose position and size are corrected based on the frame size and frame position of the frame image included in the captured image data acquired in the imaging step.
A method of projecting a manuscript image , characterized in that . On the computer
The procedure for imaging the document by the imaging means located above the document, and
The procedure for determining the size of the paper feed from the input paper feed information by the paper feed paper size determination means, and
A procedure for generating the determined paper size as a frame image by the frame image generation means with respect to the image signal output from the image pickup means, and
A procedure for synthesizing a frame image generated by the frame image generating means with an image signal output from the imaging means by the image synthesizing means, and
The procedure of projecting the image synthesized by the image synthesizing means by the projection means and
The procedure for detecting the placement position of the document and
To execute ,
It is made to judge whether or not the frame size which is the size of the frame image obtained from the composite image projected in the projection procedure matches the already generated frame image size information.
In the procedure for generating the frame image, when the frame size obtained from the composite image does not match the original frame image size information, or the frame position related to the composite image does not match the original frame position information. In this case, a new frame image whose position and size are corrected based on the frame size and frame position of the frame image included in the captured image data acquired by the imaging means is generated.
A program characterized by that .