JP3568374B2 - Dot code and information reproduction system - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention records and / or reproduces so-called multimedia information including audio information such as voice and music, video information obtained from a camera, video, and the like, and digital code data obtained from a personal computer, a word processor, and the like. Dot code that is optically readable and recorded on sheet media such as paper, various resin films, and metalAnd an information reproducing system that reads such dot codes and reproduces the original informationAbout.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, various media such as a magnetic tape and an optical disk have been known as media for recording voice, music, and the like.
[0003]
However, even if these media are made in large quantities, the unit price is somewhat expensive, and a large space is required for storage.
[0004]
Furthermore, if it is necessary to hand over the recorded media to another person at a remote location, it takes time and effort to mail it or take it directly. There was also.
[0005]
Therefore, it has been considered to record audio information on paper in the form of image information that can be transmitted by facsimile and that can be copied in large quantities at low cost. For example, as disclosed in Japanese Patent Application Laid-Open No. Sho 60-244145, a proposal has been made such that audio information is converted into image information by sending a small amount of audio into an optical code and can be transmitted by facsimile. Have been.
[0006]
[Problems to be solved by the invention]
However, in the apparatus disclosed in the above publication, the facsimile apparatus has a sensor for reading the optically readable recorded voice, and reproduces the voice according to the sensor output. Therefore, it is assumed that the optically readable audio information transmitted by facsimile can only be heard at the place where the facsimile device is installed, and that the facsimile output paper is moved to another place to reproduce the sound. Had not been.
[0007]
Therefore, if the recording capacity of audio information is increased, it may affect other facsimile transmission / reception. If the content of audio recording itself is difficult, the first It is possible that you forget. Furthermore, the recording capacity is limited by the recording density and the compression method, and only a few seconds of audio can be transmitted. Therefore, in order to transmit a large amount of audio information, a magnetic tape or an optical disk must be used.
[0008]
Further, even for short-time audio information, the reproduction apparatus itself is built in the facsimile apparatus, so that it is inconvenient for the repeated reproduction of the audio information.
[0009]
A low-cost and large-capacity recording / reproducing system for so-called multimedia information including video information obtained from a camera, video, and the like, and digital code data obtained from a personal computer, a word processor, etc., other than audio information. Has not yet been realized.
[0010]
SUMMARY OF THE INVENTION The present invention has been made in view of the above points, and is a dot code capable of recording multimedia information including audio information, video information, digital code data, and the like at a low cost, in a large capacity, and repeatedly reproducing.And information reproduction systemThe purpose is to provide.
[0011]
[Means for Solving the Problems]
In order to achieve the above object, the dot code according to the present invention is an optically readable dot code,
The dot code is
A data dot pattern consisting of a plurality of dots arranged two-dimensionally according to the content of the data,
A plurality of markers for recognizing the dot code, comprising a pattern that cannot be included in the data dot pattern;
At least
Each of the plurality of markers includes a black portion and a white portion,Separated from each other in two dimensionsThe center of gravity of a black portion that is arranged and determined by a white portion of the marker is a point for obtaining a sample point for sampling data from the data dot pattern.
In addition, the information reproducing system according to the present invention,
An optically readable dot code, a data dot pattern consisting of a plurality of dots two-dimensionally arranged in accordance with the content of data relating to information to be reproduced, and a pattern which cannot be included in the data dot pattern Comprising at least a plurality of markers for recognizing the dot code, wherein each of the plurality of markers is constituted of a black portion and a white portion, and is arranged two-dimensionally apart from each other, Optically reading the dot code from a recording medium on which a dot code is recorded in which a center of gravity of a black portion determined by a white portion of the marker is a point for obtaining a sample point for sampling data from the data dot pattern. Means,
Restoring means for detecting the marker from the dot code read by the reading means, sampling data from the data dot pattern included in the dot code and restoring original information,
Output means for outputting information restored by the restoration means,
It is characterized by having.
[0012]
That is, the dot code of the present inventionAnd information reproduction systemAccording to the above, at least a data dot pattern consisting of a plurality of dots two-dimensionally arranged according to the content of data, and a plurality of patterns for recognizing the dot code, comprising a pattern that cannot be included in the data dot pattern. A dot code is composed of markers and, in particular, each of the plurality of markers is composed of a black portion and a white portion., Separated from each other in two dimensionsThe marker is arranged, and the center of gravity of each black portion determined by each white portion of each marker is set as a point for obtaining a sample point for sampling data.
[0013]
Therefore, when the data relating to the multimedia information is recorded on the recording medium as a data dot pattern so as to be optically readable, the marker can be easily recognized from the dot code, and each of the data dot patterns in the block can be recognized by the marker pair. Since the arrangement position of the dots can be specified two-dimensionally, each dot of the data dot pattern can be recorded with a very fine size, so that low-cost and large-capacity recording can be performed. Such a dot code can be reproduced repeatedly.
[0014]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. First, embodiments of multimedia information related to audio information such as voice and music will be described.
[0015]
FIG. 1 is a block diagram of an audio information recording apparatus for recording audio information such as voice and music on a paper as an optically readable digital signal in the first embodiment of the present invention.
[0016]
An audio signal input from an audio input device 12 such as a microphone or an audio output device is amplified by a preamplifier 14 (in the case of microphone audio, AGC is applied), and then converted into a digital signal by an A / D converter 16. The digitized audio signal is subjected to data compression in a compression circuit 18 and then an error correction code addition circuit 20 adds an error correction code.
[0017]
After that, the memory circuit 22 performs interleaving. This interleaving is to two-dimensionally disperse an array of data according to a predetermined rule. When the data is returned to the original array by the reproducing apparatus, bursty stains and scratches on the paper, that is, The errors themselves are dispersed, so that error correction and data interpolation become easier. This interleaving is performed by appropriately reading and outputting the data stored in the memory 22A by the interleaving circuit 22B.
[0018]
The output data of the memory circuit 22 is then converted by a data adding circuit 24 into a marker, an x-address and a y-address indicating a two-dimensional address of the block for each block in accordance with a predetermined recording format which will be described in detail later. , And an error determination code, the data is modulated by the modulation circuit 26 for recording. Then, after data such as image data recorded together with the output data of the audio information is superimposed by the synthesizing circuit 27, the printer system or the printing plate-making system 28 performs a process for printing.
[0019]
Thereby, for example, it is recorded on the paper 30 as a recording medium in a format as shown in FIG. That is, the digital signalized sound data is printed as the recording data 36 together with the image 32 and the character 34. Here, the recording data 36 is composed of a plurality of blocks 38. Each block 38 includes a marker 38A, an error correction code 38B, audio data 38C, x address data 38D, y address data 38E, and an error determination code 38. 38F.
[0020]
Note that the marker 38A also functions as a synchronization signal, and uses a pattern such as DAT that does not normally appear in recording modulation. The error correction code 38B is used for error correction of the audio data 38C. The audio data 38C corresponds to an audio signal input from the audio input device 12 such as the microphone or the audio output device. The x and y address data 38D and 38E are data indicating the position of the block 38, and the error determination code 38F is used for error determination of these x and y addresses.
[0021]
The recording data 36 in such a format is obtained by changing the data of “1” and “0” to “1” with black dots and “0” with no black dots, for example, like a bar code. Alternatively, print recording is performed by the printing plate making system 28. Hereinafter, such recording data is referred to as a dot code.
[0022]
FIG. 2B shows a scene in which sound data recorded on the paper 30 as shown in FIG. 2A is read out by the pen-type information reproducing device 40. By tracing over the dot code 36 with the pen-type information reproducing device 40 as shown in FIG. 3, the dot code 36 can be detected, converted into sound, and heard by the audio output device 42 such as an earphone.
[0023]
FIG. 3 is a block diagram of the information reproducing apparatus 40 according to the first embodiment of the present invention. In the information reproducing apparatus according to the present embodiment, parts other than the audio output device 42 such as headphones and earphones are housed in one portable pen-shaped housing (not shown). Of course, a speaker may be built in the housing.
[0024]
The detection unit 44 basically has the same function as an imaging unit such as a television camera. That is, the light source 44A illuminates the dot code 36 on the paper surface, which is a subject, and reflects the reflected light through an imaging system 44B such as a lens and a spatial filter 44C by an imaging unit 44D including a semiconductor area sensor or the like. , And the signal is amplified and output by the preamplifier 44E.
[0025]
Here, the pixel pitch of the area sensor is set to be equal to or smaller than the dot pitch of the dot code 36 on the imaging surface according to the sampling theorem. Furthermore, a spatial filter 44C installed on the imaging surface is also inserted based on this theorem in order to prevent the moire phenomenon (aliasing) on the imaging surface. In addition, as shown in FIG. 4A, the number of pixels of the area sensor is determined by taking into account camera shake during manual scanning of the detection unit 44, and in the vertical direction of a predetermined dot code 36 that is specified to be readable at a time. It is set to be larger than the width of. That is, FIGS. 4A and 4B show the movement state of the image pickup area in a certain cycle when the detection unit 44 is manually scanned in the direction of the arrow. In particular, FIG. The state of manual scanning when the vertical width of the code 36 falls within the image pickup area (considering camera shake) is shown. (B) shows a case where the amount of the dot code 36 is large and the vertical width is one. The case where it does not fit in the imaging area is shown. In the latter case, a mark 36A for manual scanning is printed at a position where manual scanning of the dot code 36 is started. Therefore, a large number of dot codes 36 can be detected by performing manual scanning a plurality of times along the manual scanning mark 36A.
[0026]
The image signal detected by the detection unit 44 as described above is then input to the scan conversion and lens distortion correction unit 46. In the scan conversion and lens distortion correction section 46, an input image signal is first converted into a digital signal by an A / D converter 46A and stored in a frame memory 46B. This frame memory 46B has 8-bit gradation.
[0027]
Further, the marker detection circuit 46C scans the image information stored in the frame memory 46B as shown in FIG. 4C to detect the marker 38A. The detection circuit 46D detects which marker 38A detected by the marker detection circuit 46C corresponds to which address value on the imaging surface, and, based on the address value, the inclination of the imaging surface with respect to the arrangement direction of the dot code. Calculate θ. Note that the marker detection circuit 46C rotates by approximately 90 ° in the scan in only the direction as shown in FIG. 4C as shown in FIG. When the imaging of the code 36 is performed, the inclination θ may not be correctly obtained. That is, when scanning is performed in the short direction of the block 38, there is a possibility that θ may not be obtained correctly. Therefore, the marker detection circuit 46C also performs the scanning in the orthogonal direction as shown in FIG. The correct one of the results obtained by the two-way scanning is selected.
[0028]
On the other hand, the lens aberration information memory 46E stores previously measured aberration information of the lens used in the imaging system 44B of the detection unit 44 for correcting lens distortion. The next time the address control circuit 46F reads out the data stored in the frame memory 46B, the value of the inclination θ calculated by the θ detection circuit 46D and the lens aberration stored in the lens aberration information memory 46E are used. A read address in accordance with the information is given to the frame memory 46B, and scan conversion is performed in the data arrangement direction while performing data interpolation by the interpolation circuit 46G.
[0029]
FIG. 5A shows the principle of data interpolation performed by the interpolation circuit 46G. Basically, the interpolation data is created by the convolution filter and the LPF using the pixels around the position Q at which the data is interpolated. The pixel pitch and the scan line pitch after the scan conversion are set to be equal to or smaller than the dot pitch of the dot code based on the sampling theorem, as in the case of imaging.
[0030]
In the case of simple data interpolation using four pixels around the position Q to be interpolated, Q = (D6 × F6) + (D7 × F7) + (D10 × F10) + (D11 × F11) In the case of relatively accurate data interpolation using 16 surrounding pixels, interpolation data is created by the calculation of Q = (D1 × F1) + (D2 × F2) +... + (D16 × F16). . Here, Dn is a data amplitude value of the pixel n, and Fn is a coefficient of an interpolation convolution filter (LPF) determined according to a distance to the pixel n.
[0031]
The image of the dot code 36 read from the frame memory 46B after being subjected to the scan conversion as described above is binarized by the binarization circuit 48 including the latch 48A and the comparator 48B. The threshold value at the time of performing this binarization is determined by the threshold value determination circuit 50 using the value of the histogram for each screen or for each block in the screen. That is, the threshold is determined according to the stain on the dot code 36, the distortion of the paper 30, the accuracy of the built-in clock, and the like. As the threshold value judgment circuit 50, for example, it is preferable to use a circuit using a neural network disclosed in Japanese Patent Application No. Hei 4-131051 by the present applicant.
[0032]
At the same time, the image of the dot code 36 read from the frame memory 46B is input to the PLL circuit 52, and generates a clock pulse CK synchronized with the reproduced data. The clock pulse CK is used as a reference clock for binarization and demodulation after scan conversion, and for an error determination circuit 56A, x, y address detection circuit 56B and a memory unit 56C in the data string adjustment unit 56, which will be described later. .
[0033]
The binarized data is demodulated by a demodulation circuit 54 and input to an error determination circuit 56A and an x, y address detection circuit 56B in the data string adjustment unit 56. The error determination circuit 56A uses the error determination code 38F in the block 38 to determine whether or not the x and y address data 38D and 38E have an error. If there is no error, the demodulated data from the demodulation circuit is recorded in the audio data string adjustment memory unit 56C according to the address detected by the x, y address detection circuit 56B. If there is an error, the audio data 38C of the block 38 is not recorded in the audio data string adjustment memory unit 56C.
[0034]
The purpose of the data string adjusting unit 56 is to adjust the accuracy of the scan conversion in the scan conversion and lens distortion correction unit 46 (which depends on the accuracy of the reference clock and the S / N of the image sensor) and the distortion of the data. An object of the present invention is to correct a slight shift generated in the arrangement direction and the scan direction after scan conversion. This will be described with reference to FIG. In the figure, dot codes D1, D2, and D3 indicate data for each block. The pitch of the scanning lines 1, 2, 3,... After the scan conversion may be set to be equal to or less than the data dot pitch based on the sampling theorem as described above, but in FIG. It is set to の of the dot pitch for the sake of convenience. Therefore, as apparent from the figure, the dot code D1 is detected without error on the scan line 3 after the scan conversion. D2 is detected without error on the scan line 2 after the scan conversion, and D3 is similarly detected without error on the scan line 1 after the scan conversion.
[0035]
Then, in accordance with the x and y addresses 38D and 38E in the respective blocks 38, the data is stored in the data string adjusting memory 56C.
[0036]
Next, as shown in FIGS. 4A and 4B, by manually scanning the detection unit 44, the voice dot code 36 on the paper 30 can be completely stored in the data row adjustment memory unit 56C. Can be stored.
[0037]
The audio dot code whose data string has been adjusted by the data string adjusting unit 56 is then used for adjusting the data string in accordance with a reference clock CK ′ generated by a reference clock generating circuit 53 different from the PLL circuit 52. From the memory section 56C. Then, at this time, the data is de-interleaved by the de-interleave circuit 58 and converted into a formal data string. Next, error correction using the error correction code 38B in the block 38 is performed by the error correction circuit 60. Then, the decoding circuit 62 decodes the compressed data, and the data interpolation circuit 64 interpolates the error-correctable audio data. After that, the signal is converted into an analog audio signal by the D / A conversion circuit 66, amplified by the amplifier 68, and converted into sound by the audio output device (earphone, headphone, speaker, etc.) 42.
[0038]
As described above, audio information such as voice and music can be recorded on paper, and the reproduction device is a small portable device, so that it can be printed out, transmitted by facsimile, or printed. Prepress makes it possible to hear what is printed in book form anywhere and any number of times.
[0039]
The memory section 56C for adjusting the data string in the data string adjusting section 56 is not limited to a semiconductor memory, but may be a floppy disk.(Registered trademark)Other storage media, such as disks, optical disks, magneto-optical disks, etc., can be used.
[0040]
There are various applications of the audio information recorded as described above. For example, for general use, language teaching materials, music scores, various texts such as distance learning, product specifications, manuals for repairs, dictionaries in foreign languages, encyclopedias, books such as picture books, product catalogs, travel guides, direct mail and guidance Letters, newspapers, magazines, flyers, albums, congratulations, postcards, etc. are possible. For business use, FAX (voice and fax) business instructions, minutes, electronic blackboard, OHP, identification card (voiceprint), business cards, telephone memos, sticky papers, high quality paper rolled supply products (Consumables), and the like. Here, as shown in FIG. 5 (B), the consumables are provided with an easily peelable paste such as a double-sided tape or a sticky note on the back surface of the rolled paper 30A. The dot code 36 is recorded on the recording medium, and it is cut off as much as necessary and can be attached to various objects (hereinafter, this is referred to as a reel seal). Further, as shown in FIG. 3C, the width of the paper 30A is widened so that a plurality of levels of dot codes 36 can be recorded, and a manual scanning mark 36B as a guideline for manual scanning of the detection unit 44 is provided. May be printed vertically and horizontally. The mark 36B can also be used at the same time as a guide for the recording position of the dot code 36. That is, if a sensor is provided in the printer system 28, and the mark 36B is read by the sensor and a cue for printing is performed, the dot code 36 is always printed in the area surrounded by the mark 36B. Therefore, the recorded audio information can be surely reproduced by performing the manual scanning along the mark 36B. Of course, when printing the dot code 36, the mark 36B may also be printed.
[0041]
The recording time of the audio information is 200 fps in the case of a general facsimile, for example, when data is recorded in an area of 1 inch × 7 inch (2.54 cm × 17.78 cm) along one side of the paper, The total number is 280 kbit. From now on, the marker, the address signal, the error correction code, and the error determination code (however, the error determination code in this case also includes the audio data 38C in addition to the x and y addresses 38D and 38E) (30%) Is subtracted, it becomes 196 kbit. Therefore, the recording time when audio is compressed to 7 kbit / s (bit rate of mobile communication) is 28 seconds. When recording on the entire back surface of A4-size double-sided facsimile paper, an area of 7 inches × 10 inches (17.78 cm × 25.4 cm) can be taken, so that 4.7 minutes of voice recording is possible.
[0042]
Also, in the case of a G4 facsimile of 400 dpi, as a result of calculation in the same manner as described above, it is possible to record 18.8 minutes of audio in an area of 7 inches × 10 inches.
[0043]
In the case of high-quality printing at 1500 dpi, when printing is performed in an area of 5 mm × 30 mm, as a result of calculation in the same manner as above, voice recording for 52.3 seconds is possible. Also, when printing is performed on a tape-shaped area of 10 mm × 75 mm, a minute of sound recording is possible when calculated with a sound signal of high sound quality (compressed 30 kbit / s) capable of music.
[0044]
FIG. 7 is a diagram showing the configuration of the second exemplary embodiment of the present invention. The second embodiment is an example in which a memory and an xy address type imaging unit such as a CMD which can be randomly accessed are used as an imaging device, and a detection unit 44 of a reproducing apparatus and a scan conversion and lens distortion correction circuit 46 are used. Only the third embodiment differs from the first embodiment. That is, the detection unit and the scan conversion unit 70 detect the marker of the image data stored in the xy address type imaging unit 70A in the same manner as in the first embodiment, and interpolate four data when reading the data. Are sequentially read out by the decoder address generator 70B and the x, y decoders 70C, 70D and input to the interpolator 72. The interpolation unit 72 sequentially reads out coefficients from the coefficient generation circuit 70E and multiplies the input data by the multiplier 70F. The sample and hold is performed by the sample and hold circuit 70J, and the scan-converted dot code is supplied to the binarization circuit 48, the threshold value determination circuit 50, and the PLL circuit 52.
[0045]
With such a configuration, the same function as that of the first embodiment can be performed, and the frame memory 46 can be omitted, so that cost reduction and size reduction can be realized. Further, the xy address type imaging section 70A, the address generation section 70B, the decoders 70C and 70D, and the interpolation section 72 are formed on a single substrate to form an IC, so that the size can be further reduced.
[0046]
FIG. 8 is a diagram showing a configuration of the third exemplary embodiment of the present invention. In the present embodiment, the dot code 36 is recorded on the paper 30 on which pictures and characters are printed by using a transparent paint (ink) 74 that is easily specularly reflected (total reflection). Then, in the detection unit 44, polarizing filters 44F and 44G are provided between the light source 44A and the imaging system 44B, and the polarization planes of the polarizing filters 44F and 44G are matched, so that the inside (from the surface of the paper 30) can be seen. And the reflected light from the place where the hole 74A through which the transparent paint 74 is cut out according to the code, the polarization directions are disjointed, and a half of the reflected light is cut by the polarizing filter 44G. Since the difference in the amount of light between the reflected light and the totally reflected light is originally large, the contrast of the dot code recorded with the transparent paint 74 is enhanced and the image is taken.
[0047]
Further, the paper 30 is subjected to a surface treatment such as a mirror finish so that the surface is easily specularly reflected, and the transparent paint 74 is made of a material having a refractive index higher than the refractive index of the surface-treated surface, and about 1 / 4λ ( By taking into account the change in the optical path length due to the incident angle, the thickness of the film can be reduced to 1/4 of the optical path length in the transparent paint). It is amplified and easily reflected on the surface (specular reflection).
[0048]
In this case, for example, the formation of the dot code is performed by fine chemical etching or the like, and the portion of the hole corresponding to the dot is roughened to reduce the reflectance.
[0049]
When the dot code 36 is recorded with the transparent paint 74 in this manner, it can be recorded on a character or a picture. Therefore, when used in combination with a character or a picture, the recording capacity is increased as compared with the first embodiment. can do.
[0050]
Further, instead of the transparent paint, a transparent fluorescent paint may be used, or a color may be multiplexed. In the case of this color, a normal color ink can be used, or a color can be obtained by mixing a dye with a transparent ink.
[0051]
Here, as an example, the transparent ink may be an ink composed of a volatile liquid and a binder (for example, phenol resin varnish, linseed oil varnish, and alkyd resin), and the pigment may be a pigment.
[0052]
Next, a portable voice recorder to which the audio information recording device is applied will be described. FIGS. 9A and 9B are external views. This portable voice recorder includes a main body 76, a main body side and a detachable member on the voice input section side (surface fastener, magic tape).(Registered trademark)Etc.) and an audio input unit 80 that is detachable from the main body 76 by 78A and 78B. A recording start button 82 and a print sheet discharge unit 84 are provided on the surface of the main body 76. Note that the main body 76 and the audio input unit 80 are connected by a cable 86. Of course, a signal may be transmitted from the voice input unit 80 to the main unit 76 by wireless or infrared rays.
[0053]
FIG. 10 is a block diagram of such a portable voice recorder. The sound input from the microphone 88 is amplified by a preamplifier 90, converted to digital by an A / D converter 92, and supplied to a compression processing unit (ADPCM) 94. The data subjected to the compression processing is added with an error correction code by an error correction code addition section 96, and the result is supplied to an interleave section 98, where each data is stored, and thereafter, an interleave processing is performed. The interleaved data is further added with the address of the block and an error determination code (CRC or the like) for the block by the address data adding unit 100, and the result is input to the modulation circuit 102. The modulation circuit 102 converts 8-bit data, such as 8-10 modulation, into another 10-bit data. After that, the marker adding section 104 generates and adds a marker using a data string that is not included in the 256 data strings associated with the modulation circuit 102.
[0054]
The data to which the marker has been added in this manner is sent to the simple printer system 106, printed on the reel seal 108 as shown in FIGS. 11A and 11B, and discharged from the print sheet discharge section 84. In this case, the simple printer system 106 prints the date and time measured by the timer 110 on the reel sticker 108.
[0055]
The above-described units are controlled by the control unit 112 in accordance with the operation of the recording start button 82. In addition, there is no particular limitation on which part of the above components from the microphone 88 is configured in the audio input unit 80. For example, the microphone 88, the preamplifier 90, the A / D It is assumed that a converter 92 is built-in.
[0056]
FIG. 12 is an operation flowchart of the portable voice recorder having such a configuration. That is, when the recording start button 82 provided on the main body 76 is pressed down (step S12), while the button is pressed down (step S14), processing from voice input to printing of the dot code 114 on the reel seal 108 is performed. This is performed (step S16). When the pressing of the recording start button 82 is stopped, it is determined whether or not the recording start button 82 is pressed again within a predetermined period of time (step S18). And the above processing is repeated. However, if the recording start button 82 has not been pressed within a certain time, the current date and time are referred to by the timer 110 (step S20), and the reel seal 108 is fed while feeding the blank portion 116 while referring to the current date and time. The printed date and time are printed (step S22).
[0057]
In such a portable voice recorder, when the main body 76 and the voice input unit 80 are connected as shown in FIG. 9A, the user holds the main body 76 by hand and brings the voice input unit 80 close to the lips. The voice is recorded on the reel sticker 108 as a dot code 114. Also, as shown in FIG. 9B, the main body 76 and the voice input unit 80 are separated, and the voice input unit 80 is attached to the receiver side of the telephone handset using the detachable member 78B, so that the telephone can be used. Instead of writing down the content, the other party's business can be directly recorded on the reel sticker 108 as the dot code 114. Moreover, in this case, as shown in FIGS. 11A and 11B, not only is the date and time printed on the reel seal 108, but also a blank portion 116 is formed. And write comments such as to whom.
[0058]
Note that the voice input unit 80 may have various modes other than the configuration in which the voice input unit 80 is attached to and detached from the main body by the detachable member as described above. For example, as shown in FIGS. 11C and 11D, an earphone type can be used. In the case of such an earphone type voice input unit 80, the voice input unit 80 is pulled out from the voice input unit storage unit 118 of the main body 76 and inserted into the user's ear as shown in FIG. While listening to the other party's voice heard from the handset side of the telephone handset, it can be recorded in the form of a dot code.
[0059]
In the above description, the dot code printing is performed only while the recording start button 82 is kept pressed. However, a separate recording end button is provided on the main body 76, and the recording end button is pressed once the recording start button 82 is pressed. Until the button is pressed, dot code printing may be performed.
[0060]
The recording apparatus may incorporate a reproducing function as shown in FIG. 3 to be used as a recording / reproducing apparatus. At that time, the earphone type voice input unit 80 may also have an earphone function.
[0061]
In the above embodiment, the information to be recorded is described by taking audio information such as voice and music as an example. However, not only audio information but also video information obtained from a camera, video, etc. An embodiment for handling so-called multimedia information including digital code data such as text data obtained from a personal computer (hereinafter referred to as a personal computer), a word processor (hereinafter referred to as a word processor), and the like will be described.
[0062]
FIG. 13 is a block diagram of a multimedia information recording apparatus for recording such multimedia information.
[0063]
As in the case of FIG. 1, audio information is input from a microphone or an audio output device 120, amplified by a preamplifier 122, converted to digital by an A / D converter 124, and compressed. It is supplied to the unit 126.
[0064]
In the compression processing unit 126, the input digital audio signal is selectively supplied to a voice compression circuit 130 such as an ADPCM circuit and a voice synthesis coding circuit 132 by a switch 128. The audio compression circuit 130 performs data compression by performing adaptive differential PCM on the input digital audio information. The voice synthesis coding circuit 132 recognizes one voice of the input digital audio information and then converts it into a code. This is because the ADPCM encodes it in the form of audio information and reduces the amount of data, that is, processes it as it is, but once changes it to another synthesized code, it is relatively possible. It reduces the amount of data. Regarding the switching of the switch 128, for example, the user manually switches according to the purpose, for example. Alternatively, for example, information of high sound quality such as information from an audio output device is passed through a voice compression circuit 130, and information such as a human voice or comment from a microphone is passed through a voice synthesis coding circuit 132. If determined in advance as described above, it is also possible to adopt a configuration in which the input audio information is recognized at the preceding stage of the switch and automatically switched.
[0065]
Various data coming from a personal computer, a word processor, a CAD, an electronic organizer, a communication, etc., already formed as digital code data, are first transmitted via an interface (hereinafter referred to as I / F) 134 to a data form discriminating circuit 136. Is input to The data form determination circuit 136 basically determines whether or not compression can be performed by the compression processing unit 126 at the subsequent stage. The data has already undergone some compression processing. The information for which the effect of the above is not obtained is passed directly to the subsequent stage of the compression processing unit 126, bypassing the compression processing unit 126. If the input data is uncompressed data, it is sent to the compression processing unit 126. send.
[0066]
The data determined to be uncompressed code data by the data form discriminating unit 136 is input to the compression processing unit 126, and the code data is optimally compressed by a compression circuit 138 such as a Huffman, arithmetic code, or Jibrempel. A compression process is performed. The compression circuit 138 also performs a compression process on the output of the speech synthesis coding circuit 132.
[0067]
Note that the speech synthesis coding circuit 132 may recognize and convert character information other than speech into speech synthesis code.
[0068]
The image information of the camera or the video output device 140 is supplied to the compression processing unit 126 after being amplified by the preamplifier 142 and A / D converted by the A / D converter 144.
[0069]
In the compression processing unit 126, the image area determination and separation circuit 146 determines whether the input image information is a binary image such as a handwritten character or a graph or a multivalued image such as a natural image. This image area determination and separation circuit 146 uses, for example, a method of discriminating image area separation using a neural network as disclosed in Japanese Patent Application No. 5-163635 filed by the present applicant, to generate binary image data. Separate multi-valued image data. The binary image data is compressed as binary compression by a general binary compression processing circuit 148 such as MR / MH / MMR using JBIG or the like. For multi-value image data, a static image such as DPCM or JPEG is used. Is compressed by the multi-level compression processing circuit 150 using the compression function.
[0070]
The data that has been subjected to the compression processing as described above are combined by the data combining processing unit 152 as appropriate.
[0071]
Note that it is not always necessary to provide all the information input and compression processing systems in parallel, and one or a plurality of systems may be appropriately combined according to the purpose. Therefore, the data synthesizing unit 152 is not always necessary, and if there is only one type of data system, the data synthesizing unit 152 is omitted, and the data is directly input to the error correction code adding unit 154 in the next stage. Can be.
[0072]
The error correction code adding section 154 adds an error correction code and inputs the code to the data memory section 156. In the data memory unit 156, each data is stored, and thereafter, an interleave process is performed. This means that when data is actually recorded as a dot code and it is reproduced, it is possible to reduce errors a little, for example, to reduce the number of block errors due to noise etc. This is a process of distributing the columns at appropriately distant positions. That is, an operation of reducing the risk of a burst error in units of bit errors is performed.
[0073]
To the interleaved data, an address data adding unit 158 adds a block address and an error determination code (CRC or the like) for the address, and the result is input to the modulation circuit 160. The modulation circuit 160 performs, for example, 8-10 modulation.
[0074]
In the above-described embodiment, a code for error correction may be added after interleaving.
[0075]
Thereafter, the marker adding unit 162 generates and adds a marker using a data string that is not included in the 256 data strings associated with the modulation circuit 160. By adding the marker after the modulation in this way, there is an effect of solving the problem that even the marker is modulated, which makes it difficult to recognize the marker.
[0076]
The data with the marker added thereto is sent to the synthesizing and editing processing unit 164, and is recorded on a recording paper other than the generated data. For example, the data is synthesized with an image, a title, a character, or the like. The data is edited, converted to a printer output format or a data format compatible with printing prepress, and sent to the next printer system or printing prepress system 166. Then, the image is finally printed on a sheet, a tape, a printed material, and the like by the printer system and the printing plate making system 166.
[0077]
Note that the editing process in the synthesis and editing processing unit 164 may be performed by appropriately setting the code length in word units, content breaks, and the like, by adjusting the layout of the page information and the dot code, the dot size of the code to the resolution of a printing machine, a printer, or the like. This includes editing operations such as performing a step change of a break, that is, a step change in which one row is moved to the next line.
[0078]
The printed matter printed in this way is transmitted by, for example, FAX 168. Of course, instead of printing the data generated by the combining and editing processing unit 164, the data may be directly transmitted by fax.
[0079]
Here, the concept of the dot code 170 in the present embodiment will be described with reference to FIG. In the data format of the dot code 170 according to the present embodiment, one block 172 includes a marker 174, a block address 176, address error detection / error correction data 178, and a data area 180 in which actual data is entered. I have. That is, in the embodiment described with reference to FIG. 2A, one block is one-dimensionally configured in the line direction, but in the present embodiment, two blocks are two-dimensionally developed. It is formed in a shaped form. The blocks 172 are vertically, horizontally, and two-dimensionally arranged, and are collected to form a dot code 170.
[0080]
Next, the configuration of a multimedia information reproducing apparatus will be described with reference to the block diagram of FIG. The information reproducing apparatus detects a dot code from a sheet 182 as a recording medium on which the dot code 170 is printed, and performs a scan for recognizing the image data supplied from the detector 184 as a dot code and normalizing the image data. A conversion section 186, a binarization processing section 188 for converting multi-valued data into binary, a demodulation section 190, an adjustment section 192 for adjusting a data string, a data error correction section 194 for correcting a read error and a data error during reproduction, and a data The data separation unit 196 separates the data according to each attribute, a decompression processing unit for data compression processing according to each attribute, a display unit or a reproduction unit, or another input device.
[0081]
In the detection unit 184, the dot code 170 on the sheet 182 is illuminated by the light source 198, and the reflected light is transmitted through the imaging optical system 200 such as a lens and the spatial filter 202 for removing moire and the like. The light information is detected as an image signal by an imaging unit 204 such as a CCD or CMD that converts the light information into an electric signal, and is amplified by a preamplifier 206 and output. The light source 198, the imaging optical system 200, the spatial filter 202, the imaging unit 204, and the preamplifier 206 are configured in an external light shielding unit 208 for preventing disturbance to external light. Then, the image signal amplified by the preamplifier 206 is converted into digital information by the A / D converter 210 and supplied to the scan converter 186 at the next stage.
[0082]
The imaging unit 204 is controlled by the imaging unit control unit 212. For example, when an interline transfer type CCD is used as the imaging unit 204, the imaging unit control unit 212 uses the V blank signal for vertical synchronization and the information charge for resetting information charges as control signals of the imaging unit 204. Image sensor reset pulse signal, charge transfer gate pulse signal for sending charges accumulated in two-dimensionally arranged charge transfer accumulation units to a plurality of vertical shift registers, horizontal shift for transferring charges in the horizontal direction and outputting them outside A horizontal charge transfer CLK signal which is a transfer clock signal of the register, a vertical charge transfer pulse signal for transferring the plurality of vertical shift register charges in the vertical direction and sending the charges to the horizontal shift register are output. The timing of these signals is shown in FIG.
[0083]
Then, the imaging unit control unit 212 supplies the light source with a light emitting cell control pulse for setting the light emission timing of the light source 198 in accordance with this timing.
[0084]
Basically, the timing chart of FIG. 16 is a conceptual diagram for one field. The image data is read between the V blank of this one field and the V blank. The light source 198 performs pulse lighting instead of continuous lighting, and performs subsequent pulse lighting while synchronizing in units of fields. In this case, the timing is controlled such that exposure is performed during the V blanking period, that is, while no image charges are being output, so that clock noise during pulse lighting does not enter the signal output. That is, since the light emitting cell control pulse is a very thin digital clock pulse generated instantaneously and gives a large power to the light source, it is necessary to prevent noise caused by the light from entering the analog image signal. It is necessary, and as a measure for this, the light source is pulsed during the V blanking period. By doing so, the S / N is improved. In addition, turning on the pulse means shortening the light emission time, and thus has a great effect of eliminating the influence of blurring due to the shake and movement of the manual operation. Thus, high-speed scanning can be performed.
[0085]
Further, even when the reproducing apparatus is tilted and disturbance such as external light enters for some reason in spite of the presence of the external light shielding section 208, the V-block is set to minimize the S / N deterioration. Immediately before the light source 198 emits light during the ranking period, an image sensor reset pulse is output once to reset the image signal, light emission is performed immediately after that, and reading is performed immediately thereafter.
[0086]
Here, returning to FIG. 15, the scan conversion unit 186 will be described. The scan conversion unit 186 is a unit that recognizes image data supplied from the detection unit 184 as a dot code and performs normalization. As a method for this, first, the image data from the detection unit 184 is stored in the image memory 214, read out therefrom once, and sent to the marker detection unit 216. The marker detector 216 detects a marker for each block. Then, the data array direction detection unit 218 detects the rotation or tilt and the data array direction using the marker. The address control unit 220 reads out the image data from the image memory 214 based on the result so as to correct the image data and supplies it to the interpolation circuit 222. At this time, lens aberration information is read from the memory 224 for correcting distortion of the lens in the imaging optical system 200 of the detection unit 184, and the lens is also corrected. Then, the interpolation circuit 222 performs an interpolation process on the image data to convert the image data into an original dot code pattern.
[0087]
The output of the interpolation circuit 222 is provided to a binarization processing unit 188. Basically, as can be seen from FIG. 14, the dot code 170 is a pattern of white and black, that is, binary information, and is therefore binarized by the binarization processing unit 188. At this time, binarization is adaptively performed by the threshold determination circuit 226 while determining the threshold in consideration of the influence of disturbance, the influence of signal amplitude, and the like.
[0088]
Then, since the modulation described with reference to FIG. 13 is performed at the time of recording, the demodulation unit 190 first demodulates the data, and then inputs the data to the data string adjustment unit 192.
[0089]
In the data string adjusting unit 192, first, the block address of the above-described two-dimensional block is detected by the block address detecting unit 228, and thereafter, the block address error is detected and corrected by the block address error detecting and correcting unit 230. , The address control unit 232 stores the data in the data memory unit 234 in block units. By storing data in units of block addresses in this way, data can be stored without waste even when data is lost or entered halfway.
[0090]
After that, the data read from the data memory unit 234 is subjected to error correction by the data error correction unit 194. The output of the error correction unit 194 is branched into two, one of which is sent to a personal computer, a word processor, an electronic notebook, etc. as digital data via the I / F 236. The other is supplied to the data separation unit 196, where it is divided into images, handwritten characters and graphs, characters and line drawings, and sounds (two types, that is, a sound as it is and a voice synthesized).
[0091]
The image is equivalent to a natural image and is a multi-valued image. This is performed by the decompression processing section 238 to perform decompression processing corresponding to JPEG at the time of compression, and further, the data interpolation circuit 240 interpolates data that cannot be corrected.
[0092]
For binary image information such as handwritten characters and graphs, the decompression processing unit 242 performs decompression processing on MR / MH / MMR and the like performed by compression, and the data interpolation circuit 244 cannot correct errors. The interpolation of the data is performed.
[0093]
Characters and line drawings are converted to another display pattern via a PDL (page description language) processing unit 246. Note that, in this case, if the line drawing and the character are subjected to the code compression processing after being coded, the decompression processing unit 248 performs the corresponding decompression (Huffman, Jibrempel, etc.) processing, and then The data is supplied to the PDL processing unit 246.
[0094]
The outputs of the data interpolation circuits 240 and 244 and the PDL processing unit 246 are combined or selected by a combining or switching circuit 250, converted into analog signals by a D / A converter 252, and then converted to a CRT (television monitor) or FMD. (A face mounted display) or the like. Note that the FMD is a spectacle-type monitor (handy monitor) for wearing on the face, and is effective when, for example, virtual reality is used or when a large screen is viewed in a small place.
[0095]
For audio information, a decompression process is performed on the ADPCM by the decompression processing unit 256, and a data interpolation circuit 258 interpolates data that cannot be corrected. Alternatively, in the case of speech synthesis, the speech synthesis unit 260 receives the speech synthesis code and actually synthesizes the speech from the code and outputs the synthesized speech. In this case, when the code itself is compressed, as in the case of the characters and line drawings, the decompression processing unit 262 performs decompression processing such as Huffman or Jibrempel, and then performs speech synthesis.
[0096]
Further, as shown in FIG. 17, the text information may be recognized by the text recognition unit 271 and then output as voice information by the voice synthesis unit 260.
[0097]
The decompression processing unit 262 can also be used as the decompression processing unit 248. In this case, the data is appropriately switched by the switches SW1, SW2, and SW3 according to the attribute of the data to be decompressed, and the PDL processing unit 246 or the speech synthesis unit 260.
[0098]
The outputs of the data interpolation circuit 258 and the voice synthesis unit 260 are synthesized or selected by a synthesis or switching circuit 264, converted into an analog signal by a D / A conversion unit 266, and then output to a speaker, headphones, or other similar audio output device. 268.
[0099]
In addition, characters and line drawings are output directly from the data separation unit 196 to the page printer and plotter 270, and characters and the like are printed on paper as word processing characters, or line drawings and the like are output as plotters and the like. You can also.
[0100]
Of course, the image can be printed not only by the CRT or FMD but also by a video printer or the like, and the image can be photographed.
[0101]
Next, the data string adjusting unit 192 will be described. Here, in order to apply to the above-described audio information reproducing apparatus (see FIG. 3), as shown in FIG. 18A, the dot code is a block address 272A indicated by reference numeral 272 and its error correction data 272B. Are arranged two-dimensionally, linear markers 274 as shown in FIG. 3B are arranged in the vertical direction, and reference numerals 276 are assigned to each line of each block. Description will be made assuming that the indicated line address 276A and error detection data 276B are arranged.
[0102]
In this embodiment, as shown in FIG. 18C, the pitch is doubled for each line as compared to the scanning method described with reference to FIG. 6, and after the center of the marker is detected. , The center line between the markers is equally divided by twice the number of dots. That is, as shown in (D) of the figure, first, in the first scan, a vertical and horizontal half, that is, a quarter of the dot 278 is captured. In this case, the pitch is taken at the same interval as the dots 278, and therefore data is taken every other dot. In this manner, data up to the CRC error detection data 276B, for example, if one block has 64 dots, 64 dots are taken in every other dot.
[0103]
Then, first, it is confirmed whether or not the line address can be actually read by using the latter line address 276A and the CRC error detection data 276B for the line address. If this line address is readable, it is determined that the preceding data dot itself is also correctly readable. If it is determined to be wrong, the second scan is performed by shifting one dot to the right, for example, to the right (the black circle in (D) of the figure). This is taken in for all 64 dots, and it is similarly confirmed whether the line address has been actually read. If incorrect, the third scan is performed by shifting one dot down from the first dot, and if still incorrect, the fourth scan is performed by shifting one dot to the right.
[0104]
In this manner, if the scanning of one line is repeated four times, it is considered that at least one of these can be correctly read. If it is determined that the data has been read correctly, the data is written to the data memory unit 234.
[0105]
In this case, if the line address of the fetched line is, for example, "0" (start address), that is, the line address is recognized as the first, the preceding data is determined to be the block address 272A and the error correction data 272B. Note that the error correction data 272B can be used for error detection of a block address such as CRC, or error correction of Reed-Solomon of a block address in addition to error correction depending on the purpose. Then, when the first address line 0 is recognized, the block address 272A is read first, and it is determined from this address data which block the block is in. On the other hand, since the actual data is entered from the next line, the data is read, and the data is written to the block of the data memory unit 234 corresponding to the block.
[0106]
In the above description, if there is no error while scanning one line, the scanning is skipped to the scanning of the next line. However, the scanning may be repeated four times for each line. good. At that time, it is determined that there is no error a plurality of times, but there is no problem since the same data is simply written at the same address in the data memory unit 234. To simplify the processing, the scanning is repeated four times. When priority is given to speed, the former scanning method is adopted.
[0107]
The actual configuration of the block address detection section 228 and the block address error detection and correction section 230 for realizing the operation of the data string adjustment section 192 will be described with reference to FIG.
[0108]
When 10 bits of the binary interpolation data are input into the shift register 190A, the demodulation unit 190 converts the binary data into 8 bits using a look-up table (LUT) 190B.
[0109]
In the data string adjusting section 192, the demodulated data is temporarily stored in a buffer memory (all 64 dots are contained) 282 under the control of the write address control section 280. Then, only the line address information and the CRC information for the address are read out by the data read address control unit 284, and the line address error detection circuit 286 detects an error. When the determination signal indicating the result of the error detection is true, that is, when there is no error, the data read address control unit 284 reads the information before the line address information from the buffer memory 282, that is, the actual data information.
[0110]
On the other hand, the start address detection circuit 288 checks whether or not the line address for which the error has been detected by the line address error detection circuit 286 is the start address. When the start address is detected, the start address detection circuit 288 informs the block address detection circuit 290 that the line is a line having a block address as information. A block address is detected from the data read from 282, and an error detection circuit 292 performs error detection and correction. Then, the result is latched by the address control unit 232 of the data memory unit 234 as a block address.
[0111]
Note that only error detection is added to the line address in order to obtain an accurate read position, but an error correction code is added to the block address because it is used as address information.
[0112]
Since the subsequent lines are successive data lines, they are written into the data memory unit 234 as data. At that time, depending on the processing, a line address is output together if necessary. Alternatively, if there is an internal counter, the line address can be automatically counted up internally.
[0113]
When the next start address "0" is detected, the block is recognized as the next block, and the same operation is repeated for all the blocks.
[0114]
On the other hand, the determination signal output from the line address error detection circuit 286 is also supplied to the address control unit 220 of the image memory 214. This is a signal necessary for skipping to the next line when the data becomes true in order to shorten the time in the four scans per line.
[0115]
In the above example, the line address error detection circuit 286 performs the address detection on the interpolation data using the same address information for four times until it becomes true. Then, when the data becomes true, the address is skipped once to the data line of the next dot of the new next line, interpolation data is created, and then four points in the interpolation data are read out. Therefore, for such control, a determination signal is passed to the address control unit 220 of the image memory 214, whereby the same address is generated four times to interpolate, read in a different order of interpolation, or A process is performed in which the address is rewritten on the next line, the data on that line is output, and the data is output four times while interpolating.
[0116]
Although not specifically shown, the address control unit 232 of the data memory unit 234 performs mapping to the data memory unit 234, and when reading further, the address control unit 232 also controls de-interleaving. Again, for example, when an address for each dot is generated using a look-up table or the like, the block, line, and data obtained by combining the dot addresses are actually output from the look-up table using a ROM or the like. The conversion is performed so as to form a memory data string. This is the work of de-interleaving (de-shuffling), and the data is read out in the form of the original data sequence only after the processing is performed. Of course, this de-interleaving may be performed at the time of reading from the data memory unit 234, or at the time of writing, such conversion may be performed once and data may be written in a random order (mapping). Is also good.
[0117]
Further, in this example, the marker 274 has a line shape, but may be a circle as shown in FIG. 14 or a square marker. Once a marker is detected, the rest of the block is read on a line, so that the marker need not necessarily be line-shaped. For example, as shown in FIGS. 20A to 20C, markers 294, 296, and 298 of a circle, a square, and a rectangle can be considered.
[0118]
If the printed code is substantially accurate without any partial bleeding or misalignment, it can be said that (approximate center = accurate center). The processing can be performed only by the center detection processing. However, in this case, dots 294A, 296A, and 298A for detecting the arrangement direction are provided in the marker portion in order to detect the arrangement direction.
[0119]
FIG. 20D shows another aspect of the multimedia information reproducing apparatus. This means that the A / D conversion section 210 of the detection section 184 is moved to the scan conversion section 186, and the functions of the block address detection section 228 and the block address error detection / correction section 230 of the data string adjustment section 192 are changed to the scan conversion section 186. Since the configuration after the data error correction section 194 is the same as that of FIG. 15, it is omitted in the figure.
[0120]
That is, in FIG. 20 (D), the biggest difference from the configuration shown in FIG. 15 is the scan conversion unit 186 and the data string adjustment unit 192. In this embodiment, the function of the data string adjustment unit 192 is performed simultaneously from the marker detection unit 216 to the address control unit 220 in the scan conversion unit 186. That is, the marker is detected by the marker detecting unit 216, and the data array direction, that is, the inclination, rotation, and direction are detected by the data array direction detecting unit 218. Then, the block address detection, error determination, and accurate center detection unit 300 detects the block address, performs the error determination, and detects the correct center, that is, the true center depending on whether the block is erroneous or not. In this case, since the block address is detected when the true center is detected, the marker and block address are interpolated by the next marker and block address interpolation unit 302, and the information of the block address is transferred to the data. It is also provided to the address control unit 232 of the memory unit 234.
[0121]
As in the configuration of FIG. 15, the address control unit 220 performs address control based on the data of the block address interpolation processing, and controls the address, writing, and output to the image memory 214.
[0122]
Other than that, the function is not different from the embodiment of FIG.
[0123]
In FIG. 15 and FIG. 20 (D), the detection unit 184 converts the data into, for example, 8-bit multi-valued digital data by the A / D conversion unit 210, and thereafter performs the processing. Instead of the D conversion unit 210, a binarization processing unit (comparator) 188 and a threshold value determination circuit 226 may be arranged at the A / D conversion unit 210, and all subsequent processing may be performed using binary data.
[0124]
In this case, the interpolation circuit 222 performs a so-called interpolation process of four-point or sixteen-point interpolation using pixel data around the interpolation address coordinates obtained from the address control unit 220 as shown in FIG. Instead, the pixel data closest (near) to the interpolation address coordinates can be adopted as data.
[0125]
By performing binarization and processing instead of A / D conversion, the number of signal lines and the data amount are reduced to 1/8 of the case of 8 bits, for example. Therefore, the memory capacity of each of the image memory 214 and the data memory unit 234 is also reduced to 1/8, and the processing of each unit is simplified. For example, the circuit scale is significantly reduced, the processing amount is significantly reduced, and the processing time is significantly reduced. This contributes to downsizing, low cost, and speedup of the apparatus.
[0126]
In the case of (D) in FIGS. 15 and 20, when the image data is output to the interpolation circuit 222, the address output of the address control unit 220 becomes, for example, four pixel addresses around the interpolation address coordinates. The signal 222 is distance information for calculating a weighting coefficient for each pixel address by a signal line (not shown). Alternatively, each pixel address and the interpolation address coordinate data may be sent, and the interpolation circuit 222 may calculate the distance from each pixel address to calculate the weighting coefficient.
[0127]
Further, at the time of processing with binary data as described above, the address control unit 220 outputs a pixel address near the interpolation address coordinates. Therefore, in this case, the data output from the image memory 214 is directly input to the demodulation unit 190.
[0128]
Here, specific examples of the dot code shown in the conceptual diagram of FIG. 14 will be described with reference to FIGS.
[0129]
The blocks 304 are two-dimensionally arranged as shown in the conceptual diagram of FIG. 14, and have a block address 306 added thereto. The block address 306 has addresses corresponding to the X address and the Y address. For example, the upper left block in FIG. 21A is (X address, Y address) = (1, 1). On the other hand, the block address of the block on the right side is (2, 1). In the same manner, the block address incremented toward the right and the one incremented from the Y address toward the right are added. Thus, the block address 306 is added to all the blocks 304.
[0130]
Here, the lowermost marker and the rightmost marker are dummy markers 308. That is, the block 304 corresponding to a certain marker 310 is the data obliquely lower right of the four markers 310 including the marker, and the lowermost and rightmost markers are the second lowermost and the second lowermost rightmost markers. An auxiliary marker that is arranged to define a block for the marker, that is, a dummy marker 308.
[0131]
Next, the contents of the block 304 will be described. As shown in FIG. 21B, a block address 306 and an error detection code 312 of the block address are added between the marker 310 of the block 304 and a marker below. Similarly, a block address 306 and its error detection code 312 are added between the marker 310 and the right marker. In the conceptual diagram of FIG. 14, the marker is located at the upper left of the block, and the block address is located at the lower right. However, in the present embodiment, the block address 306 is located at the left and upper sides, and the marker 310 is located at the upper left. The shape is arranged at the corner. Although the block address 306 is shown as an example where it is recorded at two places in one block, it may be at one place. However, by recording at two locations, even if an error occurs due to noise on one block address, it can be reliably detected by detecting the other address. Is more preferred.
[0132]
The position of the data of the block with respect to a certain marker, the position of the block address, the position of the dummy marker on the code determined by the position, and the like are not limited to the above example.
[0133]
Next, a pattern example of the marker 310 will be described. As shown in FIG. 20C, in the present embodiment, a circular black pattern 310A having a diameter of 7 dots is used as the marker 310. Then, a portion 310B around the black circle 310A is set to white, so that a black portion of the marker can be easily distinguished. Reference numeral 310C in FIG. 21C is an auxiliary line for explanation.
[0134]
The range of the white portion 310B is desired to be as small as possible to increase the recording density, but is required to be large in order to perform marker detection processing easily and at high speed. Therefore, the range 310C for sufficiently identifying the black pattern 310A when the rotation is 45 ° is set to be within the portion 310B.
[0135]
As for the image magnification of the imaging optical system 200 in FIGS. 15 and 20D, as shown in FIG. 21D, the size of the data dot 316 in the data area 314 will be described below. Under the conditions, it is assumed that an image is formed on 1.5 pixels. The pixel here means one pixel of the imaging element of the imaging unit 204. That is, one dot recorded on the sheet 182, for example, a dot of 30 to 40 μm, is imaged through an imaging lens on 1.5 pixels of an image pickup element which is usually 7 μm or 10 μm in size. Shall be. In the sampling theorem, the pixel pitch may be smaller than the dot pitch, but here, 1.5 pixels are set here after considering safety. In the case of binarization instead of the above-mentioned A / D conversion, two pixels are used for further safety.
[0136]
Adopting the two-dimensional block division method as described above has the following advantages. That is,
If the dot pitch of each dot is equal to or less than the resolution of the image sensor, a code (a set of unit data blocks) can be read even if the data dot size is different;
Reading is possible even when the imaging unit 204 is inclined with respect to the code;
It can be read even if the sheet is locally stretched, and can be read even if it rotates.
The unit block can be freely expanded two-dimensionally according to the total data amount, so that the code size can be freely changed;
Since each block address is added, it is possible to reproduce even if reading is started from the middle of the code;
If it is a block unit, the code shape can be freely laid out according to other information on the paper surface, for example, characters, pictures, graphs, and the like. A rectangular dot code is shown in FIG. Can be key-shaped or slightly modified;
There is no need for a predetermined start code and stop code as in a bar code, and no clock code is required.
[0137]
Also, by utilizing these characteristics, reproduction can be performed even if there is camera shake. Accordingly, it is very easy to handle a handy playback device.
[0138]
That is, although the details will be described later, normalization is performed by detecting four adjacent markers on the reproduction device side and equally dividing the number of dots by the number of dots, so that the reproduction device is resistant to enlargement, reduction, deformation, and the like. In addition, there is an advantage that it is strong against camera shake and the like.
[0139]
As for the dots 316 in the data area 314, for example, one dot has a size of several tens of μm. Although this can be up to several μm depending on the application, it is generally 40 μm, 20 μm, or 80 μm. The data area 314 has a size of, for example, 64 × 64 dots. These can be freely expanded or reduced to a range in which the error due to the above-mentioned equal division can be absorbed. Further, the marker 310 has not only a function as a synchronization signal but also a function as a position index. The marker 310 has a size that is not included in the modulated data. In the present embodiment, the marker 310 has a round shape and a circle having a diameter of, for example, 7 dots or more or 7 × 7 dots with respect to the dots in the data area 314. The black marker 310A is used.
[0140]
Here, the inclination, rotation, and the like during reproduction will be described.
[0141]
The inclination of the image pickup unit 204 means that the playback apparatus should be vertically opposed to the sheet 182 on which the dot code is printed, but the user has the playback apparatus obliquely. Refers to a state that has become oblique to. Further, the rotation refers to a state in which the imaging area (see FIG. 4A) is not parallel to the dot code written on the sheet 182.
[0142]
When the above-described tilt occurs, the image obtained by the imaging unit 204 is reduced as compared with the image when the images are vertically opposed. For example, if a 30-degree tilt occurs, the apparent projected image will be reduced to 86.5%. In other words, for example, if the block 304 is a square and is inclined 30 degrees in the horizontal direction with respect to the vertical direction, the horizontal portion is 0.865 times even if the vertical direction is 1: 1. It becomes a rectangle. If there is such a slope, if there is an original internal synchronization clock, each unit operates with the equally-spaced clock, so that the resulting data may not match the original data. .
[0143]
In addition, if the image of rotation is taken as horizontal or vertical, the real data goes up diagonally or goes down diagonally, so that real information cannot be obtained. . Furthermore, when a combined state of tilt and rotation occurs, the imaging result of the square block becomes a rhombus, and the condition that the horizontal and vertical data arrays are orthogonal is not satisfied.
[0144]
Hereinafter, the marker detection unit 216 for solving these problems will be described. As shown in FIG. 22, the marker detecting section 216 detects a marker by extracting the marker from the code, a marker area detecting section 320 for detecting the area where the marker is present, and detecting the approximate center thereof. Approximate center detection unit 322 shown in FIG.
[0145]
The marker determining unit 318 searches for seven or more and thirteen or less continuous black pixels, and recognizes a case where the continuous black pixels continue for seven consecutive lines as a circular black marker 310A. As shown in FIG. Is binarized, and black and white are identified for each pixel (step S32). Then, black pixels continuous in the X-axis direction are detected on the image memory 214 (step S34). That is, continuous black pixels having 7 or more and 13 or less continuous black are detected. Next, it is checked whether or not a point shifted by one pixel in the Y-axis direction from the center pixel of the first and last black pixels is black (step S36). Then, if this continues seven times in the Y-axis direction (step S38), it is determined as the circular black marker 310A (step S40). If it is not detected in step S34 or if it is not a black pixel in step S36, it is not determined to be a marker (step S42).
[0146]
That is, it is assumed that the marker is checked on the image memory, and there is a line in which, for example, seven black pixels continue. Then, it is checked whether the point shifted by one pixel in the Y-axis direction from the center of the first black pixel and the last black pixel is black, and if black, the left and right Check if 13 pixels are black from 13 consecutive pixels, and look in the same manner while shifting one pixel at a time in the Y-axis direction. If it lasts seven times in the Y-axis direction, Is determined as the circular black marker 310A.
[0147]
Note that the minimum value of 7 when checking continuous black in the X-axis and Y-axis directions is to distinguish and discriminate the black portion (circular black marker 310A) of the marker 310 from the modulated data. This is a lower limit value set so that the data area 314 and the circular black marker 310A can be distinguished from each other even if there is a reduction due to paper shrinkage or inclination. The maximum value 13 is an upper limit value set in consideration of elongation of paper, bleeding of ink, and the like. This prevents noise such as dust and scratches larger than the marker from being erroneously detected as the marker.
[0148]
In addition, since the marker pattern 30A is circular, there is no need to consider rotation, so the difference between the lower limit and the upper limit can be minimized, and erroneous marker detection can be reduced.
[0149]
The marker area detecting section 320 slightly expands and contracts or deforms the range of the circular black marker 310A determined by the marker determining section 318 due to a change in inclination, a change in image magnification of an image, and the like. It is for detecting whether or not it is in
[0150]
As shown in FIG. 24, the marker area detection unit 320 first detects a temporary center pixel of the circular black marker 310A determined by the marker determination unit 318 (step S52). That is, one pixel near the center of the range determined by the marker determination unit 318 is set as a temporary central pixel.
[0151]
Then, it is checked from the temporary center pixel that the pixel is black in the upward direction (negative direction on the Y axis). If the pixel becomes white, the left and right pixels are checked. If the pixel is black, the upward direction is checked in the same manner as above. It checks up to the Y address where no black exists, and sets the Y address in the Ymin register (see FIG. 25A) (step S54). Similarly, it is checked that the pixel is black in the downward direction (plus direction on the Y axis) from the temporary center pixel. If white, the left and right pixels are checked. If black, the downward direction is checked in the same manner as above. It checks up to the Y address where black does not exist, and sets the Y address in the Ymax register (step S56).
[0152]
Next, it is checked from the temporary center pixel that the pixel is black in the left direction (negative direction on the X axis). If it is white, it is checked that several upper and lower pixels are black. The direction is checked in the same manner as described above, up to the X address where no black exists, and the X address is set in the Xmin register (step S58). Similarly, check that the pixel is black in the right direction (plus direction on the X axis) from the temporary center pixel. If white, check several upper and lower pixels. If black, check the right direction as above. It checks up to the X address where no black exists, and sets the X address in the Xmax register (step S60).
[0153]
A marker area 324 is selected from the values of the Xmin, Xmax, Ymin, and Ymax registers thus obtained as shown in the table of FIG. 25B (step S62). In other words, the marker area 324 is not the square area including the circular black marker 310A but the hatched area in FIG. The marker area 324 may be a square, but there is actually data around the white portion 310B of the marker 310, and the data is stored inside the white portion 310B due to the influence of the spatial filter or the like. It is conceivable that the user enters the marker area 324 for calculating the approximate center. In order to avoid this as much as possible, it is desirable to make the marker area 324 as small and necessary as possible. In this case, it is only necessary to set a circular area having the same shape as the circular black marker 310A, that is, a circle and larger than the circular black marker 310A. In the present embodiment, since the circular black marker 310A is a small circle composed of 7 dots in diameter, it becomes a marker area 324 as shown in FIG.
[0154]
The approximate center detection unit 322 is for finding the approximate center of the black circle of the marker in the marker area detected by the marker area detection unit 320 in this way. In general, in printing or the like, there is a phenomenon that a dot becomes wider than a target size due to swelling of ink (this is called dot gain) or becomes smaller (this is called dot reduction). Further, it is assumed that the ink spreads around the periphery or the ink permeates to one side. The approximate center detecting unit 322 obtains the center of the image of the circular black marker 310A, that is, the so-called center of gravity, and processes the approximate center thereof in order to cope with such dot gain, dot reduction, or ink stain. I do. Here, the processing is for obtaining the center with an accuracy smaller than one pixel pitch.
[0155]
First, for this marker area 324 on the image, the image memory 214 is divided into two directions, that is, the X axis direction and the Y axis direction, and the center line on the X axis and the center line on the Y axis are searched for. Find the final center, or approximate center. FIGS. 25C and 25D are diagrams showing accumulated values of each pixel and each pixel in the vertical and horizontal directions in FIG. 25A. The center of gravity is a half of the total cumulative value, that is, a portion where the upper, lower, left, and right cumulative values are equal.
[0156]
First, in the case of (C) in the figure, for example, if the addition result Sxl of each accumulation of the portion shown by hatching in the figure still satisfies 1/2 of the entire area S. However, if adding the next Sxc portion to it adds more than half the area, it can be determined that the column Sxc includes the center line X including the approximate center. In other words, the X address at the approximate center accumulates the accumulated value of each column (Xk) from the left side (Xmin direction), and exceeds 1/2 of the total accumulated value when the column of X '+ 1 is accumulated. At that time, there is a general center between the row of X 'and the row of X' + 1. When the column of X '+ 1 is divided into right and left so as to be added to the accumulated value up to X' and to be 1/2 of the total area S, the division line includes the approximate center.
[0157]
Therefore, the ratio of the portion excluding the portion accumulated from the area of 1/2 to the X-th column, that is, (1/2) S-Sxl, and the accumulated value Sxc of the middle column is Δx (approximate center = X ′ + Δx ).
[0158]
This will be described with reference to the flowchart of FIG.
[0159]
First, normalization is performed (step S72). That is, the white data portion is set to 0, the black data is set to 1 and the data in the image memory 214 is set to the multi-valued data so that adding the periphery to each data of the marker area 324 does not affect the accumulation. Is normalized as data having a gradation of. This is for the purpose of accurately recognizing the state because the periphery becomes blurred due to a spatial filter or the like and accurately and accurately detecting the center of gravity. Next, the accumulated value Sk of each column Xk (k = min, min + 1,..., Max) is obtained (step S74), and the barycenter calculation subroutine is called (step S76).
[0160]
In the center-of-gravity calculation subroutine, as shown in (B) of the figure, the entire area S is obtained, 1/2 is set to Sh, and Sl is set to 0 (step S92). It is set from the column (step S94), and is obtained by calculating Sl '= Sl + Si (step S96). Initially, Sl = 0, so here is Si itself, and Sl ′ = Smin. Next, Sl 'is compared with Sh, that is, the size of one half of the entire area (step S98). If Sl' does not exceed Sh, i is incremented (step S100), and Sl 'is set to Sl. Then (step S102), the next column is accumulated by repeating from step S96. Then, when the cumulative result exceeds half of the total area, Δx is obtained by subtracting Sl from S / 2 and dividing by Si (step S104). (Step S106), and returns to the upper routine.
[0161]
In the upper routine, the value of C is set as the X coordinate of the approximate center (step S78).
[0162]
Hereinafter, the same processing is performed in each row direction in steps S80 to S84, the Y coordinate is obtained, and X and Y are set as the approximate centers of the markers (step S86).
[0163]
The configuration for realizing such a process is as shown in FIG.
[0164]
The normalization circuit 326 normalizes white data as 0 and black data as 1. The output of the normalizing circuit 326 is accumulated so that the total area S is calculated by the accumulating unit 328, halved by the 掛 け multiplying unit 330, and latched by the latch circuit 332.
[0165]
On the other hand, the output of the normalization circuit 326 is delayed by the delay circuits 334 and 336 for the block in the X-axis direction, the respective columns are accumulated by the accumulator 338 in the order from the left, and the accumulator 340 outputs each column unit. Is accumulated. At the time of outputting the result, the central column Sxc is output.
[0166]
The comparator 342 compares the half area latched by the latch circuit 332 with the accumulated value of each column accumulated by the accumulation unit 338. The latch 344 stores the timing of the determination and the accumulation of the column up to that time. When the comparator 342 determines that the area has exceeded the area of ２, the X address calculation unit 346 calculates the accumulated area of １ ／ of the area latched by the latch circuit 332 and Sxl latched by the latch 344. The final X address of the approximate center of the marker is calculated from the accumulated value Sxc from the unit 340 and the address corresponding to X ′ supplied from the address control unit 220 via the delay circuit 348.
[0167]
Similarly, using the delay circuits 350 and 352, the accumulators 354 and 356, the comparator 358, the latch 360, and the Y address calculator 362, the Y address at the approximate center of the marker is calculated. Note that the delay circuits 350 and 352 in this case are constituted by line memories.
[0168]
Here, the delay circuits 334, 336, 350, and 352 adjust the respective output timings of S / 2, Sxl, Sxc, Syl, and Syc to timings required by the X address calculation unit 346 and the Y address calculation unit 362. Circuit.
[0169]
Next, the data array direction detection unit 218 will be described. For convenience of description, the detailed arrangement of each block 304 of the dot code will be described first. The dot code blocks 304 are arranged as shown in FIG. 21B, and more specifically, as shown in FIG. 28A. That is, the block address 306 is divided into an upper address code 306A and a lower address code 306B, and the error detection code 312 is also divided into an upper address CRC code 312A and a lower address CRC code 312B. The lower address code 306B is arranged beside the marker 310, and the upper address code 306A is arranged beside the marker 310 with a size larger than the lower address code 306B. Next, a CRC code 312A for the upper address having the same size as the upper address code 306A is added, and further a CRC code 312B for the lower address having the same size as the lower address code 306B is added.
[0170]
The block address and the error detection data are also arranged below the marker 310 in the above order toward the lower marker.
[0171]
Here, the upper address code 306A and the upper address CRC code 312A are collectively called a step 1 code, and the lower address code 306B and the lower address CRC code 312B are collectively called a step 2 code.
[0172]
Also, when the lower address code 306B is decomposed, on the right side of the marker 310, the data is inverted both above and below (left and right in the case of the lower side of the marker 310) the data of each dot for indicating the lower address data. The code to be used is described. Further, a data blank portion 364 is provided for distinguishing the data from the upper and lower data areas 314. Note that the data margin portion 364 may be omitted. The inversion code is added not only to the lower address but also to the upper address code. Here, dots are indicated by circles for easy understanding of the data, but actually white circles indicate that there are no dots to be printed. That is, it is not to print a white circle. Hereinafter, white circles shown in the drawings indicate the same.
[0173]
Here, assuming that the upper address and the lower address are, for example, if all addresses are composed of 12 bits, the first 4 bits are assigned to the upper address and the next 8 bits are assigned to the lower address. It is something. The data length can be appropriately changed according to the device. Basically, for all the block addresses, there is a distinction as to how many of the block addresses from the beginning are to be the upper addresses and from there to the lower addresses are to be the lower addresses.
[0174]
By providing the address codes in the horizontal and vertical directions as described above, there is an advantage that even if an address cannot be detected with a one-way address code, it can be detected with the other address code.
[0175]
Another dot code arrangement will be described with reference to FIG. This figure omits the vertical address code of FIG. 28 (A). Since the address code is only in one direction, the data area can be increased and the processing speed can be increased. If the address code is unidirectional and the address code cannot be detected, the address of the block is unknown, but can be captured by the address interpolation processing described later.
[0176]
In FIG. 29A, the block address code exists only between the markers in the horizontal direction, but a dot code having the block address code only in the vertical direction may be used.
[0177]
Alternatively, as shown in FIG. 28B, the upper address code 306A may be added between the lower address codes 306B, and the upper address CRC code 312A may be added between the lower address CRC codes 312B. .
[0178]
Hereinafter, the processing will be described based on the dot code of FIG. Only in the case of the process specific to the dot code in FIG.
[0179]
FIGS. 30 and 31 are a block diagram of the data array direction detection unit 218 shown in FIG. 20D and a flowchart showing the operation thereof.
[0180]
The data array direction detecting unit 218 receives data of the approximate center of the marker from the approximate center detecting unit 322 of the marker detecting unit 216, and the adjacent marker selecting unit 366 selects an adjacent marker. That is, the center address of each marker has been mapped on one screen by the processing of the approximate center detection unit 322, and a representative marker to be processed now, that is, a marker of interest is set for it (step S112). An adjacent marker is selected to detect which marker has the approximate center closest to the representative marker (step S114).
[0181]
In the adjacent marker selection process, as shown in FIG. 32A, the distance d between the representative marker and the adjacent marker is calculated, and the adjacent marker within the range of d ≦ dmax is specified (step S142). However, in this case, dmax is the length of the long side of the data block + α (α is determined by the expansion and contraction of the paper, etc.). Then, the approximate center address is sent to the step 1 sample address generation circuit 368 in the order of shorter distance d from the designated adjacent markers (step S144). For example, in FIG. 32B, the approximate center address at the distance D2 is closest to the representative marker, then the approximate center addresses of the distances D1 and D4, and the approximate center addresses of D3 and D5. First, the approximate center address at the closest distance D2 is sent. If the distances d are the same, a marker is searched clockwise from the distance calculation start address, and direction detection is performed in the order in which the markers appear (step S146). That is, the approximate center addresses located at the distances of D1, D4, D3, and D5 are sequentially sent to the step 1 sample address generation circuit 368, and the direction detection described later is performed.
[0182]
That is, the step 1 sample address generation circuit 368 generates a step 1 sample address centered on the approximate center of the representative marker and the selected adjacent marker (step S116), and generates a scanning line connecting the step 1 sample addresses (step S116). In step S118, a read address is generated so as to sample the data in the image memory 214 at the equally divided points on the scanning line (step S120). The address control unit 220 supplies the address of the sample point to the image memory 214 as a read address to read data.
[0183]
In the above description, the data of the sample point is approximated and output (from the image memory). However, as shown in FIG. 5A, it is determined that the sample point is between the data of the image memory. Sometimes, it may be obtained by interpolating from the data of the surrounding four pixels.
[0184]
As a result, after the read data, that is, the upper address code is detected by the error detection circuit 370 as an error, it is supplied to the upper block address calculation and center calculation circuit 372. The upper block address calculation and center calculation circuit 372 causes the next adjacent marker selection process to be performed if there is an error as a result of the error detection in the error detection circuit 370, and if a marker in two directions is detected, Since it is no longer necessary to detect the adjacent marker, the address calculation result is sent to the adjacent marker selection unit 366 to end the adjacent marker selection processing.
[0185]
When the dot code shown in FIG. 29A is used, the marker selection process is terminated when the upper address code in one direction is detected.
[0186]
If the result of the address calculation indicates that there is an address error (step S122), it is determined whether scanning of all sample points has been completed (step S124). If not, the process proceeds to step S118. If the scanning of all sample points has been completed, the presence or absence of an unsearched adjacent marker is checked (step S126). If there is, the process proceeds to step S114, and if not, the same processing is performed for all markers. After finishing the processing for all the markers, the process proceeds to the marker / address interpolation processing (step S128).
[0187]
The error detection circuit 370 is described in the Journal of the Institute of Television Engineers of Japan, Vol. 44, no. 11, p. 1549-P. A general method such as error detection based on a cyclic code as disclosed in 1555 “Code Theory” may be used.
[0188]
On the other hand, if there is no address error in step S122, it is determined whether scanning of all sample points has been completed (step S130). If not, the process proceeds to step S118, and scanning of all sample points has been completed. If so, the upper address is determined (step S132), and the center address of step 1 is calculated (step S134) and determined (step S136).
[0189]
That is, the direction is detected from the marker closest to the representative marker (in FIG. 32B, the approximate center address is at the distance D2). The detection method determines in which direction there is a surrounding marker depending on whether an address recorded in a dot code (step 1 code) larger than the data dot for direction detection can be recognized. In the step 1 code, the upper block address and its CRC code are recorded, and it is assumed that if the code is scanned, if there is no error, it is recognized.
[0190]
When the direction is detected, the inclination of the data block can be predicted. The step 1 code has directionality, and the block address is normally recognized only when scanning is performed from the representative marker to the surrounding markers. Therefore, when a recognition error does not occur, a block address code in two directions is always detected. Processing is performed until a two-way block address code is detected. Further, the data arrangement can be estimated from the positional relationship in two directions (see FIG. 32C).
[0191]
In the case of the dot code of FIG. 29A, an address code is detected only in one direction. At this time, the data area can be recognized from the detected line and the scanning direction (see FIG. 29B).
[0192]
In the actual operation, the direction is detected from the distance D2 which is the shortest distance from the representative marker, and if the address is not recognized, the search is performed clockwise. Therefore, the same operation is performed at the next closest distance D1. repeat. Assuming that the detection is performed clockwise, the detection continues with distances D4, D3, and D5. Processing is performed until two directions are detected.
[0193]
In the case of FIG. 29A, processing is performed until one direction is detected.
[0194]
If one direction can be detected, the other direction can be predicted in some cases. For example, if D4 and D5 are in the forward direction, and if D2 does not exist and the search is started from D4, if the address is confirmed at D4, it is predicted that the address can be recognized by either D3 or D5.
[0195]
The direction detection processing as described above will be described in more detail with reference to FIG.
[0196]
The approximate center of the representative marker detected by the approximate center detection unit 322 of the marker detection unit 216 is defined as a dot A5 on the upper left side of the figure, and eight dots separated by 1.5 dots (this can be appropriately changed by processing). Sample points A1 to A4 and A6 to A9 are generated by a step1 sample address generation circuit 368. Similarly, a sample address is generated around a marker whose direction is to be detected, for example, about the approximate center of the distance D2 (dot B5 on the upper right side in the figure).
[0197]
Here, the reason why the 1.5 dot interval is used will be described.
[0198]
In the processing for obtaining the approximate center of the marker, the difference is described so that the difference from the center is within one dot. However, it is assumed that no problem such as ink bleeding occurs. The detection range was set to ± 1.5 dots in consideration of ink bleeding and the like.
[0199]
The address control unit 220 draws a certain line between the addresses of both markers. First, a scanning line is drawn on the dots A1 and B1. Then, a sample clock is provided so that the upper address can be sampled, and data sampling of the image memory 214 is performed.
[0200]
As shown in FIG. 28A, since the CRC code 312A is added to the upper address code 306A, if the data sample is correctly read, the upper address code 306A is added to the upper address code 306A. The error detection result in the error detection circuit 370 is detected in a form that there is no problem, and if it cannot be read correctly, it is determined that there is an error.
[0201]
In the same manner, similarly, scanning lines are sequentially drawn in the order of dots A1 and B2, A1 and B3, A1 and B4, and each time it is checked whether an error has been detected. In total, there are nine positions on the representative marker side and nine positions on the detection marker side, so that 81 kinds of processing are performed.
[0202]
If an error occurs in all of the 81 processes, it is determined that there is no direction code in that direction, that is, the detection-side marker is a marker other than the array (a marker that has been erroneously detected).
[0203]
For example, in (A) of FIG. 33, when data is taken at each sample point on a scanning line (shown by a dotted line) drawn for dots A1 and B7, the sample points indicated by a broken circle in FIG. Since it is off, an erroneous detection is made. In particular, as described above, since an inverted code is provided on the upper and lower sides of the address data dot, an error always occurs.
[0204]
On the other hand, when the dots A5 and B5 are connected, since the data is properly collected, there is no detection error, and it is recognized that a code exists in this direction.
[0205]
In order to facilitate error detection, inverted codes are provided at the top and bottom. However, it is not always necessary to provide the inverted codes at the top and bottom. The format may be such that black data continues for the number of dots. In this case, the data on the end on the detection marker side always becomes black data, and the outside of the data becomes a white margin, so that a data error can be correctly detected. Also, when the inverted code is used, it is not necessary to provide the inverted code in the entire area of the inverted code portion, and it may be provided in a part of both sides (FIG. 28C).
[0206]
Here, the size of the dot will be described. As shown in FIG. 33B, assuming that the size of each dot of the upper address code 306A is n dots and the width of the step 1 code is m dots, the relationship between m and n is that at the inner end of the step 1 sample address. Then, a diagonal line is drawn by providing a width of 2 dots with respect to the center, and the width m determined by how much the upper address code 306A is provided has a long side, and the height of a rectangle having the diagonal line as its diagonal line is n. . That is, once m is determined, n is necessarily determined. Even if the entire area between the inner edges of the sample address of step 1 is this address code, there are only up to two dots, so n dots have a width of up to two dots. Although the width of one dot is not determined, a width that allows easy recognition of data is preferable.
[0207]
Note that the above-mentioned two dots can be obtained in such a range that, for example, a hit occurs in a scanning line connecting dots A5 and B5, but no hit occurs in a line connecting dots A6 and B4 and a line connecting A2 and B8. It is stipulated as follows. If it is larger than that, for example, in the case of hitting with dots A5 and B5, a hit may occur even when A2 and B8 are subtracted, and the detection as a center is spread. This value can also be changed according to the device.
[0208]
In the example of FIG. 33A, the hits are made for dots A5 and B5. However, in the case where a hit is also made to a line connecting dot A4 and, for example, B4, the next center detection step 2 is executed. At this stage, processing such as starting from the center of the dots A4 and A5 and performing the same search around the center is performed.
[0209]
Other methods are also conceivable. This will be described with reference to FIG. Here, when A4 and A5 are hit and B4 and B5 are hit on one side, the sample addresses (A41 to A45, A51 to A55, B41 to B45, B51 to B55) shown in FIG. . In this case, since the number of sample address points in step 2 increases from 9 to 10, the number of processes also increases from 81 to 100 (the number of scanning lines). However, the process of deriving the midpoint of A4 and A5 and the process of generating nine step2 sample addresses centering on the midpoint are eliminated because a predetermined sample point is used. Overall, processing is likely to be reduced.
[0210]
Further, assuming that there is an accurate center of step 2 between A4 and A5, assuming that address detection processing is performed on a scanning line connecting A42 to A44, A52 to A54 and B42 to B44, B52 to B54, It is possible to think that the number is reduced from 81 to 36 (6 × 6).
[0211]
In the above processing, a rough center in step 1 is obtained.
[0212]
As described above, by detecting the CRC, it is detected whether the data blocks are properly arranged in that direction. In FIG. 32B, the marker located at the distance D2 is a marker that is erroneously detected. Therefore, when the direction of the data is viewed in that direction, there is no code of the upper address. Thus, after all 81 detections have been made, all errors will occur in that direction, and it will be determined that there is no direction.
[0213]
When it is determined that there is no D2 in this way, the next closest distances are D1 and D4, but since the marker turns clockwise with respect to the marker of interest, processing is performed on the distance D1 next. As described above, since it is possible to determine only from left to right and from top to bottom in terms of data arrangement, in this case, processing is performed in the direction from the representative marker to the marker at distance D1. , That is, the CRC code is read first, and then the address code is read, so that this is naturally determined to be an error. Therefore, it is determined that there is no direction for the distance D1.
[0214]
Next, the distance D4 is determined. When D4 is read along the distance D4 from the representative marker, the address code and the CRC code are read in this order, so that it is determined that D4 has directionality. That is, no error occurs.
[0215]
Next, the objects to be determined are distances D3 and D5 that are equidistant. On the other hand, since the rotation is clockwise, the processing is first performed from the distance D3. As for D3, the CRC code is read first as described above, so that it is detected that there is no directivity. Then, finally, the distance D5 is read, and it is determined that there is a direction here.
[0216]
As a result, since the distances D4 and D5 are read, it is recognized that data corresponding to the block addresses described in the distances D4 and D5 are written in the hatched portions in FIG. can do. Eventually, if two directions are detected for one representative marker, the direction of that block can be detected. Therefore, processing is performed until two directions can be detected.
[0217]
In the case of the dot code of FIG. 29A, only one direction is detected. Processing is performed until one direction is detected (D5 in FIG. 29B).
[0218]
If an error occurs when processing is performed for all of the five directions, the direction detection processing is performed for a diagonal marker. In this case, in order to prevent an increase in the number of processing, The processing outside of a certain range is not performed, and necessary information such as address information that cannot be obtained is obtained by marker and block address interpolation processing.
[0219]
Further, as described above, the block address is not modulated. However, when the modulation is performed, a process of demodulating after recognizing the block address code is required.
[0220]
In the above description, whether or not there is directionality is determined using error detection of the upper address. However, for example, a directional pattern such as "11100001" is used instead of the upper address CRC code. Alternatively, when "11100001" is detected by pattern matching, a method of recognizing that there is a marker having a direction in that direction may be adopted.
[0221]
In the direction detection, it is not necessary to search for an adjacent marker clockwise for all markers, and the next block may perform an operation for recognizing an upper address code in that direction. That reduces the number of processes. Further, even when an abnormality occurs in the detection of the upper address, it may be recognized that there is a code in the direction obtained by detecting the peripheral direction.
[0222]
Next, the block address detection, error determination, and accurate center detection unit 300 will be described with reference to the block diagram of FIG. 35A and the flowchart of FIG.
[0223]
The upper block address calculation and center calculation circuit 372 of the data array direction detector 218 detects the upper block address when the upper address is detected. It is sent to the block address calculation and center calculation circuit 374. Further, since the approximate center at the time of detecting the upper address is known, the central address is led to the step 2 sample address generating circuit 376 (step S152).
[0224]
The step 2 sample address generation circuit 376 generates this approximate center sample address (step S154). That is, as shown in FIG. 35 (B), the sample addresses are placed at eight points outside the rough center (the center of the direction detection) obtained earlier, similarly to the above. Then, eight points are similarly provided for the markers for which the directionality has been found, and a scanning line is similarly drawn (step S156) to perform processing such as whether or not a lower address can be detected. In this case, the data interval for forming the sample address is defined every 0.5 dots in the present embodiment, but can be appropriately changed according to the specifications of the apparatus.
[0225]
Then, the address control unit 220 reads data from the image memory 214 based on the generated sample address, and derives data according to this sample point to the error detection circuit 378 (step S158). Similarly to the direction detection (as shown in FIG. 5A), when the sample point is between the data in the image memory, it is not a method representing one data in the memory but is derived by interpolation from surrounding data. Is also good. If an error has occurred in the error determination (step S160), it is determined whether or not scanning of all sample points has been completed (step S162). If not, the process proceeds to step S156, and scanning of all sample points has been completed. If so, the process proceeds to marker / block address interpolation processing after addresses have been detected for all blocks (step S164).
[0226]
On the other hand, if there is no address error in step S160, it is determined whether scanning of all sample points has been completed (step S166). If not, the process proceeds to step S156, and scanning of all sample points has been completed. If so, the lower address is determined (step S168), and the accurate center (step 2 center) is determined (step S170).
[0227]
That is, error detection is performed by the error detection circuit 378, and if an error occurs in the error determination, the process proceeds to the next process. The block address calculation and center calculation circuit 374 is supplied with a start and end address at the time of center detection from the address control unit 220, that is, a signal indicating which point is connected to which point. Determine whether or not it is possible. When there is no error detection, the block address calculation and center calculation circuit 374 combines the derived lower address with the upper address sent from the upper block address calculation and center calculation circuit 372 to generate a block address. To the next marker and address interpolation unit 302. Similarly, the center address is derived to the marker and block address interpolation unit 302.
[0228]
In FIG. 35B, the reason why the dot is set to 0.5 dot is that the sample point is detected within the range of 0.5 dot, and the center (direction detection direction) finally obtained in this processing is obtained. This is because the difference between the center and the true center falls within the 1/4 dot range. If the sampling point formed by the above processing is within the 1/4 dot range, the data in the data area can be properly reproduced.
[0229]
Further, since the smallest dot of the step 2 code is one dot, a data arrangement smaller than that is meaningless as data, so it is formed by one dot.
[0230]
As in the case of the step 1 code, inverted codes may be provided above and below the address data dots, or black data may be provided in the last few dots, and the surrounding area may be a margin. The data margin portion 364 for distinguishing the address code from the data code has a very small probability of being mistaken for a marker even if the region for distinguishing from the data area 314 is overlapped with, for example, black. , The data area 314 may be directly entered from the inversion layer.
[0231]
As shown in FIG. 35 (B), as a result, a CRC code is added in the form of a lower address, an upper address, which is almost half the data length of the entire data length, and further, the same size. The reason is that the data length is set to this data length so as to be able to detect even if a noise has been put on the entire address length or ink has come on, and a burst error in such a state can be detected. The ratio of the data length can also be changed as appropriate.
[0232]
By the above-described tree search processing, that is, a detection method of obtaining a rough center and obtaining a finer center, the accurate center for sampling data in the data area 314 and the block address have been recognized. become. That is, by performing a process called a tree search, the process is significantly reduced, and the amount of processing and the processing time are reduced as compared with the case where sampling is performed at a fine pitch from the beginning. Further, by using the block address for the direction detection and the accurate center detection, the redundancy of the entire data amount can be reduced.
[0233]
Next, the marker and address interpolation unit 302 will be described with reference to FIG. Now, it is assumed that the surrounding black marker portion has been detected in response to the error that the marker for the block B2 has not been detected or the address has not been detected.
[0234]
In this case, first, a line connecting the marker of the block B1 and the determined center of the block B3 is drawn, and a line connecting the marker of the block A2 and the determined center of the block C2 is drawn. I do. Then, address detection and processing can be performed further from the prediction center point toward the marker of block C2 and the marker of block B3. Further, even if address detection is not performed, since the arrangement is known, if the block B2 exists below the block B1, the address of the block B2 is set from the surrounding addresses, so that no detection is required. Can also be estimated. That is, it is possible to detect the address of the block and the center of the marker, which could not be predicted, which are currently focused on from the surrounding processing.
[0235]
The marker and block address interpolation unit 302 guides the address data that has been normally read, the center position, the interpolated address, and the information of the predicted center to the address control unit.
[0236]
If the scanning direction is the direction of the arrow as shown in the figure, the processing is performed with the upper left corner as the first representative marker. The center is sequentially detected in the vertical direction, and the center of eight (the markers in blocks A1 to A4 and the markers in blocks B1 to B4) is obtained by performing the first vertical detection. When the center of the next column is detected, the centers of the markers in blocks B1 to B4 are already known, so that the processing is not performed on the centers of the markers in blocks C1 to C4. , The center of step1, and the center of step2. Therefore, as described above, 81 scanning lines are not required, and once the center is obtained, the processing may be performed so as to sample the subsequent nine points. Therefore, nine processings are performed. That is, the center is obtained by 18 kinds of processing. Thus, there is an advantage that the processing is performed only at the beginning, but the processing after that is reduced.
[0237]
In the case of the dot code of FIG. 29A, first, a direction detection process is performed in the horizontal direction with A1, B1, and C1 using A1 at the upper left as a representative marker. In the processing, when the marker centers of A1 and B1 are obtained, the center detection processing of C1 may be performed in nine types of processing. In order to determine that the block below A1 is A2, since there is no address code, processing is performed as described below.
[0238]
That is, the size of the block may be determined from the lengths of the A1 marker and the B1 marker, and detection may be started from a marker located at an appropriate position based on the predicted block size, or the marker immediately below A1 may be represented first. The processing may be performed as a marker. Then, a block whose horizontal block address matches the detected block address may be set to A2. When the two-stage direction detection (A1 stage and A2 stage in the figure) is completed, the direction can be predicted in the vertical direction (the process of selecting the A3 marker), so that only the marker in that direction is detected. What is necessary is just to perform a process. Even if there is an erroneously detected marker, the processing can be performed excluding it.
[0239]
Next, the address control unit 220 of FIG. 20A will be described with reference to the block diagram of FIG.
[0240]
First, in the address control unit 220, the address generated by the write address generation unit 380 that generates an address when writing data from the A / D conversion unit 210 to the image memory 214 is stored in the image memory 214. The data of the / D conversion unit 210 is stored.
[0241]
As described above, an address is generated in each of the marker detecting section 216, the data array direction detecting section 218, the block address detection, the error determination, the accurate center detecting section 300, and the marker and address interpolating section 302. The address generators 382 to 388 are required for this purpose. In this case, in the marker generation address generation unit 382, the data generation direction detection address generation unit 384, the block address detection, the error determination, and the accurate center detection address generation unit 386, the corresponding marker detection unit 216 is used. (Internal marker determination section 318, marker area detection section 320, approximate center detection section 322), data array direction detection section 218, block address detection, error determination, accurate information exchange with center detection section 300 and address. Generate. Further, for a block in which four markers around the block are present, the interpolation processing address generation unit 388 calculates an address (hereinafter, referred to as a marker address) in which the exact center of each marker is associated with the image memory and the number of data. Further, a memory read address of the interpolation address coordinate data obtained by equally dividing the inside of the block and pixel data in the vicinity thereof is generated.
[0242]
The selection circuit 390 selects these address generation units 382 to 388 at the respective timings and supplies them to the lens aberration distortion correction circuit 392. The lens aberration distortion correction circuit 392 receives the lens aberration distortion information from the lens aberration distortion memory 224, converts (corrects) the selectively supplied address, and passes through the selection circuit 394. It is given to the image memory 214 as a read address.
[0243]
Next, another embodiment of the marker determination unit 318 in the marker detection unit 216 will be described with reference to FIGS.
[0244]
In the above-described embodiment, when the size of the dot code is determined, an image is formed by the imaging optical system 200 such that one dot corresponds to 1.5 pixels of the image sensor of the image capturing unit 204, and the marker determination unit 318 In the above, two-dimensionally continuous black pixels are found and determined as markers. On the other hand, in the present embodiment, when there are codes having different dot sizes, for example, a code having a dot size of 20 μm, a code having a dot size of 40 μm, and a code having a dot size of 80 μm, the image magnification in the imaging optical system 200 is not changed. This allows the reproduction of each code.
[0245]
That is, in various applications, the paper quality, sheet properties, ink, and printing level are different, and therefore, a dot size code corresponding to each application is used. For example, it is conceivable that 20 μm is used when the recording density can be extremely increased, and 80 μm is used depending on an application using a very rough low-cost sheet with poor sheet quality. In such a situation, the purpose is to judge the size and reproduce this code correctly.
[0246]
That is, as shown in FIG. 2B, there are a marker having a circular dot size of 20 μm, a marker having a dot size of 40 μm, and a marker having a dot size of 80 μm. The reproducing apparatus to which the present embodiment is applied is, for example, 20 μm. It is assumed that the apparatus is an apparatus for reproducing the code efficiently, that is, an apparatus having a magnification of an imaging system capable of decoding more information by one imaging. Then, in an apparatus in which the image of 20 μm is picked up at 1.5 times the image magnification, each of the 40 μm and 80 μm codes can be reproduced in the imaging system without changing the image magnification. That is the purpose. However, the size of the marker shown in (B) of the figure is seven times the diameter of each dot size.
[0247]
Therefore, as shown in FIG. 18A, first, the code of the maximum dot size to be selected is initialized (step S182). For example, if there are 80 μm, 40 μm, and 20 μm codes, and all of them are to be reproduced, the maximum size is set to 80 μm. This may be set by a key input by the user, or if it is determined that there are three types, that is, 80 μm, 40 μm, and 20 μm, and if it is possible to cope only with that size, the device itself will be the best. It may be set as a large size of 80 μm.
[0248]
Then, the temporary center is determined by performing the determination using the marker determination formula in FIG. 17B (step S184).
[0249]
That is, assuming that a code is created using markers for each dot size of 7 dots, at that time, as an image, the imaging optical system has an image magnification of 1.5 times. A code having a diameter of 10.5 dots and a code of 40 μm has a size of 21 dots, and a code of 80 μm has a size of 42 dots. Therefore, if 7 to 12 pixels and black pixels are two-dimensionally continuous, it is determined as a 20 μm code marker, 14 to 24 pixels is determined as a 40 μm code marker, and 29 to 47 pixels. Those below the pixel are determined as markers with a code of 80 μm.
[0250]
The value of this pixel is calculated by the following equation.
[0251]
r = s × d × m
int (r × 0.7) ≦ R ≦ int (r × 1.1 + 1)
However,
r: the number of pixels equivalent to the diameter of the marker (= 7)
s: dot size (20 μm, 40 μm, 80 μm)
m: imaging system image magnification (= 1.5)
d: number of dots of marker diameter
R: number of pixels of the diameter of the marker in the binary image
0.7: Reduction ratio due to inclination, dot rejection, etc.
1.1: Enlargement ratio due to dot gain etc.
It is.
[0252]
Since the marker of 80 μm is initially set in step S182, it is checked in step S184 whether the marker is a marker of 80 μm by the above-described marker determination formula, and the size of the marker (80 μm dot) is checked. The temporary center is determined for a marker determined to have a marker composed of
[0253]
Next, the number of the markers is checked, and it is checked that there are four or more markers (step S186). This means that a determination is made as to whether there is one or more blocks since one block is surrounded by four markers.
[0254]
Then, it is checked whether or not the marker has a predetermined positional relationship with the adjacent marker as shown in (C) of the figure, that is, whether or not the marker is aligned (step S188). That is, a marker B near the marker A of interest, a marker C near a position D away from the marker A in the direction perpendicular to the direction connecting the markers A and B, and the marker B A marker D located near a position separated by a distance D in the same direction as the direction from the markers A to C is detected. If they exist, for example, it is determined that the code is 80 μm in this case.
[0255]
If there are no four or more 80 μm markers in step S186, or if it is determined in step S188 that they are not aligned, this is not an 80 μm code. Thus, the code is set to one smaller code, in this case, 40 μm (step S190), and the process returns to step S184 to perform another marker determination.
[0256]
If the smallest size cannot be determined even if the smallest size is determined, the process is terminated because the code is not a code or the code cannot be reproduced. In this case, it is preferable to proceed to a process of issuing a warning such as issuing an alarm.
[0257]
Next, another embodiment of the marker determination unit 318 will be described. That is, a method of determining a marker pattern and modulated data by dilation, which is general image processing, will be described. Here, the dilation process is a process of converting a black pixel near a white pixel into a white pixel. Specifically, for example, pixels around three pixels around the pixel of interest (a 7 × 7 pixel area centered on the pixel of interest) are checked (black and white determination), and if at least one pixel is a white pixel, the pixel of interest is converted to a white pixel. The conversion process is performed for all pixels on the image.
[0258]
First, binarization processing is performed on the data in the image memory.
[0259]
Next, by the above-mentioned dilation processing, only the data portion of the code image is entirely converted into white pixels, and the pattern portion of the marker is converted into an image smaller than the original size by the number of pixels that have been dilated.
[0260]
Next, the address in the image memory of the transition point from a white pixel to a black pixel on the image and the number of continuous black pixels from the pixel are counted, and the information is classified for each marker based on the information, and The center address and the marker existence range are detected. Then, the approximate center detection processing is performed.
[0261]
This makes it possible to quickly determine the marker and detect the marker existence range at a high speed.
[0262]
In the case of a code in which the marker is uniformly deformed with respect to the center of the marker, such as the dot gain and dot reduction described above, the temporary center address obtained in the marker determination can be used as the approximate center. .
[0263]
The processing of step S184 in FIG. 38A may be the above processing.
[0264]
When the above-described A / D conversion unit is performed by binarization using a comparator, the binarization processing can be omitted in the marker determination processing.
[0265]
Next, a light source-integrated image sensor applicable to the detection unit 184 of the playback device shown in FIGS. 15 and 20D will be described. FIG. 39 is a diagram showing the structure. For example, a light emitting cell 398 is formed on a chip next to the light receiving cell 396 by using a compound semiconductor such as an LED or an electroluminescent element. Between the light receiving cell 396 and the light emitting cell 398, there is provided an isolation (light shielding) portion 400 in which a cutter is actually formed on the wafer to form a groove, and a non-transmissive material such as a metal is embedded therein. With this isolation section 400, it is possible to eliminate the problem that light emitted from the light emitting cell 398 directly enters the light receiving cell 396.
[0266]
In such a configuration, light emission of the light emitting cell 398 is controlled according to a light emitting cell control pulse signal as shown in the timing chart of FIG. The light receiving cell 396 sends the accumulated charge to the adjacent vertical charge transfer register 402 by applying a charge transfer gate pulse signal to a charge transfer gate (not shown). The vertical charge transfer register 402 sends the accumulated charge to the horizontal charge transfer register 404 line by line with a vertical charge transfer pulse. The horizontal charge transfer register 404 outputs the stored charges one pixel at a time via the buffer amplifier 406 according to the horizontal transfer clock signal.
[0267]
Next, with reference to FIG. 40, a description will be given of an embodiment in which, of the circuits of the reproducing apparatus described above, up to the stage preceding the demodulation circuit is implemented by an analog circuit and is configured by one chip. In this embodiment, an XY address type imaging unit 408 represented by CMD as disclosed in, for example, Japanese Patent Application Laid-Open No. 61-4376 is used as an imaging unit, thereby eliminating the need for a memory. , It is possible to make up one chip. An X-decoder 410 and a Y-decoder 412 are provided for address-scanning the XY-address type imaging unit 408.
[0268]
In an ordinary XY address type imaging unit, unlike a CCD, after reading one line, this line is reset to read the next line. That is, while a certain line is being read, another line is exposed during the exposure period. It is common to adopt a readout method such as entering into. However, such a reading method has a disadvantage that when extraneous light enters during the imaging time, an extra portion is exposed. Therefore, in this embodiment, the XY address method is used, and In combination with the element shutter, an operation is performed such that exposure is performed only when external light enters, that is, when exposure is to be performed, and the other portions are not exposed.
[0269]
The imaging element scanning address generation and element shutter control section 414 generates an element shutter pulse for providing an element shutter operation in an XY address manner, and generates a reset pulse for resetting all pixels.
[0270]
The X-decoder 410 and the Y-decoder 412 are circuits for turning on one of the elements in response to the generation of the image-capturing-element scanning address and the X address and the Y address from the element shutter control unit 414. Normally, the selector is constituted by a shift register or the like. In this embodiment, however, the selector is a type in which any one of the elements can be turned on by a signal from the image sensor scanning address generation and the element shutter control unit 414.
[0271]
The reset pulse in the present embodiment is equivalent to the image sensor reset pulse in the timing chart of FIG. 16, and resets the image sensor before the exposure and sets the reset pulse high during this reset period. This causes the switch 416 to switch, drawing all of the charge toward the negative power supply 418.
[0272]
The element shutter pulse is generated in such a manner that the gate can be applied from the end of the reset pulse to the end of the exposure as shown by a broken line in FIG.
[0273]
For reading, as in the case of a normal pulse, each element is sequentially turned on, and the signal charge is amplified by the current / voltage conversion amplifier 420 via the reset selection switch 416 and then supplied to the marker detection unit 422. . The marker detection unit 422 is the same as that described above, and the data detected by the marker is stored in the register 424. The θ detection unit 426 calculates the inclination based on the contents of the register 424 as in the direction detection unit described above. For example, in the circuit shown in FIG. 20D, the θ detection unit 426 corresponds to the data array direction detection unit 218, and the next data interval control unit 428 and the imaging element scan address generation and element shutter control unit 414 operate at the address. It corresponds to the control unit 220.
[0274]
Then, the coefficient for interpolation generated by the coefficient generator 430 under the control of the data interval controller 428 is multiplied by the charge read by the multiplier 432, and all are added by the adder 434. That is, the output of the addition circuit 434 is sampled and held by a sample and hold (S & H) circuit 436 and returned to the addition circuit 434 via the switch 438. This operation is performed to perform data interpolation as shown in FIG. 5A when sampling data after the direction and the scanning line are determined. In FIG. 5A, interpolation is performed by multiplying D6, D7, D10, and D11 by coefficients in order to obtain Q data. The interpolated value is sampled and held by the S & H circuit 440, and the sampled and held value is binarized by the comparator 442 and the threshold value determination circuit 444.
[0275]
Each imaging element (pixel) of the XY address type imaging unit 408 will be described in more detail. Each pixel is composed of two CMD elements, as shown in FIG. 41A, and the element shutter pulse enters the first CMD element 446, and the capacitor 448 is stored for the element shutter. Where the charge accumulates. After that, the second CMD element 450 drives a read pulse from the Y decoder 412 to select a line, and reads the electric charge for each pixel from the horizontal selection switch 452.
[0276]
At the time of exposure, the first CMD element 446 is operated as an element shutter by an element shutter pulse, and charges are stored in the element shutter capacitor 448. When the electric charge is accumulated in this way, light is shielded, a read pulse is applied from the Y decoder 412 to select a line, and the second CMD element 450 is turned on by the horizontal selection switch 452 to read out one pixel at a time.
[0277]
When resetting the charge, the horizontal selection switches 454 are all turned on by a reset pulse output from the image sensor scanning address generation and element shutter control unit 414, and the reset selection switch 416 is set to the negative power supply 418 side. Since the source of the CMD element 450 has a negative voltage, the charges accumulated in the element shutter capacitor 448 and the gate of the CMD element 446 move to the negative power source and are reset.
[0278]
In addition to the above operation, the reset can be performed by simultaneously applying a slightly higher voltage to the element shutter pulse and the read pulse.
[0279]
In the case of a normal imaging device, dark current is a problem, but in the case of the present embodiment, the device shutter pulse shown in FIG. Since the reading is performed immediately, the time during which the dark current accumulates is actually very short. Therefore, the S / N ratio is more advantageous than the operation of other imaging devices. In the exposure, a sufficient amount of light is given even in this short exposure period, so that the signal level remains unchanged and the S / N level with respect to the dark current decreases, so by applying this embodiment, As for the gain of the output degree of the current-voltage conversion amplifier 420 at the subsequent stage, a considerably large gain can be set.
[0280]
In the present embodiment, the pixel configuration for performing the above-described element shutter operation is described. However, a CMD element capable of performing the element shutter operation as disclosed in JP-A-61-4376 may be used. is there.
[0281]
Next, an embodiment in which a circuit using the XY address type imaging unit 408 as described above is constructed as a three-dimensional IC will be described with reference to FIG. Note that the present embodiment is directed to a case of an audio information reproducing apparatus.
[0282]
This is because the CMD 408, the X-decoder 410, and the Y-decoder 412 have an imaging unit layer 454 on the sheet surface of the sheet 182 and a detection unit layer 456 that detects data formed by being stacked on the imaging unit layer 454. , And an output processing layer 458 formed by being stacked on the detection section layer 456. The output processing layer 458 includes a demodulation section 190, an error correction section 194, a decompression processing section 256, a data interpolation circuit 258, a D / A conversion section, an output buffer 266, and the like, and outputs decoded audio information to an audio output device 268 such as an earphone. To play as sound.
[0283]
Of course, as described above, the output processing layer 458 can be configured to reproduce multimedia information including image information.
[0284]
By using a three-dimensional IC in this manner, processing up to sound output can be performed with one chip, so that the circuit scale is extremely reduced and the cost is reduced.
[0285]
Next, various configuration examples of the pen-type multimedia information reproducing apparatus will be described.
[0286]
For example, a pen-type information reproducing apparatus can be provided with a switch for instructing a timing for taking in a dot code.
[0287]
FIG. 41 (B) shows an example of this. The pen-type information reproducing apparatus is a light source 198 and an image forming optical system 200 in the reproducing apparatus shown in FIG. 15 or FIG. 20 (D). , A spatial filter 202, an imaging unit 204, a preamplifier 206, and a detection unit 184 including an imaging unit control unit 212 are provided at the tip thereof, and a scanning conversion unit 186, a binarization processing unit 188, a demodulation unit 190, a data error correction unit 194, a decompression processing unit 256, a data interpolation circuit 258, and the like are incorporated as an image processing unit 460, a data processing unit 462, and a data output unit 464. And it has an earphone as the audio output device 268. Although only an audio information output device is shown in this figure, it is needless to say that an output device can be connected when a processing unit for an image, a character, a line drawing, or the like is built in. The same applies to the description of the pen-type information reproducing device).
[0288]
A touch sensor 466 is provided on a side surface of the pen-type information reproducing device. As the touch sensor 466, for example, a piezoelectric switch, a micro switch, a piezoelectric rubber, or the like can be used, and a switch having a small thickness of 0.6 mm or less is known. The control unit serving as the imaging unit control unit 212 starts capturing the dot code as described above in response to the touch of the touch sensor 466 by a finger. Then, when the finger is released from the touch sensor 466, the capturing ends. That is, the start and end of the dot code capture are controlled using the touch sensor 466.
[0289]
Reference numeral 468 in the figure is a battery as an operating power supply for each unit in the pen-type information reproducing apparatus.
[0290]
The touch sensor 466 can perform the same function not only in the form of being pressed by a finger but also in a configuration in which it is attached to the tip of a pen-type information reproducing device as shown in FIG.
[0291]
That is, when the user places the pen-type information reproducing apparatus on the sheet 182 in order to manually scan the dot code printed on the sheet 182, the touch sensor 466 is turned on, and the control unit 212 recognizes it. To start reading the dot code.
[0292]
In this case, the tip of the pen-type information reproducing apparatus moves while contacting the sheet surface during scanning. In this example, the tip of the touch sensor 466, that is, the surface contacting the sheet surface is coated with a smooth resin or the like. In addition, it is preferable that a smooth movement be performed during manual scanning (moving).
[0293]
Further, a mechanism for removing specular reflection may be further provided in the detection unit of the pen-type information reproducing device.
[0294]
FIG. 44A shows the configuration, in which a first polarizing filter (polarizing filter 1) 470 is arranged on the front surface of a light source (a light source such as an LED) 198, that is, on the side to be irradiated. A second polarizing filter (polarizing filter 2) 472 is arranged on the front surface of the system (lens) 200.
[0295]
For example, the first polarizing filter 470 is formed by cutting out a polarizing filter film 474 into a donut shape as shown in (B) of the same figure, and the second polarizing filter 472 is formed of another polarizing filter film. 476 can be used, or, for example, an inner portion of the polarizing filter film 474 cut out of the first polarizing filter 470 can be used as shown in FIG.
[0296]
The first and second polarization filters 470 and 472 thus formed have a pattern surface (polarization surface) of the second polarization filter 472 with respect to a pattern surface (polarization direction) of the first polarization filter 470. They are arranged orthogonally.
[0297]
As a result, the plane of polarization of the random light emitted from the illumination light source 198 is limited by the first polarizing filter 470, and, for example, a P-wave is irradiated. Then, the specular reflection component is returned as a P-wave from the sheet surface while the polarization plane is preserved as it is. However, since the polarization plane of the second polarization filter 472 is orthogonal to the first polarization filter 470, The reflection component is blocked by the second polarization filter 472. On the other hand, when light emitted from the first polarization filter 470 returns to actual dots, that is, light that has returned on the sheet surface as luminance information on the paper surface, the plane of polarization is random. Therefore, the signal once entering the paper and returning as black and white information or color information has both the P component and the S component. Among them, the P component is similarly cut by the second polarizing filter 472, but the S component orthogonal thereto is passed through the second polarizing filter 472 and actually passed through the lens 200. To form an image on the imaging unit 204. That is, the reflected light from which the specular reflection component has been removed is guided to the imaging unit 204.
[0298]
In this case, a ４λ plate 1230 is arranged on the front surface of the spatial filter 202, and converts the image light, which is once input as linearly polarized light, into circularly polarized light and inputs the circularly polarized light to the spatial filter 202. This is because the effect of the linearly polarized light cannot be obtained because the spatial filter normally uses birefringence of quartz. In this example, the λλ plate 1230 is arranged on the front surface of the spatial filter 202, but is not limited to this, and may be an arbitrary one between the second polarizing filter 472 and the spatial filter 202. What is necessary is just to arrange in the place which is easy to install.
[0299]
As a configuration for removing the specular reflection component as described above, a configuration as shown in FIG. 45 can be further considered. This is because, instead of disposing the first polarizing filter 470 in the vicinity of the light source 198, for example, the light from the light source 198 is extremely sheeted using a transparent resin optical waveguide material 480 provided with a surface mirror coat 478. The light guide 480 illuminates the sheet (dot code) by guiding the sheet (dot code) to a position close to the surface, and is arranged at the light emitting portion of the optical waveguide member 480. In this case, the first polarization filter 470 is arranged so that light orthogonal to the second polarization filter 472 is transmitted.
[0300]
Incidentally, the use of the transparent resin optical waveguide material 480 has the advantage that the outer shape of the light source 198 can be made as thin as possible, and the advantage that the specular reflection component can be reduced because the incident angle becomes shallow.
[0301]
However, since the specular reflection component still remains due to the swelling of the ink, the swelling of the sheet paper, and the like, a polarizing filter is provided in order to eliminate this more efficiently.
[0302]
Further, instead of the second polarizing filter 472, an electro-optical element shutter 1220 such as a liquid crystal shutter or a PLZT shutter may be provided. The electro-optical element shutter 1220 includes, as shown in FIG. 44D, a polarizer 1221 as a polarizing filter, an electro-optical element 1222 such as liquid crystal or PLZT, and an analyzer 1223 as a polarizing filter. In this case, by arranging the shutter 1220 so that the light distribution direction of the polarizer (polarizing filter) 1221 of the shutter 1220 is the same as that of the second polarizing filter 472, a regular reflection removing effect can be obtained. .
[0303]
Further, the shutter function enables frame reading with an image sensor such as an IT-CCD that supports field reading, or has the advantage that all pixels can be simultaneously exposed even with an XY address type image sensor such as CMD. .
[0304]
Next, an example in which the light source 198 is made more efficient and the device is made slimmer will be described.
[0305]
FIG. 46 (A) is a view showing the structure, and is provided with an acrylic transparent resin optical waveguide material 480 having a mirror coat 478 on the surface, similarly to the example of FIG. 45 (A). As shown in FIG. 46B, the acrylic transparent resin optical waveguide material 480 is formed in a truncated cone shape, and a screw portion 482 is provided on an upper portion (a wider end portion) thereof. It is adapted to be screwed and attached to the housing 484 of the pen-type information reproducing device. Further, a surface mirror coat 478 is not applied to an inner portion near the screw portion 482, and a light source 198 is provided at the portion 486. That is, the light source 198 is provided as an LED array in which LEDs are mounted on a thinly cut flexible substrate 488 and formed into a ring shape, and this is adhered and attached to the portion 486 without the surface mirror coat. . Then, as shown in (C) of the same figure, the lower portion (tip portion) of the acrylic transparent resin optical waveguide material 480 is cut to form a portion 490 where the surface mirror coat 478 is not applied. Therefore, the light from the light source 198 enters the transparent resin optical waveguide material 480 from the non-mirror coat portion 486, is reflected by the surface mirror coat 478, passes through the optical waveguide material 480, and passes through the surface mirror coat at the tip. The light exits from the non-portion portion 490 and is irradiated on the dot code on the sheet.
[0306]
In addition, as shown in (D) of the figure, the front end of the acrylic transparent resin optical waveguide material 480 is straightened, and the surface mirror coat 478 is applied only to the outer portion, thereby facilitating the manufacture. It may be a simple shape. In this case, it is more preferable that the tip is rounded to make it slippery.
[0307]
Next, an example of a pen-type information reproducing apparatus using a light source-integrated image sensor will be described (see FIG. 47).
[0308]
That is, in the present embodiment, the light source integrated type image sensor 492 described above with reference to FIG. 39 is used, and a rod lens (for example, a cell hoc lens, a convex lens, 494) and a thin glass plate 496 are arranged and formed. Here, the thin glass plate 496 has a role of a protective glass for the actual contact surface and a role of giving a certain distance to make the illumination as flat as possible.
[0309]
As described above, by using the light source-integrated image sensor 492, it is possible to reduce the size of the pen-type information reproducing apparatus, and also to shorten the pen-type information reproducing apparatus in the length direction.
[0310]
Next, a pen-type information reproducing apparatus for handling color multiplexed dot codes will be described.
[0311]
FIG. 48A is a diagram showing the configuration, in which the touch sensor 466 as shown in FIG. 41B and the first and second polarizing filters as shown in FIG. 470,472. Further, the pen-type information reproducing apparatus of the present embodiment reads a color multiplexed dot code which is color multiplexed by combining a plurality of dot codes of different colors as shown in FIG. In addition, a color liquid crystal 498 controlled by the control unit 212 is arranged on the pupil plane of the lens 200.
[0312]
Here, in order to explain a method of controlling the color liquid crystal 498 in the control unit 212, an example of using a color multiplex dot code will be described first.
[0313]
For example, as shown in (C) of the figure, a color multiplex dot code 502 is arranged on an A4 sheet 500, and the character "Good Morning" is written in correspondence with the color multiplex dot code 502. First, consider a case where an index 504 and an index code 506 are arranged. Then, when the color multiplex dot code 502 is reproduced by this pen-type information reproducing device, the pronunciation of "Good morning" in Japanese, the pronunciation of "Good morning" in English, or the pronunciation of "Good morning" in German, or In order to select whether or not to pronounce "Guten morgen", as shown in (D) of the figure, an index code 506 arranged corresponding to an index 504 indicating the option is scanned and recognized, and for example, Japanese is selected. After that, when the color multiple dot code 502 is scanned, the following description will be given for the purpose of producing an utterance such as “Good morning”.
[0314]
First, as shown in (B) of the figure, a dot code for generating a sound in Japanese is generated, and is assigned as code 1 to red (R). Similarly, a dot code to be pronounced in English is created as code 2 and assigned to green (G), and a dot code to be pronounced in German is created as code 3 and assigned to blue (B). The color multiplex dot code 502 is recorded on the sheet 500 as the color of the overlapping portion of each information is a color formed by the color addition method of each color. In this case, portions where colors do not overlap are recorded as black dots. That is, as described above, the dot code is composed of the marker and the data dot, but the marker is black, and the data dot is recorded in another color by the additive method. Recording with the color multiplex dot code 502 in this manner means that the recording density is increased.
[0315]
It should be noted that not only the three colors of RGB but also a plurality of different pieces of information may be assigned to colors of different narrow-band wavelengths. More information, such as types, can be multiplexed. In this case, the color ink may be a mixture of a dye (an ink that reflects light having only a narrow band wavelength) in addition to the conventional inks such as cyan, yellow, and magenta.
[0316]
The index code 506 is arranged in the underlined portion of the index 504 shown by characters or pictures so that the user can recognize and select the index code 506. The print can be read regardless of which color is selected. Is printed in black.
[0317]
The color liquid crystal 498 is formed by attaching an RGB light transmission mosaic filter in accordance with liquid crystal pixels, and separates information of each color of the color multiplex dot code 502. That is, the control unit 212 controls so that only the pixels corresponding to the color of the information selected by the scan of the index code 506 are in the transmission state. Further, the liquid crystal may not be in a mosaic shape, and may be configured to divide an optical path into planes. At this time, it is preferable to make the divided area ratio of each color inversely proportional to the sensitivity of the pixel because the sensitivity for each color becomes uniform. That is, when the sensitivity of B is low, the area is made larger than other colors. The color liquid crystal may be provided on the light source side.
[0318]
Next, an operation for reading the index code 506, selecting a color, and generating a color in a desired language will be described with reference to the flowchart in FIG.
[0319]
First, the control unit 212 controls the liquid crystal transmission portion of the color liquid crystal 498 in accordance with the color selection when the touch sensor 466 is pressed (step S204) if green is temporarily selected by the initial setting (step S202) (step S206). ). For example, since green is selected in the initial state, only dots with a green filter are made transparent. Next, the light source 198 is controlled by the control unit 212, and the dot code is read by the image processing unit 460 (step S208). Then, the code is decoded by the data processing unit 462 (step S210), and it is recognized whether or not all the codes have been completed, that is, whether all the codes have been read (step S212). Emit (step S214). Next, the control unit 212 determines whether the read result is the index code 506 or the sound information (color multiplex dot code 502) based on the decoded result (step S216). Then, the color indicated by the index code 506 is selected (step S218), and the process returns to step S204. If it is sound information, the sound is reproduced from the sound output device 268 by the data output unit 464 (step S220).
[0320]
Then, after the sound is reproduced in step S220, it is further determined whether or not the sound is repeatedly generated a predetermined number of times (step S222). If the number of times is preset by the repeat switch 467, the The predetermined number of times is repeated.
[0321]
Of course, the number of repetitions may be one, and may be appropriately set by various switches. Alternatively, the number of repetitions may be recorded in the index code 506 or the dot code 502 in advance.
[0322]
In this case, the repeat reproduction can be performed by repeatedly reading the data from the data memory unit 234 in FIG. 15 or (D) of FIG.
[0323]
The imaging unit 204 includes a monochrome image sensor and a color image sensor in which a color mosaic filter is generally mounted on the image sensor unit. Although the above example uses a black-and-white image pickup unit, it is possible to use a color image pickup device and separate the colors in the image processing unit 460 to reproduce the image in different colors. In such a case, the color liquid crystal 498 can be dispensed with.
[0324]
FIG. 49B is a diagram illustrating a configuration of an image memory unit of the image processing unit 460 when a color image sensor is used. That is, a signal input from the color image sensor is separated into respective colors by a color separation circuit 508 and stored in the memories 510A, 510B, and 510C, and is selected by the multiplexer (MPX) 512 to perform the subsequent processing. To do.
[0325]
Further, of the first and second polarizing filters 470 and 472 for the purpose of preventing regular reflection, the same polarizing filter is used in the polarizer portion of the color liquid crystal 498 for the second polarizing filter 472. Therefore, it is possible to use it also. Therefore, by combining with the polarization filter for the color liquid crystal 498, the second polarization filter 472 can be omitted. However, at this time, the angle of the color liquid crystal on the horizontal plane must be the same as the direction corresponding to the second polarizing filter 472, that is, must be rotated so as to cut components in the same direction.
[0326]
Also, as shown in FIG. 50A, the color liquid crystal 498 is removed, and instead of using a white light source as the light source 198, an RGB light source such as an LED as shown in FIG. The color multiplex dot code 502 can be read. That is, in the case of separating RGB and the above three colors, among the RGB light sources 198, when reading the code 1 corresponding to red, only the LED corresponding to red is turned on. In the case of code 3, only the blue LED may be turned on to reproduce.
[0327]
Instead of using the RGB LEDs, a color filter may be added to each part as a white light source to provide a light source of each color.
[0328]
In this way, by using light sources of different colors R, G, and B as the light source 198 and controlling lighting of the light source of the color selected by the index code 506, the same effect as the configuration of FIG. it can. Furthermore, by having a plurality of light sources that emit light of a plurality of narrow-band wavelengths, it is not necessary to have a color liquid crystal and a control circuit therefor, and the size can be reduced at low cost. In particular, some LEDs have a narrow band, for example, a wavelength of about ± 27 nm of a certain wavelength. If such an LED is used, a narrower band can be reproduced.
[0329]
Next, a stealth type dot code pen type information reproducing apparatus will be described.
[0330]
FIG. 51A shows a dot data sticker 516 with a title on which an infrared-emitting paint dot code 514 as a stealth-type dot code is printed. The dot data sticker 516 prints, for example, a title in a printing machine or a printer using normal color or black and white printing, and prints a dot code below this using an invisible paint. It was done. Of course, in the dot data seal 516, since the dot code 514 is invisible, that is, transparent printing, the dot code 514 is formed on the title of the visible information by using transparent ink as shown in FIG. Printing may be performed in an overlapping manner. For example, in the case of an inkjet printer or the like, this printing is realized by applying an infrared light-emitting paint ink as a fifth ink to four inks of cyan, magenta, yellow, and black, and printing the ink. it can.
[0331]
FIG. 51A shows an example in which a title is printed in the margin of a stealth-type dot code. Needless to say, a visible-light dot code is printed on the title-attached dot data sticker, and the title is printed in the margin. The title may be printed.
[0332]
As a pen-type information reproducing apparatus that reproduces the infrared-light-emitting paint dot code 514 as such a stealth-type dot code, for example, as shown in FIG. Since it is printed, an infrared light emitting element 518 is used as the light source 198, and an infrared bandpass optical filter 520 is arranged in front of the imaging unit 204.
[0333]
That is, when the infrared light emitting element 518 irradiates the infrared light paint dot code 514 with light in the infrared region, the light is reflected in the infrared region, that is, at a wavelength in a certain narrow wave band. In order for the intensity of the reflection to be detected by the imaging unit 204, the reflected light is guided through the infrared band-pass optical filter 520 and separated from visible light information.
[0334]
In addition, since several kinds of emission bands of the paint used for printing the infrared emission paint dot code 514 can be prepared, for example, by taking an image while changing the characteristics of the bandpass optical filter 520 little by little, this transparent printing can also be performed. Multiplexing is possible.
[0335]
【The invention's effect】
As described above in detail, according to the present invention, a dot code that can record multimedia information including audio information, video information, digital code data, and the like inexpensively, in large capacity, and can be repeatedly reproducedAnd information reproduction systemCan be provided.
[Brief description of the drawings]
FIG. 1 is a block diagram of a recording device for recording dot-coded audio information according to a first embodiment of the present invention.
FIG. 2A is a diagram illustrating a recording format of a dot code, and FIG. 2B is a diagram illustrating a use situation of a reproducing apparatus according to the first embodiment.
FIG. 3 is a block diagram of a reproducing apparatus according to the first embodiment.
FIGS. 4A and 4B are explanatory diagrams of manual scanning, and FIGS. 4C and 4D are explanatory diagrams of scan conversion, respectively.
5A is a diagram for explaining data interpolation accompanying scan conversion, and FIGS. 5B and 5C are diagrams each showing an example of a recording medium. FIG.
FIG. 6 is an explanatory diagram of data string adjustment.
FIG. 7 is a diagram illustrating a configuration of a playback device according to a second embodiment.
FIG. 8 is a diagram illustrating a configuration of a playback device according to a third embodiment.
FIGS. 9A and 9B are external perspective views of a portable voice recorder, respectively.
FIG. 10 is a circuit configuration diagram of the portable voice recorder.
FIGS. 11A and 11B are diagrams showing examples of printing on a recording medium, and FIGS. 11C and 11D are external perspective views of another example of a portable voice recorder.
12 is a flowchart of a dot code printing process in the voice recorder of FIG.
FIG. 13 is a block diagram of a multimedia information recording device.
FIG. 14 is a conceptual diagram of a dot code.
FIG. 15 is a block diagram of a multimedia information reproducing apparatus.
16 is a light source emission timing chart in the multimedia information reproducing apparatus of FIG.
FIG. 17 is a diagram illustrating another configuration example of the multimedia information reproducing apparatus.
18A is a diagram illustrating a dot code applied to the reproducing device of FIG. 3 for explaining a data string adjusting unit in the multimedia information reproducing device of FIG. 15, and FIG. 18B is a diagram of FIG. FIG. 3C is a diagram illustrating a dot code linear marker, FIG. 3C is a diagram illustrating a scanning method, and FIG. 3D is a diagram illustrating a scan pitch of an image sensor.
FIG. 19 is a diagram illustrating an actual configuration of a data string adjusting unit.
FIGS. 20A to 20C are diagrams illustrating markers having arrangement direction detection dots, and FIG. 20D is a diagram illustrating still another configuration example of the multimedia information reproducing apparatus.
21A is a diagram illustrating a block address, FIG. 21B is a diagram illustrating a block configuration, FIG. 21C is a diagram illustrating a marker pattern example, and FIG. 21D is a diagram illustrating a magnification of an imaging system. FIG.
FIG. 22 is a block diagram of a marker detecting unit in the multimedia information reproducing apparatus.
FIG. 23 is a processing flowchart of a marker determination unit in FIG. 22;
FIG. 24 is a processing flowchart of a marker area detection unit in FIG. 22;
FIG. 25A is a diagram showing a marker area, FIG. 25B is a diagram showing a storage format of a table for storing a detected marker area, and FIGS. 25C and 25D are diagrams of FIG. FIG. 9 is a diagram showing the accumulated value of each pixel in FIG.
26A is a processing flowchart of the approximate center detecting unit in FIG. 22, and FIG. 26B is a flowchart of a gravity center calculation subroutine in FIG.
FIG. 27 is a block diagram of the approximate center detection unit.
28A is a diagram showing an actual configuration of a dot code data block, FIG. 28B is a diagram showing another configuration, and FIG. 28C is a diagram for explaining another arrangement of data inversion dots. FIG.
29A is a diagram showing another example of the actual configuration of a dot code data block, and FIG. 29B is a diagram for explaining selection of an adjacent marker.
FIG. 30 is a block diagram of a data array direction detecting unit in the multimedia information reproducing apparatus.
FIG. 31 is an operation flowchart of a data array direction detection unit.
32 (A) is a flowchart of an adjacent marker selection subroutine in FIG. 31, and (B) and (C) are diagrams for explaining adjacent marker selection, respectively.
FIG. 33A is an explanatory diagram of direction detection, and FIG. 33B is a diagram for explaining the relationship between m and n in FIG.
FIG. 34 is an explanatory diagram of another method of direction detection.
FIGS. 35A and 35B are a block configuration diagram and an explanatory diagram of a block address detection, error determination, and accurate center detection unit in the multimedia information reproducing apparatus, respectively.
FIG. 36 is an operation flowchart of a block address detection, error determination, and accurate center detection unit.
FIG. 37A is a diagram for explaining the operation of a marker and address interpolating unit in the multimedia information reproducing apparatus, and FIG. 37B is a block diagram of an address control unit in the multimedia information reproducing apparatus. It is a block diagram.
38A is a diagram for explaining another processing method of the marker judgment unit, FIG. 38B is a diagram for explaining a marker judgment formula, and FIG. 38C is a diagram for explaining marker alignment detection; It is.
FIG. 39 is a diagram showing a configuration of a light source integrated type image sensor.
FIG. 40 is a block diagram of a one-chip IC using an XY address type imaging unit.
41A is a circuit configuration diagram of a pixel of an XY address type imaging unit, and FIG. 41B is a diagram illustrating a configuration of a pen-type information reproducing apparatus having a dot code capture control switch.
FIG. 42 is a block diagram of a three-dimensional IC using an XY address type imaging unit.
FIG. 43 is a diagram illustrating another configuration of a pen-type information reproducing device having a switch for controlling dot code capture.
44A is a diagram illustrating a configuration of a pen-type information reproducing apparatus capable of removing regular reflection, FIG. 44B is a diagram illustrating a configuration of first and second polarizing filters, and FIG. FIG. 9 is a diagram illustrating another configuration example of the second polarization filter, and FIG. 9D is a diagram illustrating the configuration of the electro-optical element shutter.
FIG. 45 is a diagram showing another configuration of a pen-type information reproducing apparatus capable of removing regular reflection.
46A is a diagram showing a configuration of a pen-type information reproducing device using a transparent resin optical waveguide material as a light source, and FIG. 46B is an enlarged view of a connection portion between the optical waveguide material and a reproducing device housing; , (C) and (D) are diagrams showing the configuration of the tip portion of the optical waveguide material, respectively.
FIG. 47 is a diagram showing a configuration of a pen-type information reproducing apparatus using an image sensor integrated with a light source.
48A is a diagram showing a configuration of a pen-type information reproducing apparatus compatible with color multiplexing, FIG. 48B is a diagram for explaining a color multiplexing code, and FIG. (D) is a diagram showing an index code.
FIG. 49A is an operation flowchart of a color multiplexing compatible pen-type information reproducing apparatus, and FIG. 49B is a diagram showing a configuration of an image memory unit when a color imaging element is used.
50A is a diagram illustrating another configuration of a pen-type information reproducing apparatus that supports color multiplexing, and FIG. 50B is a diagram illustrating the configuration of a light source.
FIG. 51 (A) is a diagram showing a dot data sticker on which a stealth type dot code is written, FIG. 51 (B) is a diagram showing a configuration of a pen type information reproducing apparatus corresponding to a stealth type dot code, and FIG. 51 (C). FIG. 4 is a diagram showing a dot data seal in which a stealth type dot code is written in another mode.
[Explanation of symbols]
36,170 dot code
36A, 36B Mark for manual scanning
38,172,304 blocks
38A, 174, 274, 310 marker
38B error correction code
38C audio data
38D x address data
38E address data
38F error judgment code
176, 272A, 306 block address
178 Address error detection and error correction data
180,314 data area
272B Error correction data of block address
276A line address
276B Error detection data
278,316 dots
294A, 296A, 298A Dot for array direction detection
306A Upper address code
306B Lower address code
308 Dummy marker
310A circular black marker
310B White part of marker
312 Error detection code
312A Upper address CRC code
312B Lower address CRC code
364 data margin

Claims (4)

An optically readable dot code,
The dot code is
A data dot pattern consisting of a plurality of dots arranged two-dimensionally according to the content of the data,
A plurality of markers for recognizing the dot code, comprising a pattern that cannot be included in the data dot pattern;
At least
Each of the plurality of markers is composed of a black portion and a white portion, and is arranged two-dimensionally at a distance from each other. A dot code which is a point for obtaining a sample point to be sampled. The dot code is configured by two-dimensionally arranging a plurality of blocks including at least the data dot pattern and the marker,
The dot code according to claim 1, wherein data is sampled from the data dot pattern for each block unit. An optically readable dot code, a data dot pattern consisting of a plurality of dots two-dimensionally arranged in accordance with the content of data relating to information to be reproduced, and a pattern which cannot be included in the data dot pattern Comprising at least a plurality of markers for recognizing the dot code, wherein each of the plurality of markers is constituted of a black portion and a white portion, and is arranged two-dimensionally apart from each other, Optically reading the dot code from a recording medium on which a dot code is recorded in which a center of gravity of a black portion determined by a white portion of the marker is a point for obtaining a sample point for sampling data from the data dot pattern. Means,
Restoring means for detecting the marker from the dot code read by the reading means, sampling data from the data dot pattern included in the dot code, and restoring original information,
Output means for outputting information restored by the restoration means,
An information reproducing system, comprising: The dot code is configured by two-dimensionally arranging a plurality of blocks including at least the data dot pattern and the marker,
4. The information reproducing system according to claim 3, wherein the restoration unit is configured to sample data from the data dot pattern for each block unit.

Images