JP2917970B2 - Output method of mounting board inspection result - Google Patents

Description

Description: BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mounting board inspection apparatus.
Inspection of the mounting state of the mounted components on the mounting board to be inspected
If so, how to output the inspection result
About the law. 2. Description of the Related Art A mounting board made by using a mounter or the like
Conventionally, as a mounting board inspection apparatus for inspecting
What is known is known. The mounting board inspection apparatus shown in FIG.
Inspection mounting board 2b on which component b is mounted and component 1a are mounted
Camera 3 for imaging the reference mounting board 2a
Reference mounting board 2a obtained by TV camera 3
From the image (reference image), the shape, position, color, etc. of the part 1a
Feature data that is extracted and stored as feature data.
Data extraction / storage section 4 and feature data extraction / storage section 4
The TV camera 3 based on the stored feature data
Of the mounting board 2b supplied from the
Image) and inspects the component 1b on the inspected mounting board 2b.
Whether or not all the parts 1b are misaligned
A determination unit 5 for determining whether or not the like has occurred;
Display or print the judgment result of the judgment unit 5
And a monitor 6. [0004] By the way, such a problem is solved.
In a conventional mounting board inspection apparatus, the mounting board 2b to be inspected is
Display or print the inspection result data of
Out to the person in charge of inspection and repair
Inspection and correction of defective mounting locations. However, conventionally, a component identification number
Mounted by serial number (serial number or number for each component type)
Since the defective part was displayed or printed out,
Inspect and fix boards with hundreds of components
In the case of slipping, the mounting error is immediately determined from the part identification number.
It is difficult to find and check and correct
A lot of time was needed. A part identification number for one part,
Correctly associate the mounting position of this component on the board and store it
It is not easy to do, to complete the memory
It takes a long time, and it is difficult to remember
There has always been a fear of reduced reliability. [0007] In view of the above problems, the present invention has been developed for inspection and repair.
The person in charge associates the component identification number with the component mounting position.
Without knowing the location of defective parts.
To provide a method of outputting inspection results
It is intended to be. [0008] The above-mentioned problems are solved.
For the present invention, the teaching board, the reference mounting board or
Take an image of the unmounted board, and check whether the image
Create an inspection data file from the
The mounting state of the mounted components on the board to be inspected based on the
To inspect the mounting board and output this inspection result.
In the force method, each of the components mounted on the board to be inspected is
The position of the part on the board to be mounted and the shape of the part
Can be visually distinguished on a two-dimensional plane.
Graphic data storage means for image data
And store the test result in the test storage means.
Stored in the graphic image storage means.
Data related to the graphic image being
From the test results stored in the test result storage means,
The part determined to be defective is the graphic image
Image so that you can visually identify which part of the
Page output. FIG. 1 shows an embodiment of the present invention.
FIG. 2 is a block diagram showing a mounting board inspection device according to the first embodiment. [0010] The mounting board inspection apparatus shown in FIG.
Table section 18, illumination section 19, imaging section 20, processing
And a teaching board (component 27a).
The mounting base where the part is painted white and the other parts are painted black
Plate) 23, reference mounting board 24, and unmounted board 25
The inspection data file is taken from the
Create a file. After that, based on this inspection data file,
Then, the image obtained by imaging the mounting board 26 to be inspected is inspected.
Check that the parts 27d are correctly
Determine if it is implemented. The illumination unit 19 is controlled by the processing unit 21
On / off control (or dimming control) based on the signal
A ring-shaped white light source 22 which is
Lights when the illumination ON signal is supplied from 21 and
X until the illumination off signal is supplied from the processing unit 21.
-Illuminate the upper surface side of the Y table section 18. The XY table section 18 is, as shown in FIG.
A base 63 and an XY table provided on the base 63
Mechanism 64 and one end of the XY table mechanism 64
The loader 65 provided and the XY table mechanism 64
And an unloader 66 provided on the other end side of the
Each substrate 23 to 26 is inserted from the leading end side of the loader 65
When the substrate 2 is
Imaging unit while stepping 3 to 26 in the XY directions
20 for each of these substrates 23 to 26 as many times as necessary.
After the image is taken, it is supplied to the next device (not shown). In this case, the loader 65 is configured as shown in FIG.
Guide section with cuts at equal intervals as shown in (B)
Endless belt with 85 (Material is polyurethane, etc.)
86 and a guide plate 87 for guiding the endless belt 86
And a transfer belt mechanism 73 provided with
Reversible driving the transport belt mechanism 73 based on a control signal
And a rotation motor 74, which is inserted from its introduction end side.
Each of the substrates 23 to 26 is supplied to the XY table mechanism 64.
Or returned from the XY table mechanism 64
The substrates 23 to 26 are temporarily stocked. The XY table mechanism 64 is provided with the base
X positioning unit 80 provided on
Positioning portion 81 provided on the female portion 80, and the Y position
And a transport section 82 provided on the placement section 81.
You. The X positioning section 80 is disposed on the base 63.
Two guide rails 67 to be placed, and these guide rails
X-tape movably supported in the X-direction by a tool 67
On the basis of the control signal from the processing unit 21 and the
An X pulse motor 31a for driving the X table 68;
It has. The Y positioning section 81 is provided with the X table.
68, two guide rails 69 arranged on
Guide rail 69 so as to be movable in the Y direction.
Y table 70 and a control signal from the processing unit 21
Y-pulse mode for driving this Y-table 70 based on
Data 31b. The transport section 82 transports the loader 65
Conveyor belt mechanism 71 configured similarly to belt mechanism 73
And this transport based on a control signal from the processing unit 21.
A reversible motor 72 driven by a belt mechanism 71;
Each substrate 23-2 taken in by the feeding belt mechanism 71
6. A retractable stopper machine that stops 6 at a predetermined position.
Each substrate 23 is moved by the structure 77 and the transport belt mechanism 71.
Sensor 7 that detects when the 取 り 込 ま 26 is taken in
8 and each of the components taken in by the transport belt mechanism 71.
A retractable positioning pin mechanism for fixing the substrates 23 to 26
79. The loader 65 and the unloader 66
When each of the substrates 23 to 26 is supplied from the
Received by the tilting mechanism 71, and thereafter each pulse motor
31a and 31b take pictures of these substrates 23 to 26, respectively.
It is moved to a position below the image unit 20 to capture an image. And this
When the image pickup operation is completed, the transport belt mechanism 71 is returned to the original position.
To the loader 65 and the unloader 65
It moves to da66. The unloader 66 transports the loader 65
Conveyor belt mechanism 75 configured similarly to belt mechanism 73
And this transport based on a control signal from the processing unit 21.
A reversible motor 76 for driving a belt mechanism 75
And each base supplied from the XY table mechanism 64.
After temporarily stocking the plates 23 to 26, this is
-Return to Y table mechanism 64 or carry out from exit side
Or Further, the image pickup unit 20 stores information of the illumination unit 19.
A color TV camera 34 provided in the
The optical images of the substrates 23 to 26 are stored in the color TV camera 3.
4 converts it into an electric image (R, G, B color signals)
And supplied to the processing unit 21. The processing unit 21 includes an A / D conversion unit 36 and a memo
File 37, a table 38, an image processing unit 39, and two
Monitors 40 and 43 and XY stage controller 41
, An imaging controller 42, a printer 44, and a keyboard.
A card 45 and a control unit (CPU) 46 are provided.
At the time of the teaching, it is supplied from the imaging unit 20.
R, G, B color signals of each substrate 23 to 25
The inspection data file for inspecting the mounting substrate 26 to be inspected.
Create a file. At the time of inspection, the inspection
Supplied from the imaging unit 20 based on the inspection data file.
R, G, B color signals of the mounting board 26 to be inspected
The land formed on the mounting board 26 to be inspected
28d and the range in which the relative position between the component 27d is allowed.
Judge whether it is within the box and display this judgment result.
Or print or file. The A / D converter 36 is provided by the imaging unit 20
When image signals (R, G, B color signals) are supplied
A / D converted (analog / digital conversion)
Creates color image data, and sends it to the control unit 46 or monitor.
Supply to 40. The memory 37 is a semiconductor RAM (lander RAM).
Access memory), hard disk, etc.
And is used as a work area of the control unit 46.
Of the components mounted on the mounting board 26 to be inspected.
The position and the shape of the part are visually distinguished on a two-dimensional plane
Stores data on graphic images that can be
For graphic image storage means and mounting board inspection equipment
The test storage means for storing the obtained test results
doing. The image processing section 39 controls the control section 46.
This color when supplied with color image data
Image data is binarized and the position, shape and shape data of parts
Extract necessary color images from the color image data
Cut out an image or color-cut this color image
Or convert this hue lightness conversion result to a predetermined
Binarize with a threshold to extract the position, shape, etc. of the land pattern
And is configured to take out each obtained here
The data is supplied to the control unit 46. The table 38 has a floppy disk.
The control unit 46 has an inspection data file.
When a file or the like is supplied, it is stored, and
When a transfer request is output from the unit 46,
Reads inspection data files, etc., and controls overloading
Or to the unit 46. The imaging controller 42 includes the control unit
46 and the illumination unit 19 and the imaging unit 20.
Interface, etc., and the output of the control unit 46 is provided.
The illumination unit 19 and the imaging unit 20 are controlled based on the above. The XY stage controller 41 includes:
Connects the control section 46 to the XY table section 18
The control unit 46
The XY table section 18 is controlled based on the output of
You. The other monitor 40 is a CRT (C
RT) and the like, and the A / D converter 36
When the color image data of the plates 23 to 26 is supplied,
Is displayed on the screen.
The part outline frame data (image processing frame data)
When an int command or the like is supplied, as shown in FIG.
The part outline frame 57 indicated by the part outline frame data
May be displayed on the screen, or as shown in FIG. 9 (C).
The part specified by the INT directive (in this case, the land
28b) in a designated color. The other monitor 43 is shown in FIG.
As shown, the screen displays the processing status of the entire board.
Graphic display area 52 for displaying
Display procedure instruction
Rear 53 and specifications for displaying various data related to the board
A display area 54 and various error messages are displayed.
Divided into the error message display area 55
The control unit 46 has a graphic tube.
Image data, operating procedure instruction data, specification data,
When the test result, error data, etc. are supplied, this is displayed on the screen.
Display in the corresponding area above. The printer 44 is controlled by the controller 46
When the judgment result, etc. is supplied, this is written in a predetermined
Print out by formula (format). Therefore, the printer 44 and the monitor
Judgment results supplied from the control unit 46 according to 40 and 43
Components that are determined to be defective on the basis of
Can visually identify which part on the image
Image output. The keyboard 45 is used for operating information and the
Data on the name of the inspection mounting board 26, board size, etc.
With respect to the component 27d on the board 26 to be inspected.
Equipped with various keys necessary for inputting
Information and data input from the keyboard 45
Is supplied to the control unit 46. The control unit 46 includes a microprocessor and the like.
And operates as described below. First, a new board 26 to be inspected is inspected.
When the controller 46 is in the teaching position shown in FIGS.
In step ST1 of the programming flowchart,
The board name (for example, board identification)
Number) and a message requesting the board size.
Then, from the keyboard 45, these board names and board
Is input, the control unit 46 thereafter outputs the XY text.
The cable section 18 is rotated forward and the
Wait until the teaching substrate 23 is placed. And this
When the teaching board 23 is placed, the control unit 46
In step ST2, the XY table unit 18 is controlled to
The first processing of the teaching substrate 23 below the TV camera 34
And the graph on the monitor 43
The current processing is displayed in the display area 52 as shown in FIG.
Of the area being managed (in this case, the first processing area)
A processing frame 56 indicating the position, shape, and the like is displayed. Next, the control unit 46 controls the color TV camera 3
4 image the first processing area of the teaching substrate 23
And the resulting R, G, B color image
After the image signal is A / D-converted by the A / D converter 36,
A / D conversion result (color image data of teaching board 23)
Is stored in the memory 37 in real time. At this time, the A / D converter 36 obtains
The color image data of the teaching board 23
The data is supplied to the printer 40 and displayed as shown in FIG. Next, the control unit 46 proceeds to step ST3.
R image of the color image data stored in the memory 37
Pixels (or G and B pixels) are sequentially read out and
The binarization is performed by the element processing unit 39 and the teaching substrate 23
To extract the part painted white (part 27a)
After that, the position of each part 27a obtained by this extraction operation is
The position data and the shape data are stored in the memory 37. Thereafter, the control unit 46 determines in step ST4
The position data of each part 27a stored in the memory 37
Graph on the monitor 43 based on the data and the shape data.
As shown in FIG.
A part outline frame 57 indicating the position of 7a and the shape is displayed.
You. As a result, the component outline frame 57 is placed at the position of the component to be mounted.
Position and Position of Two-dimensional Plane on Teaching Board 23
Are layout information visually associated with each other. Then, the parts 27 in the first processing area
The creation and display operations of the component outline frame 57 are completed for all of a.
When the control is completed, the controller 46 proceeds to step ST5 to execute the process.
Returning to step ST2, the remaining processing area is described above.
And repeat the process. In this case, each processing area has a small number.
The processing frame 56 of this time
The parts 27a that are not completely stored in the
Processing area. Thereafter, as shown in FIG.
When the part outline frame 57 is obtained for the rear part 27a
Then, the control unit 46 exits this processing loop and executes XY
Rotate the table section 18 forward to rotate the substrate 23 for teaching.
And wait until the reference mounting board 24 is mounted. The transport on the XY table 18
The reference mounting board 24 is set on the feeding belt mechanism 71.
If the control unit 46 determines in step ST6 that the XY table unit 1
8 to control the reference mounting base below the color TV camera 34.
A first processing area of the plate 24 is located and a monitor
In the graphic display area 52 on 43, FIG.
As shown, the current processing area (in this case, the first processing area)
A) and the outline frame 57 of each part are displayed.
Let Thereafter, the control unit 46 controls the color TV camera 3
4 causes the first processing area of the reference mounting board 24 to be imaged.
In both cases, the R, G, B color image signals
After the A / D conversion of the signal, the A / D conversion result (reference
The color image data of the mounting board 24 in the memory 37
Remember by time. At this time, the A / D converter 36
The color image data of the reference mounting board 24 is
40 and displayed on the screen. Next, the control unit 46 proceeds to step ST7.
From the memory 37, regarding the component 27c in this processing area
The first component outline frame data is read out and is
0 on the screen as shown in FIG. 9 (B).
The section frame 57 is superimposed and displayed, and
The data is supplied to the monitor 43 as shown in FIG.
The part outline frame 57 corresponding to the part outline frame data is green.
Paint with color. Thereafter, the control unit 46 determines in step ST8 that
A message is displayed on the operation procedure instruction area 53 of the monitor 43.
The part corresponding to the part outline frame 57 displayed and displayed in green
The product 27c is a component other than a resistor (for example, a transistor,
Capacitors, diodes, flat package ICs, etc.)
Whether the electrode direction is correct,
It is necessary to change the position, shape, etc. of the component outline frame 57
Ask whether or not. Here, this component 27c is a component other than a resistor.
Or the part 27 displayed on the monitor 40 as a video.
c and a component outline frame 57 graphically displayed
Do not overlap to an acceptable degree, and
The operator determines the type of this part 27c, the electrode direction, and the part
Change the position and shape of the component outline frame 57 for the product 27c
Is determined to be necessary,
Is pressed, the controller 46 proceeds from step ST8 to step S8.
The process branches to step ST9. Then, in this step ST9, the operation
The participant uses the type change key, direction change key, etc.
Change the type and electrode direction of 27c, enlarge key, reduce
Video table on the monitor 40 using the
The outline of the indicated part 27c and the graphic display
The position of the part outline frame 57 is set so that the part outline frame 57 overlaps.
If the position and shape are changed, the control unit 46 will respond accordingly.
Type of the part 27c stored in the memory 37
Modify data, direction data, position data, and shape data
After that, the process returns to step ST7, and
Then, the above operation is executed again. The component 27c is a resistor, and
The electrode direction is correct and the video display on the monitor 40
The outline of the indicated part 27c and the graphic display
The part outline frame 57 overlaps to an acceptable degree,
The operator who looks at the screen of the above shows the type of this part 27c,
And the position of the part outline frame 57 for this part 27c.
Judge that there is no need to change the
When the “OK” key of the mode 45 is pressed, the control unit 46
Type of component 27c, electrode direction, and component outline frame 5
Area where land should exist depending on the position, shape, etc.
Command extraction area 48). In this case, the component 27c is a resistor or a diode.
In the case of a two-electrode component such as the one shown in FIG.
Including electrodes 47c formed at both ends of the component 27c,
Land extraction area that spreads outside of this part 27c
48 are required. After that, the control unit 46 sets the state shown in FIG.
The land extraction area 48 is expanded as shown in FIG.
Is recorded in the memory 37.
Remember. Also, the component 27c is a transistor
If it is a three-electrode component, the component 27 as shown in FIG.
c each electrode 47c, and on the outside of this part 27c
A land extraction area 48 that expands is required. this
Thereafter, the control unit 46 controls each of these as shown in FIG.
The land extraction area 48 is expanded, and the resulting run
The memory extraction area 49 is stored in the memory 37. Thereafter, the control unit 46 proceeds to step ST10.
The position and shape of the component outline frame 57 for this component 27c
As shown in FIGS. 13A and 13B,
Parts body used when cutting out the central part of 7c
The inspection area 51 is calculated and stored in the memory 37.
You. Next, the control unit 46 stores the data in the memory 37.
Color image data of the reference mounting board 24
The part body inspection area 51 is supplied to the image processing unit 39.
From this color image data, the component body inspection area 51
Color image (color image in the part body inspection area 51)
Image). Next, the control unit 46 controls the image processing unit 3
9 to supply a hue / lightness conversion command to inspect the body
Each pixel constituting the color image in the area 51 is changed in hue and brightness.
Exchange. The hue / lightness conversion formula in this case is, for example,
For example, the following equation is used. BRT (ij) = R (ij) + G (ij) + B (ij) (1) Rc (ij) = α · R (ij) / BRT (ij) (2) Gc (ij) = α G (ij) / BRT (ij) (3) Bc (ij) = αB (ij) / BRT (ij) (4) In this case, R (ij): i-th row and j-th column Picture in
R signal intensity G (ij) of element (pixel (ij)): pixel (pixel (i
j)) G signal intensity B (ij): a pixel (pixel (i
j)) B signal intensity BRT (ij): brightness of pixel (ij) α: coefficient Rc (ij): red phase Gc (ij) of pixel (ij): green phase Bc (ij) of pixel (ij) : Blue color of pixel (ij) and all pixels in the component body inspection area 51
When the hue / lightness conversion is completed, the control unit 46
Is based on the result of the hue / lightness conversion.
After the color of the pixel in the area 51 is determined, this determination result is obtained.
The fruit (body color) is stored in the memory 37. Thereafter, the control unit 46 proceeds to step ST11.
Above for all the parts 27c in this processing area.
Check whether the process described above has been completed, and
If any unfinished parts remain, this step ST
Returning to step ST7 from step 11 for the remaining parts
To execute the above-described processing. Then, the parts 27 in this processing area
creation operation of the land extraction area 49 for all of c
When the body color extraction operation is completed, the control unit 46 proceeds to step
From step ST11 to step ST12, where all
Whether the above processing has been completed for the processing area
Check that the processing area that has not finished processing is
If there is any remaining, from step ST12 to the above step
Returning to ST6, the processing described above is performed on the remaining processing areas.
Is repeatedly executed. Then, for the parts 27c in all the processing areas,
Operation of creating land extraction area 49 and extraction of body color
When the operation is completed, the control unit 46 returns from this processing loop.
Get out. After that, the control unit 46 controls the XY table unit 18.
To forward the reference mounting board 24 to the unloader 66 side.
The transfer belt mechanism 71 from the loader 65 side.
The mounting substrate 25 is supplied. Thereafter, the control unit 46 determines in step ST13
The color TV camera 34 is controlled by controlling the XY table section 18.
The first processing area of the unmounted substrate 25 below
At the same time, the graphic display area 52 on the monitor 43
The processing frame 56 showing the current processing area, and each component outline frame
57 is displayed. Thereafter, the control unit 46 controls the color TV camera 3
4 causes the first processing area of the unmounted substrate 25 to be imaged.
A / D conversion of the R, G, B color image signals obtained by
And the A / D conversion result (unmounted board 2
5 color image data) in the memory 37 in real time.
Remember. At this time, the A / D converter 36
The color image data of the unmounted board 25 is
0 and displayed on the screen. Next, control unit 46 proceeds to step ST14.
Reads the first component outline frame data from the memory 37
At the same time, this is supplied to the monitor 43, and as shown in FIG.
As shown, the part outline frame 5 corresponding to this part outline frame data
7 is displayed in green. Next, the control unit 46 reads from the memory 37.
Of the part 27c corresponding to the part outline frame data of FIG.
The land extraction area 49 and the color image data of the unmounted board 25
Data and read them out to the image processing unit 39.
The land extraction area 4 is supplied from the color image data.
9 to cut out the color image. Next, the control unit 46 controls the image processing unit 3
9, a hue / lightness conversion command is supplied to the land extraction area.
Each pixel constituting the color image in 49 is subjected to hue lightness conversion.
Red for each pixel (ij) in the land extraction area 49
Land extraction reference value C in which hue Rc (ij) is input in advance
(For example, C = 0.4 · α)
You. Thereafter, the control unit 46 proceeds to step ST15.
Is the land extraction reference value of the red phase Rc (ij) of each pixel.
If any pixel exceeds C, this pixel portion is
8b, and from step ST15 to step S15.
Branching to T16, where data on this land 28b is
The data (land data) is supplied to the monitor 40 and FIG.
The land 28b on the screen is displayed in brown as shown in
Then, as shown in FIGS. 14A and 14B, the land
28b, and the land inspection area 5 obtained by this
0 is stored in the memory 37. In step ST15, each image is
The primary red phase Rc (ij) exceeds the land extraction reference value C
If not, the control unit 46 determines that the land 28b does not exist.
From step ST15 to step ST1.
Branching to part 7, where the part outline frame data for this part
Is supplied to the monitor 43, and as shown in FIG.
The inside of the component outline frame 57 corresponding to the product outline frame data is colored red.
After the installation, the land extraction area 49 is replaced with the land inspection area 5.
0 is stored in the memory 37. Next, the control unit 46 proceeds to step ST18.
Color image of the unmounted board 25 stored in the memory 37
Image processing of the image data and the component body inspection area 51
The color image data is supplied to the
-A color image in the inspection area 51 is cut out. Next, the control unit 46 controls the image processing unit 3
9 to supply a hue / lightness conversion command to inspect the body
Each pixel constituting the color image in the area 51 is changed in hue and brightness.
In other words, the colors of the pixels in the component body inspection area 51 are changed.
After making a judgment, the result of this judgment (color when not mounted) is stored in memory.
37. After that, the control unit 46 proceeds to step ST19.
For all the part outline frame data in this processing area.
To check whether the above process has been completed.
If there is remaining component outline frame data
In this case, from step ST19 to step ST14,
Return and execute the above process for the remaining part outline frame data.
Run. Then, the contour of the part within this processing area
Land 28b detection processing for all frame data
When the color detection processing when not mounted is completed, the control unit 46
From step ST19 to step ST20, where all
Whether the above processing has been completed for all processing areas
Processing area that has not been processed yet
If there are any remaining, the above steps from step ST20 are performed.
Returning to step ST13, the remaining processing areas are described above.
Repeat the process. Then, the part outline frame data in all the processing areas
Land 28b detection processing and unreal
When the color detection process at the time of mounting is completed, the control unit 46 sets this switch.
Branching from step ST20 to step ST21, where
Each land inspection area 50 stored in the memory 37,
Day inspection area 51, body color, land 28b shape, not
Data such as colors at the time of mounting are organized for each component and inspection data
Data file and store it in table 38.
After that, the teaching operation ends. After the teaching operation is completed,
When the mode is set to the training mode, the control unit 46 executes the XY text.
The cable section 18 is reversed and the unmounted board 25 is
To the conveyor belt machine from the unloader 66 side.
The reference mounting board 24 is returned to the structure 71. Thereafter, the control unit 46 executes the test routine shown in FIG.
XY table in step ST30 of the
The color TV camera 34 by controlling the
With the arrangement of the first processing area of the semi-mounting board 24,
The current time is displayed in the graphic display area 52 on the monitor 43.
Processing indicating the processing area (in this case, the first processing area)
A frame 56 and each component outline frame 57 are displayed. Next, the control unit 46 controls the color TV camera 3
4 image the first processing area of the reference mounting board 24,
The R, G, B color image signals obtained by the
The A / D conversion is performed by the conversion unit 36, and the A / D conversion is performed.
Note the replacement result (color image data of the reference mounting board 24)
The data is stored in the real time 37 in real time. At this time, the A / D converter 36
The color image data of the reference mounting board 24 is
The data is supplied to the display unit 40 and displayed as shown in FIG. Next, the control unit 46 proceeds to step ST31.
The inspection routine 60 shown in FIG.
This processing is performed from the table 38 in step ST32 of the
Read the first part body inspection area 51 in the area
And supplies it to the monitor 43, as shown in FIG.
The component outline frame corresponding to the component body inspection area 51
After the inside of 57 is displayed in green, the part body inspection area
51 and the reference mounting board 24 stored in the memory 37
Is supplied to the image processing unit 39 and
From the color image data of the
Cut out the error image. Next, the control section 46 controls the image processing section 3
9 to supply a hue / lightness conversion command to inspect the body
Each image constituting the color image cut out by the area 51
After the element is converted to hue and lightness, the part body inspection area
The color of the pixel in 51 is determined. Thereafter, the control unit 46 proceeds to step ST33.
In the part body inspection area 51, the color of the image
Judge whether the color is the body color or the color when it is not mounted.
The color of the image in the inspection area 51 matches the color of the part body
If so, the process proceeds from step ST33 to step ST3.
4 and the part body inspection area 51 is
Check the part inspection algorithm. In this case, in the test running mode
Since the inspection algorithm for this part has not been changed,
The control unit 46 performs the processing from step ST34 to step ST3.
5 and the part 38 is inspected from the table 38 here.
Reads land inspection area 50 corresponding to inspection area 51
This is supplied to the image processing unit 39 and the memory
37, the color image data of the reference mounting board 24 is stored.
The color image data is supplied to the image
An image in the land inspection area 50 is cut out from the data. Next, the control unit 46 controls the image processing unit 3
9 to the land inspection area.
Each pixel constituting the image within 50 is subjected to hue / lightness conversion. The entire image in the land inspection area 50 is
If the above hue / lightness conversion is completed for the element,
The unit 46 determines each of the land inspection areas 50 in step ST36.
The red phase Rc (ij) for the pixel (ij) is input in advance.
Land extraction reference value C (for example, C = 0.4 · α) or less
Check whether it is above
Of the part 27c and the electrode 47c of the land 28c
Extract the part (land area) not hidden by. Thereafter, the control unit 46 determines in step ST37
BRT for each pixel (ij) in the land inspection area 50
Whether (ij) is greater than or equal to a previously input electrode extraction reference value D
Check whether the electrode 4 in the land inspection area 50
7c is extracted. Next, the control unit 46 proceeds to step ST38.
The position and shape of the land area are recorded in the table 38.
The position of the land 28b of the unmounted substrate 25
And the shape of the part 27c of the land 28c.
Calculate (estimate) the data and the part hidden by the electrode 47c.
You. After that, the control unit 46 determines in step ST39
From this calculation result, as shown in FIGS.
Indicates the positional relationship between the land 28c and the component 27c.
Area data (body and power of the part 27c of the land 28c)
Area data of the part hidden by the pole 47c), width data
Data and depth data, and
Check if the value is sufficient. In this case, component 27c is a transistor
Then, in the length direction (the X direction in FIG. 16A)
On the other hand, the electrode 47c protrudes from the land 28c.
And its width direction (Y direction in FIG. 16A)
In contrast, the electrode 47c and the land 28c
If they are, it is judged that they are sufficiently joined.
The part 27c and the land 28c are shown in FIG.
If they are in such a positional relationship, it is determined that they are
And the position relationship as shown in FIGS.
If so, it is determined that they are not sufficiently joined. If the component 27c is a resistor, its length
Direction (X direction in FIG. 17A).
The pole 47c does not protrude from the land 28c, and
In the width direction (Y direction in FIG. 17A),
The electrode 47c and the land 28c are overlapped by 2/3 or more.
Then, it is determined that they are sufficiently joined, so that the component 2
7C and the land 28c are shown in FIGS. 17 (A) and (B).
It is determined that the joint is sufficient if the positional relationship is
And the positional relationship as shown in FIGS. 17 (C) and (D).
, It is determined that they are not sufficiently joined. Then, the parts 27c are sufficiently joined.
If so, the controller 46 proceeds from step ST39 to step ST39.
Branch to step ST40, where the part 27c is
It is determined that it is implemented, and this determination result is stored in the memory 37.
To memorize. Further, in each of the steps ST33 and ST39,
The color of the image in the part body inspection area 51 is not
The color matches the color at the time of mounting, or the land 28c and the component 2
7c is not sufficient, the control unit 46
Steps ST33 and ST39 to step ST41
The process branches, and it is determined that the component 27c is defective in mounting.
Then, the determination result is stored in the memory 37. Note that step S of this inspection routine 60
The operation from T42 to ST46 will be described later in detail. Thereafter, the control unit 46 executes this inspection routine 6
0 and the steps of the test learning flowchart are completed.
Returning to step ST50, the part 2 is
7c is read out, and the component
If 27c is a mounting failure, from this step ST50
It branches to step ST51. In this step ST51, the control
The control unit 46 stores the part outline frame data related to the part 27c.
This part is supplied to a monitor 43 and is supplied to the monitor 43 as shown in FIG.
After the inside of the outline frame 57 is displayed in red, step ST52
The message is displayed on the operation procedure instruction area 53 of the monitor 43.
Corresponding to the component outline frame 57 displayed in red
The user asks whether the part 27c to be modified is a correctable part. Here, a video is displayed on the screen of the monitor 40.
Image of the part 27c displayed and the part displayed graphically
Check whether the part can be corrected while looking at the
The part 27c incorrectly registers its type and electrode direction.
Recorded or input by the teaching board 23.
Component outline frame 57 and component on reference mounting board 24
The operator determines that the outline of 27c is out of alignment, and
When the correction request key of the mode 45 is pressed, the control unit 46
The process branches from step ST52 to step ST53.
Will wait for input. Then, the operator places the reference mounting board 24
Alternatively, another reference mounting base on which the component 27c is mounted correctly.
Set the board on the XY table section 18 or change the type
The type of the component 27a is
Change direction, enlarge key, reduce key, translate key
Of the component 27c displayed on the monitor 40 by using
Of the component outline frame 57 so that the
After changing the position or shape, press the correction end key.
If this is the case, the control unit 46 responds to the
Type data and direction data for this part 27a
Data, position data, shape data, land inspection area data, etc.
Is returned to step ST31, and the part
Again, the above-described inspection of the mounting state is performed on the semiconductor device 27a.
Run. In step ST52, the monitor
Is displayed in red on the graphic display area 52 of the
Attention to the land corresponding to the part outline frame 57
The algorithm determines that the part cannot be inspected and operates
If the member presses the uncorrectable key, the control unit 46 proceeds to this step.
The process branches from step ST52 to step ST62. In this step ST62, the control
The control unit 46 is located on the operation procedure instruction area 53 of the monitor 43.
Switched from land detection mode to resist detection mode
Message and resist inspection area, threshold, etc.
And a message telling you to set
The operator is requested to input a resist inspection area and the like. Here, a video table is displayed on the screen of the monitor 40.
The image of the part 27c shown and the graphic display
Enlarge key, reduce key, parallel while looking at the part outline frame 57
18A and 18B, the operator uses the movement keys and the like.
If the resist inspection area 58 is set as described above, the control unit 46
Stores the resist inspection area 58 in the table 38.
After that, on the XY table section 18 in step ST63
Check whether the reference mounting board 24 is set.
Click. In this case, on the XY table section 18,
Since the reference mounting board 24 has already been set, the control unit 4
6 is a feature extraction routine 6 shown in FIG.
1 and calls ST in this feature extraction routine 61.
64 controls the XY table section 18 to control the color TV camera.
The resist inspection area 58 is set below the frame 34.
The processing area including the component 27a (in this case, the first processing area
A) and the graphic on the monitor 43
Frame 56 indicating the current processing area in the mark display area 52
Is displayed. Next, the control unit 46 controls the color TV camera 3
4 images the processing area of the reference mounting board 24,
The R, G, B color image signals obtained by the
The A / D conversion is performed by the conversion unit 36, and the A / D conversion is performed.
Note the replacement result (color image data of the reference mounting board 24)
The data is stored in the real time 37 in real time. At this time, the A / D converter 36
The color image data of the reference mounting board 24 is
It is supplied to and displayed at 40. Next, the control unit 46 proceeds to step ST65.
Cash register relating to the component 27c stored in the table 38
And the reference stored in the memory 37.
The color image data of the mounting board 24 and the image processing unit 39
Transfer the color image data to the resist inspection area.
The color image of the area 58 is cut out. Then, control unit 46 proceeds to step ST66.
And supplies a hue / lightness conversion command to this image processing unit 39.
Color image cut out by the resist inspection area 58
Each pixel constituting the image is converted into a hue / brightness value.
In step ST67, based on the result of the hue / lightness conversion, the resist
While determining the color of each pixel in the inspection area 58,
From this determination result, the resist inspection area at the time of component mounting
Color (resist color) and shape of resist part in 58
Is obtained and stored in the table 38. Thereafter, the control unit 46 sets the test run
Returning to step ST68 of the flowchart, the XY text
The cable section 18 is rotated forward and the reference mounting board 24 is unloaded.
Conveyor belt machine from the loader 65 side
The unmounted substrate 25 is supplied to the structure 71. Thereafter, the control unit 46 sets the feature extraction rule.
When the chin 61 is executed again and no components are mounted
Of the resist portion in the resist inspection area 58 at
And the shape were obtained and stored in the table 38.
Thereafter, the process returns to step ST30. Then, in step ST30, the control
The control unit 46 includes the reference mounting board 24 on the XY table 32.
Wait until it is loaded, and when this is loaded, X-
It controls the Y table section 18 and the color TV camera 34
The part 27c in which the lever inspection area 58 is set is
The processing area (in this case, the first processing area) is imaged.
Then, the color image data of this processing area is stored in the memory 37.
In real time. The color of the processing area obtained at this time is
The image is supplied to the monitor 40 and displayed. Next, control unit 46 proceeds to step ST31.
The inspection routine 60 is executed.
Since the resist inspection mode is set,
The color of the image in the part body inspection area 51 and the teach
If the color of the part body obtained at the time of
When step ST34 of the inspection routine 60 is executed
It is determined that the inspection algorithm has been changed,
The process branches from step ST34 to step ST42.
You. Then, in this step ST42,
The control unit 46 determines the part body inspection area from the table 38.
The resist inspection area 58 corresponding to the area 51 is read,
This is supplied to the image processing unit 39 and the memory 37
Image data of the reference mounting board 24 stored in
Is supplied to the image processing unit 39, and the color image data
Then, a color image of the resist inspection area 58 is cut out. Next, control unit 46 proceeds to step ST43.
And supplies a hue / lightness conversion command to this image processing unit 39.
Each pixel constituting the image of the resist inspection area 58 is colored.
After the brightness conversion, each image after the hue brightness conversion
The part corresponding to the resist color in the element (ij) is registered.
Extracted as a part. Next, control unit 46 proceeds to step ST44.
And the shape of this resist portion and stored in the table 38
Compared with the resist shape at the time of unmounted parts
Of the resist portion, the body of the component 27a and the electrode 47c
The shape of the part that is not hidden by
Is obtained in step ST45.
At the time of component mounting stored in the table 38
Compared with the resist shape, these differences are acceptable.
Check if it is in the enclosure. Then, these differences are within an allowable range.
If there is, the controller 46 proceeds from step ST45 to step ST45.
The process branches to step ST40 where the resist inspection area 5
It is determined that the component 27c corresponding to No. 8 is mounted favorably
Then, the determination result is stored in the memory 37. The resist shape and the table 38
With the resist shape at the time of component mounting stored in
If the difference is not within the allowable range, the control unit 46
The process branches from step ST45 to step ST46.
And the component 27c corresponding to the resist inspection area 58 is good.
Judgment that it is not implemented well,
In the memory 37. Thereafter, the control unit 46 checks the inspection routine 6
0 and the steps of the test learning flowchart are completed.
Returning to step ST50, the part 2 is
7c is read out, and the component
If 27c is a mounting failure, from this step ST50
Step ST51 is sequentially performed through steps ST51 and ST52.
The process branches to 62, where the above-described operation is executed again to execute
After resetting the dying inspection area 58 and the like,
The quality of the resist inspection area 58 is determined by repeating the operation.
I do. In step ST50, the part
If it is determined that 27c is correctly mounted, the control unit
46 is a division from step ST50 to step ST54.
Branch, where all parts 2 in this first processing area
7c is checked to determine whether the above-described processing has been completed.
If there are still unprocessed parts,
Returning to step ST31, the remaining parts 27c are
To execute the above-described processing. Then, the remaining part in the first processing area
When the above-described processing is completed for all the products 27c,
The control unit 46 performs steps ST54 to ST55.
And the above processing is performed for all the processing areas.
Check whether the process has been completed.
If no processing area remains, the process proceeds to step ST30.
And execute the above processing for the remaining processing area
I do. The parts 27c in all the processing areas are
After the above-described processing is completed, the monitor is displayed as shown in FIG.
All displayed in the graphic display area 52 of the
If the part outline frame 57 is not painted in red,
The control unit 46 exits this loop and executes the XY table unit.
18 to rotate the reference mounting board 24 to the unloader 66 side
To the transport belt mechanism 71 from the loader 65 side.
Is supplied with the unmounted substrate 25. After that, the control unit 46 determines in step ST56.
The color TV camera 34 is controlled by controlling the XY table section 18.
The first processing area of the unmounted substrate 25 below the
At the same time, the graphic display area 52 on the monitor 43
Shows the current processing area (in this case, the first processing area)
A processing frame 56 is displayed. Next, the control unit 46 controls the color TV camera 3
4 causes the first processing area of the unmounted substrate 25 to be imaged.
A / D conversion of the R, G, B color image signals obtained by
A / D conversion is performed by the conversion unit 36, and the A / D conversion is performed.
The result (color image data of the unmounted board 25) is stored in the memory 3
7 is stored in real time. At this time, the A / D converter 36 obtains
The color image data of the unmounted board 25 is
0 and is displayed as shown in FIG. Next, the control unit 46 proceeds to step ST57.
The inspection routine 60 is executed, and the
After the mounting status of the first component is determined,
At step ST58, it is checked whether or not this component is defective.
Click. Then, this component is correctly mounted.
If it is determined that the part is
Judging that the inspection algorithm is incorrect, this step
From step ST58 to step ST61, where
Supplying the component outline frame data related to the component to the monitor 43
The inside of the part outline frame 57 corresponding to this part is displayed in red.
You. Thereafter, control unit 46 proceeds to step ST62.
~ ST68 to execute the optimal resist for this part
In addition to setting the inspection area 58 and thresholds,
Resist shape and the like at the time of component mounting
And its color, and the resist shape and its
The colors were extracted and stored in the table 38.
Thereafter, the process returns to step ST30. Then, in steps ST30 to ST55,
, The control unit 46 is a unit on the reference mounting board 24
Of the product 27c, corresponding to the resist inspection area 58.
Check whether the component is determined to be good. Then, it is determined that the component 27c is good in mounting.
If so, the control unit 46 performs step ST56 and step ST56.
In step ST57, the resist inspection is performed on the unmounted substrate 25.
After inspecting the mounting state of the component corresponding to the inspection area 58,
Whether this component is determined to be defective in step ST58
Check if. Here, this component is correctly mounted.
Is determined, the control unit 46 proceeds to step ST58.
Branch to step ST62 via step ST61
Then, the operation described above is executed again in step ST62.
And reset the resist inspection area 58 and threshold
Thereafter, the above-described operation is repeated to repeat the resist inspection area 5.
8 is determined. In step ST58, the aforementioned
The component corresponding to the resist inspection area 58 is determined to be defective in mounting.
Then, the control unit 46 proceeds from step ST58 to step ST58.
The process branches to step ST59 where the first processing area
Check if the above process has been completed for all parts
Check that there are still unprocessed parts
If so, the process returns to step ST57, and the remaining parts are
To execute the above-described processing. Then, the first processing is performed as shown in FIG.
Processing described above for all remaining parts in the area
Is completed, the control unit 46 proceeds from step ST59.
Branching to step ST60, for all processing areas
Check if the above process has been completed, and if
If there is a processing area that has not been processed yet,
Returning to step ST56, the remaining processing area is described above.
Execute the executed processing. Then, all parts in all processing areas are described above.
Is completed and the graphic display area on the monitor 43 is
A) The inside of all the component outline frames 57 displayed on the
If so, the control unit 46 executes this test running
End the operation. After the teaching operation is completed, an inspection is performed.
When the mode is set, the control unit 46 performs the detection shown in FIG.
On the monitor 43 in step ST70 of the inspection flowchart
A message requesting the board name of the mounting board 26 to be inspected
Display. Then, the name of this board is input from the keyboard 45.
Is input, the control unit 46 displays on the XY table unit 18
Wait until the board 26 to be inspected is placed on the board. Thereafter, the inspection target is displayed on the XY table section 18.
If the mounting board 26 is placed, the control unit 46 proceeds to step S
At T71, the XY table unit 18 is controlled to control the color TV camera.
The first processing area of the mounting board 26 under inspection below the camera 34
And the graphic table on the monitor 43
The current processing area (in this case, the first processing
Area), a processing frame 56 indicating each area and each component outline frame 57 are displayed.
Let it. Next, the control unit 46 controls the color TV camera 3
4 causes the first processing area of the mounting board 26 to be inspected to be imaged,
The obtained R, G, B color image signals are converted to A /
The A / D conversion is performed by the D / D converter 36 and the A / D conversion is performed.
The conversion result (color image data of the mounting board 26 to be inspected)
It is stored in the memory 37 in real time. Next, the control unit 46 proceeds to step ST72.
The inspection routine 60 is executed, and the
The mounting state of the first component 27d was determined.
Later, in step ST73, this component 27d is correctly mounted.
Check if this is a mounting failure.
If so, the process branches from step ST73 to step ST74.
Then, the fact that the component 27d is defective is indicated in the table.
38, or displayed on the monitor 43.
Or the component outline frame 57 of the component is displayed in red. In step ST73, the part
If it is determined that 27d is correctly mounted, the control unit
The step 46 performs the step ST74. Thereafter, control unit 46 proceeds to step ST75.
Above all parts 27d in the first processing area.
Checks whether the processing described has been completed,
If there are any components that have not been processed, the above-described step S
Returning to T72, the processing described above for the remaining part 27d
Execute Then, the remaining parts in the first processing area
When the above-described processing is completed for all the products 27d,
The control unit 46 performs steps ST75 to ST76.
And the above processing is completed for all the processing areas.
Check whether the process has been completed.
If there is any remaining processing area, the process proceeds to step ST71.
Return and execute the above processing for the remaining processing area.
You. Then, all parts in all processing areas are
When the processing described above is completed, the control unit 46
The process branches from ST76 to step ST77, where the monitor is performed.
43 is displayed on the graphic display area 52.
Keep the image as it is, and
44 to the component outline frame of each component 27d as shown in FIG.
57, and a defective mounting component among these component outline frames 57.
Provided so as to surround the component outline frame 57 corresponding to
After outputting the paper with “0” symbol printed,
End the operation. As described above, in this embodiment, each
The part outline frame 57 of the part 27d and the position of the defective part are shown.
Red (or “0” sign)
Characters, so that the position of defective parts can be
It can be intuitively recognized. In the above-described embodiment, each part
Component outline frame 57 of the product 27d and each of these component outline frames 57
Out of the component outline frame 57 corresponding to the defective component
Output the paper on which the "0" symbol is printed.
However, as shown in FIG.
The number may be displayed or printed. In the above-described embodiment, the test
The land 28d of the mounting board 26 is different for each board.
The components are mounted within the allowable range on the land 28d.
If it is, it can be determined that the implementation is good.
It is possible to prevent erroneous determinations caused by plate processing errors.
Automatically adjusts the optimal amount of misalignment for each part
Can be set manually. In the above-described embodiment, the tee
Input the type of parts manually
However, from the image input using the reference mounting board etc.
Detects a land that can be connected to the component, and from this land
The type of the component may be automatically input. As explained above, according to the present invention, the
Image of the teaching board, reference mounted board or unmounted board
The inspection data file is obtained from the image obtained by this imaging.
File, and based on this inspection data file,
Inspection Checks the mounting state of the mounted components on the mounting board, and
In the mounting board inspection result output method of outputting the inspection result,
The mounting substrate of each component mounted on the inspection mounting substrate
The position on the top and the shape of the part are viewed on a two-dimensional plane
Data on graphic images that can be distinguished visually
Is stored in the graphic image storage means.
The inspection result is stored in the inspection result storage means,
Graphic stored in the graphic image storage means.
Data relating to a fixed image and the inspection result memory
Based on the inspection results stored in the column,
Which part of the graphic image is
Output images so that they can be visually identified.
From the above, the parts to be inspected
In other words, components that are determined to be defective
To visually identify which part is on the page
Makes operators intuitively recognize the position of defective parts
be able to.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing an embodiment of a mounting board inspection apparatus according to the present invention. FIG. 2 is a plan view of an XY table unit according to the embodiment. 3A is a cross-sectional view for explaining the transport belt mechanism of FIG. 2, and FIG. 3B is a perspective view for explaining the transport belt mechanism of FIG. FIG. 4 is a flowchart showing an operation example of the embodiment. FIG. 5 is a flowchart showing an operation example of the embodiment.
is there. FIG. 6 is a flowchart showing an operation example of the embodiment. FIG. 7 is a flowchart showing an operation example of the embodiment. FIG. 8 is a flowchart showing an operation example of the embodiment. FIGS. 9A to 9E are schematic diagrams each showing a display example of one monitor in the embodiment. FIGS. 10A to 10F are schematic diagrams each showing a display example of the other monitor in the embodiment. FIGS. 11A and 11B are schematic diagrams each showing a land extraction area for each component of the embodiment. FIGS. 12A and 12B are schematic diagrams each showing an example of an enlarged land extraction region for each component of the embodiment. FIGS. 13A and 13B are schematic diagrams each showing an example of a component body inspection area for each component of the embodiment. FIGS. 14A and 14B are schematic diagrams each showing an example of a land inspection area for each component of the embodiment. FIGS. 15A and 15B are schematic diagrams for explaining a determination operation for a positional relationship between a component and a land in the embodiment. FIGS. 16A to 16C are schematic diagrams for explaining a determination example of the embodiment. FIGS. 17A to 17D are schematic diagrams each illustrating a determination example according to the embodiment; FIGS. FIGS. 18A and 18B are schematic diagrams each showing an example of a resist inspection area for each component of the embodiment. FIG. 19 is a schematic diagram showing a print example of the embodiment. FIG. 20 is a schematic diagram showing another printing example used in the embodiment. FIG. 21 is a block diagram illustrating an example of a conventional mounting board inspection apparatus. [Description of Signs] 20 Imaging unit 26 Mounting substrate (substrate to be inspected) 27d Component 37 Memory (graphic image storage unit, inspection result storage unit) 43 Monitor (display unit) 44 Printer (output unit) 46 Control unit (determination unit) )

Continuation of the front page (58) Field surveyed (Int.Cl. ⁶ , DB name) H04N 7/18 G01N 21/88 H01L 21/66 H05K 13/08

Claims (1)

(57) [Claims] Image the teaching board, reference mounting board or unmounted board, create an inspection data file from the image obtained by this imaging, and inspect the mounting state of the mounted components on the board to be inspected based on this inspection data file. And
In the mounting board inspection result output method for outputting the inspection result, the position of each component mounted on the mounting board to be inspected on the mounting inspection board and the shape of the component are visually determined on a two-dimensional plane. In addition to storing data relating to a graphic image that can be stored in a graphic image storage unit, storing the inspection result in an inspection storage unit, and storing data relating to a graphic image stored in the graphic image storage unit and the inspection result storage unit. A method of outputting a mounted board inspection result, wherein the image output is performed so as to visually identify which of the graphic images the component determined as a mounting defect is based on the inspection result obtained.