TW202208831A - Centralized defect reviewing system and method - Google Patents
Centralized defect reviewing system and method Download PDFInfo
- Publication number
- TW202208831A TW202208831A TW109128610A TW109128610A TW202208831A TW 202208831 A TW202208831 A TW 202208831A TW 109128610 A TW109128610 A TW 109128610A TW 109128610 A TW109128610 A TW 109128610A TW 202208831 A TW202208831 A TW 202208831A
- Authority
- TW
- Taiwan
- Prior art keywords
- image
- inspection
- defect
- centralized
- judgment
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8803—Visual inspection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
- G01N2021/8854—Grading and classifying of flaws
Landscapes
- Chemical & Material Sciences (AREA)
- Pathology (AREA)
- Analytical Chemistry (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biochemistry (AREA)
- Immunology (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
Abstract
Description
本發明有關於一種集中式複判系統及方法,特別是指一種用於瑕疵檢測的集中式複判系統及方法。The present invention relates to a centralized re-judgment system and method, in particular to a centralized re-judgment system and method for defect detection.
自動光學檢查(Automated Optical Inspection, AOI),係運用機器視覺做為檢測標準技術,透過機器視覺取代傳統人眼辨識以達到高精密度及高效率的檢測,作為改良傳統上以人力使用光學儀器進行檢測的缺點,應用層面包括從高科技產業之研發、製造品管、國防、民生、醫療、環保、電力等領域。Automated Optical Inspection (AOI), which uses machine vision as the standard inspection technology, replaces traditional human eye recognition through machine vision to achieve high-precision and high-efficiency inspection. Detection of shortcomings, the application level includes high-tech industry research and development, manufacturing quality control, national defense, people's livelihood, medical care, environmental protection, power and other fields.
一般透過機器視覺檢查,比起人眼檢測可以大幅度地增加檢測的效率,然而,機器視覺仍然經常會發生誤檢或誤判的情事。舉例而言,於面板表面上的毛髮、灰塵經常會被誤判為面板上的刮痕或是噪點,因為在形態上與面板的瑕疵相當接近。基於上面的原因,為了降低誤檢、誤判的機率,並提升產品的良率及產能,待測物被檢出的瑕疵一般要再透過人眼進行一次複檢,透過人眼再次確認待測物的瑕疵,以減少誤宰(overkill)的可能性。Generally, through machine vision inspection, the detection efficiency can be greatly increased compared with human eye detection. However, machine vision still often causes false detection or misjudgment. For example, hair and dust on the surface of the panel are often misidentified as scratches or noise on the panel, because the shape is quite similar to the defects of the panel. Based on the above reasons, in order to reduce the probability of false detection and misjudgment, and improve the product yield and productivity, the detected defects of the object to be tested are generally re-inspected through the human eye, and the object to be tested is re-confirmed through the human eye. defects to reduce the possibility of overkill.
現行的光學檢測設備(包括用於半導體、電路板(Printed Circuit Board, PCB)、面板等各段製程中的光學檢測設備)都有搭配所謂的「複檢設備」,其目的是將檢測出來的缺陷影像,經由另一獨立的顯示裝置(複判顯示裝置)顯示給人員針對已檢出、或未檢出的缺陷進行重複檢查,作為複判之用。Existing optical inspection equipment (including optical inspection equipment used in semiconductors, printed circuit boards (PCB), panels, etc.) is equipped with so-called "re-inspection equipment", the purpose of which is to detect The defect image is displayed to the personnel through another independent display device (re-judgment display device) for repeated inspection of detected or undetected defects for the purpose of re-judgment.
然而,為了提升自動光學檢測的檢測效率,在同一個產線上進行自動光學檢測的檢測設備可能設置為複數個,在這樣的配置下,每一個檢測設備支線都必須要由獨立的目檢人員經由複檢設備進行檢測,例如在設置有三個自動光學檢測設備的情況下,至少也必須要配置三個目檢人員配合三個複檢站台個別進行目檢複判,隨著人力費用的提高,傳統一人一機式的影像複判方法,對人力成本的耗費過高,無形中增加了勞動成本,因此有必要尋求降低成本的方法。However, in order to improve the inspection efficiency of automatic optical inspection, there may be a plurality of inspection equipment for automatic optical inspection on the same production line. Under such a configuration, each branch line of inspection equipment must be passed by an independent visual inspector Re-inspection equipment is used for inspection. For example, in the case of three automatic optical inspection equipment, at least three visual inspection personnel must be arranged to cooperate with three re-inspection stations to individually conduct visual inspection and re-judgment. With the increase of labor costs, traditional The one-person-one-machine-type image rejudgment method consumes too much labor costs and increases labor costs virtually, so it is necessary to seek ways to reduce costs.
本發明的主要目的,在於提供一種集中式複判系統,包括複數個影像重製裝置、一傳輸網路、以及一複判平台。該影像重製裝置個別地對應配置於複數個複檢設備終端上,其中任一個該影像重製裝置對應地自任一個該複檢設備終端上,以獲取瑕疵位置影像。該傳輸網路係配置用於複數個該影像重製裝置的通信,以傳輸該瑕疵位置影像。該複判平台耦合至該傳輸網路,接收並分析自複數個該影像重製裝置所傳送的該瑕疵位置影像,以產生一影像複檢結果。The main purpose of the present invention is to provide a centralized re-judgment system, including a plurality of image reproduction devices, a transmission network, and a re-judgment platform. The image reproducing apparatuses are individually and correspondingly disposed on a plurality of re-inspection equipment terminals, and any one of the image reproducing apparatuses is correspondingly obtained from any of the re-inspection equipment terminals to acquire a defect position image. The transmission network is configured for communication of a plurality of the image reproduction devices to transmit the defect location image. The re-judgment platform is coupled to the transmission network, and receives and analyzes the defect position images transmitted from the plurality of image reproduction devices to generate an image re-inspection result.
本發明的另一目的,在於提供一種集中式複判方法,包括:自複檢設備終端,對應地獲取瑕疵位置影像至影像重製裝置;透過傳輸網路,複數個該影像重製裝置個別地傳輸該瑕疵位置影像至一複判平台;以及於該複判平台,接收並分析自複數個該影像重製裝置所傳送的該瑕疵位置影像,以產生一影像複檢結果。Another object of the present invention is to provide a centralized re-judgment method, comprising: a self-re-inspection equipment terminal, correspondingly acquiring images of defect positions to an image reproduction device; through a transmission network, a plurality of the image reproduction devices individually transmitting the image of the defect position to a re-judgment platform; and receiving and analyzing the image of the defect position transmitted from the plurality of image reproducing devices on the re-judgment platform to generate an image re-inspection result.
本發明可以將多個複檢設備終端的複檢結果集中提供至複判平台由目檢人員進行複檢,有效的減少非必要的勞動成本並提升檢測的效率。The present invention can centrally provide the re-inspection results of multiple re-inspection equipment terminals to the re-judgment platform for re-inspection by visual inspection personnel, effectively reducing unnecessary labor costs and improving inspection efficiency.
本發明可以改善傳統程序需要大量人工執行複檢的缺失,尤其是可以解決檢測軟體能力不足或是製程變更時所造成大量過檢、誤判時所產生人力負荷過重的問題,透過本發明可以提升複檢設備終端的檢測效率及精確度,並可以大幅縮減人員的工作負擔。The present invention can improve the defect that a large number of manual rechecks are required in traditional procedures, and especially can solve the problem of insufficient detection software capability or a large number of overchecks and misjudgments caused by process changes. The detection efficiency and accuracy of the inspection equipment terminal can be greatly reduced, and the workload of personnel can be greatly reduced.
有關本發明之詳細說明及技術內容,現就配合圖式說明如下。再者,本發明中之圖式,為說明方便,其比例未必照實際比例繪製,該等圖式及其比例並非用以限制本發明之範圍,在此先行敘明。The detailed description and technical content of the present invention are described below with reference to the drawings. Furthermore, the drawings in the present invention are not necessarily drawn according to the actual scale for the convenience of description. These drawings and their scales are not intended to limit the scope of the present invention, and are described here in advance.
以下針對本發明舉一較佳實施例進行說明,請先參閱「圖1」,係為本發明集中式複判系統其中一實施例的方塊示意圖,如圖所示:The following describes a preferred embodiment of the present invention. Please refer to FIG. 1 first, which is a block diagram of one embodiment of the centralized rejudgment system of the present invention, as shown in the figure:
本實施例揭示一種集中式複判系統100,用以配合複數個檢測線、-上的自動光學檢測設備、-及其複檢設備終端、-設置。該集中式複判系統100包括複數個影像重製裝置、-、傳輸網路TN、以及複判平台RP。該影像重製裝置、-個別地對應配置於複數個複檢設備終端、-上,其中任一個該影像重製裝置、-對應地自任一個該複檢設備終端、-上,以獲取瑕疵位置影像。該傳輸網路TN係配置用於複數個該影像重製裝置、-的通信,以傳輸該瑕疵位置影像。該複判平台RP耦合至該傳輸網路TN,接收並分析自複數個該影像重製裝置、-所傳送的該瑕疵位置影像,以產生一影像複檢結果。This embodiment discloses a
本實施例係基於一人一機式的複檢設備終端、-,經由影像重製裝置、-獲取複檢設備終端、-的瑕疵位置影像,傳送至集中複判的複判平台RP,以經由目檢人員基於瑕疵位置影像以及影像複檢結果進行複判。This embodiment is based on a one-person-one-machine type re-inspection equipment terminal , - , via a video reproduction device , - Get the re-inspection equipment terminal , - The image of the defect location is transmitted to the re-evaluation platform RP for centralized re-evaluation for re-evaluation by visual inspectors based on the image of the defect location and the image re-inspection results.
所述的傳輸網路TN可以包括有線/無線傳輸網路,配置用於複數個該影像重製裝置、-與該複判平台RP的通信。具體而言,該傳輸網路TN可以使用藍芽傳輸、USB傳輸、HDMI傳輸、ZigBee傳輸、行動通訊傳輸、乙太網路傳輸、WIFI傳輸或其他類此的通訊協定,於本發明中不予以限制。The transmission network TN may include a wired/wireless transmission network configured for a plurality of the image reproduction devices , - Communication with the retrial platform RP. Specifically, the transmission network TN can use Bluetooth transmission, USB transmission, HDMI transmission, ZigBee transmission, mobile communication transmission, Ethernet transmission, WIFI transmission or other such communication protocols, which are not included in the present invention. limit.
所述的複判平台RP經由有線/無線傳輸網路(傳輸網路TN)同時連接至複數個該影像重製裝置、-,該複判平台RP將複數個該影像重製裝置、-所獲得到的該瑕疵位置影像及該影像複檢結果顯示於螢幕上供人員檢閱複判。The re-judgment platform RP is simultaneously connected to a plurality of the image reproduction apparatuses via a wired/wireless transmission network (transmission network TN) , - , the re-judgment platform RP will put a plurality of the image reproduction devices , - The obtained image of the defect position and the re-inspection result of the image are displayed on the screen for personnel to review and re-evaluate.
於一實施例中,該複判平台RP可以包括單一或複數個電腦、伺服器、工作站等或其他類此的裝置,於本發明中不予以限制。於另一實施例中,該複判平台RP可以是可攜式電子產品,例如手機、平板、筆記型電腦或其他智慧型電子產品,於本發明中不予以限制。In one embodiment, the re-judgment platform RP may include a single or a plurality of computers, servers, workstations, etc., or other such devices, which are not limited in the present invention. In another embodiment, the rejudgment platform RP may be a portable electronic product, such as a mobile phone, a tablet, a notebook computer or other smart electronic products, which is not limited in the present invention.
請一併參閱「圖2」,係為本發明中複判平台的方塊示意圖,如圖所示:Please also refer to "Figure 2", which is a block diagram of the rejudgment platform in the present invention, as shown in the figure:
於一實施例中,該複判平台RP包括一通訊裝置RP1、一儲存裝置RP2、一判定裝置RP3、一調閱裝置RP4以及一結果呈現裝置RP5。該通訊裝置RP1係用以連接至該傳輸網路TN,用以經由該傳輸網路TN耦接至該複數個影像重製裝置、-及複檢設備終端、-;具體而言,該通訊裝置RP1可以為任意的有線或無線通訊介面,例如網路卡、路由器、無線WiFi收發器或上述裝置的組合或其他類似的裝置,於本發明中不予以限制。該儲存裝置RP2用以儲存複數個該影像重製裝置、-所傳送的該瑕疵位置影像;具體而言,該儲存裝置RP2可以為記錄資料的資料庫,例如硬碟、網路硬碟、電腦、伺服器等或其他類此的裝置,於本發明中不予以限制。該判定裝置RP3連接至該儲存裝置RP2,用以影像分析該瑕疵位置影像,產生該影像複檢結果;具體而言,該判定裝置RP3可以為任意安裝有影像處理軟體的電腦、伺服器、或是載入記錄媒體後執行程序的影像處理晶片,於本發明中不予以限制。該調閱裝置RP4提供操作介面及介面索引至該結果呈現裝置RP5(例如螢幕),供使用者調閱檢測的結果或瑕疵資訊。其中,上述複判平台RP的所有裝置可以共同構成一電腦或伺服器、或是由複數個電腦或伺服器協同執行,於本發明中不予以限制。In one embodiment, the re-judgment platform RP includes a communication device RP1, a storage device RP2, a judgment device RP3, a retrieval device RP4, and a result presentation device RP5. The communication device RP1 is used for connecting to the transmission network TN for coupling to the plurality of image reproduction devices via the transmission network TN , - and recheck equipment terminal , - Specifically, the communication device RP1 can be any wired or wireless communication interface, such as a network card, a router, a wireless WiFi transceiver or a combination of the above devices or other similar devices, which are not limited in the present invention. The storage device RP2 is used for storing a plurality of the image reproduction devices , - The transmitted image of the defect position; specifically, the storage device RP2 can be a database for recording data, such as a hard disk, a network hard disk, a computer, a server, etc., or other such devices, which are not included in the present invention. be restricted. The judging device RP3 is connected to the storage device RP2 for image analysis of the defect position image to generate the image re-examination result; specifically, the judging device RP3 can be any computer, server, or It is an image processing chip that executes a program after being loaded into a recording medium, which is not limited in the present invention. The retrieval device RP4 provides an operation interface and an interface index to the result presentation device RP5 (eg, a screen) for the user to retrieve the detected results or defect information. Wherein, all the devices of the above-mentioned rejudgment platform RP may jointly constitute a computer or server, or be executed by a plurality of computers or servers, which is not limited in the present invention.
該複判平台RP可以供具備權限的該複檢設備終端、-(或其他任意具備權限的電子產品)經由該傳輸網路TN調閱檢查結果,例如自動光學檢測設備、-的檢測結果、複檢設備終端、-的瑕疵位置影像以及影像複檢結果、以及該複判平台RP複判或目檢人員複判之後的結果。The re-examination platform RP can be used for the re-examination equipment terminal that has the authority , - (or any other authorized electronic product) to access inspection results via the transmission network TN, such as automatic optical inspection equipment , - test results, re-test equipment terminals , - The image of the defect position and the image re-inspection result, as well as the re-evaluation result of the re-evaluation platform RP or the re-evaluation of the visual inspection personnel.
於一實施例中,該判定裝置RP3包括一瑕疵複檢裝置M1及/或一類別複檢裝置M2,該瑕疵複檢裝置M1根據該瑕疵位置影像,判斷待測物是否包括缺陷;該類別複檢裝置M2根據該瑕疵位置影像,分類該待測物的缺陷類型,以產生該影像複檢結果。其中,該瑕疵複檢裝置M1判斷該待測物是否包括缺陷,可以透過傳統影像演算法(例如高斯、傅立葉、二值化、影像相減、型態分析),確認影像中是否包括缺陷,該瑕疵複檢裝置M1亦可以透過機器學習、深度學習等利用類神經網絡進行瑕疵種類的辨識及定位,於本發明中不予以限制。同樣的,該類別複檢裝置M2可以透過傳統演算法,經由邊緣檢測及灰階檢測分析缺陷的型態,確認缺陷的種類,該類別複檢裝置M2亦可以透過機器學習、深度學習等利用類神經網絡進行瑕疵種類的辨識及定位,於本發明中不予以限制。In one embodiment, the determination device RP3 includes a defect re-inspection device M1 and/or a class re-inspection device M2, and the defect re-inspection device M1 determines whether the object to be tested includes a defect according to the image of the defect position; The inspection device M2 classifies the defect type of the object to be tested according to the image of the defect position, so as to generate the image re-inspection result. Wherein, the defect re-inspection device M1 determines whether the object to be tested contains defects, and can use traditional image algorithms (such as Gaussian, Fourier, binarization, image subtraction, morphological analysis) to confirm whether the image contains defects. The defect re-inspection device M1 can also use a neural network-like network to identify and locate defect types through machine learning, deep learning, etc., which is not limited in the present invention. Similarly, the type re-inspection device M2 can analyze the type of defects through traditional algorithms, edge detection and gray-scale detection, and confirm the type of defects. The type re-inspection device M2 can also use machine learning, deep learning, etc. The neural network can identify and locate defect types, which is not limited in the present invention.
於其中一可行的實施例中,該集中式複判系統100的複判平台RP可以提供遠端調閱功能。於所述實施例中,該集中式複判系統100包括複數個影像重製裝置、-,共同連接至該傳輸網路TN,並透過傳輸網路TN連接至遠端的複判平台RP,用以統一集中儲存影像重製裝置、-的瑕疵位置影像及該瑕疵位置影像的相關資訊(例如待測物編號、複檢設備終端、-的影像複檢結果等),並依據該等資訊設置索引並建立資料庫,複數個第三方裝置TH(例如電腦、筆記型電腦、行動裝置等)藉由傳輸網路TN連接到該複判平台RP,以經由該複判平台RP的調閱裝置RP4存取瑕疵位置影像的相關資訊。In one possible embodiment, the retrial platform RP of the centralized
以下針對自動光學檢測設備、複檢設備終端、與影像重製裝置的配置關係以具體實施例進行說明,請一併參閱「圖3」、及「圖4」,係為本發明中集中式複判系統的方塊示意圖(一)、以及方塊示意圖(二),如圖所示:The following describes the configuration relationship between the automatic optical inspection equipment, the re-inspection equipment terminal, and the image reproduction device with specific embodiments. Please refer to "Fig. 3" and "Fig. 4" together. The block diagram (1) and the block diagram (2) of the evaluation system, as shown in the figure:
本實施例中,於單一檢測支線上主要包括自動光學檢測設備A、複檢設備終端R、以及配合該複檢設備終端R設置的影像重製裝置AT。In this embodiment, a single detection branch line mainly includes an automatic optical detection device A, a re-inspection device terminal R, and an image reproducing device AT set in cooperation with the re-inspection device terminal R.
所述的自動光學檢測設備A用以檢測待測物H的缺陷,並記錄該待測物H的缺陷位置及缺陷種類。該自動光學檢測設備A可以為現行任意的自動光學檢測設備(Automated Optical Inspection, AOI),用以透過機器視覺的方式,對待測物H進行影像分析以擷取出可能的缺陷及並分析缺陷種類。其中,該自動光學檢測設備A分析缺陷的方式,可以透過傳統影像演算法(例如高斯、傅立葉、二值化、影像相減、型態分析)獲得缺陷位置及缺陷種類、或是透過機器學習、深度學習等利用類神經網絡進行缺陷的辨識及定位,於本發明中不予以限制。The automatic optical inspection equipment A is used to detect the defects of the object to be tested H, and to record the defect position and the type of the defects of the object to be tested H. The automatic optical inspection equipment A can be any existing automatic optical inspection equipment (Automated Optical Inspection, AOI), which is used for image analysis of the object H to be tested by means of machine vision to capture possible defects and analyze the types of defects. Among them, the automatic optical inspection equipment A can analyze defects through traditional image algorithms (such as Gaussian, Fourier, binarization, image subtraction, morphological analysis) to obtain defect positions and defect types, or through machine learning, Deep learning and the like use neural networks to identify and locate defects, which are not limited in the present invention.
所述的複檢設備終端R設置於該自動光學檢測設備A的後端,用以接收由該自動光學檢測設備A輸出並被歸類為瑕疵品的待測物H。該複檢設備終端R依據該自動光學檢測設備A提供的缺陷位置及缺陷種類進行複檢,藉以進一步確認是否有誤判的情況,透過複判的程序減少待測物H的誤宰率(Overkill),進一步提高產線的良率。The re-inspection equipment terminal R is disposed at the rear end of the automatic optical inspection equipment A, and is used for receiving the test object H output by the automatic optical inspection equipment A and classified as a defective product. The re-inspection equipment terminal R performs re-inspection according to the defect position and defect type provided by the automatic optical inspection equipment A, so as to further confirm whether there is a misjudgment, and reduce the overkill rate of the object to be tested H through the re-judgment process. , to further improve the yield of the production line.
有關於複檢設備終端R的詳細結構,請一併參閱「圖4」,該複檢設備終端R主要包括移載裝置R1、檢測平台R2、複檢攝影機R3、手動操作裝置R4、以及複檢顯示裝置R5。For the detailed structure of the re-inspection equipment terminal R, please refer to FIG. 4. The re-inspection equipment terminal R mainly includes a transfer device R1, a detection platform R2, a re-inspection camera R3, a manual operation device R4, and a re-inspection device R4. Display device R5.
該檢測平台R2用於承載該待測物H,該移載裝置R1用以將該自動光學檢測設備A檢測完成的該待測物H,移載至該檢測平台R2,藉以通過檢測平台R2上的複檢攝影機R3,拍攝該待測物H以便對該待測物H的缺陷進行複判。於一可行的實施例中,當該自動光學檢測設備A與該複檢設備終端R之間有一段距離時,該自動光學檢測設備A及該複檢設備終端R之間可以再設置一輸送平台(例如輸送帶、線性載台等,圖未示),透過該輸送平台將待測物H由自動光學檢測設備A移動至該複檢設備終端R。The detection platform R2 is used to carry the object to be tested H, and the transfer device R1 is used to transfer the object to be tested H that has been detected by the automatic optical inspection equipment A to the detection platform R2 so as to pass on the detection platform R2 The re-inspection camera R3 takes pictures of the object to be tested H so as to re-evaluate the defects of the object to be tested. In a feasible embodiment, when there is a certain distance between the automatic optical inspection device A and the re-inspection device terminal R, a conveying platform can be set between the automatic optical inspection device A and the re-inspection device terminal R. (For example, a conveyor belt, a linear stage, etc., not shown in the figure), the object to be tested H is moved from the automatic optical inspection equipment A to the terminal R of the re-inspection equipment through the conveying platform.
於另一可行的實施例中,當該自動光學檢測設備A與該複檢設備終端R的距離較為接近時,該複檢設備終端R的移載裝置R1可以延伸執行移載待測物H的工作;又於另一可行的實施例中,可以省略該移載裝置R1,直接透過人工上料的方式將待測物H放置於該檢測平台R2上,於本發明中不予以限制。In another feasible embodiment, when the distance between the automatic optical inspection device A and the re-inspection device terminal R is relatively close, the transfer device R1 of the re-inspection device terminal R can extend to perform the transfer and load of the object to be tested H. In another feasible embodiment, the transfer device R1 can be omitted, and the object to be tested H is directly placed on the detection platform R2 by manual feeding, which is not limited in the present invention.
該複檢攝影機R3用以拍攝該檢測平台R2上的該待測物H。該複檢攝影機R3包括攝影機本體R31、以及一供該攝影機本體R31設置並連接至該手動操作裝置R4的複檢攝影機移動載台R32。The re-inspection camera R3 is used for photographing the object H on the inspection platform R2. The re-inspection camera R3 includes a camera body R31, and a re-inspection camera moving stage R32 for the camera body R31 to be installed and connected to the manual operation device R4.
於一實施例中,該攝影機本體R31可以為線掃描攝影機(Line Scan Camera)或面掃描攝影機(Area Scan Camera),於本發明中不予以限制。該攝影機本體R31可以進一步包括一光學裝置(例如配合光源設置的外掛式透鏡組、或其他可調節式光學系統的總成),透過光學裝置將待測物H的瑕疵影像放大,以獲取放大後更為清晰的強化瑕疵影像。於另一可行的實施例中,該攝影機本體R31亦可以直接透過本身的鏡頭調整焦段藉以達到放大瑕疵影像的功能,於本發明中不予以限制。於另一可行的實施例中,可以透過光源對該瑕疵影像進行強化,藉此強化瑕疵影像中的瑕疵特徵。In one embodiment, the camera body R31 may be a line scan camera or an area scan camera, which is not limited in the present invention. The camera body R31 may further include an optical device (for example, an externally mounted lens group arranged with the light source, or an assembly of other adjustable optical systems), through which the defective image of the object to be tested H is magnified to obtain the magnified image. Sharper images with enhanced imperfections. In another feasible embodiment, the camera body R31 can also directly adjust the focal length through its own lens to achieve the function of magnifying the defective image, which is not limited in the present invention. In another feasible embodiment, the flawed image can be enhanced through a light source, thereby enhancing flawed features in the flawed image.
於一實施例中,該複檢攝影機移動載台R32可以依據該手動操作裝置R4所輸入的控制指令移動該攝影機本體R31至對應的位置,藉以拍攝待測物H的瑕疵。於一實施例中,該複檢攝影機移動載台R32例如可以為一XY載台(或XYZ載台),透過對應的控制指令將待測物H進行X方向上或Y方向上的移動。除了XY載台(或XYZ載台)外,亦不排除可以使用多軸機械手臂或其他類似的裝置用以移動攝影機本體R31至對應的位置,於本發明中不予以限制。In one embodiment, the re-inspection camera moving stage R32 can move the camera body R31 to a corresponding position according to the control command input from the manual operation device R4, so as to photograph the defects of the object H to be tested. In one embodiment, the re-inspection camera moving stage R32 can be, for example, an XY stage (or an XYZ stage), and moves the object to be tested H in the X direction or the Y direction through corresponding control commands. In addition to the XY stage (or the XYZ stage), it is not excluded that a multi-axis robot arm or other similar devices can be used to move the camera body R31 to a corresponding position, which is not limited in the present invention.
該手動操作裝置R4連接至該複檢攝影機R3,控制該複檢攝影機R3的操作。該手動操作裝置R4可以包括按鍵R41(例如鍵盤、按鈕、或是其他類此的人機介面),該手動操作裝置R4係包括有一控制電路板,該控制電路板依據輸入的指令輸出控制訊號至該複檢攝影機移動載台R32,以操作該攝影機本體R31移動至該瑕疵位置。該控制電路板例如可以是安裝有複檢攝影機R3驅動程式或韌體的處理器、主板、控制板、電腦等,於本發明中不予以限制。The manual operating device R4 is connected to the re-inspection camera R3, and controls the operation of the re-inspection camera R3. The manual operation device R4 may include buttons R41 (such as keyboards, buttons, or other such human-machine interfaces), and the manual operation device R4 includes a control circuit board, which outputs control signals to The re-inspection camera moves the stage R32 to operate the camera body R31 to move to the defect position. The control circuit board can be, for example, a processor, a mainboard, a control board, a computer, etc., on which the R3 driver or firmware of the recheck camera is installed, which is not limited in the present invention.
該複檢顯示裝置R5用以呈現該複檢攝影機R3拍攝的該瑕疵位置影像,以供人員目視檢查。具體而言,該複檢顯示裝置R5例如可以為液晶顯示器(Liquid Crystal Display, LCD)、有機發光二極體顯示器(Organic Light Emitting Diode display, OLED display)、電泳顯示器(Electro-Phoretic Display, EPD)、電漿顯示器(Plasma Display Panel, PDP)等用於呈現影像資訊的顯示裝置,於本發明中不予以限制。The re-inspection display device R5 is used for presenting the image of the defect position captured by the re-inspection camera R3 for visual inspection by personnel. Specifically, the re-inspection display device R5 may be, for example, a liquid crystal display (Liquid Crystal Display, LCD), an organic light emitting diode display (Organic Light Emitting Diode display, OLED display), an electrophoretic display (Electro-Phoretic Display, EPD) , Plasma Display Panel (PDP) and other display devices for presenting image information, which are not limited in the present invention.
所述的影像重製裝置AT設置於複檢設備終端R,自複檢設備終端R上的複檢顯示裝置R5上,重製瑕疵位置影像。於一實施例中,該影像重製裝置AT可以經由訊號連接的方式連接至複檢攝影機R3,重製所拍攝到的瑕疵位置影像;於其他實施例中,影像重製裝置AT可以經由複檢設備終端R的接收端擷取複檢顯示裝置R5的影像重製瑕疵位置影像;再於其他實施例中,影像重製裝置AT則可以透過影像擷取單元拍攝複檢顯示裝置R5或其他有顯示瑕疵位置影像的顯示裝置,以重製瑕疵位置影像,於本發明中不予以限制。The image reproducing device AT is set on the re-inspection equipment terminal R, and reproduces the defect position image from the re-inspection display device R5 on the re-inspection equipment terminal R. In one embodiment, the image reproducing device AT can be connected to the re-inspection camera R3 via a signal connection to reproduce the captured image of the defect position; in other embodiments, the image reproducing device AT can pass the re-inspection The receiving end of the equipment terminal R captures the image of the re-inspection display device R5 to reproduce the image of the defect position; in other embodiments, the image reproduction device AT can use the image capture unit to photograph the re-inspection display device R5 or other display devices The display device for the image of the defect position, so as to reproduce the image of the defect position, is not limited in the present invention.
在此需特別說明的是,於另一些實施例中,影像重製裝置AT可直接自複檢設備終端R獲取重製的瑕疵位置影像,於本發明中不予以限制。It should be noted here that, in other embodiments, the image reproducing apparatus AT can directly acquire the reproduced defect position image from the re-inspection equipment terminal R, which is not limited in the present invention.
關於影像重製裝置AT其中一具體實施方式,請參閱「圖5」,係為影像重製裝置AT的方塊示意圖,於本實施例中,影像重製裝置AT包括一殼體AT1、一重製模組AT2以及一傳輸模組AT3。重製模組AT2容置於殼體AT1內,自複檢設備終端R的複檢顯示裝置R5上,重製待測物H的瑕疵位置影像。經由殼體AT1包覆內部構件,以便於設備工程師拾取影像重製裝置AT,將影像重製裝置AT設置或安裝於適當位置。如同前述,重製模組AT2可透過特定的訊號連接方式或透過直接拍攝複檢顯示裝置R5(或任意顯示瑕疵位置影像的螢幕)的方式來重製待測物H的瑕疵位置影像。For one specific implementation of the image reproducing apparatus AT, please refer to FIG. 5, which is a block diagram of the image reproducing apparatus AT. In this embodiment, the image reproducing apparatus AT includes a casing AT1, a reproducing mold A group AT2 and a transmission module AT3. The reproduction module AT2 is accommodated in the casing AT1, and reproduces the defect position image of the object to be tested H from the re-inspection display device R5 of the re-inspection equipment terminal R. The internal components are covered by the casing AT1, so that the equipment engineer can pick up the image reproduction apparatus AT, and set or install the image reproduction apparatus AT in a proper position. As mentioned above, the reproduction module AT2 can reproduce the defect position image of the object to be tested H through a specific signal connection method or by directly photographing the re-inspection display device R5 (or any screen displaying the defect position image).
傳輸模組AT3耦合至重製模組AT2,將重製模組AT2重製的瑕疵位置影像傳送至複判平台RP,藉以經由該複判平台RP產生一影像複檢結果。傳輸模組AT3可包括一有線/無線傳輸單元,用以傳輸瑕疵位置影像至複判平台RP。詳細而言,傳輸模組AT3可透過有線或無線的傳輸技術,將瑕疵位置影像經由傳輸網路TN傳送至複判平台RP。然而,本發明對於傳輸模組AT3所使用的傳輸技術並不加以限制。舉例而言,傳輸模組AT3可使用藍芽傳輸、USB傳輸、HDMI傳輸、行動網路傳輸、ZigBee傳輸、乙太網路傳輸、WIFI傳輸或其他適合的通訊介面來傳輸瑕疵位置影像。The transmission module AT3 is coupled to the reproducing module AT2, and transmits the image of the defect position reproduced by the reproducing module AT2 to the re-judgment platform RP, so as to generate an image re-inspection result through the re-judgment platform RP. The transmission module AT3 may include a wired/wireless transmission unit for transmitting the defect position image to the re-judgment platform RP. Specifically, the transmission module AT3 can transmit the defect position image to the re-judgment platform RP through the transmission network TN through a wired or wireless transmission technology. However, the present invention does not limit the transmission technology used by the transmission module AT3. For example, the transmission module AT3 can use Bluetooth transmission, USB transmission, HDMI transmission, mobile network transmission, ZigBee transmission, Ethernet transmission, WIFI transmission or other suitable communication interfaces to transmit the defect location image.
以下針對影像重製裝置AT的不同實施例進行說明,請參閱「圖6」,為本發明中影像重製裝置於一實施例的使用狀態示意圖。於本實施例中所揭示的影像重製裝置AT,重製模組AT2包括一第一影像擷取單元ATA,朝向複檢顯示裝置R5拍攝, 以重製複檢顯示裝置R5所呈現的瑕疵位置影像或一部份瑕疵位置影像。於其中一可行的實施例中,第一影像擷取單元ATA可以直接在預先調校時對準至複檢顯示裝置R5上,擷取瑕疵位置影像,於本發明中不予以限制。具體而言,第一影像擷取單元ATA例如是網路攝影機或其他攝影設備等等,本發明對此不予以限制。The following describes different embodiments of the image reproducing apparatus AT. Please refer to FIG. 6 , which is a schematic diagram of a use state of the image reproducing apparatus in an embodiment of the present invention. In the image reproduction apparatus AT disclosed in the present embodiment, the reproduction module AT2 includes a first image capture unit ATA, which is photographed towards the re-inspection display device R5 to reproduce the defect position displayed by the re-inspection display device R5 image or a portion of the image where the defect is located. In one possible embodiment, the first image capturing unit ATA can be directly aligned on the re-inspection display device R5 during pre-adjustment to capture the image of the defect position, which is not limited in the present invention. Specifically, the first image capturing unit ATA is, for example, a network camera or other photographing equipment, etc., which is not limited in the present invention.
於另一實施例中,請參閱「圖7」,為本發明中影像重製裝置於一實施例的使用狀態示意圖。於本實施例中,該影像重製裝置AT包括一影像截圖裝置ATB,訊號耦合至該複檢顯示裝置R5,以獲取該複檢顯示裝置R5所呈現的該瑕疵位置影像。具體而言,該影像重製裝置AT可以直接經由有線或無線手段連接至該複檢顯示裝置R5,直接經由該複檢顯示裝置R5接收輸出影像,並經由影像截圖裝置ATB由該輸出影像中獲取擷取出瑕疵位置影像。於一可行的實施例中,該影像重製裝置AT可以依據預設定的範圍對輸入至複檢顯示裝置R5的輸出影像進行截圖,例如直接依據預設定的像素座標決定截圖的範圍,影像重製裝置AT亦可以透過影像中的顯著邊界獲取顯示畫面可能是瑕疵影像的候選影像, 對候選影像中透過影像辨識選出瑕疵位置影像,並記錄像素座標以便進行持續的追蹤。In another embodiment, please refer to FIG. 7 , which is a schematic diagram of a use state of the image reproduction apparatus in an embodiment of the present invention. In this embodiment, the image reproducing device AT includes an image capturing device ATB, and the signal is coupled to the re-inspection display device R5 to acquire the image of the defect position displayed by the re-inspection display device R5. Specifically, the image reproduction device AT can be directly connected to the recheck display device R5 via wired or wireless means, directly receive the output image via the recheck display device R5, and obtain the output image via the image capture device ATB Capture images of defect locations. In a feasible embodiment, the image reproduction device AT can take a screenshot of the output image input to the recheck display device R5 according to a preset range, for example, directly determine the scope of the screenshot according to the preset pixel coordinates, and the image reproduction The device AT can also obtain candidate images that may be defective images in the display frame through the prominent boundaries in the images, select the defective position images from the candidate images through image recognition, and record the pixel coordinates for continuous tracking.
於又一實施例中,請參閱「圖8」,為本發明中影像重製裝置於又一實施例的使用狀態示意圖,如圖所示:In another embodiment, please refer to FIG. 8 , which is a schematic diagram of the use state of the image reproduction apparatus in the present invention in another embodiment, as shown in the figure:
於本實施例中,複檢設備終端R的複檢顯示裝置R5可能不會提供影像輸出埠,在這樣的條件下,影像重製裝置AT可訊號耦合至複檢顯示裝置R5,以重製複檢顯示裝置R5所呈現的瑕疵位置影像。具體而言,影像重製裝置AT包括一第一分屏單元ATC,連接至該複檢設備終端R主機的影像輸出埠R6,以重製該複檢設備終端R的該瑕疵位置影像。In this embodiment, the rechecking display device R5 of the rechecking equipment terminal R may not provide an image output port. Check the defect position image displayed by the display device R5. Specifically, the image reproducing apparatus AT includes a first split screen unit ATC, which is connected to the image output port R6 of the mainframe of the re-inspection equipment terminal R, so as to reproduce the image of the defect position of the re-inspection equipment terminal R.
所述的第一分屏單元ATC的訊號輸入埠耦接至影像輸出埠R6,接收並重製自複檢攝影機R3所拍攝的瑕疵位置影像。第一分屏單元ATC的一個訊號輸出埠耦接至複檢顯示裝置R5,且第一分屏單元ATC的另一個訊號輸出埠耦接至複判平台RP。換言之,第一分屏單元ATC將影像輸出埠R6輸出的瑕疵位置影像分為兩路訊號,其中一路通向複檢顯示裝置R3,另外一路通向複判平台RP。其中,該第一分屏單元ATC例如可以為視訊分屏器,直接由輸入至複檢顯示裝置R5的接頭分接訊號、或是直接連接至複檢顯示裝置R5的主板以重製訊號等,於本發明中不予以限制。The signal input port of the first split-screen unit ATC is coupled to the image output port R6 for receiving and reproducing the image of the defect position captured by the self-checking camera R3. One signal output port of the first screen splitting unit ATC is coupled to the rechecking display device R5, and the other signal output port of the first screen splitting unit ATC is coupled to the reviewing platform RP. In other words, the first screen splitting unit ATC divides the image of the defect position output by the image output port R6 into two signals, one of which leads to the re-inspection display device R3 and the other to the re-judgment platform RP. Wherein, the first screen splitting unit ATC can be, for example, a video splitter, which directly taps the signal input to the connector of the recheck display device R5, or is directly connected to the main board of the recheck display device R5 to reproduce the signal, etc., Not limited in the present invention.
於再一實施例中,請參閱「圖9」,為本發明中影像重製裝置於再一實施例的使用狀態示意圖,如圖所示:In yet another embodiment, please refer to FIG. 9 , which is a schematic diagram of the use state of the image reproducing apparatus of the present invention in another embodiment, as shown in the figure:
於本實施例中,影像重製裝置AT包括第二分屏單元ATD、重製顯示單元ATE、以及第二影像擷取單元ATF。該第二分屏單元ATD連接至該複檢設備終端R主機的影像輸出埠R6,用以重製該複檢設備終端R的複檢顯示裝置R5所呈現的該瑕疵位置影像,並傳送至複判平台RP。該重製顯示單元ATE連接至該第二分屏單元ATD,用以顯示該瑕疵位置影像。該第二影像擷取單元ATF朝向該重製顯示單元ATE拍攝,以獲得該瑕疵位置影像或一部分該瑕疵位置影像,上述的實施例亦不排除於本發明的保護範圍之外。In this embodiment, the image reproduction device AT includes a second screen splitting unit ATD, a reproduction display unit ATE, and a second image capture unit ATF. The second screen splitting unit ATD is connected to the image output port R6 of the mainframe of the re-inspection equipment terminal R, and is used for reproducing the image of the defect position displayed by the re-inspection display device R5 of the re-inspection equipment terminal R, and transmits it to the re-inspection equipment terminal R. Judge the platform RP. The reproduction display unit ATE is connected to the second split screen unit ATD for displaying the image of the defect position. The second image capturing unit ATF shoots toward the reproduction display unit ATE to obtain the defect position image or a part of the defect position image, and the above embodiments are not excluded from the protection scope of the present invention.
請一併參閱「圖10」,係為本發明中複判平台一實施例的方塊示意圖,如圖所示:於一實施例中,該複判平台RP更進一步包括一自動操作裝置RP6。該自動操作裝置RP6連接或耦接至該自動光學檢測設備A及/或該複檢設備終端R的主機系統以取得該待測物H的瑕疵位置資訊,輸出一操作指令至該複檢設備終端R,使該複檢設備終端R的攝影機本體R31,移動至該待測物H的瑕疵位置上方,並拍攝一瑕疵位置影像。Please also refer to FIG. 10 , which is a schematic block diagram of an embodiment of the re-judgment platform in the present invention. As shown in the figure, in an embodiment, the re-judgment platform RP further includes an automatic operation device RP6 . The automatic operation device RP6 is connected or coupled to the host system of the automatic optical inspection equipment A and/or the re-inspection equipment terminal R to obtain the defect position information of the object H to be tested, and output an operation command to the re-inspection equipment terminal R, the camera body R31 of the re-inspection equipment terminal R is moved to above the defect position of the object H to be tested, and an image of the defect position is captured.
請一併參閱「圖11」,係為本發明中自動操作裝置的工作示意圖,如圖所示:當待測物H被移動至該檢測平台R2時,該自動操作裝置RP6經由接收到的瑕疵位置資訊(例如座標)輸出一操作指示至該手動操作裝置R4,在此所述的操作指示可以透過機械控制手段輸入至該手動操作裝置R4、或是透過電控手段將類比或數位訊號輸入至該手動操作裝置R4以控制該手動操作裝置R4的工作模式,於本發明中不予以限制。Please also refer to "FIG. 11", which is a working schematic diagram of the automatic operation device in the present invention. As shown in the figure: when the object to be tested H is moved to the inspection platform R2, the automatic operation device RP6 passes through the received defects The position information (such as coordinates) outputs an operation instruction to the manual operation device R4. The operation instruction described here can be input to the manual operation device R4 through mechanical control means, or analog or digital signals can be input to the manual operation device through electronic control means. The manual operation device R4 is used to control the working mode of the manual operation device R4, which is not limited in the present invention.
於一實施例中,該手動操作裝置R4於接收到操作指示後,係經由複檢攝影機移動載台R32將攝影機本體R31經由平面方向移動至對應的座標位置(X1, Y1),藉此拍攝待測物H的影像,本實施例可應用於平面待測物的檢測。於另一實施例中,於進行多面物體、或立體物件的檢測,複檢攝影機移動載台R32則可以作為多軸機械臂實施,透過輸入的三維座標(X1, Y1, Z1)控制該多軸機械臂動作,藉此將設置於多軸機械臂活動端上的攝影機本體R31移動至對應的三維座標位置,對準至該待測物H的瑕疵位置進行拍攝,以獲取瑕疵位置影像。In one embodiment, after receiving the operation instruction, the manual operation device R4 moves the camera body R31 to the corresponding coordinate position (X1, Y1) in the plane direction through the re-checking camera moving stage R32, so as to shoot the object to be photographed. The image of the test object H, this embodiment can be applied to the detection of the plane test object. In another embodiment, in the detection of polyhedral objects or three-dimensional objects, the re-inspection camera moving stage R32 can be implemented as a multi-axis manipulator, and the multi-axis is controlled by the input three-dimensional coordinates (X1, Y1, Z1). The manipulator moves, thereby moving the camera body R31 set on the movable end of the multi-axis manipulator to the corresponding three-dimensional coordinate position, aiming at the defect position of the object H to shoot, so as to obtain the image of the defect position.
以下針對該自動操作裝置RP6兩種不同實施例進行說明,請先參閱「圖12」,係為本發明中自動操作裝置第一實施例的使用狀態示意圖,如圖所示:The following describes two different embodiments of the automatic operating device RP6. Please refer to FIG. 12 first, which is a schematic diagram of the use state of the first embodiment of the automatic operating device in the present invention, as shown in the figure:
在機械控制手段的其中一可行的實施例中,請參閱「圖12」,該自動操作裝置RP6包括一機械控制裝置RP61A,連接至手動操作裝置R4A,該機械控制裝置RP61A以機械動作(例如直接設置於鍵盤上的頂針、或壓鈕)輸入該操作指令至該手動操作裝置R4A,使該複檢攝影機R3的攝影機本體R31移動至該待測物H的瑕疵位置上方,並拍攝該瑕疵位置。In one possible embodiment of the mechanical control means, please refer to "Fig. 12", the automatic operating device RP6 includes a mechanical control device RP61A, connected to the manual operating device R4A, the mechanical control device RP61A operates mechanically (eg, direct A thimble or button on the keyboard is used to input the operation command to the manual operation device R4A, so that the camera body R31 of the re-inspection camera R3 is moved above the defect position of the test object H, and the defect position is photographed.
該手動操作裝置R4A的實體按鍵(或虛擬按鍵)分布可以直接預存於該機械控制裝置RP61A的控制器RP611A、或配合控制器RP611A設置的儲存單元內。該控制器RP611A於接收到瑕疵位置資訊時,係依據所接收到的瑕疵座標控制機械單元RP612A的動作,以鍵入對應的指令。於一具體實施態樣中,該機械控制裝置RP61A可以為一壓鈕裝置,安裝於該手動操作裝置R4A的操作介面上。該壓鈕裝置包括一或複數個按壓單元、驅動該按壓單元動作的驅動單元、以及一連接至該驅動單元以輸出控制指令的控制器。該驅動單元於接收到該控制器指令後驅動該按壓單元按壓操作介面上對應的按鈕,以操作該複檢攝影機R3的攝影機本體R31移動至該瑕疵位置。The distribution of physical keys (or virtual keys) of the manual operation device R4A can be directly pre-stored in the controller RP611A of the mechanical control device RP61A, or in a storage unit provided with the controller RP611A. When the controller RP611A receives the defect position information, it controls the action of the mechanical unit RP612A according to the received defect coordinates to input corresponding commands. In a specific embodiment, the mechanical control device RP61A can be a push button device installed on the operation interface of the manual operation device R4A. The button pressing device includes one or more pressing units, a driving unit that drives the pressing units to act, and a controller that is connected to the driving unit to output control commands. After receiving the command from the controller, the driving unit drives the pressing unit to press the corresponding button on the operation interface, so as to operate the camera body R31 of the re-inspection camera R3 to move to the defect position.
於另一實施例中,請參閱「圖13」,係為本發明中自動操作裝置第二實施例的使用狀態示意圖,如圖所示:In another embodiment, please refer to FIG. 13 , which is a schematic diagram of the use state of the second embodiment of the automatic operation device in the present invention, as shown in the figure:
該自動操作裝置RP6包括電控裝置RP61B,該電控裝置RP61B直接訊號連接至手動操作裝置R4B的控制電路板R41B,直接經由輸入類比或數位訊號的操作指令至該手動操作裝置R4B,以操作該該複檢攝影機R3的攝影機本體R31移動至該待測物H的瑕疵位置上方,並拍攝該瑕疵位置。於一實施例中,該電控裝置RP61B可以是可程式邏輯控制器、微處理器、控制板、電腦、或其他類此的裝置,於本發明中不予以限制。The automatic operation device RP6 includes an electronic control device RP61B. The electronic control device RP61B is directly connected to the control circuit board R41B of the manual operation device R4B, and the operation command of analog or digital signals is directly input to the manual operation device R4B to operate the manual operation device R4B. The camera body R31 of the re-inspection camera R3 is moved to above the defect position of the object H to be tested, and the defect position is photographed. In one embodiment, the electronic control device RP61B may be a programmable logic controller, a microprocessor, a control board, a computer, or other such devices, which are not limited in the present invention.
上述的方式僅為自動操作裝置RP6具體用以操作複檢攝影機R3的其中幾種實施方式,除上述的方式外,亦可以透過其他方式例如直接連接至複檢攝影機移動載台R32以操作攝影機本體R31的位置,上述方式於本發明中不予以限制。此外,除上述的幾種實施例外,於一可行的實施例中,該自動操作裝置RP6亦可以省略,透過單純的輸出控制指令操作(例如下一頁、上一頁)至該複檢設備終端R並由該複檢設備終端R切換瑕疵位置影像。The above-mentioned methods are only some of the specific implementations of the automatic operation device RP6 for operating the re-inspection camera R3. In addition to the above methods, other methods, such as directly connecting to the re-inspection camera moving stage R32, can also be used to operate the camera body. The position of R31 is not limited in the present invention as described above. In addition, in addition to the above-mentioned several embodiments, in a feasible embodiment, the automatic operation device RP6 can also be omitted, and the re-inspection equipment terminal can be operated by simply outputting control commands (eg, next page, previous page). R and the defect position image is switched by the re-inspection equipment terminal R.
於複檢攝影機R3的攝影機本體R31移動至該待測物H的瑕疵位置時,該攝影機本體R31將依據複檢設備終端R、自動操作裝置RP6、或是複判平台RP的指令自動對該待測物H進行取像,所拍攝到的影像將轉移至該複檢設備終端R的複檢顯示裝置R5顯示。影像重製裝置AT配合該複檢設備終端R設置,自該複檢設備終端R獲取該瑕疵位置影像。When the camera body R31 of the re-inspection camera R3 moves to the defect position of the object to be tested H, the camera body R31 will automatically perform the inspection according to the instructions of the re-inspection equipment terminal R, the automatic operation device RP6, or the re-judgment platform RP. The test object H takes an image, and the captured image will be transferred to the re-inspection display device R5 of the re-inspection equipment terminal R for display. The image reproducing apparatus AT is set up in cooperation with the re-inspection equipment terminal R, and acquires the image of the defect position from the re-inspection equipment terminal R. FIG.
以下針對本發明的集中式複判方法進行詳細的說明,請一併參閱「圖14」,係為本發明集中式複判方法的流程示意圖,如圖所示:The following is a detailed description of the centralized re-judgment method of the present invention, please refer to "Fig. 14" together, which is a schematic flowchart of the centralized re-judgment method of the present invention, as shown in the figure:
本實施例係提供一種集中式複判方法,用以配合複數個檢測線上的自動光學檢測設備、-、及複檢設備終端、-實施,所述的方法包括:This embodiment provides a centralized re-judgment method for cooperating with automatic optical inspection equipment on multiple inspection lines , - , and recheck the equipment terminal , - To implement, the method includes:
首先,自複檢設備終端、-,對應地獲取瑕疵位置影像至影像重製裝置、-(步驟S01);於本步驟中,該複檢設備終端、-及該影像重製裝置、-中任一裝置可以做為主控端(Master)、或從控端(Slave),更具體而言,對應至不同檢測線、-(或複檢設備終端、-)上的影像重製裝置、-可以主動的於獲得瑕疵位置影像後將訊息傳送至後端的複判平台RP,或是由複判平台RP向影像重製裝置、-提出請求後,再由複判平台RP將瑕疵位置影像回傳至該複判平台RP,於本發明中不予以限制。First, self-recheck the device terminal , - , correspondingly obtain the image of the defect position to the image reproduction device , - (Step S01); In this step, the re-inspection equipment terminal , - and the video reproduction device , - Any one of the devices can be used as a master (Master) or a slave (Slave), more specifically, corresponding to different detection lines , - (or recheck the equipment terminal , - ) on the video reproduction device , - It can actively transmit the information to the back-end re-judgment platform RP after obtaining the image of the defect position, or from the re-judgment platform RP to the image reproduction device , - After the request is made, the re-judgment platform RP sends back the image of the defect position to the re-judgment platform RP, which is not limited in the present invention.
獲取瑕疵位置影像的方式主要可以透過該影像重製裝置、-經由第一影像擷取單元ATA朝向對應的該複檢設備終端、-的複檢顯示裝置R5拍攝,以重製該瑕疵位置影像、或一部份該瑕疵位置影像;或是該影像重製裝置、-經由一影像截圖裝置ATB訊號耦合至該複檢顯示裝置R5,以獲取該複檢顯示裝置R5所呈現的該瑕疵位置影像,於本發明中不予以限制。The method of obtaining the image of the defect position is mainly through the image reproduction device , - facing the corresponding re-inspection equipment terminal through the first image capture unit ATA , - The re-inspection display device R5 is used to reproduce the image of the defect position, or a part of the image of the defect position; or the image reproduction device , - The ATB signal is coupled to the re-inspection display device R5 through an image capturing device to obtain the image of the defect position presented by the re-inspection display device R5, which is not limited in the present invention.
承步驟S01,透過傳輸網路TN,複數個影像重製裝置、-個別地傳輸瑕疵位置影像至一複判平台RP (步驟S02);於一實施例中,複數個該影像重製裝置、-將獲取的瑕疵位置影像傳輸至該複判平台RP,再由一或複數個該第三方裝置TH分別調閱該瑕疵位置影像,通過將瑕疵位置影像集中儲存於該複判平台RP,可以分配給複數個複判平台RP或是提供至複數個螢幕供目檢人員進行複判。Following step S01, a plurality of image reproduction devices are connected through the transmission network TN. , - Individually transmit the defect position images to a re-judgment platform RP (step S02); in one embodiment, a plurality of the image reproduction devices , - The acquired defect position image is transmitted to the re-judgment platform RP, and then the defect position image is respectively accessed by one or more of the third-party devices TH. A plurality of re-judgment platforms RP may be provided to a plurality of screens for visual inspection personnel to conduct a re-judgment.
最終,於該複判平台RP接收並分析自複數個該影像重製裝置、-所傳送的該瑕疵位置影像,以產生一影像複檢結果 (步驟S03)。其中該複判平台RP可以根據該瑕疵位置影像判斷該待測物H是否為缺陷及/或分類該待測物H的缺陷類型。經檢測過後,該複判平台RP將所產生的該影像複檢結果可以集中儲存於一調閱裝置RP2以供複數個該複檢設備終端、-調閱檢查結果,在複檢設備終端、-配置人員的情況下亦可以反查調閱檢查結果。Finally, the re-judgment platform RP is received and analyzed from a plurality of the image reproduction devices , - The transmitted image of the defect position is used to generate an image rechecking result (step S03). The re-judgment platform RP can judge whether the object to be tested H is a defect and/or classify the defect type of the object to be tested H according to the image of the defect position. After the inspection, the re-judgment platform RP can centrally store the generated image re-inspection results in a review device RP2 for a plurality of the re-inspection equipment terminals. , - Retrieve the inspection results, at the re-inspection equipment terminal , - In the case of deploying personnel, the inspection results can also be reversely checked.
綜上所述,本發明可以將複數個複檢設備終端的複檢結果集中提供至複判平台由目檢人員進行複檢,有效的減少非必要的勞動成本並提升檢測的效率。此外,本發明可以改善傳統程序需要大量人工執行複檢的缺失,尤其是可以解決檢測軟體能力不足或是製程變更時所造成大量過檢、誤判時所產生人力負荷過重的問題,透過本發明可以提升複檢設備終端的檢測效率及精確度,並可以大幅縮減人員的工作負擔。To sum up, the present invention can centrally provide re-inspection results of multiple re-inspection equipment terminals to the re-judgment platform for re-inspection by visual inspection personnel, effectively reducing unnecessary labor costs and improving inspection efficiency. In addition, the present invention can improve the defect that a large number of manual re-inspections are required in traditional procedures, and especially can solve the problem of insufficient detection software capability or excessive human load caused by a large number of over-inspections and misjudgments caused by process changes. Improve the detection efficiency and accuracy of the re-inspection equipment terminal, and can greatly reduce the workload of personnel.
以上已將本發明做一詳細說明,惟以上所述者,僅為本發明之一較佳實施例而已,當不能以此限定本發明實施之範圍,即凡依本發明申請專利範圍所作之均等變化與修飾,皆應仍屬本發明之專利涵蓋範圍內。The present invention has been described in detail above, but the above is only one of the preferred embodiments of the present invention, and should not limit the scope of the present invention, that is, all claims made according to the scope of the present invention are equal. Changes and modifications should still fall within the scope of the patent of the present invention.
100:集中式複判系統、-:檢測線、-:自動光學檢測設備、-:複檢設備終端、-:影像重製裝置 TN:傳輸網路 RP:複判平台 RP1:通訊裝置 RP2:儲存裝置 RP3:判定裝置 M1:瑕疵複檢裝置 M2:類別複檢裝置 RP4:調閱裝置 RP5:結果呈現裝置 RP6:自動操作裝置 H:待測物 TH:第三方裝置 A:自動光學檢測設備 R:複檢設備終端 R1:移載裝置 R2:檢測平台 R3:複檢攝影機 R31:攝影機本體 R32:複檢攝影機移動載台 R4:手動操作裝置 R41:按鍵 R4A:手動操作裝置 R4B:手動操作裝置 R41B:控制電路板 R5:複檢顯示裝置 R6:影像輸出埠 AT:影像重製裝置 AT1:殼體 AT2:重製模組 AT3:傳輸模組 ATA:第一影像擷取單元 ATB:影像截圖裝置 ATC:第一分屏單元 ATD:第二分屏單元 ATE:重製顯示單元 ATF:第二影像擷取單元 RP6:自動操作裝置 RP61A:機械控制裝置 RP611A:控制器 RP612A:機械單元 RP61B:電控裝置 S01-S03:步驟100: Centralized Review System , - :Test line , - : Automatic optical inspection equipment , - : Recheck the equipment terminal , - : Video reproduction device TN: Transmission network RP: Review platform RP1: Communication device RP2: Storage device RP3: Judgment device M1: Defect review device M2: Category review device RP4: Review device RP5: Result presentation device RP6 : automatic operation device H: object to be tested TH: third-party device A: automatic optical inspection equipment R: re-inspection equipment terminal R1: transfer device R2: inspection platform R3: re-inspection camera R31: camera body R32: re-inspection camera movement Stage R4: Manual operation device R41: Button R4A: Manual operation device R4B: Manual operation device R41B: Control circuit board R5: Recheck display device R6: Video output port AT: Video reproduction device AT1: Shell AT2: Reproduce Module AT3: Transmission Module ATA: First Image Capture Unit ATB: Image Capture Device ATC: First Split Screen Unit ATD: Second Split Screen Unit ATE: Reproduction Display Unit ATF: Second Image Capture Unit RP6: Automatic Operation Unit RP61A: Mechanical Control Unit RP611A: Controller RP612A: Mechanical Unit RP61B: Electronic Control Unit S01-S03: Steps
圖1,本發明中集中式複判系統其中一實施例的方塊示意圖。FIG. 1 is a schematic block diagram of one embodiment of the centralized re-judgment system of the present invention.
圖2,本發明中複判平台的方塊示意圖。FIG. 2 is a block schematic diagram of a rejudgment platform in the present invention.
圖3,本發明中集中式複判系統的方塊示意圖(一)。FIG. 3 is a block schematic diagram (1) of the centralized re-judgment system in the present invention.
圖4,本發明中集中式複判系統的方塊示意圖(二)。FIG. 4 is a schematic block diagram (2) of the centralized re-judgment system in the present invention.
圖5,本發明中影像重製裝置的方塊示意圖。FIG. 5 is a block diagram of the image reproduction apparatus in the present invention.
圖 6,本發明中影像重製裝置於一實施例的使用狀態示意圖。FIG. 6 is a schematic diagram of a use state of the image reproducing apparatus in an embodiment of the present invention.
圖7,本發明中影像重製裝置於一實施例的使用狀態示意圖。FIG. 7 is a schematic diagram of a use state of the image reproducing apparatus according to an embodiment of the present invention.
圖8,本發明中影像重製裝置於又一實施例的使用狀態示意圖。FIG. 8 is a schematic diagram of the use state of the image reproducing apparatus in accordance with another embodiment of the present invention.
圖9,本發明中影像重製裝置於再一實施例的使用狀態示意圖。FIG. 9 is a schematic diagram of a use state of the image reproducing apparatus in accordance with another embodiment of the present invention.
圖10,本發明中複判平台一實施例的方塊示意圖。FIG. 10 is a schematic block diagram of an embodiment of a rejudgment platform in the present invention.
圖11,本發明中自動操作裝置的工作示意圖。Fig. 11 is a working schematic diagram of the automatic operation device in the present invention.
圖12,本發明中自動操作裝置第一實施例的使用狀態示意圖。FIG. 12 is a schematic diagram of the use state of the first embodiment of the automatic operating device in the present invention.
圖13,本發明中自動操作裝置第二實施例的使用狀態示意圖。Fig. 13 is a schematic diagram of the use state of the second embodiment of the automatic operating device in the present invention.
圖14,本發明集中式複判方法的流程示意圖。FIG. 14 is a schematic flowchart of the centralized re-judgment method of the present invention.
100:集中式複判系統100: Centralized Review System
L1 、L2 -LN :檢測線L 1 , L 2 -L N : Detection line
A1 、A2 -AN :自動光學檢測設備A1, A2 - AN : Automatic Optical Inspection Equipment
R1 、R2 -RN :複檢設備終端R 1 , R 2 -R N : Recheck equipment terminal
AT1 、AT2 -ATN :影像重製裝置AT 1 , AT 2 -AT N : Video reproduction device
TN:傳輸網路TN: Transport Network
RP:複判平台RP: Retrial Platform
Claims (16)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109128610A TW202208831A (en) | 2020-08-21 | 2020-08-21 | Centralized defect reviewing system and method |
CN202110943521.0A CN114076764A (en) | 2020-08-21 | 2021-08-17 | Centralized complex judgment system and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109128610A TW202208831A (en) | 2020-08-21 | 2020-08-21 | Centralized defect reviewing system and method |
Publications (1)
Publication Number | Publication Date |
---|---|
TW202208831A true TW202208831A (en) | 2022-03-01 |
Family
ID=80283278
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW109128610A TW202208831A (en) | 2020-08-21 | 2020-08-21 | Centralized defect reviewing system and method |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN114076764A (en) |
TW (1) | TW202208831A (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117969523A (en) * | 2023-12-20 | 2024-05-03 | 上海欧普泰科技创业股份有限公司 | Product defect detection method, storage medium, detection device and system |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7203355B2 (en) * | 2002-12-24 | 2007-04-10 | Orbotech Ltd. | Automatic optical inspection system and method |
US8290239B2 (en) * | 2005-10-21 | 2012-10-16 | Orbotech Ltd. | Automatic repair of electric circuits |
JP2013024666A (en) * | 2011-07-20 | 2013-02-04 | Panasonic Corp | Defect detection method and defect detection device |
CN102565074B (en) * | 2012-01-09 | 2014-02-05 | 西安印钞有限公司 | System and method for rechecking images of suspected defective products by small sheet sorter |
CN109115780A (en) * | 2017-06-23 | 2019-01-01 | 大陆泰密克汽车系统(上海)有限公司 | For monitoring the method and device thereof of multiple automated optical detection equipments |
-
2020
- 2020-08-21 TW TW109128610A patent/TW202208831A/en unknown
-
2021
- 2021-08-17 CN CN202110943521.0A patent/CN114076764A/en active Pending
Also Published As
Publication number | Publication date |
---|---|
CN114076764A (en) | 2022-02-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10991088B2 (en) | Defect inspection system and method using artificial intelligence | |
TWI689875B (en) | Defect inspection and classification apparatus and training apparatus using deep learning system | |
TW202107073A (en) | System and method for pcb inspection based on false defect detection | |
US20200294222A1 (en) | Method and apparatus for outputting information | |
US10241990B2 (en) | Gesture based annotations | |
US20130010068A1 (en) | Augmented reality system | |
US7796802B2 (en) | System for recording and displaying annotated images of object features | |
Li et al. | System design for PCB defects detection based on AOI technology | |
KR20210059148A (en) | Purchase system of used mobile | |
CN106040608A (en) | Dynamic optical detection device and detection method for laptop keyboards | |
JP2013077127A (en) | Image classification device and image classification method | |
CN103389308A (en) | Optical reinspection system and detection method thereof | |
CN102495064A (en) | Touch screen screen-printed circuit automatic optic inspection system | |
TW202208831A (en) | Centralized defect reviewing system and method | |
CN206311047U (en) | A kind of product profile tolerance testing equipment | |
CN103308522A (en) | Automatic camera chip module wire bonding quality tester | |
TWM556842U (en) | Testing device for curved touch panel | |
CN109632815A (en) | Surface defect on-line detecting system and method | |
CN110987926A (en) | Automatic display screen defect detection method based on machine vision | |
JP6027717B2 (en) | Visual inspection apparatus provided with gaze position specifying means | |
TW202134634A (en) | Attached re-inspection system, and attached re-inspection method | |
CN103901039A (en) | Detection system | |
KR102544533B1 (en) | Object management system through electronic pen record information and photo image information matching | |
TW202144765A (en) | Image recording device and inspect method thereof | |
KR102419738B1 (en) | Method for generate image data for stain inspection learning using artificial intelligence |