Nothing Special   »   [go: up one dir, main page]

CN107481205A - A kind of Terahertz image fringes noise processing method and system - Google Patents

A kind of Terahertz image fringes noise processing method and system Download PDF

Info

Publication number
CN107481205A
CN107481205A CN201710732679.7A CN201710732679A CN107481205A CN 107481205 A CN107481205 A CN 107481205A CN 201710732679 A CN201710732679 A CN 201710732679A CN 107481205 A CN107481205 A CN 107481205A
Authority
CN
China
Prior art keywords
mrow
frequency
msub
terahertz
frequency domain
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710732679.7A
Other languages
Chinese (zh)
Other versions
CN107481205B (en
Inventor
王军
杜培甫
梁恺
朱瑶瑶
苟君
蒋亚东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Electronic Science and Technology of China
Original Assignee
University of Electronic Science and Technology of China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Electronic Science and Technology of China filed Critical University of Electronic Science and Technology of China
Priority to CN201710732679.7A priority Critical patent/CN107481205B/en
Publication of CN107481205A publication Critical patent/CN107481205A/en
Application granted granted Critical
Publication of CN107481205B publication Critical patent/CN107481205B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20048Transform domain processing

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Abstract

本发明涉及太赫兹探测阵列或红外探测阵列成像领域,公开了一种太赫兹图像条纹噪声处理方法及系统,包括如下内容:对获取的太赫兹图像数据进行傅里叶变换,获得表征所述太赫兹图像数据的频域特征的频域图;对所述频域图进行第一次带阻滤波,用于消除条纹噪声所在的频率范围的周期噪声;对经过第一次带阻滤波的频域图进行高通滤波,用于衰减或抑制低频分量,突出剩余的条纹噪声;对经过高通滤波的频域图进行第二次带阻滤波,用于对第一次带阻滤波未滤除完全的条纹噪声进行第二次带阻滤波;将经过第二次带阻滤波的频域图采用傅里叶逆变换,转换为时域图,进而能够有效对太赫兹条纹噪声进行消除。

The present invention relates to the field of terahertz detection array or infrared detection array imaging, and discloses a terahertz image fringe noise processing method and system, including the following content: Fourier transform is performed on the acquired terahertz image data to obtain and characterize the terahertz image data. A frequency-domain map of the frequency-domain characteristics of the Hertz image data; the first band-stop filtering is performed on the frequency-domain map to eliminate periodic noise in the frequency range where the streak noise is located; High-pass filtering is performed on the image to attenuate or suppress low-frequency components to highlight the remaining streak noise; a second band-stop filter is performed on the high-pass-filtered frequency-domain image to filter out the stripes that are not completely filtered out by the first band-stop filter The second band-stop filtering is performed on the noise; the frequency-domain image after the second band-stop filtering is converted into a time-domain image by inverse Fourier transform, and then the terahertz fringe noise can be effectively eliminated.

Description

一种太赫兹图像条纹噪声处理方法及系统A method and system for processing streak noise in terahertz images

技术领域technical field

本发明涉及太赫兹探测阵列或红外探测阵列成像领域,尤其涉及一种太赫兹图像条纹噪声处理方法及系统。The invention relates to the field of terahertz detection array or infrared detection array imaging, in particular to a method and system for processing fringe noise of a terahertz image.

背景技术Background technique

太赫兹辐射指的是频率在0.1THz一10THz之间的电磁波,其波段处于微波和红外之间,属于远红外电磁辐射范畴。物质的太赫兹光谱包含着丰富的物理和化学信息。同时,由于太赫兹辐射自身的特点,决定了它在很多方面可以成为傅立叶变换红外光潜技术和X射线技术的互补技术,太赫兹辐射在很多基础研究领域、工业应用及军事应用领域有着广阔的发展空间。它在生物学、医学、微电子学、农业及安全检查领域也有很大的应用潜力。另外,与低频电磁波相比,太赫兹频率较高,可作为通讯载体,在单位时间内可以承载更多的信息。太赫兹辐射方向性很好,可用于战场中的短距离定向保密通讯。利用太赫兹成像还可获得更高的空间分辨率及更长的景深等。Terahertz radiation refers to electromagnetic waves with a frequency between 0.1THz and 10THz. Its wave band is between microwave and infrared, and it belongs to the category of far-infrared electromagnetic radiation. The terahertz spectrum of matter contains rich physical and chemical information. At the same time, due to the characteristics of terahertz radiation itself, it can become a complementary technology of Fourier transform infrared optical latent technology and X-ray technology in many aspects. Terahertz radiation has broad applications in many basic research fields, industrial applications and military applications. Expansion capacity. It also has great application potential in the fields of biology, medicine, microelectronics, agriculture and security inspection. In addition, compared with low-frequency electromagnetic waves, terahertz has a higher frequency and can be used as a communication carrier, which can carry more information per unit time. Terahertz radiation has good directivity and can be used for short-distance directional secure communication in the battlefield. Higher spatial resolution and longer depth of field can also be obtained by using terahertz imaging.

然而正是由于太赫兹辐射自身的特点,波长较长,故在利用太赫兹探测器进行图形采集时经常出现干涉条纹噪声,一直以来研究人员对此做了大量研究,但大多仍是直接高频滤波,并不能有针对性的滤除干涉噪声,故仍有许多不足。而且由于采集时条纹的疏密程度以及方向的不确定性,所以去除干涉条纹仍有很大的难度。However, due to the characteristics of terahertz radiation itself and its long wavelength, interference fringe noise often occurs when using terahertz detectors for image acquisition. Researchers have done a lot of research on this, but most of them are still directly high-frequency Filtering cannot filter out interference noise in a targeted manner, so there are still many deficiencies. Moreover, due to the density and direction uncertainty of fringes during acquisition, it is still very difficult to remove interference fringes.

因此,现有技术中无法有效对太赫兹图像的条纹噪声进行有效消除。Therefore, the streak noise of the terahertz image cannot be effectively eliminated in the prior art.

发明内容Contents of the invention

本发明为了解决现有技术中存在无法有效对太赫兹图像条纹噪声进行有效消除的技术问题,进而提供了一种太赫兹图像条纹噪声处理方法及系统。In order to solve the technical problem in the prior art that the fringe noise of a terahertz image cannot be effectively eliminated, the present invention further provides a method and system for processing the fringe noise of a terahertz image.

为解决上述技术问题,本发明采用的一个技术方案是:一种太赫兹图像条纹噪声处理方法,包括如下内容:In order to solve the above-mentioned technical problems, a technical solution adopted by the present invention is: a method for processing terahertz image streak noise, including the following content:

对获取的太赫兹图像数据进行傅里叶变换,获得表征所述太赫兹图像数据的频域特征的频域图;Performing Fourier transform on the acquired terahertz image data to obtain a frequency domain map representing the frequency domain characteristics of the terahertz image data;

对所述频域图进行第一次带阻滤波,用于消除条纹噪声所在的频率范围的周期噪声;Carrying out the first band-stop filtering on the frequency-domain image to eliminate the periodic noise in the frequency range where the streak noise is located;

对经过第一次带阻滤波的频域图进行高通滤波,用于衰减或抑制低频分量,突出剩余的条纹噪声;Perform high-pass filtering on the frequency domain image after the first band-stop filtering to attenuate or suppress low-frequency components and highlight the remaining streak noise;

对经过高通滤波的频域图进行第二次带阻滤波,用于对第一次带阻滤波未滤除完全的条纹噪声进行第二次带阻滤波;Performing a second band-stop filter on the high-pass filtered frequency-domain image is used to perform a second band-stop filter on the streak noise that was not completely filtered out by the first band-stop filter;

将经过第二次带阻滤波的频域图采用傅里叶逆变换,转换为时域图。The frequency-domain image after the second band-stop filtering is transformed into a time-domain image by inverse Fourier transform.

另一方面,还提供了一种太赫兹图像条纹噪声处理系统,包括:On the other hand, a terahertz image streak noise processing system is also provided, including:

傅里叶变换模块,用于对所述太赫兹图像数据进行傅里叶变换,获得表征所述太赫兹图像数据的频域特征的频域图;A Fourier transform module, configured to perform Fourier transform on the terahertz image data to obtain a frequency-domain map representing the frequency-domain features of the terahertz image data;

第一带阻滤波器,用于对所述频域图进行第一次带阻滤波,消除条纹噪声所在的频率范围的周期噪声;The first band-stop filter is used to perform a first band-stop filter on the frequency domain image to eliminate periodic noise in the frequency range where the streak noise is located;

频域高通滤波器,用于对经过第一次带阻滤波的频域图进行高通滤波,用于衰减或抑制低频分量,突出剩余的条纹噪声;A frequency-domain high-pass filter is used to perform high-pass filtering on the frequency-domain image after the first band-stop filter, to attenuate or suppress low-frequency components, and to highlight the remaining streak noise;

第二带阻滤波器,用于对经过高通滤波的频域图进行第二次带阻滤波,对第一次带阻滤波未滤除完全的条纹噪声的进行第二次带阻滤波;The second band-stop filter is used to perform a second band-stop filter on the high-pass filtered frequency domain image, and perform a second band-stop filter on the first band-stop filter that does not filter out complete streak noise;

傅里叶逆变换模块,用于将经过第二次带阻滤波的频域图采用傅里叶逆变换,转换为时域图。The inverse Fourier transform module is used to transform the frequency-domain image after the second band-stop filtering into a time-domain image by using an inverse Fourier transform.

本发明的有益效果是:区别于现有技术的情况:The beneficial effect of the present invention is: be different from the situation of prior art:

由于在该太赫兹图像条纹噪声处理方法中对获取的太赫兹图像数据进行傅里叶变换,然后通过第一次带阻滤波除去一部分条纹噪声,然后,经过高通滤波,第二次带阻滤波滤除剩余的条纹噪声,最后通过傅里叶逆变换,转换为时域图,获得最终滤除噪声的图像,该图像突出目标物,可以通过频域图设置滤波器,简单并且容易观察,解决了算法通用性的问题,最后又通过图像增强,使得目标物更加明显的显现出来,使得处理后的图像不仅消除了条纹噪声,还起到了图像增强的作用。In this terahertz image streak noise processing method, Fourier transform is performed on the acquired terahertz image data, and then part of the streak noise is removed through the first band-stop filter, and then, after high-pass filtering, the second band-stop filter Remove the remaining fringe noise, and finally convert it into a time-domain image through inverse Fourier transform to obtain the final noise-filtered image. The image highlights the target object, and the filter can be set through the frequency-domain image, which is simple and easy to observe, and solves the problem. The problem of the generality of the algorithm, and finally through image enhancement, the target object is more obvious, so that the processed image not only eliminates the stripe noise, but also plays the role of image enhancement.

附图说明Description of drawings

图1为本发明实施例中太赫兹图像条纹噪声处理方法的步骤流程示意图;FIG. 1 is a schematic flow chart of the steps of a method for processing streak noise in a terahertz image in an embodiment of the present invention;

图2a-图2f为本发明实施例中太赫兹图像条纹噪声处理过程的效果图;Fig. 2a-Fig. 2f are the effect diagrams of the fringe noise processing process of the terahertz image in the embodiment of the present invention;

图3为本发明实施例中太赫兹图像条纹噪声处理系统的模块示意图。Fig. 3 is a block diagram of a terahertz image streak noise processing system in an embodiment of the present invention.

具体实施方式detailed description

本发明为了解决现有技术中存在无法有效对太赫兹图像的条纹噪声进行有效消除的技术问题,进而提供了一种太赫兹图像条纹噪声处理方法及系统,进而能够有效对太赫兹条纹噪声进行消除。In order to solve the technical problem that the fringe noise of the terahertz image cannot be effectively eliminated in the prior art, the present invention further provides a method and system for processing the fringe noise of the terahertz image, which can effectively eliminate the fringe noise of the terahertz image .

为了更好的理解本发明的技术方案,下面将结合说明书附图以及具体的实施方式对本发明技术方案进行详细的说明。In order to better understand the technical solution of the present invention, the technical solution of the present invention will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

本发明实施例提供的一种太赫兹图像条纹噪声处理方法,如图1所示,包括:S101,对获取的太赫兹图像数据进行傅里叶变换,获得表征所述太赫兹图像数据的频域特征的频域图;S102,对该频域图进行第一次带阻滤波,用于消除条纹噪声所在的频率范围的周期噪声;S103,对经过第一次带阻滤波的频域图进行高通滤波,用于衰减或抑制低频分量,突出剩余的条纹噪声;S104,对经过高通滤波的频域图进行第二次带阻滤波,用于对第一次带阻滤波未滤除完全的条纹噪声进行第二次带阻滤波;S105,将经过第二次带阻滤波的频域图采用傅里叶逆变换,转换为时域图。A method for processing streak noise in a terahertz image provided by an embodiment of the present invention, as shown in FIG. 1 , includes: S101, performing Fourier transform on the acquired terahertz image data to obtain a frequency domain characterizing the terahertz image data The frequency-domain image of the feature; S102, performing the first band-rejection filter on the frequency-domain image to eliminate the periodic noise in the frequency range where the streak noise is located; S103, performing high-pass on the frequency-domain image after the first band-rejection filter Filtering, used to attenuate or suppress low-frequency components, highlighting the remaining streak noise; S104, performing a second band-stop filter on the high-pass filtered frequency domain image, used to filter out the streak noise that was not completely filtered out by the first band-stop filter Perform a second band-rejection filtering; S105, convert the frequency-domain image after the second band-rejection filtering into a time-domain image by inverse Fourier transform.

在具体的实施方式中,获取的太赫兹图像数据可以是太赫兹成像系统已经获得并存储于存储器中的图像数据,从存储器中读出,也可以是太赫兹外成像系统当前实施采集获得的图像数据,具体的原始图像如图2a所示。In a specific implementation, the acquired terahertz image data can be the image data that has been acquired by the terahertz imaging system and stored in the memory, read from the memory, or it can be the image currently acquired by the terahertz imaging system Data, the specific original image is shown in Figure 2a.

具体地,对该获取的太赫兹图像数据进行傅里叶变换,获得表征太赫兹图像数据的频域特征的频域图,具体包括:采用傅里叶变换对获取的太赫兹图像数据的频谱移频到原点,使得太赫兹图像的频率分布以原点为圆心,对称分布;接着,从该经过傅里叶变换的太赫兹图像上获得频率分布,除圆心亮点外,还存在对称分布的亮点集合,该亮点集合为干扰噪音产生的,及周期性规律的干扰信号。Specifically, Fourier transform is performed on the acquired terahertz image data to obtain a frequency domain map representing the frequency domain characteristics of the terahertz image data, which specifically includes: using Fourier transform to shift the frequency spectrum of the acquired terahertz image data frequency to the origin, so that the frequency distribution of the terahertz image is symmetrically distributed with the origin as the center; then, the frequency distribution is obtained from the Fourier-transformed terahertz image, in addition to the bright spot at the center of the circle, there is also a set of bright spots with symmetrical distribution, The set of bright spots is generated by interference noise and a periodic interference signal.

上述在将频谱移频到圆心可以清晰看到图像频率分布,而且可以分离出有周期性规律的干扰信号,频移到原点的频谱图上可以看出除了圆心以外还存在以某一点为中心,对称分布的亮点集合,这个亮点集合就是干扰噪音产生的,这时可以很直观的通过在该位置放置带阻滤波器消除干扰。具体的经过傅里叶变换后获得的频域图如图2b所示。The frequency distribution of the image can be clearly seen when the frequency spectrum is shifted to the center of the circle above, and the periodic interference signal can be separated. It can be seen from the frequency shift to the origin of the spectrum diagram that there is a certain point as the center in addition to the center of the circle. Symmetrically distributed bright spot set, this bright spot set is generated by interference noise, at this time, it is very intuitive to eliminate the interference by placing a band-stop filter at this position. A specific frequency domain diagram obtained after Fourier transform is shown in FIG. 2b.

由于在S101中获得的频域图可以看到干涉条纹噪声所在的频域范围,因此,在S102中可以构造合适的第一带阻滤波器,将该构造的第一带阻滤波器对应的公式和太赫兹图像数据傅里叶变换后对应的公式相乘,滤除频域中大部分的条纹噪声成分。Since the frequency domain map obtained in S101 can see the frequency domain range where the interference fringe noise is located, therefore, in S102, a suitable first band-stop filter can be constructed, and the formula corresponding to the constructed first band-stop filter Multiply with the formula corresponding to the Fourier transform of the terahertz image data to filter out most of the fringe noise components in the frequency domain.

该第一带阻滤波器是用来抑制距离频域中心一定距离的一个圆环区域的频率,可以用来消除一定频率范围的周期噪声,对进行第一带阻滤波的第一带阻滤波器的选取,具体步骤如下:The first band-stop filter is used to suppress the frequency of a ring area at a certain distance from the center of the frequency domain, and can be used to eliminate periodic noise in a certain frequency range. For the first band-stop filter that performs the first band-stop filtering selection, the specific steps are as follows:

从该带阻滤波器的公式为:The formula from this bandstop filter is:

其中,D0为需要阻止的频率点与频率中心的距离,W为带阻滤波器的带宽,对于大小为M*N的图像,频率点(u,v)与频域中心的距离为D0(u,v),其表达式为H0(u,v)为所需带阻滤波器公式,当其值为1时,对此频域下的波段完全通过,当其值为0时,对此频域下的波段完全滤除。根据该频域范围,获得需要阻止的频率点与频域中心距离D0和带阻滤波器的宽带W。从而获得第一带通滤波器的参数。Among them, D 0 is the distance between the frequency point to be blocked and the frequency center, W is the bandwidth of the band-stop filter, and for an image of size M*N, the distance between the frequency point (u, v) and the frequency domain center is D 0 (u,v), whose expression is H 0 (u, v) is the required band-stop filter formula, when its value is 1, the band under this frequency domain is completely passed, when its value is 0, the band under this frequency domain is completely filtered . According to the range of the frequency domain, the distance D 0 between the frequency point to be blocked and the center of the frequency domain and the bandwidth W of the band-stop filter are obtained. Thus, parameters of the first bandpass filter are obtained.

接着,在S103中,对经过第一次带阻滤波的频域图进行高通滤波,用于衰减或抑制低频分量,突出剩余的条纹噪声。具体地,对该经过第一次带阻滤波的频域图采用巴特沃斯滤波器进行二阶高通滤波处理,用于衰减或抑制低频分量,突出剩余的条纹噪声,具体地,该巴特沃斯滤波器是傅里叶频域中的一种滤波器类型,该巴特沃斯滤波器的传递函数的截断部分的梯度可以由指数n控制,低阶的巴特沃斯滤波器的截断部分不会很陡,振铃效果可以减轻或者避免。该巴特沃斯滤波器的特点是同频带内的频率响应曲线最大限度平坦,没有起伏,而在阻频带逐渐下降为零。在振幅的对数对角频率的波特图上,从某一边界角频率开始,振幅随着角频率的增加而逐渐减少,趋向负无穷大,二阶巴特沃斯滤波器的衰减率为每倍频12分贝。Next, in S103 , high-pass filtering is performed on the frequency-domain image that has undergone the first band-rejection filtering, so as to attenuate or suppress low-frequency components and highlight remaining streak noise. Specifically, the Butterworth filter is used to perform second-order high-pass filtering on the frequency-domain image that has undergone the first band-rejection filter, which is used to attenuate or suppress low-frequency components and highlight the remaining streak noise. Specifically, the Butterworth The filter is a type of filter in the Fourier frequency domain. The gradient of the truncated part of the transfer function of the Butterworth filter can be controlled by the exponent n, and the truncated part of the low-order Butterworth filter will not be very Steep, the ringing effect can be mitigated or avoided. The characteristic of the Butterworth filter is that the frequency response curve in the same frequency band is as flat as possible without fluctuations, and it gradually decreases to zero in the stop frequency band. On the Bode plot of the logarithmic diagonal frequency of the amplitude, starting from a certain boundary angular frequency, the amplitude gradually decreases with the increase of the angular frequency, tending to negative infinity, and the attenuation rate of the second-order Butterworth filter per time Frequency 12dB.

具体地,巴特沃斯高通滤波器的传递函数为Specifically, the transfer function of the Butterworth high-pass filter is

其中,D1为巴特沃斯滤波器的截止频率,n为巴特沃斯滤波器的阶数,用来控制巴特沃斯滤波器的陡峭程度,对于大小为M*N的图像,频率点(u,v)与频域中心的距离为D1(u,v),其表达式为 Among them, D 1 is the cut-off frequency of the Butterworth filter, n is the order of the Butterworth filter, which is used to control the steepness of the Butterworth filter. For an image with a size of M*N, the frequency points (u , v) is D 1 (u,v) from the center of the frequency domain, and its expression is

经过上述巴特沃斯滤波器的之后的频域图由图2c所示,能够看到其中一些干涉条纹并未滤除干净,可以通过此时的频域图找出这些干涉条纹所在的频域范围,便于再次滤波。The frequency domain diagram after the above-mentioned Butterworth filter is shown in Figure 2c. It can be seen that some of the interference fringes have not been filtered out, and the frequency domain range of these interference fringes can be found through the frequency domain diagram at this time. , which is convenient for re-filtering.

因此,在S104中,对经过高通滤波的频域图进行第二次带阻滤波,用于对第一次带阻滤波未滤除完全的条纹噪声进行第二次带阻滤波,获得如图2d所示,此时该第二次带阻滤波采用的第二带阻滤波器也需要构造,由于在第一次带阻滤波过程中,干涉条纹排列紧密,频域图上光电所在位置离中心原点较近,直径较大,因此,该第一带阻滤波器中所选的需要阻止的频率点与频率中心的距离值小,带宽W值大;第二次带阻滤波过程中,干涉条纹排列疏松,频域图上光电所在位置离中心原点较远,直径较小,所以该第二带阻滤波器所选的需要阻止的频率点与频率中心的距离值较大,带宽W值较小,具体地,就是第二带阻滤波器所选的需要阻止的频率点与频率中心的距离大于第一带阻滤波器所选的需要阻止的频率点与频率中心的距离,第二带阻滤波器的带宽小于第一带阻滤波器的带宽。Therefore, in S104, a second band-stop filter is performed on the high-pass filtered frequency-domain image, which is used to perform a second band-stop filter on the streak noise that was not completely filtered out by the first band-stop filter, and the obtained As shown, the second band-stop filter used in the second band-stop filtering also needs to be constructed at this time. Since the interference fringes are closely arranged during the first band-stop filtering process, the photoelectric position on the frequency domain map is far from the center origin Closer and larger in diameter, therefore, the distance between the frequency point to be blocked and the frequency center selected in the first band-stop filter is small, and the bandwidth W value is large; in the second band-stop filtering process, the interference fringe arrangement Loose, the position of the photoelectricity on the frequency domain diagram is far away from the center origin, and the diameter is small, so the distance between the frequency point to be blocked and the frequency center selected by the second band-stop filter is relatively large, and the bandwidth W value is small. Specifically, the distance between the frequency point that needs to be blocked and the frequency center selected by the second band-stop filter is greater than the distance between the frequency point that needs to be blocked and the frequency center selected by the first band-stop filter, and the second band-stop filter The bandwidth of is smaller than the bandwidth of the first band-stop filter.

最后,执行S105,将经过第二次带阻滤波的频域图采用傅里叶逆变换,转换为时域图。具体如图2e所示。Finally, S105 is executed to convert the frequency-domain image after the second band-stop filtering into a time-domain image by inverse Fourier transform. Specifically shown in Figure 2e.

由图2e可以看出图像的对比度比较低,为了强调图像的整体或局部特性,将原来不清晰的图像变得清晰或者强调某些感兴趣的特征,扩大图像中不同物体特征之间的差别,抑制不感兴趣的特征,使之改善图像质量、丰富信息量,加强图像判读和识别效果,满足某些特殊分析的需求,因此,在经过傅里叶逆变换之后,对该时域图调整灰度范围,获得如图2f所示的图。It can be seen from Figure 2e that the contrast of the image is relatively low. In order to emphasize the overall or local characteristics of the image, the original unclear image becomes clear or some interesting features are emphasized, and the difference between different object features in the image is enlarged. Suppress uninteresting features to improve image quality, enrich information, enhance image interpretation and recognition effects, and meet the needs of some special analysis. Therefore, after inverse Fourier transform, adjust the grayscale of the time domain image range, the graph shown in Figure 2f is obtained.

具体地,就是对时域图在0-255的灰度范围内做线性灰度拉伸。具体地,对图像中的像素点进行操作时,用公式描述如下:Specifically, linear grayscale stretching is performed on the time domain image within the grayscale range of 0-255. Specifically, when operating on the pixels in the image, the formula is described as follows:

g(x,y)=f(x,y)*h(x,y),其中是f(x,y)是原图像;h(x,y)为空间转换函数;g(x,y)表示进行处理后的图像。从而得到最终结果图。g(x,y)=f(x,y)*h(x,y), where f(x,y) is the original image; h(x,y) is the space conversion function; g(x,y) Indicates the processed image. to get the final result graph.

使得经过上述处理后的图像不仅消除了条纹噪声,而且还起到图像增强的作用。The image after the above processing not only eliminates the stripe noise, but also plays the role of image enhancement.

基于相同的发明构思,本发明实施例还提供了一种太赫兹图像条纹噪声处理系统,如图3所示,包括:傅里叶变换模块301、第一带阻滤波器302、频域高通滤波器303、第二带阻滤波器304、傅里叶逆变换模块305,其中,傅里叶变换模块301,用于对获取的太赫兹图像数据进行傅里叶变换,获得表征太赫兹图像数据的频域特征的频域图;第一带阻滤波器302,用于对频域图进行第一次带阻滤波,消除条纹噪声所在的频率范围的周期噪声,频域高通滤波器303,用于对经过第一次带阻滤波的频域图进行高通滤波,用于衰减或抑制低频分量,突出剩余的条纹噪声,第二带阻滤波器304,用于对经过高通滤波的频域图进行第二次带阻滤波,对第一次带阻滤波未滤除完全的条纹噪声的进行第二次带阻滤波,傅里叶逆变换模块305,用于将经过第二次带阻滤波的频域图采用傅里叶逆变换,转换为时域图。Based on the same inventive concept, an embodiment of the present invention also provides a terahertz image streak noise processing system, as shown in FIG. device 303, a second band-rejection filter 304, and an inverse Fourier transform module 305, wherein the Fourier transform module 301 is used to perform Fourier transform on the acquired terahertz image data to obtain a representation of the terahertz image data The frequency-domain graph of frequency-domain features; the first band-stop filter 302, used to carry out band-stop filtering for the first time to the frequency-domain graph, to eliminate the periodic noise in the frequency range where the streak noise is located, and the frequency-domain high-pass filter 303, used for Perform high-pass filtering on the frequency-domain image after the first band-stop filtering, for attenuating or suppressing low-frequency components, highlighting the remaining streak noise, and the second band-stop filter 304, for performing the first high-pass filtering on the frequency-domain image after high-pass filtering The second band-stop filtering is to perform the second band-stop filtering on the band-stop filtering that does not filter out the complete streak noise in the first band-stop filtering, and the Fourier inverse transform module 305 is used to convert the frequency domain through the second band-stop filtering The graph is transformed into a time-domain graph using an inverse Fourier transform.

在该具体实施方式中,该太赫兹图像条纹噪声处理系统还包括图像增强模块306,用于对该傅里叶逆变换模块获得的时域图调整灰度范围,从而获得图像增强的图。In this specific embodiment, the terahertz image streak noise processing system further includes an image enhancement module 306, configured to adjust the grayscale range of the time-domain image obtained by the inverse Fourier transform module, so as to obtain an enhanced image.

以上所述仅为本发明实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above is only an embodiment of the present invention, and does not limit the patent scope of the present invention. Any equivalent structure or equivalent process conversion made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in other related technical fields , are all included in the scope of patent protection of the present invention in the same way.

Claims (9)

1. a kind of Terahertz image fringes noise processing method, it is characterised in that including following content:
Fourier transformation is carried out to the Terahertz view data of acquisition, obtains the frequency domain character for characterizing the Terahertz view data Frequency domain figure;
First time bandreject filtering is carried out to the frequency domain figure, for eliminating the periodic noise of the frequency range where fringes noise;
It is prominent remaining for decaying or suppressing low frequency component to carrying out high-pass filtering by the frequency domain figure of first time bandreject filtering Fringes noise;
Second of bandreject filtering is carried out to the frequency domain figure Jing Guo high-pass filtering, for not filtered out completely to first time bandreject filtering Fringes noise carries out second of bandreject filtering;
Inverse Fourier transform will be used by the frequency domain figure of second of bandreject filtering, be converted to time-domain diagram.
2. Terahertz image fringes noise processing method according to claim 1, it is characterised in that passing through by described The frequency domain figure of secondary bandreject filtering uses inverse Fourier transform, after being converted to time-domain diagram, in addition to:
Tonal range is adjusted to the time-domain diagram.
3. Terahertz image fringes noise processing method according to claim 1, it is characterised in that described pair obtains too Hertz view data carries out Fourier transformation, obtains the frequency domain figure for the frequency domain character for characterizing the Terahertz view data, specifically Including:
The frequency spectrum shift frequency of the Terahertz view data obtained using Fourier transform pairs is to origin so that the Terahertz image Frequency distribution is symmetrical using origin as the center of circle;
Frequency distribution is obtained from the Terahertz image Jing Guo Fourier transformation, in addition to the center of circle bright spot, also there is symmetrical point The bright spot set of cloth, the bright spot collection is combined into caused by interfering noise, and the interference signal of periodic regularity.
4. Terahertz image fringes noise processing method according to claim 1, it is characterised in that enter to the frequency domain figure Row first time bandreject filtering, for eliminating the periodic noise of the frequency range where fringes noise, specifically include:
Pair so frequency domain figure is found out on the centrosymmetric bright spot of frequency domain, it is determined that what is needed to use is corresponding with first time bandreject filtering The first bandstop filter;
First bandstop filter is used for the frequency for suppressing a circle ring area apart from frequency domain center pre-determined distance, wherein institute The formula for stating bandstop filter is:
<mrow> <msub> <mi>H</mi> <mn>0</mn> </msub> <mrow> <mo>(</mo> <mi>u</mi> <mo>,</mo> <mi>v</mi> <mo>)</mo> </mrow> <mo>=</mo> <mfenced open = "{" close = ""> <mtable> <mtr> <mtd> <mrow> <mn>1</mn> <mo>,</mo> <msub> <mi>D</mi> <mn>0</mn> </msub> <mrow> <mo>(</mo> <mi>u</mi> <mo>,</mo> <mi>v</mi> <mo>)</mo> </mrow> <mo>&lt;</mo> <msub> <mi>D</mi> <mn>0</mn> </msub> <mo>-</mo> <mfrac> <mi>W</mi> <mn>2</mn> </mfrac> </mrow> </mtd> </mtr> <mtr> <mtd> <mrow> <mn>0</mn> <mo>,</mo> <msub> <mi>D</mi> <mn>0</mn> </msub> <mo>-</mo> <mfrac> <mi>W</mi> <mn>2</mn> </mfrac> <mo>&amp;le;</mo> <msub> <mi>D</mi> <mn>0</mn> </msub> <mrow> <mo>(</mo> <mi>u</mi> <mo>,</mo> <mi>v</mi> <mo>)</mo> </mrow> <mo>&amp;le;</mo> <msub> <mi>D</mi> <mn>0</mn> </msub> <mo>+</mo> <mfrac> <mi>W</mi> <mn>2</mn> </mfrac> </mrow> </mtd> </mtr> <mtr> <mtd> <mrow> <mn>1</mn> <mo>,</mo> <msub> <mi>D</mi> <mn>0</mn> </msub> <mrow> <mo>(</mo> <mi>u</mi> <mo>,</mo> <mi>v</mi> <mo>)</mo> </mrow> <mo>&gt;</mo> <msub> <mi>D</mi> <mn>0</mn> </msub> <mo>+</mo> <mfrac> <mi>W</mi> <mn>2</mn> </mfrac> </mrow> </mtd> </mtr> </mtable> </mfenced> </mrow>
Wherein, D0To need the distance of the Frequency point and center frequency prevented, W is the bandwidth of bandstop filter, is M* for size N image, Frequency point (u, v) and the distance at frequency domain center are D0(u, v), its expression formula are
Formula corresponding to first bandstop filter is multiplied with corresponding formula after Terahertz view data Fourier transformation, Filter out the periodic noise in the frequency domain where fringes noise.
5. Terahertz image fringes noise processing method according to claim 1, it is characterised in that to passing through first time band The frequency domain figure of resistance filtering carries out high-pass filtering, for decaying or suppressing low frequency component, prominent remaining fringes noise, is specially:
Second order high-pass filtering processing is carried out using Butterworth filter to the frequency domain figure by first time bandreject filtering, for declining Subtract or suppress low frequency component, prominent remaining fringes noise, the transmission function formula of the Butterworth filter is specially:
<mrow> <msub> <mi>H</mi> <mn>1</mn> </msub> <mrow> <mo>(</mo> <mi>u</mi> <mo>,</mo> <mi>v</mi> <mo>)</mo> </mrow> <mo>=</mo> <mfrac> <mn>1</mn> <mrow> <mn>1</mn> <mo>+</mo> <msup> <mrow> <mo>&amp;lsqb;</mo> <msub> <mi>D</mi> <mn>1</mn> </msub> <mo>/</mo> <msub> <mi>D</mi> <mn>1</mn> </msub> <mrow> <mo>(</mo> <mi>u</mi> <mo>,</mo> <mi>v</mi> <mo>)</mo> </mrow> <mo>&amp;rsqb;</mo> </mrow> <mn>2</mn> </msup> </mrow> </mfrac> </mrow>
Wherein, D1For the cut-off frequency of Butterworth filter, n is the exponent number of Butterworth filter, for controlling the Bart The steep of Butterworth wave filter, for the image that size is M*N, Frequency point (u, v) and the distance at frequency domain center are D1(u, V), its expression formula is
<mrow> <msub> <mi>D</mi> <mn>1</mn> </msub> <mrow> <mo>(</mo> <mi>u</mi> <mo>,</mo> <mi>v</mi> <mo>)</mo> </mrow> <mo>=</mo> <msup> <mrow> <mo>&amp;lsqb;</mo> <msup> <mrow> <mo>(</mo> <mi>u</mi> <mo>-</mo> <mfrac> <mi>M</mi> <mn>2</mn> </mfrac> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>+</mo> <msup> <mrow> <mo>(</mo> <mi>v</mi> <mo>-</mo> <mi>N</mi> <mo>/</mo> <mn>2</mn> <mo>)</mo> </mrow> <mn>2</mn> </msup> <mo>&amp;rsqb;</mo> </mrow> <mrow> <mn>1</mn> <mo>/</mo> <mn>2</mn> </mrow> </msup> <mo>.</mo> </mrow>
6. Terahertz image fringes noise processing method according to claim 4, it is characterised in that the second bandstop filter The Frequency point that prevents of needs and the distance of center frequency be more than Frequency point and the frequency that the needs of the first bandstop filter prevent The distance at center, the bandwidth of second bandstop filter are less than the bandwidth of the first bandstop filter, second bandreject filtering Device is that second of bandreject filtering uses, and the first bandstop filter is what first time bandreject filtering used.
7. Terahertz image fringes noise processing method according to claim 2, it is characterised in that adjusted to the time-domain diagram Whole tonal range, it is specially:
Linear gradation stretching is done in 0-255 tonal range to the time-domain diagram.
A kind of 8. Terahertz image fringes noise processing system, it is characterised in that including:
Fourier transformation module, for carrying out Fourier transformation to the Terahertz view data of acquisition, obtain and characterize the terahertz The hereby frequency domain figure of the frequency domain character of view data;
First bandstop filter, for carrying out first time bandreject filtering to the frequency domain figure, eliminate the frequency where fringes noise The periodic noise of scope;
Frequency domain high-pass filter, for carrying out high-pass filtering to the frequency domain figure for passing through first time bandreject filtering, for decaying or pressing down Low frequency component processed, prominent remaining fringes noise;
Second bandstop filter, for carrying out second of bandreject filtering to the frequency domain figure Jing Guo high-pass filtering, band for the first time is hindered Filtering does not filter out second of bandreject filtering of carry out of complete fringes noise;
Inverse Fourier transform module, for inverse Fourier transform will to be used by the frequency domain figure of second of bandreject filtering, be converted to Time-domain diagram.
9. Terahertz image fringes noise processing system according to claim 8, it is characterised in that also include:
Image enhancement module, for adjusting tonal range to the time-domain diagram.
CN201710732679.7A 2017-08-23 2017-08-23 Terahertz image stripe noise processing method and system Active CN107481205B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710732679.7A CN107481205B (en) 2017-08-23 2017-08-23 Terahertz image stripe noise processing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710732679.7A CN107481205B (en) 2017-08-23 2017-08-23 Terahertz image stripe noise processing method and system

Publications (2)

Publication Number Publication Date
CN107481205A true CN107481205A (en) 2017-12-15
CN107481205B CN107481205B (en) 2020-06-09

Family

ID=60602454

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710732679.7A Active CN107481205B (en) 2017-08-23 2017-08-23 Terahertz image stripe noise processing method and system

Country Status (1)

Country Link
CN (1) CN107481205B (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108537735A (en) * 2018-04-16 2018-09-14 电子科技大学 A kind of image split-joint method of focal plane terahertz imaging
CN109146812A (en) * 2018-08-16 2019-01-04 上海波汇科技股份有限公司 A method of the endoscopic images based on frequency domain filtering remove hexagon noise
CN109993174A (en) * 2018-12-25 2019-07-09 华中科技大学 A method and system for air target detection based on noise suppression
CN110245384A (en) * 2019-05-16 2019-09-17 中国工程物理研究院激光聚变研究中心 A kind of parasitic striped removing method and device based on characteristic frequency spectrum bandreject filtering
CN110837130A (en) * 2019-11-22 2020-02-25 中国电子科技集团公司第四十一研究所 Target automatic detection algorithm based on millimeter wave/terahertz wave radiation
CN110838093A (en) * 2019-11-05 2020-02-25 安徽大学 Efficient and high-quality fMOST or MOST microscopic image stripe noise removing method
CN110866874A (en) * 2019-10-21 2020-03-06 南京大学 Method for removing periodic noise in light field reconstruction image based on frequency domain
CN111539967A (en) * 2020-04-24 2020-08-14 电子科技大学 A method and system for identifying and processing interference fringe regions in focal plane terahertz imaging
CN111784617A (en) * 2020-06-09 2020-10-16 国家卫星气象中心(国家空间天气监测预警中心) An image processing method and device
CN111855672A (en) * 2020-07-29 2020-10-30 佛山市南海区广工大数控装备协同创新研究院 A method of COF soft board defect detection
CN115272137A (en) * 2022-09-28 2022-11-01 北京万龙精益科技有限公司 Real-time fixed mode noise removing method, device, medium and system based on FPGA
CN116074645A (en) * 2022-11-29 2023-05-05 哈尔滨工业大学 Active suppression method for image stripe noise
CN117830141A (en) * 2024-03-04 2024-04-05 奥谱天成(成都)信息科技有限公司 Method, medium, equipment and device for removing vertical stripe noise of infrared image

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140231648A1 (en) * 2013-02-20 2014-08-21 Battelle Energy Alliance, Llc Terahertz imaging devices and systems, and related methods, for detection of materials
CN104517270A (en) * 2014-12-25 2015-04-15 深圳市一体太赫兹科技有限公司 Terahertz image processing method and system
CN104517269A (en) * 2014-12-25 2015-04-15 深圳市一体太赫兹科技有限公司 Terahertz image strip processing method and system
CN104574300A (en) * 2014-12-25 2015-04-29 深圳市一体太赫兹科技有限公司 Terahertz image noise processing method and system
US20160216202A1 (en) * 2013-09-17 2016-07-28 Commissariat à I'énergie atomique et aux énergies alternatives Terahertz image sensor
CN106204490A (en) * 2016-07-12 2016-12-07 厦门大学 A kind of terahertz pulse image de-noising method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140231648A1 (en) * 2013-02-20 2014-08-21 Battelle Energy Alliance, Llc Terahertz imaging devices and systems, and related methods, for detection of materials
US20160216202A1 (en) * 2013-09-17 2016-07-28 Commissariat à I'énergie atomique et aux énergies alternatives Terahertz image sensor
CN104517270A (en) * 2014-12-25 2015-04-15 深圳市一体太赫兹科技有限公司 Terahertz image processing method and system
CN104517269A (en) * 2014-12-25 2015-04-15 深圳市一体太赫兹科技有限公司 Terahertz image strip processing method and system
CN104574300A (en) * 2014-12-25 2015-04-29 深圳市一体太赫兹科技有限公司 Terahertz image noise processing method and system
CN106204490A (en) * 2016-07-12 2016-12-07 厦门大学 A kind of terahertz pulse image de-noising method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
邹园园 等: "基于频域滤波的THz图像条纹噪声处理", 《S计算机工程与应用》 *
陈霖: "连续太赫兹波图像去噪与对比度增强研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108537735A (en) * 2018-04-16 2018-09-14 电子科技大学 A kind of image split-joint method of focal plane terahertz imaging
CN109146812A (en) * 2018-08-16 2019-01-04 上海波汇科技股份有限公司 A method of the endoscopic images based on frequency domain filtering remove hexagon noise
CN109146812B (en) * 2018-08-16 2022-09-06 上海波汇科技有限公司 Method for removing hexagonal noise from endoscope image based on frequency domain filtering
CN109993174B (en) * 2018-12-25 2021-01-05 华中科技大学 A method and system for air target detection based on noise suppression
CN109993174A (en) * 2018-12-25 2019-07-09 华中科技大学 A method and system for air target detection based on noise suppression
CN110245384A (en) * 2019-05-16 2019-09-17 中国工程物理研究院激光聚变研究中心 A kind of parasitic striped removing method and device based on characteristic frequency spectrum bandreject filtering
CN110866874A (en) * 2019-10-21 2020-03-06 南京大学 Method for removing periodic noise in light field reconstruction image based on frequency domain
CN110866874B (en) * 2019-10-21 2021-07-30 南京大学 A Method of Removing Periodic Noise in Light Field Reconstructed Image Based on Frequency Domain
CN110838093A (en) * 2019-11-05 2020-02-25 安徽大学 Efficient and high-quality fMOST or MOST microscopic image stripe noise removing method
CN110838093B (en) * 2019-11-05 2022-06-10 安徽大学 Fringe noise removing method for fMOST or MOST microscopic image
CN110837130A (en) * 2019-11-22 2020-02-25 中国电子科技集团公司第四十一研究所 Target automatic detection algorithm based on millimeter wave/terahertz wave radiation
CN111539967B (en) * 2020-04-24 2023-03-28 电子科技大学 Method and system for identifying and processing interference fringe region in terahertz imaging of focal plane
CN111539967A (en) * 2020-04-24 2020-08-14 电子科技大学 A method and system for identifying and processing interference fringe regions in focal plane terahertz imaging
CN111784617B (en) * 2020-06-09 2023-08-15 国家卫星气象中心(国家空间天气监测预警中心) Image processing method and device
CN111784617A (en) * 2020-06-09 2020-10-16 国家卫星气象中心(国家空间天气监测预警中心) An image processing method and device
CN111855672A (en) * 2020-07-29 2020-10-30 佛山市南海区广工大数控装备协同创新研究院 A method of COF soft board defect detection
CN115272137A (en) * 2022-09-28 2022-11-01 北京万龙精益科技有限公司 Real-time fixed mode noise removing method, device, medium and system based on FPGA
CN115272137B (en) * 2022-09-28 2022-12-20 北京万龙精益科技有限公司 Real-time fixed pattern noise removing method, device, medium and system based on FPGA
CN116074645A (en) * 2022-11-29 2023-05-05 哈尔滨工业大学 Active suppression method for image stripe noise
CN116074645B (en) * 2022-11-29 2024-02-09 哈尔滨工业大学 Active suppression method for image stripe noise
CN117830141A (en) * 2024-03-04 2024-04-05 奥谱天成(成都)信息科技有限公司 Method, medium, equipment and device for removing vertical stripe noise of infrared image
CN117830141B (en) * 2024-03-04 2024-05-03 奥谱天成(成都)信息科技有限公司 Method, medium, equipment and device for removing vertical stripe noise of infrared image

Also Published As

Publication number Publication date
CN107481205B (en) 2020-06-09

Similar Documents

Publication Publication Date Title
CN107481205A (en) A kind of Terahertz image fringes noise processing method and system
CN111311510B (en) Method and device for removing stripe noise in image
El Helou et al. Stochastic frequency masking to improve super-resolution and denoising networks
CN106462957A (en) A method and system for removing streak noise in an infrared image
CN103345732B (en) Based on PCNN algorithm for image enhancement and the device of contourlet transformation
CN109816599A (en) An image strip noise suppression method based on wavelet decomposition convolutional neural network
CN104504664B (en) The automatic strengthening system of NSCT domains underwater picture based on human-eye visual characteristic and its method
Chen et al. Adaptive wavelet filter with edge compensation for remote sensing image denoising
CN108537735B (en) An image stitching method for focal plane terahertz imaging
CN105741305A (en) Method and system for filtering electromyographical interference based on stationary wavelet transformation
Dai et al. Study on infrared image detail enhancement algorithm based on adaptive lateral inhibition network
CN109993174B (en) A method and system for air target detection based on noise suppression
CN109949329B (en) Phase Stretch Transform PST Image Edge Detection Method Based on Phase Consistency
CN104103040A (en) Image enhancement method
Fan et al. Adaptive enhancement for infrared image using shearlet frame
CN106570890B (en) A method of multidate information in friction speed section in extraction sun high resolution sequence image
CN103310414A (en) Image enhancement method based on directionlet transform and fuzzy theory
CN105139362A (en) Image enhancing method based on frequency domain
CN106384341A (en) Millimeter wave passive image enhancement method based on target polarization radiation characteristics
Guo et al. Ghost imaging of the low or high frequency based on the corresponding spatial-frequency of the reference pattern
CN109212749A (en) A kind of filter plate and its design method for realizing edge enhancing imaging
Wang et al. Modulation transfer function of an imaging system with a hexagonal pixel array detector
Rao et al. Denoising and enhancement of medical images using wavelets in LabVIEW
Allaberdiev et al. Speeded-up robust feature matching algorithm based on image improvement technology
CN108665422B (en) Single-frame infrared heterogeneity detection method based on reverse sensing in Fourier domain

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant