Nothing Special   »   [go: up one dir, main page]

CN102507147A - Real-time evaluation system for performance of self-adaptive optical system - Google Patents

Real-time evaluation system for performance of self-adaptive optical system Download PDF

Info

Publication number
CN102507147A
CN102507147A CN2011103110705A CN201110311070A CN102507147A CN 102507147 A CN102507147 A CN 102507147A CN 2011103110705 A CN2011103110705 A CN 2011103110705A CN 201110311070 A CN201110311070 A CN 201110311070A CN 102507147 A CN102507147 A CN 102507147A
Authority
CN
China
Prior art keywords
real
digital signal
signal processor
adaptive optics
optics systems
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011103110705A
Other languages
Chinese (zh)
Other versions
CN102507147B (en
Inventor
母杰
饶长辉
李梅
郑文佳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Optics and Electronics of CAS
Original Assignee
Institute of Optics and Electronics of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Optics and Electronics of CAS filed Critical Institute of Optics and Electronics of CAS
Priority to CN201110311070.5A priority Critical patent/CN102507147B/en
Publication of CN102507147A publication Critical patent/CN102507147A/en
Application granted granted Critical
Publication of CN102507147B publication Critical patent/CN102507147B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Optical Communication System (AREA)

Abstract

The invention provides a real-time evaluation system of the performance of a self-adaptive optical system, which comprises an input interface module (1), a programmable logic device (2), a digital signal processor (3), a storage module (4) and an output interface module (5), wherein the input interface module (1) receives synchronous signals and data signals, the programmable logic device (2) realizes high-speed preprocessing of the front end, the digital signal processor (3) realizes subsequent operation with high complexity, and the output interface module (5) outputs calculated performance indexes; the memory module (4) is used for improving the capacity of the digital signal processor (3) for storing data and programs. The invention realizes the evaluation of the compensation capability of the adaptive optical system to the disturbance of the atmospheric turbulence in the working process, has good real-time performance, small volume and easy large-scale integration, and can be applied to different adaptive optical systems on the basis of not changing the realization of hardware.

Description

A kind of Real-Time Evaluation system of ADAPTIVE OPTICS SYSTEMS performance
Technical field
The present invention relates to high speed signal disposal system technical field, particularly a kind of Real-Time Evaluation system of ADAPTIVE OPTICS SYSTEMS performance, the performance parameter of calculating ADAPTIVE OPTICS SYSTEMS is estimated its compensation ability to the atmospheric turbulence disturbance in the time of in fact.
Background technology
(Adaptive Optics, AO) technology can real-time detection also be proofreaied and correct the random wave front-distortion that is caused by the atmospheric turbulence disturbance to adaptive optics, is widely used in fields such as astronomical sight and Laser Transmission.ADAPTIVE OPTICS SYSTEMS is directly connected to the quality of celestial body target imaging and the focusing effect of laser to the compensation ability of atmospheric turbulence disturbance; Usually adopt following index as its effect judging basis: Si Telieer than (Strehl Ratio; SR), full width at half maximum (Full Width HalfMaximum; FWHM), point spread function (Point Spread Function, PSF), modulation transfer function (ModulationTransfer Function, MTF) etc.
Performance to ADAPTIVE OPTICS SYSTEMS is estimated, and traditional realization means are in ADAPTIVE OPTICS SYSTEMS, to build imaging system.During adaptive system work, imaging system is responsible for gathering the far field image of target, the performance of ADAPTIVE OPTICS SYSTEMS is being carried out calculated off-line and analysis afterwards.The problem that this method is brought has: one, can not be in real time and reflect the correcting feature of ADAPTIVE OPTICS SYSTEMS intuitively; Two, need build imaging system, make the structure of ADAPTIVE OPTICS SYSTEMS more complicated, when the ADAPTIVE OPTICS SYSTEMS light path changes, need readjust the light path of imaging system, use inconvenience; Three, according to the picture characteristics of target, this method can only be used for the ADAPTIVE OPTICS SYSTEMS of point target, can not be used to expand the ADAPTIVE OPTICS SYSTEMS of target, like sun ADAPTIVE OPTICS SYSTEMS.
Along with the development of technology, the performance of on-line evaluation ADAPTIVE OPTICS SYSTEMS becomes an important research direction.Shack-Hartmann wave front sensor is a kind ofly to be measured as the wavefront testing tool on basis with average gradient, can detect time response and spatial character that Wave-front phase distributes, can obtain the near field and the far field situation of tested wavefront according to these information.Therefore, can carry out the on-line performance evaluation of ADAPTIVE OPTICS SYSTEMS according to the residual mean slope.6 performance parameters that TMS320C40DSP comes to calculate in real time atmospheric turbulence parameter and ADAPTIVE OPTICS SYSTEMS have been adopted among the NAOS of European Southern Observatory ESO (Nasmyth Adaptive Optics System); Wherein, the calculating refresh cycle of ADAPTIVE OPTICS SYSTEMS performance parameter is 2 minutes; Adopt the associative processor crowd to realize the performance evaluation that ADAPTIVE OPTICS SYSTEMS is online in the SPARTA platform.In the on-line performance evaluation module of NAOS and the design of SPARTA, exist following not enough: use more chip, hardware cost is bigger, and integrated level is not high; Computing power is limited, causes refresh time longer at interval.
PLD has abundant register resources and a large number of users IO; Help the utilization of streamline and concurrent technique; The Harvard structure that the inside of digital signal processor adopts program bus and data bus to separate provides special digital signal processing instructions, helps realizing the digital signal processing algorithm of various complicacies; The characteristics of PLD and digital signal processor very are fit to realize the real-time calculating of ADAPTIVE OPTICS SYSTEMS performance parameter.
Summary of the invention
The technical matters that the present invention will solve is: utilize PLD and digital signal processor; Design a kind of Real-Time Evaluation system of ADAPTIVE OPTICS SYSTEMS performance; According to the residual wave front slope that Shack-Hartmann wave front sensor is surveyed, calculate in real time and characterize the performance index parameter of ADAPTIVE OPTICS SYSTEMS atmospheric turbulence disturbance compensation ability.
The present invention solves the problems of the technologies described above the technical scheme that is adopted: a kind of Real-Time Evaluation system of ADAPTIVE OPTICS SYSTEMS performance; Comprise input interface module, PLD, digital signal processor, memory module and output interface module; Wherein, input interface module receives synchronizing signal and data-signal, and PLD is realized the high speed pre-service of front end; The follow-up computing that the digital signal processor implementation complexity is high, output interface module is with the performance index output of calculating; Memory module is used to improve the ability of digital signal processor storage data and program.
Further, described interface module adopts high-speed bus to realize the transmission of signal.
Further, described PLD is realized the high speed pre-service of front end by address generation module and ping-pong buffer module.
Further; Usage counter is counted the data useful signal in the synchronizing signal in the generation module of described address; Count results is as the sub-aperture location of the pairing Shack-Hartmann wave front sensor of current data signal, and the frame useful signal in the synchronizing signal is responsible for counter O reset.
Further, described ping-pong buffer module uses two RAM to constitute, and by address generation module addressing, uses the ping-pong cache data signals.
Further, described digital signal processor is accomplished complicated follow-up computing, and the control output interface module is exported performance index.
Further, described memory module is expanded storer outward as the sheet of digital signal processor, is used to improve the ability of digital signal processor storage data and program.
Further, the mode with streamline is worked between PLD and the digital signal processor.
Principle of the present invention is: traditional obtains the target far field image based on imaging system, estimates the method for ADAPTIVE OPTICS SYSTEMS performance, can only calculate afterwards; Can not real-time implementation, use inconvenience, the scope of application is little; Point target can only be applied to, target can not be used to expand.Shack-Hartmann wave front sensor is that the core of ADAPTIVE OPTICS SYSTEMS is formed one of structure; Can survey the residual wave front slope; According to the residual wave front slope; Can detect time response and spatial character that Wave-front phase distributes, can access the near field and the far field situation of tested wavefront, so can be used to weigh the performance of ADAPTIVE OPTICS SYSTEMS according to these information.
The advantage that the present invention has: the characteristics that combined PLD and digital signal processor; Adopt PLD to realize the high speed pre-service of front end; Guarantee real-time, realize rear end complex mathematical computing, guarantee the degree of accuracy of result of calculation with digital signal processor.Can realize and the seamless link of ADAPTIVE OPTICS SYSTEMS, can be used as an independent module and be present in the ADAPTIVE OPTICS SYSTEMS.This disposal system has very high calculating handling capacity; Can in the ADAPTIVE OPTICS SYSTEMS course of work, realize the ADAPTIVE OPTICS SYSTEMS performance index in line computation; Have good real-time, and have very high integrated level and versatility, promoted the miniaturization and the compatibility of device.
Description of drawings
Fig. 1 is the Real-Time Evaluation entire system electrical block diagram of ADAPTIVE OPTICS SYSTEMS performance of the present invention;
Fig. 2 is the inner structure synoptic diagram of the PLD among the present invention;
Fig. 3 is the sequential chart of input data signal, PLD, digital signal processor among the present invention.
Wherein, 1 is input interface module; 2 is PLD; 3 is digital signal processor; 4 is memory module; 5 is output interface module.
Embodiment
Below in conjunction with accompanying drawing and embodiment the present invention is further specified.
As shown in Figure 1, a kind of Real-Time Evaluation system of ADAPTIVE OPTICS SYSTEMS performance comprises input interface module 1, PLD 2, digital signal processor 3, memory module 4 and output interface module 5.Synchronizing signal and data-signal are through the form entering Real-Time Evaluation system of input interface module 1 with data stream; The data-signal of 2 pairs of high speeds of PLD carries out pre-service, under the control of address generation module, data-signal is stored in the ping-pong buffer module.Ping-pong buffer module output terminal is connected with digital signal processor 3.Digital signal processor 3 obtains the follow-up computing that pretreated signal results is carried out the ADAPTIVE OPTICS SYSTEMS performance index from the ping-pong buffer module.PLD 2 and digital signal processor 3 are through carrying out the exchange that read-write operation is realized data to the ping-pong buffer module.The result of calculation of performance index is through output interface module 5 outputs.Memory module 4 is connected with digital signal processor 3, expands storer outward as the sheet of digital signal processor 3, improves the ability of signal processor 3 storage data and program.
It is that residual wave front slope signal g is operated that the data-signal of 2 pairs of high speeds of described PLD carries out pre-service:
g ‾ k x = g k x - - - ( 1 )
Wherein, K representes k group residual wave front slope signal; X representes the x frame in the k group residual wave front slope signal, and expression is to the pre-service result of the x frame in the k group residual wave front slope signal.
Described digital signal processor 3 obtains the follow-up computing that pretreated signal results is carried out the ADAPTIVE OPTICS SYSTEMS performance parameter from the ping-pong buffer module of PLD 2, be the index parameter that calculates measurement ADAPTIVE OPTICS SYSTEMS performance according to the pre-service result
Figure BDA0000098653790000033
of the x frame in the k group residual wave front slope signal: point spread function PSF, Si Telieer are than SR, full width at half maximum FWHM and modulation transfer function MTF.
Point spread function PSF has described target as the optical field distribution on the plane, and by the aberration of incident wavefront and the diffraction limit decision of optical system, it can be expressed as:
PSF=|FT(P(x,y))| 2 (2)
Wherein, FT representes Fourier transform; || 2The expression ask mould square; P (x y) is incident wavefront, is confirmed by amplitude and phase place:
P(x,y)=A(x,y)e iΦ(x,y) (3)
In the following formula, A (x y) is pupil function, Φ (x y) is the PHASE DISTRIBUTION of incident wavefront, can utilize Ze Nike pattern wave front restoration algorithm computation to obtain according to the residual wave front slope:
A = D + · g ‾ k x Φ ( x , y ) = Σ i = 1 n a i Z i ( x , y ) - - - ( 4 )
Wherein, D +Be the inverse matrix of recovery matrix D, by the layout decision in the sub-aperture of Shack-Hartmann wave front sensor;
Figure BDA0000098653790000042
The pre-service result who representes the x frame in the k group residual wave front slope signal; A is the zernike polynomial matrix of coefficients; I is the exponent number that the Ze Nike pattern is restored; a iBe the plain representation of A entry of a matrix, represent i rank zernike polynomial coefficient; Z i(x y) is i rank zernike polynomials.
Peak value SR is defined as far field peak light intensity I and its diffraction limit peak strength I on the actual light beam axle DiffRatio, from the calibration capability of reflection ADAPTIVE OPTICS SYSTEMS in energy aspect to wavefront distortion:
SR = I I diff - - - ( 5 )
Full width at half maximum FWHM refers to the width between first peak value of detection of a target far field image, and the reflection ADAPTIVE OPTICS SYSTEMS is to the calibration capability of wavefront distortion from the resolution aspect.
Modulation transfer function MTF representes the transmission characteristic of optical system to each frequency component contrast, can be obtained by the Fourier transform of point spread function PSF:
MTF=|FT(PSF)| (6)
Wherein, FT representes Fourier transform, || the mould value is asked in expression.
In the ADAPTIVE OPTICS SYSTEMS closed loop course of work, data-signal and synchronizing signal are input in the PLD 2 through input interface module 1 order.Wherein, Data-signal is residual wave front slope
Figure BDA0000098653790000044
(x=1; L), the data-signal of each frame contains 2n road residual wave front slope data, and n is the sub-aperture number of Shack-Hartmann wave front sensor.
As shown in Figure 2, PLD 3 is made up of address generation module and ping-pong buffer module.Address generation module usage counter is counted the data useful signal in the synchronizing signal; Count results is as the sub-aperture location of the pairing Shack-Hartmann wave front sensor of current data signal, and the frame useful signal in the synchronizing signal is responsible for counter O reset.The ping-pong buffer module uses two RAM to constitute, and by address generation module addressing, data-signal is carried out buffer memory with table tennis mode alternately.
Digital signal processor 4 at first obtains pretreated signal results from PLD 3; Accomplish ADAPTIVE OPTICS SYSTEMS performance index point spread function PSF, Si Telieer follow-up computing then than SR, full width at half maximum FWHM and modulation transfer function MTF; Shown in formula (2)~(6), control the result of calculation of output interface module 5 output adaptive Performance of Optical System indexs again.
The on-chip memory finite capacity of digital signal processor, memory module 4 are used for the chip external memory capacity of expansion of digital signal processor, improve the ability of digital signal processor storage data and program.The inverse matrix D of the recovery matrix D described in the formula (4) for example +, i rank zernike polynomial Z iDeng.When program run, move corresponding data as required in the on-chip memory of digital signal processor, solve the contradiction of the big and data storage of data capacity program run limited speed outside sheet the time.
As shown in Figure 3, PLD 2 and the mode collaborative work of digital signal processor 3 with streamline are handled one group of continuous L frame signal data at every turn.When 2 pairs of k+1 groups of PLD data-signal carried out pre-service, digital signal processor calculated the performance index of ADAPTIVE OPTICS SYSTEMS according to the pre-service result of k group data-signal.Since the exchange data using between PLD 2 and the digital signal processor 3 mode read and write of table tennis; K+1 group data-signal will be written into another buffer area of the ping-pong buffer module of PLD 2, can not influence digital signal processor 3 and from the ping-pong buffer module, read the pretreated data-signal of k group completion.The performance index point spread function PSF of the ADAPTIVE OPTICS SYSTEMS that calculates, Si Telieer use { Performance} than SR, full width at half maximum FWHM, modulation transfer function MTF kExpression, subscript represent that these group performance index utilize k to organize data-signal and calculate.The refresh cycle of ADAPTIVE OPTICS SYSTEMS performance index is by the frame frequency of wave front processor, the length of L and the processing speed decision of Real-Time Evaluation system.
The part that the present invention does not set forth in detail belongs to techniques well known.

Claims (8)

1. the Real-Time Evaluation system of an ADAPTIVE OPTICS SYSTEMS performance; Comprise input interface module (1), PLD (2), digital signal processor (3), memory module (4) and output interface module (5); It is characterized in that: input interface module (1) receives synchronizing signal and data-signal; PLD (2) is realized the high speed pre-service of front end, the follow-up computing that digital signal processor (3) implementation complexity is high, and output interface module (5) is with the performance index output of calculating; Memory module (4) is used to improve the ability of digital signal processor (3) storage data and program.
2. the Real-Time Evaluation system of a kind of ADAPTIVE OPTICS SYSTEMS performance according to claim 1 is characterized in that: described interface module (1) adopts high-speed bus to realize the transmission of signal.
3. the Real-Time Evaluation system of a kind of ADAPTIVE OPTICS SYSTEMS performance according to claim 1 is characterized in that: described PLD (2) is realized the high speed pre-service of front end by address generation module and ping-pong buffer module.
4. the Real-Time Evaluation system of a kind of ADAPTIVE OPTICS SYSTEMS performance according to claim 3; It is characterized in that: usage counter is counted the data useful signal in the synchronizing signal in the generation module of described address; Count results is as the sub-aperture location of the pairing Shack-Hartmann wave front sensor of current data signal, and the frame useful signal in the synchronizing signal is responsible for counter O reset.
5. the Real-Time Evaluation system of a kind of ADAPTIVE OPTICS SYSTEMS performance according to claim 3 is characterized in that: described ping-pong buffer module uses two RAM to constitute, and by address generation module addressing, uses the ping-pong cache data signals.
6. the Real-Time Evaluation system of a kind of ADAPTIVE OPTICS SYSTEMS performance according to claim 1 is characterized in that: described digital signal processor (3), accomplish complicated follow-up computing, and control output interface module (5) is exported performance index.
7. the Real-Time Evaluation system of a kind of ADAPTIVE OPTICS SYSTEMS performance according to claim 1; It is characterized in that: described memory module (4); Sheet as digital signal processor (3) is expanded storer outward, is used to improve the ability of digital signal processor (3) storage data and program.
8. the Real-Time Evaluation system of a kind of ADAPTIVE OPTICS SYSTEMS performance according to claim 1 is characterized in that: work with the mode of streamline between PLD (2) and the digital signal processor (3).
CN201110311070.5A 2011-10-14 2011-10-14 Real-time evaluation system for performance of self-adaptive optical system Expired - Fee Related CN102507147B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110311070.5A CN102507147B (en) 2011-10-14 2011-10-14 Real-time evaluation system for performance of self-adaptive optical system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110311070.5A CN102507147B (en) 2011-10-14 2011-10-14 Real-time evaluation system for performance of self-adaptive optical system

Publications (2)

Publication Number Publication Date
CN102507147A true CN102507147A (en) 2012-06-20
CN102507147B CN102507147B (en) 2014-05-28

Family

ID=46219254

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110311070.5A Expired - Fee Related CN102507147B (en) 2011-10-14 2011-10-14 Real-time evaluation system for performance of self-adaptive optical system

Country Status (1)

Country Link
CN (1) CN102507147B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104374546A (en) * 2014-09-25 2015-02-25 太原理工大学 Universal atmosphere turbulence phase screen design method based on diffractive optical element
CN105204405A (en) * 2015-10-21 2015-12-30 中国科学院光电技术研究所 Real-time controller based on multi-sight related shack-Hartmann wavefront sensor
CN105404217A (en) * 2015-10-21 2016-03-16 中国科学院光电技术研究所 Detectable self-adaptive optical electronic control system and design method thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007298307A (en) * 2006-04-27 2007-11-15 Kyocera Corp Module evaluation device and method, program, and recording medium
CN101246256A (en) * 2008-01-11 2008-08-20 中国科学院光电技术研究所 Scalable high-speed wavefront slope processor based on FPGA
CN101303269A (en) * 2007-05-09 2008-11-12 奥林巴斯株式会社 Optical system evaluation apparatus, optical system evaluation method and program thereof
CN101587009A (en) * 2009-07-02 2009-11-25 北京理工大学 Microminiature photoelectric LCD device dynamic image transmission apparatus

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007298307A (en) * 2006-04-27 2007-11-15 Kyocera Corp Module evaluation device and method, program, and recording medium
CN101303269A (en) * 2007-05-09 2008-11-12 奥林巴斯株式会社 Optical system evaluation apparatus, optical system evaluation method and program thereof
CN101246256A (en) * 2008-01-11 2008-08-20 中国科学院光电技术研究所 Scalable high-speed wavefront slope processor based on FPGA
CN101587009A (en) * 2009-07-02 2009-11-25 北京理工大学 Microminiature photoelectric LCD device dynamic image transmission apparatus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李小芸等: "《光学系统成像质量评价基本指标体系的研究》", 《江西科学》 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104374546A (en) * 2014-09-25 2015-02-25 太原理工大学 Universal atmosphere turbulence phase screen design method based on diffractive optical element
CN104374546B (en) * 2014-09-25 2017-01-18 太原理工大学 Universal atmosphere turbulence phase screen design method based on diffractive optical element
CN105204405A (en) * 2015-10-21 2015-12-30 中国科学院光电技术研究所 Real-time controller based on multi-sight related shack-Hartmann wavefront sensor
CN105404217A (en) * 2015-10-21 2016-03-16 中国科学院光电技术研究所 Detectable self-adaptive optical electronic control system and design method thereof
CN105204405B (en) * 2015-10-21 2017-11-24 中国科学院光电技术研究所 Real-time controller based on multi-sight related shack-Hartmann wavefront sensor

Also Published As

Publication number Publication date
CN102507147B (en) 2014-05-28

Similar Documents

Publication Publication Date Title
CN103901617B (en) Wavefront detection-free adaptive optical system based on model
CN102331336B (en) Method and device for measuring focal distance of long-focal-length and large-aperture lens
CN103293663B (en) Self-adaptive optical system for controlling multiple wavefront correctors based on voltage decoupling
CN103310427B (en) Image super-resolution and quality enhancement method
CN106526839A (en) Synchronous wavefront-free self-adaptive optical system based on mode
CN111579097B (en) High-precision optical scattering compensation method based on neural network
CN102507147B (en) Real-time evaluation system for performance of self-adaptive optical system
CN105933060B (en) A kind of wavefront reconstruction method based on dynamics Feedback Neural Network
CN102967379B (en) Wavefront sensor for solar self-adaptive optical system
Archinuk et al. Mitigating the nonlinearities in a pyramid wavefront sensor
CN117977356B (en) Apparatus and method for improving beam quality of large aperture laser
Chen et al. Wavefront measurement method based on improved light field camera
CN108663123A (en) A kind of Hartmann's wavefront reconstruction method to match with micro scanning device
CN101285711A (en) Linear phase inversion wavefront sensor based on area array CCD
CN112099229A (en) High-speed self-adaptive optical closed-loop control method based on far field
Weddell et al. Reservoir computing for prediction of the spatially-variant point spread function
CN114035300B (en) Self-adaptive correction method based on zoom lens under high-capacity space optical communication link
Ding et al. Spatial phase retrieval of vortex beam using convolutional neural network
Chen et al. The improvement of spgd algorithm convergence in satellite-to-ground laser communication links
CN112179503A (en) Deep learning wavefront restoration method based on sparse subaperture shack-Hartmann wavefront sensor
Li et al. Active compensation for perturbed coaxial reflecting space telescope using defocus point spread function and convolutional neural network
Kong et al. On-sky results and performance of low latency centroiding algorithms for adaptive optics implemented in FPGA
US12140774B2 (en) Light field-based beam correction systems and methods
Plemmons et al. Some computational problems arising in adaptive optics imaging systems
US20220171204A1 (en) Light field-based beam correction systems and methods

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20140528

Termination date: 20211014

CF01 Termination of patent right due to non-payment of annual fee