Nothing Special   »   [go: up one dir, main page]

CN103108169A - Mobile terminal which display video frame rate in real time and achieving method thereof - Google Patents

Mobile terminal which display video frame rate in real time and achieving method thereof Download PDF

Info

Publication number
CN103108169A
CN103108169A CN2013100615410A CN201310061541A CN103108169A CN 103108169 A CN103108169 A CN 103108169A CN 2013100615410 A CN2013100615410 A CN 2013100615410A CN 201310061541 A CN201310061541 A CN 201310061541A CN 103108169 A CN103108169 A CN 103108169A
Authority
CN
China
Prior art keywords
video frame
mobile terminal
frame per
real
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2013100615410A
Other languages
Chinese (zh)
Inventor
俞斌
杨维琴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TCL Communication Ningbo Ltd
Original Assignee
TCL Communication Ningbo Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TCL Communication Ningbo Ltd filed Critical TCL Communication Ningbo Ltd
Priority to CN2013100615410A priority Critical patent/CN103108169A/en
Publication of CN103108169A publication Critical patent/CN103108169A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Studio Devices (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The invention discloses a mobile terminal which display a video frame rate in real time and an achieving method of the mobile terminal . The mobile terminal comprises a base band chip, a camera module and a display screen. The camera module and the display screen are in signal connection with the base band chip. The base band chip comprises a frame rate obtaining module. The camera module comprises a lens and an optical sensing module. The lens is used for shooting a video frame image and transmits the image to the optical sensing module. The optical sensing module automatically adjusts, controls and outputs the video frame image according to environment to the frame rate obtaining module. The frame rate obtaining module calculates the frame rate of the video frame image and outputs the frame rate to the display screen for real-time display. The mobile terminal which displays the video frame rate in real time and the achieving method of the mobile terminal can display frame rates of functions such as previewing, shooting and recording in real time and provide technology reference when a professional user uses a mobile terminal camera.

Description

A kind of mobile terminal of real-time display video frame per second and its implementation
Technical field
The present invention relates to mobile communication terminal, relate in particular to mobile terminal and its implementation of a kind of real-time display video frame per second.
Background technology
At present, extensive use in mobile terminal of camera, mobile terminals such as panel computer, mobile phone all possesses camera function, along with the development of technology, the optical pickocff of a lot of cameras can be adjusted the frame per second of output video image automatically according to external environment, for example, under the more sufficient environment of light, optical pickocff is controlled the higher image of output video frame per second, and under the darker environment of light, optical pickocff can be controlled again the lower image of output video frame per second.The prior art camera has possessed the ability of automatically adjusting the output video frame per second according to environment on hardware condition, but the user can not be from direct feel on display screen to the video frame rate of exporting.
Therefore, prior art has yet to be improved and developed.
Summary of the invention
In view of above-mentioned the deficiencies in the prior art part, the present invention proposes a kind of for addressing the deficiencies of the prior art and deficiency.
The technical scheme that technical solution problem of the present invention adopts is as follows:
A kind of mobile terminal of real-time display video frame per second, described mobile terminal comprises baseband chip, camera module and display screen, described camera module, display screen all are connected with the baseband chip signal; Described baseband chip comprises the frame per second acquisition module, and described camera module comprises camera lens and optical sensing module; Described camera lens is used for obtaining video frame images and being transferred to the optical sensing module, described optical sensing module is automatically adjusted according to environment and is controlled and pass through data transmission interface output video two field picture to described frame per second acquisition module, and described frame per second acquisition module calculates the frame per second of video frame images and outputs to display screen and shows in real time.
Described optical sensing module comprises optical pickocff and graphics processing unit, the video frame images that the described camera lens of described optical pickocff induction obtains also is transferred to graphics processing unit with it, and described graphics processing unit is transferred to frame per second acquisition module in described baseband chip by data transmission interface after with the video frame images digitlization.
Described frame per second acquisition module is according to the time interval between two two field pictures of two field picture calculating of data transmission interface input in described camera module, draw the transmission time of each video frame images, then the frame image data that calculates per second transmission outputs to display screen and shows in real time.
Described mobile terminal is mobile phone, panel computer or PDA.
The present invention also provides the implementation method of the real-time display video frame per second of a kind of mobile terminal, realizes based on above-mentioned mobile terminal, comprises the steps:
A. open mobile terminal about the application of camera;
B. described camera lens obtains video frame images and is transferred to the optical sensing module, and described optical sensing module is automatically adjusted according to environment and controlled and pass through data transmission interface output video two field picture to described frame per second acquisition module;
C. described frame per second acquisition module obtains the video frame images of camera module, and the time interval between calculating two adjacent video frames image is to obtain the transmission time of each video frame images;
D. described frame per second acquisition module calculates the number of image frames of per second transmission and outputs to display screen according to transmission time of each video frame images and shows in real time.
Step B specifically comprises: described optical sensing module is provided with optical pickocff, graphics processing unit and data transmission interface, the video frame images that the described camera lens of described optical pickocff induction obtains also is transferred to graphics processing unit with it, and described graphics processing unit is transferred to frame per second acquisition module in described baseband chip by data transmission interface after with the video frame images digitlization.
Step C specifically comprises: the two field picture by described data transmission interface calculates time interval between two two field pictures, the transmission time that draws each video frame images to described frame per second acquisition module according to described graphics processing unit.
Described mobile terminal is mobile phone, panel computer or PDA.
Compared with prior art, the present invention obtains the video frame images of mobile terminal by camera lens, when obtaining each frame video frame images, it is controlled the output frame image to the frame per second acquisition module of baseband chip by optical pickocff, calculated the transmission time of each two field picture by the frame per second acquisition module, then the transmission time according to each frame transmitting image calculates the number of image frames of transmitting each second, it is frame per second, be shown on display screen, the frame per second of the functions such as the present invention possesses real-time demonstration preview, takes pictures, video recording provides Technical Reference when using camera for the user.In addition, can write each two field picture to frame per second information when video recording, frame per second can be presented on display screen when playing this video, remove the computing cost of player calculating frame per second from.
Description of drawings
Fig. 1 is the structural principle block diagram of the mobile terminal of a kind of real-time display video frame per second of the present invention.
Fig. 2 is the syndeton schematic diagram of baseband chip and camera module in Fig. 1.
Fig. 3 is the pin annexation figure of baseband chip and camera module in the mobile terminal of the real-time display video frame per second of the present invention.
Fig. 4 is the flow chart of the implementation method of the real-time display video frame per second of a kind of mobile terminal of the present invention.
Fig. 5 is the sequential chart of a certain frame image signal of camera module output in the implementation method of the real-time display video frame per second of a kind of mobile terminal of the present invention, and a certain frame image data and display screen matrix graph of a relation.
Fig. 6 is the sequential chart of camera module continuous wave output frame image signal in the implementation method of the real-time display video frame per second of a kind of mobile terminal of the present invention.
Embodiment
For making purpose of the present invention, technical scheme and advantage clearer, clear and definite, developing simultaneously referring to accompanying drawing, the present invention is described in more detail for embodiment.Should be appreciated that specific embodiment described herein only in order to explain the present invention, is not intended to limit the present invention.
for most mobile phone users, when using camera to use, can not intuitively see the frame per second that shows up till now image from display screen, this needs to use the image frame per second for part is very inconvenient for the user who uses, the invention provides mobile terminal and its implementation of a kind of real-time display video frame per second, the image frame per second that camera can be obtained is presented on display screen in real time, for providing convenience according to the user that the image frame per second is used, the mobile terminal of indication of the present invention has included but not limited to use the mobile phone of camera, panel computer, the mobile terminals such as PDA.
As shown in Figure 1 to Figure 3, Fig. 1 shows the structural principle block diagram of the mobile terminal of a kind of real-time display video frame per second of the present invention, this mobile terminal comprises baseband chip 10, camera module 20 and display screen 30, baseband chip 10 is electrically connected to respectively with camera module 20, display screen 30 and carries out the signal transmission, wherein, two-way signaling transmission between baseband chip 10 and camera module 20.Shown in Figure 2 is the syndeton schematic diagram of baseband chip and camera module in Fig. 1, this baseband chip 10 comprises frame per second acquisition module 11, this camera module 20 comprises camera lens 21, optical sensing module 22 and data transmission interface 23, wherein, optical sensing module 22 comprises optical pickocff 221 and graphics processing unit 222.
Camera lens 21 is used for obtaining video frame images and being transferred to optical sensing module 22, optical sensing module 22 is automatically adjusted according to environment and is controlled and pass through data transmission interface 23 output video two field pictures to frame per second acquisition module 11, and frame per second acquisition module 11 calculates the frame per second of video frame images and outputs to display screen and shows in real time.Particularly, the video frame images that is obtained by the induction of the optical pickocff 221 in optical sensing module 22 camera lenses 21 also is transferred to graphics processing unit 222 with it, and graphics processing unit 222 is transferred to frame per second acquisition module 11 in baseband chip 10 by data transmission interface 23 after with the video frame images digitlization.11 two field pictures according to data transmission interface 23 in camera module 20 of frame per second acquisition module calculate the time interval between two two field pictures, draw the transmission time of each video frame images, then the frame image data that calculates per second transmission outputs to display screen and shows in real time.
Fig. 3 shows the pin annexation of baseband chip and camera module in the mobile terminal of the real-time display video frame per second of the present invention, and camera module 20 comprises PIXCLK, DOUT[7:0], FRAME_VALID, the LINE_VALID pin, baseband chip 10 comprises CAMDCK, CAMD[7:0], CAMVS, the CAMHS pin, PIXCLK, DOUT[7:0], FRAME_VALID, LINE_VALID pin and CAMDCK, CAMD[7:0], CAMVS, the CAMHS pin connects respectively one by one, and wherein PIXCLK is the two field picture clock frequency signal of camera module output, and CAMDCK is the two field picture clock frequency signal of baseband chip, DOUT[7:0], CAMD[7:0] be respectively the camera module, the frame image data signal output of baseband chip, frame image data signal input pin, FRAME_VALID is effective clock signal of a two field picture of camera module output, CAMVS is the clock signal pin that baseband chip receives a two field picture, LINE_VALID is effective clock signal pin of delegation's picture signal in a two field picture of camera module output, and CAMHS receives the clock signal pin of delegation's picture signal in the two field picture that the camera module exports for baseband chip.The frame image data that the data transmission interface 23 of frame per second acquisition module 11 by camera module 20 transmits and clock signal calculate the time interval between two two field pictures, can calculate the transmission time of a frame video image according to this time interval, and then can calculate the quantity of per second display frame image, it is frame per second, again this frame per second is sent to display screen and realize real-time demonstration, for user's reference.
The invention provides the implementation method of the real-time display video frame per second of a kind of mobile terminal, realize based on above-mentioned mobile terminal, its hardware configuration is not given unnecessary details.Fig. 4 shows the performing step of the inventive method:
S100 opens mobile terminal about the application of camera;
S200, camera lens obtain video frame images and are transferred to the optical sensing module, and the optical sensing module is automatically adjusted according to environment and controlled and pass through data transmission interface output video two field picture to the frame per second acquisition module.Particularly, the optical sensing module is provided with optical pickocff, graphics processing unit and data transmission interface, the video frame images that optical pickocff induction camera lens obtains also is transferred to graphics processing unit with it, and graphics processing unit is transferred to frame per second acquisition module in baseband chip by data transmission interface after with the video frame images digitlization.
S300, the frame per second acquisition module obtains the video frame images of camera module, and the time interval between calculating two adjacent video frames image is to obtain the transmission time of each video frame images.Particularly, the two field picture by data transmission interface calculates time interval between two two field pictures, the transmission time that draws each video frame images to the frame per second acquisition module according to graphics processing unit.
S400, frame per second acquisition module calculate the number of image frames of per second transmission and output to display screen according to transmission time of each video frame images and show in real time.
The below is horizontal 480 pixels take the image resolution ratio of camera module 20 output as 640 * 480 pixel PX(, vertical 640 pixels), be also that the output resolution ratio of display screen further illustrates the implementation procedure of said method as example.
camera module 20 is processed frame image data being transferred to baseband chip 10, both need to be carried out correct signal connects, particularly, that the pin that respectively connects in the data transmission interface 23 of camera module 20 is connected respectively with the pin that respectively is connected of baseband chip 10, concrete annexation please refer to the baseband chip of Fig. 3 and the annexation figure of camera module, (the not output in figure of data transmission interface in camera module 20, only illustrate and connect pin) comprise 4 pins, the PIXCLK pin is connected the clock frequency signal of transmission camera module output frame image with the CAMDCK pin of baseband chip, the LINE_VALID pin is used for the capable pixel valid data signal of two field picture of transmission 640 * 480 resolution to the CAMHS pin reception of baseband chip, the FRAME_VALID pin is used for whole pixel effective picture signals of transmission 640 * 480 resolution, be that the valid data signal of two field picture is to the CAMVS pin reception of baseband chip, DOUT[7:0] be 8 data-signal output pins of DOUT7 ~ DOUT0, be transferred to the CAMD[7:0 of baseband chip] 8 data input pins of CAMD7 ~ CAMD0.Fig. 5 shows the sequential of a two field picture transmission, between high period be continuously a two field picture transmission at FRAME_VALID, LINE_VALID is being delegation's image transmitting between high period continuously, view data delegation of delegation transmission from top to bottom is totally 640 row, pixel transmission 480PX altogether one by one from left to right during every delegation transmission, final formation one two field picture, as shown in Figure 5, LINE_VALID is in the clock signal cycle T LINEIn, DOUT[7:0] export respectively the 480PX of every delegation, every 640 T LINECycle is the clock signal cycle T of a two field picture FRAME, at a T FRAMEA two field picture of output display screen 30 resolution 640 * 480 in cycle.As shown in Figure 6, the camera module is successively exported image one by one, and Fig. 6 is the sequential chart of continuous wave output image, only needs to calculate the time difference T between adjacent two two field pictures FF, particularly, when being the rising edge level, the FRAME_VALID signal (transfers high level to by low level), be the time started of a two field picture, T FFBe the time difference of transmission two adjacent two field pictures, by calculating this time difference, i.e. time interval of two adjacent two field pictures transmission, can calculate the transmission time of a two field picture, and then calculate the quantity of per second transmission frame image, be frame per second, the frame per second acquisition module can send to this frame per second on display screen and show in real time.
Should be understood that; the above is only preferred embodiment of the present invention; be not sufficient to limit technical scheme of the present invention; for those of ordinary skills; within the spirit and principles in the present invention; can be increased and decreased according to the above description, replacement, conversion or improvement, and all these increases and decreases, replacement, conversion or improve after technical scheme, all should belong to the protection range of claims of the present invention.

Claims (8)

1. the mobile terminal of a real-time display video frame per second, is characterized in that, described mobile terminal comprises baseband chip, camera module and display screen, and described camera module, display screen all are connected with the baseband chip signal; Described baseband chip comprises the frame per second acquisition module, and described camera module comprises camera lens, optical sensing module and data transmission interface; Described camera lens is used for obtaining video frame images and being transferred to the optical sensing module, described optical sensing module is automatically adjusted according to environment and is controlled and pass through data transmission interface output video two field picture to described frame per second acquisition module, and described frame per second acquisition module calculates the frame per second of video frame images and outputs to display screen and shows in real time.
2. the mobile terminal of real-time display video frame per second according to claim 1, it is characterized in that, described optical sensing module comprises optical pickocff and graphics processing unit, the video frame images that the described camera lens of described optical pickocff induction obtains also is transferred to graphics processing unit with it, and described graphics processing unit is transferred to frame per second acquisition module in described baseband chip by data transmission interface after with the video frame images digitlization.
3. the mobile terminal of real-time display video frame per second according to claim 2, it is characterized in that, described frame per second acquisition module is according to the time interval between two two field pictures of two field picture calculating of data transmission interface input in described camera module, draw the transmission time of each video frame images, then the frame image data that calculates per second transmission outputs to display screen and shows in real time.
4. the mobile terminal of the described real-time display video frame per second of according to claim 1 to 3 any one, is characterized in that, described mobile terminal is mobile phone, panel computer or PDA.
5. the implementation method of the real-time display video frame per second of mobile terminal, is characterized in that, based on mobile terminal claimed in claim 1, comprises the steps:
A. open mobile terminal about the application of camera;
B. described camera lens obtains video frame images and is transferred to the optical sensing module, and described optical sensing module is automatically adjusted according to environment and controlled and pass through data transmission interface output video two field picture to described frame per second acquisition module;
C. described frame per second acquisition module obtains the video frame images of camera module, and the time interval between calculating two adjacent video frames image is to obtain the transmission time of each video frame images;
D. described frame per second acquisition module calculates the number of image frames of per second transmission and outputs to display screen according to transmission time of each video frame images and shows in real time.
6. the implementation method of the real-time display video frame per second of mobile terminal according to claim 5, is characterized in that, step B specifically comprises:
Described optical sensing module is provided with optical pickocff, graphics processing unit and data transmission interface, the video frame images that the described camera lens of described optical pickocff induction obtains also is transferred to graphics processing unit with it, and described graphics processing unit is transferred to frame per second acquisition module in described baseband chip by data transmission interface after with the video frame images digitlization.
7. the implementation method of the real-time display video frame per second of mobile terminal according to claim 6, is characterized in that, step C specifically comprises:
Two field picture by described data transmission interface calculates time interval between two two field pictures, the transmission time that draws each video frame images to described frame per second acquisition module according to described graphics processing unit.
8. the implementation method of the real-time display video frame per second of the described mobile terminal of according to claim 5 to 7 any one, is characterized in that, described mobile terminal is mobile phone, panel computer or PDA.
CN2013100615410A 2013-02-27 2013-02-27 Mobile terminal which display video frame rate in real time and achieving method thereof Pending CN103108169A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2013100615410A CN103108169A (en) 2013-02-27 2013-02-27 Mobile terminal which display video frame rate in real time and achieving method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2013100615410A CN103108169A (en) 2013-02-27 2013-02-27 Mobile terminal which display video frame rate in real time and achieving method thereof

Publications (1)

Publication Number Publication Date
CN103108169A true CN103108169A (en) 2013-05-15

Family

ID=48315702

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2013100615410A Pending CN103108169A (en) 2013-02-27 2013-02-27 Mobile terminal which display video frame rate in real time and achieving method thereof

Country Status (1)

Country Link
CN (1) CN103108169A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104166614A (en) * 2013-05-17 2014-11-26 腾讯科技(深圳)有限公司 Frame rate detecting method for mobile device and related device
CN106970875A (en) * 2017-03-01 2017-07-21 福建天晴数码有限公司 The frame per second method of testing and its system of virtual reality software
CN108322737A (en) * 2018-02-08 2018-07-24 广东欧珀移动通信有限公司 Image frame per second measurement method and device
CN108600668A (en) * 2018-03-27 2018-09-28 维沃移动通信有限公司 A kind of record screen frame per second method of adjustment and mobile terminal
CN112748814A (en) * 2019-10-29 2021-05-04 北京小米移动软件有限公司 Ambient light detection method and device and terminal

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004104209A (en) * 2002-09-05 2004-04-02 Auto Network Gijutsu Kenkyusho:Kk Moving picture display apparatus
CN1992885A (en) * 2005-12-28 2007-07-04 腾讯科技(深圳)有限公司 Method for displaying video quality and client end
CN101663676A (en) * 2007-02-28 2010-03-03 霍尼韦尔国际公司 Method and system for indexing and searching objects of interest across a plurality of video streams
CN201467383U (en) * 2009-07-27 2010-05-12 北京汉邦高科数字技术有限公司 Video frequency frame rate tester
CN102665040A (en) * 2010-10-13 2012-09-12 精工爱普生株式会社 Timing generator, imaging device, and dot-clock output method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004104209A (en) * 2002-09-05 2004-04-02 Auto Network Gijutsu Kenkyusho:Kk Moving picture display apparatus
CN1992885A (en) * 2005-12-28 2007-07-04 腾讯科技(深圳)有限公司 Method for displaying video quality and client end
CN101663676A (en) * 2007-02-28 2010-03-03 霍尼韦尔国际公司 Method and system for indexing and searching objects of interest across a plurality of video streams
CN201467383U (en) * 2009-07-27 2010-05-12 北京汉邦高科数字技术有限公司 Video frequency frame rate tester
CN102665040A (en) * 2010-10-13 2012-09-12 精工爱普生株式会社 Timing generator, imaging device, and dot-clock output method

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104166614A (en) * 2013-05-17 2014-11-26 腾讯科技(深圳)有限公司 Frame rate detecting method for mobile device and related device
CN104166614B (en) * 2013-05-17 2017-12-15 腾讯科技(深圳)有限公司 The frame per second detection method and relevant apparatus of a kind of mobile device
CN106970875A (en) * 2017-03-01 2017-07-21 福建天晴数码有限公司 The frame per second method of testing and its system of virtual reality software
CN106970875B (en) * 2017-03-01 2019-08-27 福建天晴数码有限公司 The frame per second test method and its system of virtual reality software
CN108322737A (en) * 2018-02-08 2018-07-24 广东欧珀移动通信有限公司 Image frame per second measurement method and device
CN108600668A (en) * 2018-03-27 2018-09-28 维沃移动通信有限公司 A kind of record screen frame per second method of adjustment and mobile terminal
CN108600668B (en) * 2018-03-27 2020-09-29 维沃移动通信有限公司 Screen recording frame rate adjusting method and mobile terminal
CN112748814A (en) * 2019-10-29 2021-05-04 北京小米移动软件有限公司 Ambient light detection method and device and terminal

Similar Documents

Publication Publication Date Title
CN111179282B (en) Image processing method, image processing device, storage medium and electronic apparatus
CN108282612B (en) Video processing method, computer storage medium and terminal
CN103531174B (en) Brightness adjusting device and method
CN108986726B (en) Information terminal
KR102617258B1 (en) Image processing method and apparatus
CN103108169A (en) Mobile terminal which display video frame rate in real time and achieving method thereof
CN114071223B (en) Optical flow-based video plug-in frame generation method, storage medium and terminal equipment
CN111260601B (en) Image fusion method and device, readable medium and electronic equipment
WO2021052342A1 (en) Frame color adjustment method for electronic apparatus, and device
WO2017095179A1 (en) Method and apparatus for image enhancement of virtual reality images
CN108391060A (en) A kind of image processing method, image processing apparatus and terminal
CN111866483A (en) Color restoration method and device, computer readable medium and electronic device
KR20170067675A (en) Liquid crystal display method and device
CN108986768B (en) Control method
CN103595924A (en) Image fusion system based on Cameralink and image fusion method based on Cameralink
WO2017138728A1 (en) Method and apparatus for creating, streaming, and rendering hdr images
US20230300475A1 (en) Image processing method and apparatus, and electronic device
WO2023226628A1 (en) Image display method and apparatus, and electronic device and storage medium
CN114298889A (en) Image processing circuit and image processing method
KR20100007628A (en) Image sensor interface apparatus and digital photographing apparatus comprising the same
CN114067733A (en) Display screen correction method, display screen correction device and display chip
CN114567767B (en) Display device, light field acquisition method, image data transmission method and related equipment
CN104918037B (en) 3D rendering display device and method and mobile terminal
CN118018835A (en) Image capturing method, image capturing device, image capturing apparatus, and storage medium
CN104935803A (en) Image acquisition method and electronic equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20130515

RJ01 Rejection of invention patent application after publication