CN110121022A - Control method, filming apparatus and the electronic equipment of filming apparatus - Google Patents
Control method, filming apparatus and the electronic equipment of filming apparatus Download PDFInfo
- Publication number
- CN110121022A CN110121022A CN201910576480.9A CN201910576480A CN110121022A CN 110121022 A CN110121022 A CN 110121022A CN 201910576480 A CN201910576480 A CN 201910576480A CN 110121022 A CN110121022 A CN 110121022A
- Authority
- CN
- China
- Prior art keywords
- filming apparatus
- frame per
- image
- image data
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/682—Vibration or motion blur correction
- H04N23/683—Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Studio Devices (AREA)
Abstract
This application discloses a kind of control method of filming apparatus, filming apparatus and electronic equipments.Filming apparatus includes imaging sensor.Control method includes: in filming apparatus start-up course, and control imaging sensor is obtained with the first frame per second and exports image data;Image data is exported with the second frame per second with imaging sensor after filming apparatus completes starting, is controlled, the first frame per second is greater than the second frame per second.In the control method of the filming apparatus of the application embodiment, filming apparatus and electronic equipment, in filming apparatus start-up course, imaging sensor is obtained with the first frame per second greater than the second frame per second and exports image data, imaging sensor output image data is very fast, is conducive to the starting speed for promoting filming apparatus.
Description
Technical field
This application involves technical field of image processing, more specifically, are related to control method, the shooting of a kind of filming apparatus
Device and electronic equipment.
Background technique
As the requirement that user shoots mobile phone is higher and higher, the requirement to the starting speed of camera is also higher and higher.With
It is generally desirable to the starting speed of camera, The faster the better at family, so as to be captured with most fast speed to fine moment.It is how excellent
The starting speed for changing camera becomes urgent problem to be solved.
Summary of the invention
The application embodiment provides control method, filming apparatus and the electronic equipment of a kind of filming apparatus.
The application embodiment provides a kind of control method of filming apparatus, and the filming apparatus includes imaging sensor,
The control method includes: to control described image sensor in the filming apparatus start-up course and obtained simultaneously with the first frame per second
Export image data;Image is exported with the second frame per second with described image sensor after the filming apparatus completes starting, is controlled
Data, first frame per second are greater than second frame per second.
The application embodiment provides a kind of filming apparatus, and the filming apparatus includes image processor and image sensing
Device, described image processor are used for: in the filming apparatus start-up course, control described image sensor is obtained with the first frame per second
It takes and exports image data;With after the filming apparatus completes starting, control described image sensor is exported with the second frame per second
Image data, first frame per second are greater than second frame per second.
The application embodiment provides a kind of electronic equipment, and the electronic equipment includes filming apparatus and shell, the bat
Device is taken the photograph in conjunction with the shell;The filming apparatus includes imaging sensor, and the control method includes: to fill in the shooting
It sets in start-up course, control described image sensor is obtained with the first frame per second and exports image data;With in the filming apparatus
After completing starting, described image sensor is controlled with the second frame per second and exports image data, first frame per second is greater than described second
Frame per second.
In the control method of the filming apparatus of the application embodiment, filming apparatus and electronic equipment, opened in filming apparatus
During dynamic, imaging sensor obtains and exports image data, imaging sensor output to be greater than the first frame per second of the second frame per second
Image data is very fast, is conducive to the starting speed for promoting filming apparatus.
The additional aspect and advantage of presently filed embodiment will be set forth in part in the description, partially will be from following
Description in become obvious, or recognized by the practice of presently filed embodiment.
Detailed description of the invention
The above-mentioned and/or additional aspect and advantage of the application is from combining in description of the following accompanying drawings to embodiment by change
It obtains obviously and is readily appreciated that, in which:
Fig. 1 is the flow diagram of the control method of the filming apparatus of the application certain embodiments;
Fig. 2 is the module diagram of the filming apparatus of the application certain embodiments;
Fig. 3 is the working state schematic representation of the imaging sensor of the filming apparatus of the application certain embodiments;
Fig. 4 is the flow diagram of the control method of the filming apparatus of the application certain embodiments;
Fig. 5 is the flow diagram of the control method of the filming apparatus of the application certain embodiments;
Fig. 6 is the working state schematic representation of the imaging sensor of the filming apparatus of the application certain embodiments;
Fig. 7 is the flow diagram of the control method of the filming apparatus of the application certain embodiments;
Fig. 8 is the module diagram of the filming apparatus of the application certain embodiments;
Fig. 9 is the schematic diagram of the algorithm post-processing module of the application certain embodiments;
Figure 10 is the module diagram of the filming apparatus of the application certain embodiments;
Figure 11 is the structural schematic diagram of the electronic equipment of the application certain embodiments;
Figure 12 is the structural schematic diagram of the electronic equipment of the application certain embodiments.
Specific embodiment
Presently filed embodiment is described below in detail, the example of the embodiment is shown in the accompanying drawings, wherein identical
Or similar label indicates same or similar element or element with the same or similar functions from beginning to end.Below by ginseng
The embodiment for examining attached drawing description is exemplary, and is only used for explaining presently filed embodiment, and should not be understood as to this Shen
The limitation of embodiment please.
Fig. 1 and Fig. 2 are please referred to, the application embodiment provides a kind of control method of filming apparatus 100.Filming apparatus
100 include imaging sensor 20.Control method includes:
01: in 100 start-up course of filming apparatus, control imaging sensor 20 is obtained with the first frame per second and exports picture number
According to;With
02: after filming apparatus 100 completes starting, imaging sensor 20 is controlled with the second frame per second and exports image data, the
One frame per second is greater than the second frame per second.
Referring to Fig. 2, the application embodiment also provides a kind of filming apparatus 100.Filming apparatus 100 includes image procossing
Device 10 and imaging sensor 20.The control method of the filming apparatus 100 of the application embodiment can be applied to the application embodiment party
The filming apparatus 100 of formula.For example, image processor 10 can be used for executing the method in 01 and 02.
In other words, image processor 10 can be used for: in 100 start-up course of filming apparatus, control imaging sensor
20 are obtained with the first frame per second and export image data;With after filming apparatus 100 completes starting, control imaging sensor 20 with the
Two frame per second export image data, and the first frame per second is greater than the second frame per second.
In the control method and filming apparatus 100 of the filming apparatus 100 of the application embodiment, opened in filming apparatus 100
During dynamic, imaging sensor 20 obtains and exports image data, imaging sensor 20 with the first frame per second for being greater than the second frame per second
Output image data is very fast, is conducive to the starting speed for promoting filming apparatus 100.
During the work time, the frame per second of imaging sensor output image data is typically mounted on 30fps to current camera,
Only in slow video actions, just frame per second can be arranged relatively high, such as 240fps, 480fps etc..
In the application embodiment, imaging sensor 20 is configured to be obtained with the first frame per second and exports picture number
According to can also obtain and export image data with the second frame per second, or obtain to be arbitrarily less than other frame per second of first frame rate
And export image data.The application embodiment combines the hardware feature and software control of the imaging sensor 20 of high frame per second, comes
Promote the starting speed of filming apparatus 100.
Specifically, referring to Fig. 3, in 100 start-up course of filming apparatus, imaging sensor 20 is obtained with the first frame per second f1
Image data, and image data is exported with the first frame per second f1;After filming apparatus 100 completes starting, imaging sensor 20 is with the
Two frame per second f2 export image data.Second frame per second can be when filming apparatus 100 works, and imaging sensor 20 obtains and output
The conventional frame per second of image data, for example, the second frame per second is 30fps.First frame per second can be predetermined times of the second frame per second, such as 2
Again, 3 times or 4 times.In other words, the first frame per second can be 60fps, 90fps or 120fps.It is appreciated that when the first frame per second mistake
When fast, for example, the first frame per second be 480fps when, the power consumption of filming apparatus 100 is high, and the imaging sensor 20 of 480fps is defeated
The picture size that the imaging sensor 20 of picture size ratio 30fps out exports is small, and the requirement of full-scale output is not achieved.And work as
When imaging sensor 20 exports image data with 60fps, 90fps or 120fps, for 30fps, imaging sensor 20
Output image data becomes faster, i.e., in 100 start-up course of filming apparatus, imaging sensor 20 can quickly export picture number
According to, the experience to user be can image that quickly preview shooting device 100 exports, the starting speed of filming apparatus 100 becomes
(when the first frame per second is 60fps, the second frame per second is 30fps, the starting speed of filming apparatus 100 can be improved about one times) fastly.Separately
Outside, when imaging sensor 20 exports image data with 60fps, 90fps or 120fps, the image ruler of the output of imaging sensor 20
It is very little to keep identical as the picture size that the imaging sensor 20 of 30fps exports, i.e., still it is able to maintain full-scale output.Further more, working as
When imaging sensor 20 exports image data with 60fps, 90fps or 120fps, for 480fps, filming apparatus 100
Power consumption will not be excessively high.
In the application embodiment, distinguishing filming apparatus 100 is the mode for being in start-up course or being completed starting
It may is that according to whether imaging sensor 20 can steadily export image data.When imaging sensor 20 cannot be steadily defeated
Out when image data, show filming apparatus 100 still in start-up course;When imaging sensor 20 can steadily export image
When data, show that starting is completed in filming apparatus 100.For example, when user just opens filming apparatus 100, image processor 10
It controls imaging sensor 20 and obtains and export image data with the first frame per second 30fps, nominally, imaging sensor 20 should
It is 30 frame image datas of output per second, and due to influence factors such as the rigid startings of filming apparatus 100, it is likely to result in imaging sensor
20 25 frame image datas of output per second;Or cause within the unit time, imaging sensor 20 exports the speed of image data not
Stablize, such as be getting faster, exports every frame image data 20 early period of imaging sensor and need 1/20 second, subsequently become needs 1/25
Second subsequently becomes needs 1/28 second etc..Above situation, which can be regarded as imaging sensor 20, cannot steadily export picture number
According to performance.Therefore, it may determine that filming apparatus 100 according to whether imaging sensor 20 can steadily export image data
It is that in start-up course or starting is completed.
Alternatively, distinguishing, filming apparatus 100 is in the start-up course or the mode of starting, which is completed, may also is that basis
User opens the duration after filming apparatus 100.Wherein, after can showing that user opens filming apparatus 100 by many experiments, shooting
Device 100 completes the time required for starting.For example, filming apparatus 100 completes starting institute after user opens filming apparatus 100
The empirical value of the time needed is 0.3 second.So, within a predetermined period of time, such as in 0.3 second, control imaging sensor 20 with
First frame per second obtains and exports image data;When exceeding predetermined amount of time, such as beyond 0.3 second, imaging sensor 20 is controlled
Image data is exported with the second frame per second.
It should be pointed out that above-mentioned differentiation filming apparatus 100 is the mode for being in start-up course or being completed starting
It is merely illustrative, those skilled in the art can also judge that filming apparatus 100 is to be in start using other modes
Still starting is completed in journey, this is not restricted.
Referring to Fig. 4, in some embodiments, control method further include:
03: after filming apparatus 100 completes starting, controlling imaging sensor 20 with the second frame per second and obtain image data.
Referring to Fig. 2, in some embodiments, image processor 10 can be used for executing the method in 03.
In other words, image processor 10 can be used for after filming apparatus 100 completes starting, control imaging sensor 20
Image data is obtained with the second frame per second.
Specifically, referring to Fig. 3, in 100 start-up course of filming apparatus, imaging sensor 20 is obtained with the first frame per second f1
Image data, and image data is exported with the first frame per second f1;After filming apparatus 100 completes starting, imaging sensor 20 is with the
Two frame per second f2 obtain image data, and imaging sensor 20 exports image data with the second frame per second f2.The application embodiment is being clapped
It takes the photograph device 100 to complete after starting, reduces the frame per second that imaging sensor 20 obtains image data, advantageously reduce filming apparatus 100
Power consumption.
Referring to Fig. 5, in some embodiments, control method further include:
04: after filming apparatus 100 completes starting, control imaging sensor 20 keeps the first frame per second to obtain image data;
With
05: control imaging sensor 20 take out at frame to image data according to the relationship of the second frame per second and the first frame per second
Reason, so that imaging sensor 20 exports image data with the second frame per second.
Referring to Fig. 2, in some embodiments, image processor 10 can be used for executing the method in 04 and 05.
In other words, image processor 10 can be used for: after filming apparatus 100 completes starting, control imaging sensor
20 keep the first frame per second to obtain image data;With control imaging sensor 20 according to the relationship of the second frame per second and the first frame per second to figure
It is handled as data carry out pumping frame, so that imaging sensor 20 exports image data with the second frame per second.
Specifically, referring to Fig. 6, in 100 start-up course of filming apparatus, imaging sensor 20 is obtained with the first frame per second f1
Image data, and image data is exported with the first frame per second f1;Filming apparatus 100 complete starting after, imaging sensor 20 still with
First frame per second f1 obtains image data, and imaging sensor 20 exports image data with the second frame per second f2.The application embodiment exists
After filming apparatus 100 completes starting, the frame per second that imaging sensor 20 obtains image data is remained unchanged, so that imaging sensor 20
The logic control for obtaining the frame per second of image data is relatively simple, is convenient for software design.
By taking the first frame per second is 60fps, the second frame per second is 30fps as an example, after filming apparatus 100 completes starting, image is passed
Sensor 20 still keeps 60fps to obtain image data, since imaging sensor 20 needs to export image data with 30fp, need
The image data to obtain to imaging sensor 20 carries out taking out frame processing, i.e., skips a frame image data in every two field pictures data
Output, to export image data with 30fp.It is appreciated that needing when the first frame per second is 90fps in every three frame image data
In skip two field pictures data output;When the first frame per second is 120fps, need to skip three frame figures in every four frame image data
As data export.
Referring to Fig. 7, in some embodiments, filming apparatus 100 further includes register 30, it is stored in register 30
For controlling the control instruction of imaging sensor 20.Control method further include:
06: reading the control instruction stored in register 30;With
07: the frame per second that imaging sensor 20 obtains and exports image data is controlled according to control instruction.
Referring to Fig. 2, in some embodiments, filming apparatus 100 further includes register 30, it is stored in register 30
For controlling the control instruction of imaging sensor 20.Image processor 10 can be used for executing the method in 06 and 07.
In other words, image processor 10 can be used for: read the control instruction stored in register 30;With according to control
Instruction control imaging sensor 20 obtains and the frame per second of output image data.
For example, image processor 10 reads the control instruction stored in register 30, to be filled according to control instruction in shooting
It sets in 100 start-up courses, control imaging sensor 20 is obtained with the first frame per second and exports image data;It is complete in filming apparatus 100
After starting, imaging sensor 20 is controlled with the second frame per second and exports image data.Alternatively, image processor 10 reads register 30
The control instruction of middle storage, after filming apparatus 100 completes starting, to control imaging sensor 20 according to control instruction with second
Frame per second obtains image data.Alternatively, image processor 10 reads the control instruction stored in register 30, according to control instruction
After filming apparatus 100 completes starting, control imaging sensor 20 keeps the first frame per second to obtain image data;Control image sensing
Device 20 carries out image data according to the relationship of the second frame per second and the first frame per second to take out frame processing, so that imaging sensor 20 is with second
Frame per second exports image data.
It is appreciated that when imaging sensor 20 is configured as being obtained or being exported image data with the first frame per second or the second frame per second
When, register 30 needs to configure to be stored with corresponding control instruction, to realize the control to imaging sensor 20.Register 30
It can be arranged independently of image processor 10 and imaging sensor 20.Register 30 also can integrate in image processor 10,
I other words image processor 10 includes register 30.Or register 30 is integrated in imaging sensor 20, and in other words, figure
As sensor 20 includes register 30.
Referring to Fig. 8, in some embodiments, the image data that imaging sensor 20 obtains is RAW image.Image passes
Sensor 20 may include image acquisition units (sensor) 22 and RAW image data cell (Image Front-end, IFE) 24.Figure
Image data (RAW image) is obtained as acquisition unit 22 is acquired for receiving light, RAW image data cell 24 will be for that will scheme
As the image data that acquisition unit 22 acquires is transmitted to image processor 10.Wherein, RAW image data cell 24 can be to image
The RAW image that the acquisition of acquisition unit 22 obtains is handled and the RAW image that exports that treated is to image processor 10.
Image processor 10 and imaging sensor 20 connect.Image processor 10 may include hardware abstraction layer 12, application
Program module (APP) 14 and algorithm post-processing module (Algo process service, APS) 16.
Hardware abstraction layer 12 for receive RAW image, RAW image is converted to YUV image and transmission RAW image and/
Or YUV image.Hardware abstraction layer 12 can be connect with imaging sensor 20.Specifically, hardware abstraction layer 12 may include
Cache unit (buffer queue) 122, the RAW connecting with imaging sensor 20 turn RGB processing unit (Bayer Process
Segment, BPS) 124 and the noise reduction and YUV post-processing unit (Image Process that are connect with application program module 14
Engine, IPE) 126.Cache unit 122 is for caching the RAW image from imaging sensor 20 and passing through application program module
14 are transferred to algorithm post-processing module 16.RAW turns RGB processing unit 124 for that will turn from the RAW image of cache unit 122
It is changed to RGB image.Noise reduction and YUV post-processing unit 126 obtain YUV image and pass through YUV image to answer for handling RGB image
Algorithm post-processing module 16 is transferred to program module 14.Hardware abstraction layer 12 can also transmit the metadata of image data
(metadata), metadata include 3a (auto-exposure control AE, auto focus control AF, automatic white balance control AWB) information,
Pictorial information (such as picture traverse, height), exposure parameter (aperture size, shutter speed and sensitivity f-number) etc., can be with
Realize the post-processing of taking pictures to RAW image and/or YUV image (at the processing of U.S. face, filter using metadata auxiliary
At least one of reason, rotation processing, watermark processing, virtualization processing, HDR processing and multi-frame processing).In one embodiment,
Metadata includes sensitivity (ISO) information, can be with the bright of auxiliary adjustment RAW image and/or YUV image according to sensitivity information
Degree, to realize post-processing of taking pictures relevant to brightness is adjusted.
Since hardware abstraction layer 12 (such as does not only receive RAW to the post-processing that take pictures of RAW image and/or YUV image
RAW image is converted to YUV image and transmission RAW image and/or YUV image by image), the image procossing for post-processing of taking pictures is calculated
Method only need to do compatibility in outside, design difficulty subtracts without doing process truncation on the algorithm framework of hardware abstraction layer 12 itself
It is small.
In the related art, hardware abstraction layer is created as the side of pipeline (pipeline) by application programming interfaces (API)
Formula is needed in camera starting by the corresponding Working mould of camera since the creation of pipeline needs a large amount of time and memory
All pipelines that formula is used first create, and in order to realize various image processing algorithms, generally require a large amount of pipeline (examples of creation
Such as more than three pipelines), this starting needs that will lead to camera takes a substantial amount of time, and occupies a large amount of memory.This Shen
Please the hardware abstraction layer 12 of embodiment take pictures post-processing, therefore, hardware abstraction are not carried out to RAW image and/or YUV image
Module 12 need to establish a small amount of (such as one or two) pipeline, without establishing a large amount of pipeline, in saving
It deposits, and the starting speed of camera can be made to become faster.
Application program module 14 is connect with hardware abstraction layer 12.Application program module 14 can be used for according to the defeated of user
Enter to generate control instruction and the control instruction is sent to imaging sensor 20 to image sensing by hardware abstraction layer 12
The work of device 20 is controlled accordingly.Wherein, application program module 14 can be run with 64 bits (bit), and be taken pictures
The static data link library (lib) of the image processing algorithm of post-processing is configurable to 64 bits, to improve arithmetic speed.It answers
It, can be to RAW and/or YUV image after the RAW image and/or YUV image that receive hardware abstraction layer transmission with program module 14
Post-processing of taking pictures is carried out, RAW and/or YUV image algorithm post-processing module 16 can also be transmitted to and carry out post-processing of taking pictures.When
So, it can also be that application program module 14 carries out some post-processings of taking pictures (such as the processing of U.S. face, filter processing, rotation processing, water
Print processing, virtualization processing etc.), algorithm post-processing module 16 carries out other and takes pictures that (such as HDR is handled, at multiframe for post-processing
Reason etc.).In the application embodiment, RAW and/or YUV image are transmitted to algorithm post-processing module by application program module 14
16 carry out post-processing of taking pictures.
Algorithm post-processing module 16 is connect by application program module 14 with hardware abstraction layer 12, algorithm post-processing module
At least one image processing algorithm is stored in 16 (to calculate for example including U.S. face Processing Algorithm, filter Processing Algorithm, rotation processing
At least one of method, watermark processing algorithm, virtualization Processing Algorithm, HDR Processing Algorithm and multi-frame processing algorithm), after algorithm
Reason module 16 is for using image processing algorithm processing RAW image and/or YUV image to realize post-processing of taking pictures.Due to RAW
The post-processing that take pictures of image and/or YUV image can be realized by algorithm post-processing module 16, without in hardware abstraction layer
Process truncation is done on 12 algorithm frameworks itself, only need to do compatibility in outside, design difficulty reduces.And due to post-processing of taking pictures
It is realized by algorithm post-processing module 16, therefore the function of algorithm post-processing module 16 is more single, more focuses, is moved so as to reach
It plants fast, it is simple and other effects to extend new image processing algorithm.Certainly, if after application program module 14 carries out some take pictures
Reason (such as U.S. face processing, filter processing, rotation processing, watermark processing, virtualization processing etc.), algorithm post-processing module 16 carries out separately
When outer some post-processing of taking pictures (such as HDR processing, multi-frame processings etc.), at least one can also be stored in application program module 14
Image processing algorithm is (for example including U.S. face Processing Algorithm, filter Processing Algorithm, rotation processing algorithm, watermark processing algorithm, virtualization
At least one of Processing Algorithm, HDR Processing Algorithm and multi-frame processing algorithm), application program module 14 is also used to using image
Processing Algorithm handles RAW image and/or YUV image to realize post-processing of taking pictures.Due to RAW image and/or YUV image progress
Post-processing of taking pictures is realized by application program module 14 and algorithm post-processing module 16, without in hardware abstraction layer 12 itself
Algorithm framework on do process truncation, only need to do compatibility in outside, design difficulty also greatly reduces.
16 processing RAW images of algorithm post-processing module (such as image processing algorithm is handled for RAW image)
When, hardware abstraction layer 12 can only transmission RAW image (can not need RAW image being converted to YUV image at this time);It is calculating
When 16 processing YUV images of method post-processing module (such as image processing algorithm is handled for YUV image), hardware abstraction mould
Block 12 can only transmit YUV image;When algorithm post-processing module 16 handles RAW image and YUV image, hardware abstraction layer 12
RAW image and YUV image can be transmitted.
In some embodiments, hardware abstraction layer 12 can be according to sensitivity information, the jitter conditions of gyroscope, AR
Scene detection results (detection scene type, such as personage, animal, landscape etc.) etc. send frame number to application program module 14 and build
View, for example, hardware abstraction layer 12 is built to the frame number that application program module 14 is sent when the shake that gyroscope detects is larger
View may is that suggestion compared with multiframe, post-processing of taking pictures is better achieved;When the shake that gyroscope detects is smaller, hardware is taken out
As module 12 may is that the less frame of suggestion to the frame number suggestion that application program module 14 is sent, to reduce volume of transmitted data.Namely
It is to say, the degree of jitter positive that the frame number that hardware abstraction layer 12 is suggested to application program module 14 can be detected with gyroscope
It closes.Hardware abstraction layer 12 can also be according to sensitivity information, the jitter conditions of gyroscope, AR scene detection results etc. to application
14 transmission algorithm suggestion of program module, for example, hardware abstraction layer 12 is to using journey when the shake that gyroscope detects is larger
The algorithm suggestion that sequence module 14 is sent can be multi-frame processing, be shaken with being eliminated according to multi-frame processing;When AR scene detection results
When the scene type of detection is personage, hardware abstraction layer 12 can be U.S. face to the algorithm suggestion that application program module 14 is sent
Processing, to carry out U.S. face to personage;When AR scene detection results detection scene type be landscape when, hardware abstraction layer 12 to
The algorithm suggestion that application program module 14 is sent can be HDR processing, to form the landscape image of high dynamic range.Application program
Module 14 issues request of data to hardware abstraction layer 12 according to frame number suggestion and algorithm suggestion, and hardware abstraction layer 12 is according to this
Request of data transmits corresponding data to application program module 14, and application program module 14 sends data to algorithm post-processing again
Module 16 carries out post-processing of taking pictures.
After imaging sensor 20 is once shot (exposure image), photographed data (RAW image) is transferred to hardware and is taken out
As module 12, after algorithm post-processing module 16 receives RAW image corresponding with photographed data and/or YUV image, image is passed
Sensor 20 is able to carry out shooting next time or imaging sensor 20 can close or application program module 14 can be closed or be answered
Application interface can be exited with program module 14.It is realized, will be being clapped by algorithm post-processing module 16 due to taking pictures post-processing
Take the photograph the corresponding RAW image of data and/or after YUV image is transferred to algorithm post-processing module 16, it is only necessary to algorithm post-processing module
16 achieve that post-processing of taking pictures, and imaging sensor 20 and application program module 14 can be not involved in post-processing of taking pictures at this time, because
This, imaging sensor 20 can be closed or be executed and shoot next time, and application interface can be closed or be exited to application program module 14.
In this way, filming apparatus 100 can be realized snap, and it can close and answer when algorithm post-processing module 16 take pictures and post-processes
With program module 14 or exit Application Program Interface, thus carry out on an electronic device it is some other operation (such as with shooting fill
100 unrelated operations are set, for example browses webpage, sees video, makes a phone call), so that user is without devoting a tremendous amount of time waiting
It takes pictures the completion of post-processing, user-friendly electronic equipment.
Algorithm post-processing module 16 may include coding unit 162, and coding unit 162 is used to YUV image being converted to JPG
Image (or jpeg image etc.).Specifically, algorithm post-processing module 16 processing be YUV image when, coding unit 162 can
Directly to be encoded YUV image to form JPG image, to improve the output speed of image.In algorithm post-processing module
16 processing be RAW image when, processing can be realized the RAW image for post-processing of taking pictures through using journey by algorithm post-processing module 16
Sequence module 14 is back to hardware abstraction layer 12, such as is back to RAW and turns RGB processing unit 124, and RAW turns RGB processing unit
124 can be used for realizing the processing of algorithm post-processing module 16 into the RAW figure for taking pictures and post-processing and returning through application program module 14
As being converted to RGB image, RGB image can be converted to YUV image by noise reduction and YUV post-processing unit 126, which can
To be re-transmitted in the coding unit 162 of algorithm post-processing module 16 so that the YUV image is converted to JPG image.Certain
In embodiment, processing can also be realized the RAW image for post-processing of taking pictures through application program module by algorithm post-processing module 16
14 are back to cache unit 122, and the RAW image of passback turns RGB processing unit 124 and noise reduction and YUV post-processing unit by RAW
126 form YUV image, then are transmitted to coding unit 162 to form JPG image.After forming JPG image, algorithm post-processes mould
Block 16 can be used for saving JPG image transmitting into memory.
Referring to Fig. 9, algorithm post-processing module 16 includes logical process calling layer 164, algoritic module interface layer 166 and calculates
Method process layer 168.Logical process calling layer 164 with application program module 14 for communicating.Algoritic module interface layer 166 is for tieing up
Protect algorithm interface.Algorithm process layer 168 includes at least one image processing algorithm.Algoritic module interface layer 166 is for passing through calculation
Operation at least one of is registered, nullifies, calls and adjust back to method interface to the image processing algorithm of algorithm process layer 168.
Logical process calling layer 164 may include thread queue, algorithm post-processing module 16 receive RAW image and/or
After the post-processing task of taking pictures of YUV image, can will take pictures post-processes task buffer and handles in thread queue, wherein thread
Queue can cache multiple post-processing tasks of taking pictures, in this way, can realize snap (i.e. snap by logical process calling layer 164
Mechanism).In addition, logical process calling layer 164 also can receive the initialization (init) of the transmission of application program module 14, process
(process) instruction such as, and corresponding instruction and data is saved in thread queue.Logical process calling layer 164 is according to line
Task in journey queue carries out the calling of specific logic (i.e. specific logic calls combination).Logical process calling layer 164 can be with
The thumbnail (thumbnail) that processing obtains is returned into application program module 14 and is shown (i.e. thumbnail echo).At this
In the description of the embodiment of application, the meaning of " plurality " is two or more, unless otherwise specifically defined.
Algoritic module interface layer 166 is for calling algorithm interface, and call instruction can also be saved in thread queue, algorithm
Process layer 168 can parse the figure that the gain of parameter of call instruction needs to call in the call instruction for receiving thread queue
As Processing Algorithm.It, can be new in algorithm process layer 168 when algoritic module interface layer 166 registers image processing algorithm
Increase a kind of image processing algorithm;When algoritic module interface layer 166 is unregistered image processing algorithm, it can be handled with deletion algorithm
A kind of image processing algorithm in layer 168;When algoritic module interface layer 166 is called image processing algorithm, calculation can be called
A kind of image processing algorithm in method process layer 168;It, can be with when algoritic module interface layer 166 adjusts back image processing algorithm
By after algorithm process data and state return to application program module 14.Wherein it is possible to be realized at image using unified interface
The operation such as registration, cancellation, calling, readjustment of adjustment method.Each image processing algorithm in algorithm process layer 168 is all independent
, it so can be convenient and the operation such as registration realized to image processing algorithm, nullified, called, adjust back.
Referring to Fig. 10, in some embodiments, image processor 10 may also include camera service module 18.Hardware is taken out
As module 12 is connect by camera service module 18 with application program module 14.Camera service module 18 to RAW image and/or
YUV image be packaged and by after encapsulation RAW image and/or YUV image be transmitted to application program module 14 and journey will be applied
The RAW image that sequence module 14 returns is transmitted to hardware abstraction layer 12.In this way, being sealed by camera service module 18 to image
Dress, can be improved the efficiency of image transmitting, and can be improved the safety of image transmitting.It include camera in image processor 10
When service module 18, the path of data (the image, metadata etc.) transmission in image processor 10 can be adaptively adjusted,
The data transmitted between hardware abstraction layer 12 and application program module 14 are required to through camera service module 18.For example,
When hardware abstraction layer 12 transmits RAW image and/or YUV image to application program module 14, hardware abstraction layer 12 is first by RAW
Image and/or YUV image are transmitted to camera service module 18, and camera service module 18 carries out RAW image and/or YUV image
Encapsulate and by after encapsulation RAW image and/or YUV image be transmitted to application program module 14.In another example hardware abstraction layer 12
When transmitting metadata to application program module 14, metadata is first transmitted to camera service module 18, phase by hardware abstraction layer 12
Machine service module 18 is packaged metadata and the metadata after encapsulation is transmitted to application program module 14.In another example firmly
When part abstract module 12 transmits frame number suggestion to application program module 14, frame number suggestion is first transmitted to phase by hardware abstraction layer 12
Machine service module 18, camera service module 18 are packaged frame number suggestion and the frame number suggestion after encapsulation are transmitted to using journey
Sequence module 14.In another example hardware abstraction layer 12 is first when hardware abstraction layer 12 is suggested to 14 transmission algorithm of application program module
Algorithm suggestion is transmitted to camera service module 18, camera service module 18 is packaged algorithm suggestion and by the calculation after encapsulation
Method suggestion is transmitted to application program module 14.Certainly, in some embodiments, hardware abstraction layer 12 can believe sensitivity
Breath, the jitter conditions of gyroscope, AR scene detection results etc. are transmitted to camera service module 18, and camera service module 18 is according to sense
Luminosity information, the jitter conditions of gyroscope, AR scene detection results etc. obtain frame number suggestion and/or algorithm suggestion, then by frame number
It is recommended that and/or algorithm suggestion be transmitted to application program module 14.
Figure 11 and Figure 12 are please referred to, the application embodiment also provides a kind of electronic equipment 1000.Electronic equipment 1000 wraps
Include the filming apparatus 100 and shell 200 of any one of the above embodiment.Electronic equipment 1000 can be mobile phone, tablet computer,
Laptop, Intelligent bracelet, smartwatch, intelligent helmet, intelligent glasses etc..
Filming apparatus 100 is combined with shell 200.Shell 200 can be used as the installation of the function element of electronic equipment 1000
Carrier.Shell 200 can provide the protection such as dust-proof, shatter-resistant, waterproof for function element, and function element can be display screen, shooting
Device 100, receiver etc..Wherein, in one embodiment, shell 200 includes main body 210 and movable support 220, movable branch
Frame 220 can move under the drive of the drive relative to main body 210, such as movable support 220 can be relative to main 210 bodies
Sliding, to slide into main body 210 (such as state of Figure 11) or skid off (such as state of Figure 12) from main body 210.Partial function member
Part may be mounted in main body 210, and another part function element (such as filming apparatus 100) may be mounted at movable support 220
On, the movement of movable support 220 can drive another part function element to retract in main body 210 or stretch out from main body 210.Another
In one embodiment, acquisition window is offered on shell 200, filming apparatus 100 is aligned with acquisition window to be installed so that shooting
Device 100 can receive ambient by acquisition window to form image.
In the description of this specification, reference term " certain embodiments ", " in an example ", " illustratively " etc. are retouched
It states and means to be contained in the application extremely in conjunction with the embodiment or example particular features, structures, materials, or characteristics described
In a few embodiment or example.In the present specification, schematic expression of the above terms are not necessarily referring to identical
Embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be real in any one or more
Applying can be combined in any suitable manner in mode or example.In addition, without conflicting with each other, those skilled in the art can be with
The feature of different embodiments or examples described in this specification and different embodiments or examples is combined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be by the application
Embodiment person of ordinary skill in the field understood.
Although presently filed embodiment has been shown and described above, it is to be understood that above embodiment is
Illustratively, it should not be understood as the limitation to the application, those skilled in the art within the scope of application can be right
Above embodiment is changed, modifies, replacement and variant.
Claims (10)
1. a kind of control method of filming apparatus, which is characterized in that the filming apparatus includes imaging sensor, the controlling party
Method includes:
In the filming apparatus start-up course, control described image sensor is obtained with the first frame per second and exports image data;
With
After the filming apparatus completes starting, described image sensor is controlled with the second frame per second and exports image data, described the
One frame per second is greater than second frame per second.
2. control method according to claim 1, which is characterized in that the control method further include:
After the filming apparatus completes starting, described image sensor is controlled with second frame per second and obtains image data.
3. control method according to claim 1, which is characterized in that the control method further include:
After the filming apparatus completes starting, control described image sensor keeps first frame per second to obtain image data;
With
It controls described image sensor and described image data is carried out according to the relationship of second frame per second and first frame per second
Frame processing is taken out, so that described image sensor exports image data with second frame per second.
4. control method according to claim 1, which is characterized in that the filming apparatus further includes register, described to post
The control instruction for controlling imaging sensor, the control method are stored in storage further include:
Read the control instruction stored in the register;With
The frame per second that described image sensor obtains and exports image data is controlled according to the control instruction.
5. a kind of filming apparatus, which is characterized in that including image processor and imaging sensor, described image processor is used for:
In the filming apparatus start-up course, control described image sensor is obtained with the first frame per second and exports image data;
With
After the filming apparatus completes starting, described image sensor is controlled with the second frame per second and exports image data, described the
One frame per second is greater than second frame per second.
6. filming apparatus according to claim 5, which is characterized in that described image processor is also used to:
After the filming apparatus completes starting, described image sensor is controlled with second frame per second and obtains image data.
7. filming apparatus according to claim 5, which is characterized in that described image processor is also used to:
After the filming apparatus completes starting, control described image sensor keeps first frame per second to obtain image data;
With
It controls described image sensor and described image data is carried out according to the relationship of second frame per second and first frame per second
Frame processing is taken out, so that described image sensor exports image data with second frame per second.
8. filming apparatus according to claim 5, which is characterized in that the filming apparatus further includes register, described to post
The control instruction for controlling imaging sensor is stored in storage, described image processor is also used to:
Read the control instruction stored in the register;With
The frame per second that described image sensor obtains and exports image data is controlled according to the control instruction.
9. filming apparatus according to claim 5, which is characterized in that described image sensor obtain image data be
RAW image, described image processor include:
Hardware abstraction layer, the hardware abstraction layer is for receiving the RAW image, the RAW image being converted to YUV figure
Picture and the transmission RAW image and/or the YUV image;
Application program module, the application program module with the hardware abstraction layer for connecting;With
Algorithm post-processing module, the algorithm post-processing module are connected by the application program module and the hardware abstraction layer
It connects, at least one image processing algorithm is stored in the algorithm post-processing module, the algorithm post-processing module is for using
Described image Processing Algorithm handles the RAW image and/or the YUV image to realize post-processing of taking pictures.
10. a kind of electronic equipment, which is characterized in that the electronic equipment includes:
Filming apparatus described in claim 5 to 9 any one;With
Shell, the filming apparatus is in conjunction with the shell.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910576480.9A CN110121022A (en) | 2019-06-28 | 2019-06-28 | Control method, filming apparatus and the electronic equipment of filming apparatus |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910576480.9A CN110121022A (en) | 2019-06-28 | 2019-06-28 | Control method, filming apparatus and the electronic equipment of filming apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110121022A true CN110121022A (en) | 2019-08-13 |
Family
ID=67524496
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910576480.9A Pending CN110121022A (en) | 2019-06-28 | 2019-06-28 | Control method, filming apparatus and the electronic equipment of filming apparatus |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110121022A (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110602359A (en) * | 2019-09-02 | 2019-12-20 | Oppo广东移动通信有限公司 | Image processing method, image processor, photographing device and electronic equipment |
CN111314606A (en) * | 2020-02-21 | 2020-06-19 | Oppo广东移动通信有限公司 | Photographing method and device, electronic equipment and storage medium |
WO2020207192A1 (en) * | 2019-04-10 | 2020-10-15 | Oppo广东移动通信有限公司 | Image processor, image processing method, photography apparatus, and electronic device |
WO2021103388A1 (en) * | 2019-11-29 | 2021-06-03 | 浙江宇视科技有限公司 | Image capturing method and apparatus, electronic photography device, and computer-readable storage medium |
WO2022089479A1 (en) * | 2020-10-30 | 2022-05-05 | 维沃移动通信(杭州)有限公司 | Photographing method and apparatus, and electronic device |
WO2022188343A1 (en) * | 2021-03-11 | 2022-09-15 | 广州安凯微电子股份有限公司 | Control method and apparatus for camera device |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004180151A (en) * | 2002-11-28 | 2004-06-24 | Fuji Photo Film Co Ltd | Digital camera |
JP2009033468A (en) * | 2007-07-26 | 2009-02-12 | Sharp Corp | Interpolation frame image display method and interpolation frame image generation apparatus for low frame rate moving image |
CN103905708A (en) * | 2012-12-24 | 2014-07-02 | 联想(北京)有限公司 | Shooting frame rate adjusting method and electronic device |
CN104065886A (en) * | 2014-07-04 | 2014-09-24 | 联想(北京)有限公司 | Starting control method and electronic device |
CN104601897A (en) * | 2015-02-13 | 2015-05-06 | 浙江宇视科技有限公司 | Anti-shake device and method of video camera |
CN105120112A (en) * | 2015-09-25 | 2015-12-02 | 维沃移动通信有限公司 | Camera starting method for mobile terminal and mobile terminal |
CN106454127A (en) * | 2016-11-29 | 2017-02-22 | 惠州Tcl移动通信有限公司 | Method and system of improving the starting speed of camera of mobile terminal |
CN106937055A (en) * | 2017-03-30 | 2017-07-07 | 维沃移动通信有限公司 | A kind of image processing method and mobile terminal |
CN108718362A (en) * | 2018-04-28 | 2018-10-30 | 上海与德通讯技术有限公司 | Kinescope method and terminal |
CN109101352A (en) * | 2018-08-30 | 2018-12-28 | Oppo广东移动通信有限公司 | Algorithm framework, algorithm call method, device, storage medium and mobile terminal |
CN109922322A (en) * | 2019-04-10 | 2019-06-21 | Oppo广东移动通信有限公司 | Photographic method, image processor, camera arrangement and electronic equipment |
-
2019
- 2019-06-28 CN CN201910576480.9A patent/CN110121022A/en active Pending
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004180151A (en) * | 2002-11-28 | 2004-06-24 | Fuji Photo Film Co Ltd | Digital camera |
JP2009033468A (en) * | 2007-07-26 | 2009-02-12 | Sharp Corp | Interpolation frame image display method and interpolation frame image generation apparatus for low frame rate moving image |
CN103905708A (en) * | 2012-12-24 | 2014-07-02 | 联想(北京)有限公司 | Shooting frame rate adjusting method and electronic device |
CN104065886A (en) * | 2014-07-04 | 2014-09-24 | 联想(北京)有限公司 | Starting control method and electronic device |
CN104601897A (en) * | 2015-02-13 | 2015-05-06 | 浙江宇视科技有限公司 | Anti-shake device and method of video camera |
CN105120112A (en) * | 2015-09-25 | 2015-12-02 | 维沃移动通信有限公司 | Camera starting method for mobile terminal and mobile terminal |
CN106454127A (en) * | 2016-11-29 | 2017-02-22 | 惠州Tcl移动通信有限公司 | Method and system of improving the starting speed of camera of mobile terminal |
CN106937055A (en) * | 2017-03-30 | 2017-07-07 | 维沃移动通信有限公司 | A kind of image processing method and mobile terminal |
CN108718362A (en) * | 2018-04-28 | 2018-10-30 | 上海与德通讯技术有限公司 | Kinescope method and terminal |
CN109101352A (en) * | 2018-08-30 | 2018-12-28 | Oppo广东移动通信有限公司 | Algorithm framework, algorithm call method, device, storage medium and mobile terminal |
CN109922322A (en) * | 2019-04-10 | 2019-06-21 | Oppo广东移动通信有限公司 | Photographic method, image processor, camera arrangement and electronic equipment |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020207192A1 (en) * | 2019-04-10 | 2020-10-15 | Oppo广东移动通信有限公司 | Image processor, image processing method, photography apparatus, and electronic device |
CN110602359A (en) * | 2019-09-02 | 2019-12-20 | Oppo广东移动通信有限公司 | Image processing method, image processor, photographing device and electronic equipment |
WO2021103388A1 (en) * | 2019-11-29 | 2021-06-03 | 浙江宇视科技有限公司 | Image capturing method and apparatus, electronic photography device, and computer-readable storage medium |
CN111314606A (en) * | 2020-02-21 | 2020-06-19 | Oppo广东移动通信有限公司 | Photographing method and device, electronic equipment and storage medium |
WO2022089479A1 (en) * | 2020-10-30 | 2022-05-05 | 维沃移动通信(杭州)有限公司 | Photographing method and apparatus, and electronic device |
WO2022188343A1 (en) * | 2021-03-11 | 2022-09-15 | 广州安凯微电子股份有限公司 | Control method and apparatus for camera device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110086967B (en) | Image processing method, image processor, photographing device and electronic equipment | |
CN110121022A (en) | Control method, filming apparatus and the electronic equipment of filming apparatus | |
WO2022262260A1 (en) | Photographing method and electronic device | |
CN109963083A (en) | Image processor, image processing method, filming apparatus and electronic equipment | |
US9723159B2 (en) | RAW camera peripheral for handheld mobile unit | |
US11070742B2 (en) | Optimized exposure temporal smoothing for time-lapse mode | |
US8446484B2 (en) | Image processing architecture with pre-scaler | |
CN110276718A (en) | Image processing method, image processor, filming apparatus and electronic equipment | |
CN110290288B (en) | Image processor, image processing method, photographing device, and electronic apparatus | |
CN110177215A (en) | Image processing method, image processor, filming apparatus and electronic equipment | |
CN110278373A (en) | Image processor, image processing method, filming apparatus and electronic equipment | |
CN110266951A (en) | Image processor, image processing method, filming apparatus and electronic equipment | |
KR20130109588A (en) | Apparatus and mehod for processing a image in camera device | |
CN110062161B (en) | Image processor, image processing method, photographing device, and electronic apparatus | |
US20240056685A1 (en) | Image photographing method, device, storage medium, and program product | |
CN113596321A (en) | Transition dynamic effect generation method, apparatus, storage medium, and program product | |
CN111510629A (en) | Data display method, image processor, photographing device and electronic equipment | |
KR102058860B1 (en) | Apparatus and mehod for processing a image in camera device | |
CN110035233A (en) | Image processing method, device, storage medium and electronic equipment | |
CN110049254A (en) | Image processing method, device, storage medium and electronic equipment | |
CN116055855B (en) | Image processing method and related device | |
IES20140134A2 (en) | Improved smartphone imaging using an external peripheral | |
IES86536B2 (en) | Smartphone user interfaces for a RAW camera peripheral | |
IES86519B2 (en) | Camera peripheral with external camera controls and lens mount for smartphone or hand-held device | |
IES86520B2 (en) | RAW camera peripheral for smartphone or hand-held device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190813 |
|
RJ01 | Rejection of invention patent application after publication |