Nothing Special   »   [go: up one dir, main page]

CN110121022A - Control method, filming apparatus and the electronic equipment of filming apparatus - Google Patents

Control method, filming apparatus and the electronic equipment of filming apparatus Download PDF

Info

Publication number
CN110121022A
CN110121022A CN201910576480.9A CN201910576480A CN110121022A CN 110121022 A CN110121022 A CN 110121022A CN 201910576480 A CN201910576480 A CN 201910576480A CN 110121022 A CN110121022 A CN 110121022A
Authority
CN
China
Prior art keywords
filming apparatus
frame per
image
image data
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910576480.9A
Other languages
Chinese (zh)
Inventor
李小朋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910576480.9A priority Critical patent/CN110121022A/en
Publication of CN110121022A publication Critical patent/CN110121022A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0264Details of the structure or mounting of specific components for a camera module assembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682Vibration or motion blur correction
    • H04N23/683Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Studio Devices (AREA)

Abstract

This application discloses a kind of control method of filming apparatus, filming apparatus and electronic equipments.Filming apparatus includes imaging sensor.Control method includes: in filming apparatus start-up course, and control imaging sensor is obtained with the first frame per second and exports image data;Image data is exported with the second frame per second with imaging sensor after filming apparatus completes starting, is controlled, the first frame per second is greater than the second frame per second.In the control method of the filming apparatus of the application embodiment, filming apparatus and electronic equipment, in filming apparatus start-up course, imaging sensor is obtained with the first frame per second greater than the second frame per second and exports image data, imaging sensor output image data is very fast, is conducive to the starting speed for promoting filming apparatus.

Description

Control method, filming apparatus and the electronic equipment of filming apparatus
Technical field
This application involves technical field of image processing, more specifically, are related to control method, the shooting of a kind of filming apparatus Device and electronic equipment.
Background technique
As the requirement that user shoots mobile phone is higher and higher, the requirement to the starting speed of camera is also higher and higher.With It is generally desirable to the starting speed of camera, The faster the better at family, so as to be captured with most fast speed to fine moment.It is how excellent The starting speed for changing camera becomes urgent problem to be solved.
Summary of the invention
The application embodiment provides control method, filming apparatus and the electronic equipment of a kind of filming apparatus.
The application embodiment provides a kind of control method of filming apparatus, and the filming apparatus includes imaging sensor, The control method includes: to control described image sensor in the filming apparatus start-up course and obtained simultaneously with the first frame per second Export image data;Image is exported with the second frame per second with described image sensor after the filming apparatus completes starting, is controlled Data, first frame per second are greater than second frame per second.
The application embodiment provides a kind of filming apparatus, and the filming apparatus includes image processor and image sensing Device, described image processor are used for: in the filming apparatus start-up course, control described image sensor is obtained with the first frame per second It takes and exports image data;With after the filming apparatus completes starting, control described image sensor is exported with the second frame per second Image data, first frame per second are greater than second frame per second.
The application embodiment provides a kind of electronic equipment, and the electronic equipment includes filming apparatus and shell, the bat Device is taken the photograph in conjunction with the shell;The filming apparatus includes imaging sensor, and the control method includes: to fill in the shooting It sets in start-up course, control described image sensor is obtained with the first frame per second and exports image data;With in the filming apparatus After completing starting, described image sensor is controlled with the second frame per second and exports image data, first frame per second is greater than described second Frame per second.
In the control method of the filming apparatus of the application embodiment, filming apparatus and electronic equipment, opened in filming apparatus During dynamic, imaging sensor obtains and exports image data, imaging sensor output to be greater than the first frame per second of the second frame per second Image data is very fast, is conducive to the starting speed for promoting filming apparatus.
The additional aspect and advantage of presently filed embodiment will be set forth in part in the description, partially will be from following Description in become obvious, or recognized by the practice of presently filed embodiment.
Detailed description of the invention
The above-mentioned and/or additional aspect and advantage of the application is from combining in description of the following accompanying drawings to embodiment by change It obtains obviously and is readily appreciated that, in which:
Fig. 1 is the flow diagram of the control method of the filming apparatus of the application certain embodiments;
Fig. 2 is the module diagram of the filming apparatus of the application certain embodiments;
Fig. 3 is the working state schematic representation of the imaging sensor of the filming apparatus of the application certain embodiments;
Fig. 4 is the flow diagram of the control method of the filming apparatus of the application certain embodiments;
Fig. 5 is the flow diagram of the control method of the filming apparatus of the application certain embodiments;
Fig. 6 is the working state schematic representation of the imaging sensor of the filming apparatus of the application certain embodiments;
Fig. 7 is the flow diagram of the control method of the filming apparatus of the application certain embodiments;
Fig. 8 is the module diagram of the filming apparatus of the application certain embodiments;
Fig. 9 is the schematic diagram of the algorithm post-processing module of the application certain embodiments;
Figure 10 is the module diagram of the filming apparatus of the application certain embodiments;
Figure 11 is the structural schematic diagram of the electronic equipment of the application certain embodiments;
Figure 12 is the structural schematic diagram of the electronic equipment of the application certain embodiments.
Specific embodiment
Presently filed embodiment is described below in detail, the example of the embodiment is shown in the accompanying drawings, wherein identical Or similar label indicates same or similar element or element with the same or similar functions from beginning to end.Below by ginseng The embodiment for examining attached drawing description is exemplary, and is only used for explaining presently filed embodiment, and should not be understood as to this Shen The limitation of embodiment please.
Fig. 1 and Fig. 2 are please referred to, the application embodiment provides a kind of control method of filming apparatus 100.Filming apparatus 100 include imaging sensor 20.Control method includes:
01: in 100 start-up course of filming apparatus, control imaging sensor 20 is obtained with the first frame per second and exports picture number According to;With
02: after filming apparatus 100 completes starting, imaging sensor 20 is controlled with the second frame per second and exports image data, the One frame per second is greater than the second frame per second.
Referring to Fig. 2, the application embodiment also provides a kind of filming apparatus 100.Filming apparatus 100 includes image procossing Device 10 and imaging sensor 20.The control method of the filming apparatus 100 of the application embodiment can be applied to the application embodiment party The filming apparatus 100 of formula.For example, image processor 10 can be used for executing the method in 01 and 02.
In other words, image processor 10 can be used for: in 100 start-up course of filming apparatus, control imaging sensor 20 are obtained with the first frame per second and export image data;With after filming apparatus 100 completes starting, control imaging sensor 20 with the Two frame per second export image data, and the first frame per second is greater than the second frame per second.
In the control method and filming apparatus 100 of the filming apparatus 100 of the application embodiment, opened in filming apparatus 100 During dynamic, imaging sensor 20 obtains and exports image data, imaging sensor 20 with the first frame per second for being greater than the second frame per second Output image data is very fast, is conducive to the starting speed for promoting filming apparatus 100.
During the work time, the frame per second of imaging sensor output image data is typically mounted on 30fps to current camera, Only in slow video actions, just frame per second can be arranged relatively high, such as 240fps, 480fps etc..
In the application embodiment, imaging sensor 20 is configured to be obtained with the first frame per second and exports picture number According to can also obtain and export image data with the second frame per second, or obtain to be arbitrarily less than other frame per second of first frame rate And export image data.The application embodiment combines the hardware feature and software control of the imaging sensor 20 of high frame per second, comes Promote the starting speed of filming apparatus 100.
Specifically, referring to Fig. 3, in 100 start-up course of filming apparatus, imaging sensor 20 is obtained with the first frame per second f1 Image data, and image data is exported with the first frame per second f1;After filming apparatus 100 completes starting, imaging sensor 20 is with the Two frame per second f2 export image data.Second frame per second can be when filming apparatus 100 works, and imaging sensor 20 obtains and output The conventional frame per second of image data, for example, the second frame per second is 30fps.First frame per second can be predetermined times of the second frame per second, such as 2 Again, 3 times or 4 times.In other words, the first frame per second can be 60fps, 90fps or 120fps.It is appreciated that when the first frame per second mistake When fast, for example, the first frame per second be 480fps when, the power consumption of filming apparatus 100 is high, and the imaging sensor 20 of 480fps is defeated The picture size that the imaging sensor 20 of picture size ratio 30fps out exports is small, and the requirement of full-scale output is not achieved.And work as When imaging sensor 20 exports image data with 60fps, 90fps or 120fps, for 30fps, imaging sensor 20 Output image data becomes faster, i.e., in 100 start-up course of filming apparatus, imaging sensor 20 can quickly export picture number According to, the experience to user be can image that quickly preview shooting device 100 exports, the starting speed of filming apparatus 100 becomes (when the first frame per second is 60fps, the second frame per second is 30fps, the starting speed of filming apparatus 100 can be improved about one times) fastly.Separately Outside, when imaging sensor 20 exports image data with 60fps, 90fps or 120fps, the image ruler of the output of imaging sensor 20 It is very little to keep identical as the picture size that the imaging sensor 20 of 30fps exports, i.e., still it is able to maintain full-scale output.Further more, working as When imaging sensor 20 exports image data with 60fps, 90fps or 120fps, for 480fps, filming apparatus 100 Power consumption will not be excessively high.
In the application embodiment, distinguishing filming apparatus 100 is the mode for being in start-up course or being completed starting It may is that according to whether imaging sensor 20 can steadily export image data.When imaging sensor 20 cannot be steadily defeated Out when image data, show filming apparatus 100 still in start-up course;When imaging sensor 20 can steadily export image When data, show that starting is completed in filming apparatus 100.For example, when user just opens filming apparatus 100, image processor 10 It controls imaging sensor 20 and obtains and export image data with the first frame per second 30fps, nominally, imaging sensor 20 should It is 30 frame image datas of output per second, and due to influence factors such as the rigid startings of filming apparatus 100, it is likely to result in imaging sensor 20 25 frame image datas of output per second;Or cause within the unit time, imaging sensor 20 exports the speed of image data not Stablize, such as be getting faster, exports every frame image data 20 early period of imaging sensor and need 1/20 second, subsequently become needs 1/25 Second subsequently becomes needs 1/28 second etc..Above situation, which can be regarded as imaging sensor 20, cannot steadily export picture number According to performance.Therefore, it may determine that filming apparatus 100 according to whether imaging sensor 20 can steadily export image data It is that in start-up course or starting is completed.
Alternatively, distinguishing, filming apparatus 100 is in the start-up course or the mode of starting, which is completed, may also is that basis User opens the duration after filming apparatus 100.Wherein, after can showing that user opens filming apparatus 100 by many experiments, shooting Device 100 completes the time required for starting.For example, filming apparatus 100 completes starting institute after user opens filming apparatus 100 The empirical value of the time needed is 0.3 second.So, within a predetermined period of time, such as in 0.3 second, control imaging sensor 20 with First frame per second obtains and exports image data;When exceeding predetermined amount of time, such as beyond 0.3 second, imaging sensor 20 is controlled Image data is exported with the second frame per second.
It should be pointed out that above-mentioned differentiation filming apparatus 100 is the mode for being in start-up course or being completed starting It is merely illustrative, those skilled in the art can also judge that filming apparatus 100 is to be in start using other modes Still starting is completed in journey, this is not restricted.
Referring to Fig. 4, in some embodiments, control method further include:
03: after filming apparatus 100 completes starting, controlling imaging sensor 20 with the second frame per second and obtain image data.
Referring to Fig. 2, in some embodiments, image processor 10 can be used for executing the method in 03.
In other words, image processor 10 can be used for after filming apparatus 100 completes starting, control imaging sensor 20 Image data is obtained with the second frame per second.
Specifically, referring to Fig. 3, in 100 start-up course of filming apparatus, imaging sensor 20 is obtained with the first frame per second f1 Image data, and image data is exported with the first frame per second f1;After filming apparatus 100 completes starting, imaging sensor 20 is with the Two frame per second f2 obtain image data, and imaging sensor 20 exports image data with the second frame per second f2.The application embodiment is being clapped It takes the photograph device 100 to complete after starting, reduces the frame per second that imaging sensor 20 obtains image data, advantageously reduce filming apparatus 100 Power consumption.
Referring to Fig. 5, in some embodiments, control method further include:
04: after filming apparatus 100 completes starting, control imaging sensor 20 keeps the first frame per second to obtain image data; With
05: control imaging sensor 20 take out at frame to image data according to the relationship of the second frame per second and the first frame per second Reason, so that imaging sensor 20 exports image data with the second frame per second.
Referring to Fig. 2, in some embodiments, image processor 10 can be used for executing the method in 04 and 05.
In other words, image processor 10 can be used for: after filming apparatus 100 completes starting, control imaging sensor 20 keep the first frame per second to obtain image data;With control imaging sensor 20 according to the relationship of the second frame per second and the first frame per second to figure It is handled as data carry out pumping frame, so that imaging sensor 20 exports image data with the second frame per second.
Specifically, referring to Fig. 6, in 100 start-up course of filming apparatus, imaging sensor 20 is obtained with the first frame per second f1 Image data, and image data is exported with the first frame per second f1;Filming apparatus 100 complete starting after, imaging sensor 20 still with First frame per second f1 obtains image data, and imaging sensor 20 exports image data with the second frame per second f2.The application embodiment exists After filming apparatus 100 completes starting, the frame per second that imaging sensor 20 obtains image data is remained unchanged, so that imaging sensor 20 The logic control for obtaining the frame per second of image data is relatively simple, is convenient for software design.
By taking the first frame per second is 60fps, the second frame per second is 30fps as an example, after filming apparatus 100 completes starting, image is passed Sensor 20 still keeps 60fps to obtain image data, since imaging sensor 20 needs to export image data with 30fp, need The image data to obtain to imaging sensor 20 carries out taking out frame processing, i.e., skips a frame image data in every two field pictures data Output, to export image data with 30fp.It is appreciated that needing when the first frame per second is 90fps in every three frame image data In skip two field pictures data output;When the first frame per second is 120fps, need to skip three frame figures in every four frame image data As data export.
Referring to Fig. 7, in some embodiments, filming apparatus 100 further includes register 30, it is stored in register 30 For controlling the control instruction of imaging sensor 20.Control method further include:
06: reading the control instruction stored in register 30;With
07: the frame per second that imaging sensor 20 obtains and exports image data is controlled according to control instruction.
Referring to Fig. 2, in some embodiments, filming apparatus 100 further includes register 30, it is stored in register 30 For controlling the control instruction of imaging sensor 20.Image processor 10 can be used for executing the method in 06 and 07.
In other words, image processor 10 can be used for: read the control instruction stored in register 30;With according to control Instruction control imaging sensor 20 obtains and the frame per second of output image data.
For example, image processor 10 reads the control instruction stored in register 30, to be filled according to control instruction in shooting It sets in 100 start-up courses, control imaging sensor 20 is obtained with the first frame per second and exports image data;It is complete in filming apparatus 100 After starting, imaging sensor 20 is controlled with the second frame per second and exports image data.Alternatively, image processor 10 reads register 30 The control instruction of middle storage, after filming apparatus 100 completes starting, to control imaging sensor 20 according to control instruction with second Frame per second obtains image data.Alternatively, image processor 10 reads the control instruction stored in register 30, according to control instruction After filming apparatus 100 completes starting, control imaging sensor 20 keeps the first frame per second to obtain image data;Control image sensing Device 20 carries out image data according to the relationship of the second frame per second and the first frame per second to take out frame processing, so that imaging sensor 20 is with second Frame per second exports image data.
It is appreciated that when imaging sensor 20 is configured as being obtained or being exported image data with the first frame per second or the second frame per second When, register 30 needs to configure to be stored with corresponding control instruction, to realize the control to imaging sensor 20.Register 30 It can be arranged independently of image processor 10 and imaging sensor 20.Register 30 also can integrate in image processor 10, I other words image processor 10 includes register 30.Or register 30 is integrated in imaging sensor 20, and in other words, figure As sensor 20 includes register 30.
Referring to Fig. 8, in some embodiments, the image data that imaging sensor 20 obtains is RAW image.Image passes Sensor 20 may include image acquisition units (sensor) 22 and RAW image data cell (Image Front-end, IFE) 24.Figure Image data (RAW image) is obtained as acquisition unit 22 is acquired for receiving light, RAW image data cell 24 will be for that will scheme As the image data that acquisition unit 22 acquires is transmitted to image processor 10.Wherein, RAW image data cell 24 can be to image The RAW image that the acquisition of acquisition unit 22 obtains is handled and the RAW image that exports that treated is to image processor 10.
Image processor 10 and imaging sensor 20 connect.Image processor 10 may include hardware abstraction layer 12, application Program module (APP) 14 and algorithm post-processing module (Algo process service, APS) 16.
Hardware abstraction layer 12 for receive RAW image, RAW image is converted to YUV image and transmission RAW image and/ Or YUV image.Hardware abstraction layer 12 can be connect with imaging sensor 20.Specifically, hardware abstraction layer 12 may include Cache unit (buffer queue) 122, the RAW connecting with imaging sensor 20 turn RGB processing unit (Bayer Process Segment, BPS) 124 and the noise reduction and YUV post-processing unit (Image Process that are connect with application program module 14 Engine, IPE) 126.Cache unit 122 is for caching the RAW image from imaging sensor 20 and passing through application program module 14 are transferred to algorithm post-processing module 16.RAW turns RGB processing unit 124 for that will turn from the RAW image of cache unit 122 It is changed to RGB image.Noise reduction and YUV post-processing unit 126 obtain YUV image and pass through YUV image to answer for handling RGB image Algorithm post-processing module 16 is transferred to program module 14.Hardware abstraction layer 12 can also transmit the metadata of image data (metadata), metadata include 3a (auto-exposure control AE, auto focus control AF, automatic white balance control AWB) information, Pictorial information (such as picture traverse, height), exposure parameter (aperture size, shutter speed and sensitivity f-number) etc., can be with Realize the post-processing of taking pictures to RAW image and/or YUV image (at the processing of U.S. face, filter using metadata auxiliary At least one of reason, rotation processing, watermark processing, virtualization processing, HDR processing and multi-frame processing).In one embodiment, Metadata includes sensitivity (ISO) information, can be with the bright of auxiliary adjustment RAW image and/or YUV image according to sensitivity information Degree, to realize post-processing of taking pictures relevant to brightness is adjusted.
Since hardware abstraction layer 12 (such as does not only receive RAW to the post-processing that take pictures of RAW image and/or YUV image RAW image is converted to YUV image and transmission RAW image and/or YUV image by image), the image procossing for post-processing of taking pictures is calculated Method only need to do compatibility in outside, design difficulty subtracts without doing process truncation on the algorithm framework of hardware abstraction layer 12 itself It is small.
In the related art, hardware abstraction layer is created as the side of pipeline (pipeline) by application programming interfaces (API) Formula is needed in camera starting by the corresponding Working mould of camera since the creation of pipeline needs a large amount of time and memory All pipelines that formula is used first create, and in order to realize various image processing algorithms, generally require a large amount of pipeline (examples of creation Such as more than three pipelines), this starting needs that will lead to camera takes a substantial amount of time, and occupies a large amount of memory.This Shen Please the hardware abstraction layer 12 of embodiment take pictures post-processing, therefore, hardware abstraction are not carried out to RAW image and/or YUV image Module 12 need to establish a small amount of (such as one or two) pipeline, without establishing a large amount of pipeline, in saving It deposits, and the starting speed of camera can be made to become faster.
Application program module 14 is connect with hardware abstraction layer 12.Application program module 14 can be used for according to the defeated of user Enter to generate control instruction and the control instruction is sent to imaging sensor 20 to image sensing by hardware abstraction layer 12 The work of device 20 is controlled accordingly.Wherein, application program module 14 can be run with 64 bits (bit), and be taken pictures The static data link library (lib) of the image processing algorithm of post-processing is configurable to 64 bits, to improve arithmetic speed.It answers It, can be to RAW and/or YUV image after the RAW image and/or YUV image that receive hardware abstraction layer transmission with program module 14 Post-processing of taking pictures is carried out, RAW and/or YUV image algorithm post-processing module 16 can also be transmitted to and carry out post-processing of taking pictures.When So, it can also be that application program module 14 carries out some post-processings of taking pictures (such as the processing of U.S. face, filter processing, rotation processing, water Print processing, virtualization processing etc.), algorithm post-processing module 16 carries out other and takes pictures that (such as HDR is handled, at multiframe for post-processing Reason etc.).In the application embodiment, RAW and/or YUV image are transmitted to algorithm post-processing module by application program module 14 16 carry out post-processing of taking pictures.
Algorithm post-processing module 16 is connect by application program module 14 with hardware abstraction layer 12, algorithm post-processing module At least one image processing algorithm is stored in 16 (to calculate for example including U.S. face Processing Algorithm, filter Processing Algorithm, rotation processing At least one of method, watermark processing algorithm, virtualization Processing Algorithm, HDR Processing Algorithm and multi-frame processing algorithm), after algorithm Reason module 16 is for using image processing algorithm processing RAW image and/or YUV image to realize post-processing of taking pictures.Due to RAW The post-processing that take pictures of image and/or YUV image can be realized by algorithm post-processing module 16, without in hardware abstraction layer Process truncation is done on 12 algorithm frameworks itself, only need to do compatibility in outside, design difficulty reduces.And due to post-processing of taking pictures It is realized by algorithm post-processing module 16, therefore the function of algorithm post-processing module 16 is more single, more focuses, is moved so as to reach It plants fast, it is simple and other effects to extend new image processing algorithm.Certainly, if after application program module 14 carries out some take pictures Reason (such as U.S. face processing, filter processing, rotation processing, watermark processing, virtualization processing etc.), algorithm post-processing module 16 carries out separately When outer some post-processing of taking pictures (such as HDR processing, multi-frame processings etc.), at least one can also be stored in application program module 14 Image processing algorithm is (for example including U.S. face Processing Algorithm, filter Processing Algorithm, rotation processing algorithm, watermark processing algorithm, virtualization At least one of Processing Algorithm, HDR Processing Algorithm and multi-frame processing algorithm), application program module 14 is also used to using image Processing Algorithm handles RAW image and/or YUV image to realize post-processing of taking pictures.Due to RAW image and/or YUV image progress Post-processing of taking pictures is realized by application program module 14 and algorithm post-processing module 16, without in hardware abstraction layer 12 itself Algorithm framework on do process truncation, only need to do compatibility in outside, design difficulty also greatly reduces.
16 processing RAW images of algorithm post-processing module (such as image processing algorithm is handled for RAW image) When, hardware abstraction layer 12 can only transmission RAW image (can not need RAW image being converted to YUV image at this time);It is calculating When 16 processing YUV images of method post-processing module (such as image processing algorithm is handled for YUV image), hardware abstraction mould Block 12 can only transmit YUV image;When algorithm post-processing module 16 handles RAW image and YUV image, hardware abstraction layer 12 RAW image and YUV image can be transmitted.
In some embodiments, hardware abstraction layer 12 can be according to sensitivity information, the jitter conditions of gyroscope, AR Scene detection results (detection scene type, such as personage, animal, landscape etc.) etc. send frame number to application program module 14 and build View, for example, hardware abstraction layer 12 is built to the frame number that application program module 14 is sent when the shake that gyroscope detects is larger View may is that suggestion compared with multiframe, post-processing of taking pictures is better achieved;When the shake that gyroscope detects is smaller, hardware is taken out As module 12 may is that the less frame of suggestion to the frame number suggestion that application program module 14 is sent, to reduce volume of transmitted data.Namely It is to say, the degree of jitter positive that the frame number that hardware abstraction layer 12 is suggested to application program module 14 can be detected with gyroscope It closes.Hardware abstraction layer 12 can also be according to sensitivity information, the jitter conditions of gyroscope, AR scene detection results etc. to application 14 transmission algorithm suggestion of program module, for example, hardware abstraction layer 12 is to using journey when the shake that gyroscope detects is larger The algorithm suggestion that sequence module 14 is sent can be multi-frame processing, be shaken with being eliminated according to multi-frame processing;When AR scene detection results When the scene type of detection is personage, hardware abstraction layer 12 can be U.S. face to the algorithm suggestion that application program module 14 is sent Processing, to carry out U.S. face to personage;When AR scene detection results detection scene type be landscape when, hardware abstraction layer 12 to The algorithm suggestion that application program module 14 is sent can be HDR processing, to form the landscape image of high dynamic range.Application program Module 14 issues request of data to hardware abstraction layer 12 according to frame number suggestion and algorithm suggestion, and hardware abstraction layer 12 is according to this Request of data transmits corresponding data to application program module 14, and application program module 14 sends data to algorithm post-processing again Module 16 carries out post-processing of taking pictures.
After imaging sensor 20 is once shot (exposure image), photographed data (RAW image) is transferred to hardware and is taken out As module 12, after algorithm post-processing module 16 receives RAW image corresponding with photographed data and/or YUV image, image is passed Sensor 20 is able to carry out shooting next time or imaging sensor 20 can close or application program module 14 can be closed or be answered Application interface can be exited with program module 14.It is realized, will be being clapped by algorithm post-processing module 16 due to taking pictures post-processing Take the photograph the corresponding RAW image of data and/or after YUV image is transferred to algorithm post-processing module 16, it is only necessary to algorithm post-processing module 16 achieve that post-processing of taking pictures, and imaging sensor 20 and application program module 14 can be not involved in post-processing of taking pictures at this time, because This, imaging sensor 20 can be closed or be executed and shoot next time, and application interface can be closed or be exited to application program module 14. In this way, filming apparatus 100 can be realized snap, and it can close and answer when algorithm post-processing module 16 take pictures and post-processes With program module 14 or exit Application Program Interface, thus carry out on an electronic device it is some other operation (such as with shooting fill 100 unrelated operations are set, for example browses webpage, sees video, makes a phone call), so that user is without devoting a tremendous amount of time waiting It takes pictures the completion of post-processing, user-friendly electronic equipment.
Algorithm post-processing module 16 may include coding unit 162, and coding unit 162 is used to YUV image being converted to JPG Image (or jpeg image etc.).Specifically, algorithm post-processing module 16 processing be YUV image when, coding unit 162 can Directly to be encoded YUV image to form JPG image, to improve the output speed of image.In algorithm post-processing module 16 processing be RAW image when, processing can be realized the RAW image for post-processing of taking pictures through using journey by algorithm post-processing module 16 Sequence module 14 is back to hardware abstraction layer 12, such as is back to RAW and turns RGB processing unit 124, and RAW turns RGB processing unit 124 can be used for realizing the processing of algorithm post-processing module 16 into the RAW figure for taking pictures and post-processing and returning through application program module 14 As being converted to RGB image, RGB image can be converted to YUV image by noise reduction and YUV post-processing unit 126, which can To be re-transmitted in the coding unit 162 of algorithm post-processing module 16 so that the YUV image is converted to JPG image.Certain In embodiment, processing can also be realized the RAW image for post-processing of taking pictures through application program module by algorithm post-processing module 16 14 are back to cache unit 122, and the RAW image of passback turns RGB processing unit 124 and noise reduction and YUV post-processing unit by RAW 126 form YUV image, then are transmitted to coding unit 162 to form JPG image.After forming JPG image, algorithm post-processes mould Block 16 can be used for saving JPG image transmitting into memory.
Referring to Fig. 9, algorithm post-processing module 16 includes logical process calling layer 164, algoritic module interface layer 166 and calculates Method process layer 168.Logical process calling layer 164 with application program module 14 for communicating.Algoritic module interface layer 166 is for tieing up Protect algorithm interface.Algorithm process layer 168 includes at least one image processing algorithm.Algoritic module interface layer 166 is for passing through calculation Operation at least one of is registered, nullifies, calls and adjust back to method interface to the image processing algorithm of algorithm process layer 168.
Logical process calling layer 164 may include thread queue, algorithm post-processing module 16 receive RAW image and/or After the post-processing task of taking pictures of YUV image, can will take pictures post-processes task buffer and handles in thread queue, wherein thread Queue can cache multiple post-processing tasks of taking pictures, in this way, can realize snap (i.e. snap by logical process calling layer 164 Mechanism).In addition, logical process calling layer 164 also can receive the initialization (init) of the transmission of application program module 14, process (process) instruction such as, and corresponding instruction and data is saved in thread queue.Logical process calling layer 164 is according to line Task in journey queue carries out the calling of specific logic (i.e. specific logic calls combination).Logical process calling layer 164 can be with The thumbnail (thumbnail) that processing obtains is returned into application program module 14 and is shown (i.e. thumbnail echo).At this In the description of the embodiment of application, the meaning of " plurality " is two or more, unless otherwise specifically defined.
Algoritic module interface layer 166 is for calling algorithm interface, and call instruction can also be saved in thread queue, algorithm Process layer 168 can parse the figure that the gain of parameter of call instruction needs to call in the call instruction for receiving thread queue As Processing Algorithm.It, can be new in algorithm process layer 168 when algoritic module interface layer 166 registers image processing algorithm Increase a kind of image processing algorithm;When algoritic module interface layer 166 is unregistered image processing algorithm, it can be handled with deletion algorithm A kind of image processing algorithm in layer 168;When algoritic module interface layer 166 is called image processing algorithm, calculation can be called A kind of image processing algorithm in method process layer 168;It, can be with when algoritic module interface layer 166 adjusts back image processing algorithm By after algorithm process data and state return to application program module 14.Wherein it is possible to be realized at image using unified interface The operation such as registration, cancellation, calling, readjustment of adjustment method.Each image processing algorithm in algorithm process layer 168 is all independent , it so can be convenient and the operation such as registration realized to image processing algorithm, nullified, called, adjust back.
Referring to Fig. 10, in some embodiments, image processor 10 may also include camera service module 18.Hardware is taken out As module 12 is connect by camera service module 18 with application program module 14.Camera service module 18 to RAW image and/or YUV image be packaged and by after encapsulation RAW image and/or YUV image be transmitted to application program module 14 and journey will be applied The RAW image that sequence module 14 returns is transmitted to hardware abstraction layer 12.In this way, being sealed by camera service module 18 to image Dress, can be improved the efficiency of image transmitting, and can be improved the safety of image transmitting.It include camera in image processor 10 When service module 18, the path of data (the image, metadata etc.) transmission in image processor 10 can be adaptively adjusted, The data transmitted between hardware abstraction layer 12 and application program module 14 are required to through camera service module 18.For example, When hardware abstraction layer 12 transmits RAW image and/or YUV image to application program module 14, hardware abstraction layer 12 is first by RAW Image and/or YUV image are transmitted to camera service module 18, and camera service module 18 carries out RAW image and/or YUV image Encapsulate and by after encapsulation RAW image and/or YUV image be transmitted to application program module 14.In another example hardware abstraction layer 12 When transmitting metadata to application program module 14, metadata is first transmitted to camera service module 18, phase by hardware abstraction layer 12 Machine service module 18 is packaged metadata and the metadata after encapsulation is transmitted to application program module 14.In another example firmly When part abstract module 12 transmits frame number suggestion to application program module 14, frame number suggestion is first transmitted to phase by hardware abstraction layer 12 Machine service module 18, camera service module 18 are packaged frame number suggestion and the frame number suggestion after encapsulation are transmitted to using journey Sequence module 14.In another example hardware abstraction layer 12 is first when hardware abstraction layer 12 is suggested to 14 transmission algorithm of application program module Algorithm suggestion is transmitted to camera service module 18, camera service module 18 is packaged algorithm suggestion and by the calculation after encapsulation Method suggestion is transmitted to application program module 14.Certainly, in some embodiments, hardware abstraction layer 12 can believe sensitivity Breath, the jitter conditions of gyroscope, AR scene detection results etc. are transmitted to camera service module 18, and camera service module 18 is according to sense Luminosity information, the jitter conditions of gyroscope, AR scene detection results etc. obtain frame number suggestion and/or algorithm suggestion, then by frame number It is recommended that and/or algorithm suggestion be transmitted to application program module 14.
Figure 11 and Figure 12 are please referred to, the application embodiment also provides a kind of electronic equipment 1000.Electronic equipment 1000 wraps Include the filming apparatus 100 and shell 200 of any one of the above embodiment.Electronic equipment 1000 can be mobile phone, tablet computer, Laptop, Intelligent bracelet, smartwatch, intelligent helmet, intelligent glasses etc..
Filming apparatus 100 is combined with shell 200.Shell 200 can be used as the installation of the function element of electronic equipment 1000 Carrier.Shell 200 can provide the protection such as dust-proof, shatter-resistant, waterproof for function element, and function element can be display screen, shooting Device 100, receiver etc..Wherein, in one embodiment, shell 200 includes main body 210 and movable support 220, movable branch Frame 220 can move under the drive of the drive relative to main body 210, such as movable support 220 can be relative to main 210 bodies Sliding, to slide into main body 210 (such as state of Figure 11) or skid off (such as state of Figure 12) from main body 210.Partial function member Part may be mounted in main body 210, and another part function element (such as filming apparatus 100) may be mounted at movable support 220 On, the movement of movable support 220 can drive another part function element to retract in main body 210 or stretch out from main body 210.Another In one embodiment, acquisition window is offered on shell 200, filming apparatus 100 is aligned with acquisition window to be installed so that shooting Device 100 can receive ambient by acquisition window to form image.
In the description of this specification, reference term " certain embodiments ", " in an example ", " illustratively " etc. are retouched It states and means to be contained in the application extremely in conjunction with the embodiment or example particular features, structures, materials, or characteristics described In a few embodiment or example.In the present specification, schematic expression of the above terms are not necessarily referring to identical Embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be real in any one or more Applying can be combined in any suitable manner in mode or example.In addition, without conflicting with each other, those skilled in the art can be with The feature of different embodiments or examples described in this specification and different embodiments or examples is combined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discussed suitable Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be by the application Embodiment person of ordinary skill in the field understood.
Although presently filed embodiment has been shown and described above, it is to be understood that above embodiment is Illustratively, it should not be understood as the limitation to the application, those skilled in the art within the scope of application can be right Above embodiment is changed, modifies, replacement and variant.

Claims (10)

1. a kind of control method of filming apparatus, which is characterized in that the filming apparatus includes imaging sensor, the controlling party Method includes:
In the filming apparatus start-up course, control described image sensor is obtained with the first frame per second and exports image data; With
After the filming apparatus completes starting, described image sensor is controlled with the second frame per second and exports image data, described the One frame per second is greater than second frame per second.
2. control method according to claim 1, which is characterized in that the control method further include:
After the filming apparatus completes starting, described image sensor is controlled with second frame per second and obtains image data.
3. control method according to claim 1, which is characterized in that the control method further include:
After the filming apparatus completes starting, control described image sensor keeps first frame per second to obtain image data; With
It controls described image sensor and described image data is carried out according to the relationship of second frame per second and first frame per second Frame processing is taken out, so that described image sensor exports image data with second frame per second.
4. control method according to claim 1, which is characterized in that the filming apparatus further includes register, described to post The control instruction for controlling imaging sensor, the control method are stored in storage further include:
Read the control instruction stored in the register;With
The frame per second that described image sensor obtains and exports image data is controlled according to the control instruction.
5. a kind of filming apparatus, which is characterized in that including image processor and imaging sensor, described image processor is used for:
In the filming apparatus start-up course, control described image sensor is obtained with the first frame per second and exports image data; With
After the filming apparatus completes starting, described image sensor is controlled with the second frame per second and exports image data, described the One frame per second is greater than second frame per second.
6. filming apparatus according to claim 5, which is characterized in that described image processor is also used to:
After the filming apparatus completes starting, described image sensor is controlled with second frame per second and obtains image data.
7. filming apparatus according to claim 5, which is characterized in that described image processor is also used to:
After the filming apparatus completes starting, control described image sensor keeps first frame per second to obtain image data; With
It controls described image sensor and described image data is carried out according to the relationship of second frame per second and first frame per second Frame processing is taken out, so that described image sensor exports image data with second frame per second.
8. filming apparatus according to claim 5, which is characterized in that the filming apparatus further includes register, described to post The control instruction for controlling imaging sensor is stored in storage, described image processor is also used to:
Read the control instruction stored in the register;With
The frame per second that described image sensor obtains and exports image data is controlled according to the control instruction.
9. filming apparatus according to claim 5, which is characterized in that described image sensor obtain image data be RAW image, described image processor include:
Hardware abstraction layer, the hardware abstraction layer is for receiving the RAW image, the RAW image being converted to YUV figure Picture and the transmission RAW image and/or the YUV image;
Application program module, the application program module with the hardware abstraction layer for connecting;With
Algorithm post-processing module, the algorithm post-processing module are connected by the application program module and the hardware abstraction layer It connects, at least one image processing algorithm is stored in the algorithm post-processing module, the algorithm post-processing module is for using Described image Processing Algorithm handles the RAW image and/or the YUV image to realize post-processing of taking pictures.
10. a kind of electronic equipment, which is characterized in that the electronic equipment includes:
Filming apparatus described in claim 5 to 9 any one;With
Shell, the filming apparatus is in conjunction with the shell.
CN201910576480.9A 2019-06-28 2019-06-28 Control method, filming apparatus and the electronic equipment of filming apparatus Pending CN110121022A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910576480.9A CN110121022A (en) 2019-06-28 2019-06-28 Control method, filming apparatus and the electronic equipment of filming apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910576480.9A CN110121022A (en) 2019-06-28 2019-06-28 Control method, filming apparatus and the electronic equipment of filming apparatus

Publications (1)

Publication Number Publication Date
CN110121022A true CN110121022A (en) 2019-08-13

Family

ID=67524496

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910576480.9A Pending CN110121022A (en) 2019-06-28 2019-06-28 Control method, filming apparatus and the electronic equipment of filming apparatus

Country Status (1)

Country Link
CN (1) CN110121022A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110602359A (en) * 2019-09-02 2019-12-20 Oppo广东移动通信有限公司 Image processing method, image processor, photographing device and electronic equipment
CN111314606A (en) * 2020-02-21 2020-06-19 Oppo广东移动通信有限公司 Photographing method and device, electronic equipment and storage medium
WO2020207192A1 (en) * 2019-04-10 2020-10-15 Oppo广东移动通信有限公司 Image processor, image processing method, photography apparatus, and electronic device
WO2021103388A1 (en) * 2019-11-29 2021-06-03 浙江宇视科技有限公司 Image capturing method and apparatus, electronic photography device, and computer-readable storage medium
WO2022089479A1 (en) * 2020-10-30 2022-05-05 维沃移动通信(杭州)有限公司 Photographing method and apparatus, and electronic device
WO2022188343A1 (en) * 2021-03-11 2022-09-15 广州安凯微电子股份有限公司 Control method and apparatus for camera device

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004180151A (en) * 2002-11-28 2004-06-24 Fuji Photo Film Co Ltd Digital camera
JP2009033468A (en) * 2007-07-26 2009-02-12 Sharp Corp Interpolation frame image display method and interpolation frame image generation apparatus for low frame rate moving image
CN103905708A (en) * 2012-12-24 2014-07-02 联想(北京)有限公司 Shooting frame rate adjusting method and electronic device
CN104065886A (en) * 2014-07-04 2014-09-24 联想(北京)有限公司 Starting control method and electronic device
CN104601897A (en) * 2015-02-13 2015-05-06 浙江宇视科技有限公司 Anti-shake device and method of video camera
CN105120112A (en) * 2015-09-25 2015-12-02 维沃移动通信有限公司 Camera starting method for mobile terminal and mobile terminal
CN106454127A (en) * 2016-11-29 2017-02-22 惠州Tcl移动通信有限公司 Method and system of improving the starting speed of camera of mobile terminal
CN106937055A (en) * 2017-03-30 2017-07-07 维沃移动通信有限公司 A kind of image processing method and mobile terminal
CN108718362A (en) * 2018-04-28 2018-10-30 上海与德通讯技术有限公司 Kinescope method and terminal
CN109101352A (en) * 2018-08-30 2018-12-28 Oppo广东移动通信有限公司 Algorithm framework, algorithm call method, device, storage medium and mobile terminal
CN109922322A (en) * 2019-04-10 2019-06-21 Oppo广东移动通信有限公司 Photographic method, image processor, camera arrangement and electronic equipment

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004180151A (en) * 2002-11-28 2004-06-24 Fuji Photo Film Co Ltd Digital camera
JP2009033468A (en) * 2007-07-26 2009-02-12 Sharp Corp Interpolation frame image display method and interpolation frame image generation apparatus for low frame rate moving image
CN103905708A (en) * 2012-12-24 2014-07-02 联想(北京)有限公司 Shooting frame rate adjusting method and electronic device
CN104065886A (en) * 2014-07-04 2014-09-24 联想(北京)有限公司 Starting control method and electronic device
CN104601897A (en) * 2015-02-13 2015-05-06 浙江宇视科技有限公司 Anti-shake device and method of video camera
CN105120112A (en) * 2015-09-25 2015-12-02 维沃移动通信有限公司 Camera starting method for mobile terminal and mobile terminal
CN106454127A (en) * 2016-11-29 2017-02-22 惠州Tcl移动通信有限公司 Method and system of improving the starting speed of camera of mobile terminal
CN106937055A (en) * 2017-03-30 2017-07-07 维沃移动通信有限公司 A kind of image processing method and mobile terminal
CN108718362A (en) * 2018-04-28 2018-10-30 上海与德通讯技术有限公司 Kinescope method and terminal
CN109101352A (en) * 2018-08-30 2018-12-28 Oppo广东移动通信有限公司 Algorithm framework, algorithm call method, device, storage medium and mobile terminal
CN109922322A (en) * 2019-04-10 2019-06-21 Oppo广东移动通信有限公司 Photographic method, image processor, camera arrangement and electronic equipment

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020207192A1 (en) * 2019-04-10 2020-10-15 Oppo广东移动通信有限公司 Image processor, image processing method, photography apparatus, and electronic device
CN110602359A (en) * 2019-09-02 2019-12-20 Oppo广东移动通信有限公司 Image processing method, image processor, photographing device and electronic equipment
WO2021103388A1 (en) * 2019-11-29 2021-06-03 浙江宇视科技有限公司 Image capturing method and apparatus, electronic photography device, and computer-readable storage medium
CN111314606A (en) * 2020-02-21 2020-06-19 Oppo广东移动通信有限公司 Photographing method and device, electronic equipment and storage medium
WO2022089479A1 (en) * 2020-10-30 2022-05-05 维沃移动通信(杭州)有限公司 Photographing method and apparatus, and electronic device
WO2022188343A1 (en) * 2021-03-11 2022-09-15 广州安凯微电子股份有限公司 Control method and apparatus for camera device

Similar Documents

Publication Publication Date Title
CN110086967B (en) Image processing method, image processor, photographing device and electronic equipment
CN110121022A (en) Control method, filming apparatus and the electronic equipment of filming apparatus
WO2022262260A1 (en) Photographing method and electronic device
CN109963083A (en) Image processor, image processing method, filming apparatus and electronic equipment
US9723159B2 (en) RAW camera peripheral for handheld mobile unit
US11070742B2 (en) Optimized exposure temporal smoothing for time-lapse mode
US8446484B2 (en) Image processing architecture with pre-scaler
CN110276718A (en) Image processing method, image processor, filming apparatus and electronic equipment
CN110290288B (en) Image processor, image processing method, photographing device, and electronic apparatus
CN110177215A (en) Image processing method, image processor, filming apparatus and electronic equipment
CN110278373A (en) Image processor, image processing method, filming apparatus and electronic equipment
CN110266951A (en) Image processor, image processing method, filming apparatus and electronic equipment
KR20130109588A (en) Apparatus and mehod for processing a image in camera device
CN110062161B (en) Image processor, image processing method, photographing device, and electronic apparatus
US20240056685A1 (en) Image photographing method, device, storage medium, and program product
CN113596321A (en) Transition dynamic effect generation method, apparatus, storage medium, and program product
CN111510629A (en) Data display method, image processor, photographing device and electronic equipment
KR102058860B1 (en) Apparatus and mehod for processing a image in camera device
CN110035233A (en) Image processing method, device, storage medium and electronic equipment
CN110049254A (en) Image processing method, device, storage medium and electronic equipment
CN116055855B (en) Image processing method and related device
IES20140134A2 (en) Improved smartphone imaging using an external peripheral
IES86536B2 (en) Smartphone user interfaces for a RAW camera peripheral
IES86519B2 (en) Camera peripheral with external camera controls and lens mount for smartphone or hand-held device
IES86520B2 (en) RAW camera peripheral for smartphone or hand-held device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190813

RJ01 Rejection of invention patent application after publication