US10659683B2 - Rolling shutter synchronization - Google Patents
Rolling shutter synchronization Download PDFInfo
- Publication number
- US10659683B2 US10659683B2 US14/926,325 US201514926325A US10659683B2 US 10659683 B2 US10659683 B2 US 10659683B2 US 201514926325 A US201514926325 A US 201514926325A US 10659683 B2 US10659683 B2 US 10659683B2
- Authority
- US
- United States
- Prior art keywords
- camera
- rolling shutter
- cameras
- view
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related, expires
Links
- 238000005096 rolling process Methods 0.000 title claims abstract description 48
- 238000004891 communication Methods 0.000 claims abstract description 8
- 230000008878 coupling Effects 0.000 claims abstract description 6
- 238000010168 coupling process Methods 0.000 claims abstract description 6
- 238000005859 coupling reaction Methods 0.000 claims abstract description 6
- 238000010586 diagram Methods 0.000 description 38
- 230000000116 mitigating effect Effects 0.000 description 29
- 230000001360 synchronised effect Effects 0.000 description 12
- 230000015654 memory Effects 0.000 description 11
- 238000000034 method Methods 0.000 description 11
- 238000012805 post-processing Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 230000002123 temporal effect Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000001427 coherent effect Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000009189 diving Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000011152 fibreglass Substances 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- H04N5/23238—
-
- G02B27/2264—
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/22—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type
- G02B30/24—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type involving temporal multiplexing, e.g. using sequentially activated left and right shutters
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
- G03B37/04—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B7/00—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B9/00—Exposure-making shutters; Diaphragms
- G03B9/08—Shutters
- G03B9/28—Roller blind or flexible plate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/296—Synchronisation thereof; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/53—Control of the integration time
- H04N25/531—Control of the integration time by controlling rolling shutters in CMOS SSIS
-
- H04N5/247—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H04N5/3532—
-
- G02B27/2228—
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/34—Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B35/00—Stereoscopic photography
- G03B35/08—Stereoscopic photography by simultaneous recording
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B9/00—Exposure-making shutters; Diaphragms
- G03B9/08—Shutters
-
- G06K2009/2045—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
- G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19617—Surveillance camera constructional details
- G08B13/19626—Surveillance camera constructional details optical details, e.g. lenses, mirrors or multiple lenses
- G08B13/19628—Surveillance camera constructional details optical details, e.g. lenses, mirrors or multiple lenses of wide angled cameras and camera groups, e.g. omni-directional cameras, fish eye, single units having multiple cameras achieving a wide angle view
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19639—Details of the system layout
- G08B13/19641—Multiple cameras having overlapping views on a single scene
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/167—Synchronising or controlling image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/189—Recording image signals; Reproducing recorded image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/246—Calibration of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/327—Calibration thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/398—Synchronisation thereof; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/51—Housings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/41—Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
-
- H04N5/2252—
-
- H04N5/2254—
-
- H04N5/2258—
-
- H04N5/3415—
Definitions
- FIG. 2 b is a diagram illustrating an image captured from each camera of a two camera system according to one example embodiment.
- each camera 100 may include various optical components, a microphone, speakers, an image and/or audio processor, a controller, internal storage (e.g., flash memory, disk, memory cache or the like), an image preview display screen, input/output ports (e.g., USB, IEEE-1394, Bluetooth, or the like) a communications module (e.g., WiFi or mobile communication such as 3G, 4G, LTE or the like) and other conventional components.
- each camera 100 may include different or additional control inputs than those illustrated in FIG. 1 for capturing images and/or videos, for viewing previously captured images and/or videos, and for managing various camera settings.
- any camera can be configured as either a master or slave (e.g., using a physical switch or a software setting).
- the cameras are time-synchronized to ensure that each of the synchronized cameras initializes video capture at the same time.
- the slave camera's clocks are periodically re-synchronized with the master camera's clock in order to re-synchronize the cameras and compensate for potential draft due to different internal camera clock characteristics.
- captured images or video are wireless streamed to a remote device for live viewing. Each camera may also record and store their respective data locally.
- the field of views 103 a , 103 b overlap to form region 114 .
- the FOV overlap region 114 increases. While the overlap region 114 decreases if the cameras 100 are rotated away from each other or moved further apart, the image distortion at FOV boundaries 115 and 116 results in other impracticalities for stitching collected image data.
- the actual size of the overlap region 114 may be altered based on the user's desired application or equipment qualities (e.g., lens 102 distortion). In either instance, FOV artifacts may occur within the overlap region 114 .
- FIG. 6 c is a diagram illustrating stitched image data from a two camera system for mitigating FOV artifacts according to one example embodiment.
- the stitched image data 615 results from splicing the captured image data 610 at the stitching line 205 by discarding overlapping image data.
- stitching by discarding the overlapping image data in the overlap region 114 results in a final image 615 with the object in position 625 a for cameras 100 with RS configuration 400 and position 625 b for cameras with RS configuration 500 , with mitigated FOV artifacts.
- FIG. 7 is a diagram illustrating a top down view of an example four camera system 705 for mitigating FOV artifacts according to one example embodiment.
- the four camera system 705 includes cameras 700 a through 700 d that are respectively oriented 0°, 90°, 180°, and 270° to capture 360 degree 2D panoramic images.
- Each camera 100 includes a corresponding RS direction 701 for mitigating FOV artifacts when collected image data is stitched together.
- the RS direction 701 of one or more cameras 700 is user configurable.
- cameras 700 a and 700 c have a RS direction 701 a , 701 c configured to roll in the opposite direction of the RSs 701 b , 701 d of cameras 700 b and 700 d.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Studio Devices (AREA)
- Stereoscopic And Panoramic Photography (AREA)
Abstract
Description
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/926,325 US10659683B2 (en) | 2012-07-03 | 2015-10-29 | Rolling shutter synchronization |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261667882P | 2012-07-03 | 2012-07-03 | |
US13/610,753 US9204041B1 (en) | 2012-07-03 | 2012-09-11 | Rolling shutter synchronization |
US14/926,325 US10659683B2 (en) | 2012-07-03 | 2015-10-29 | Rolling shutter synchronization |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/610,753 Continuation US9204041B1 (en) | 2012-07-03 | 2012-09-11 | Rolling shutter synchronization |
Publications (2)
Publication Number | Publication Date |
---|---|
US20160050370A1 US20160050370A1 (en) | 2016-02-18 |
US10659683B2 true US10659683B2 (en) | 2020-05-19 |
Family
ID=54609407
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/610,753 Expired - Fee Related US9204041B1 (en) | 2012-07-03 | 2012-09-11 | Rolling shutter synchronization |
US14/926,325 Expired - Fee Related US10659683B2 (en) | 2012-07-03 | 2015-10-29 | Rolling shutter synchronization |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/610,753 Expired - Fee Related US9204041B1 (en) | 2012-07-03 | 2012-09-11 | Rolling shutter synchronization |
Country Status (1)
Country | Link |
---|---|
US (2) | US9204041B1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11212509B2 (en) | 2018-12-20 | 2021-12-28 | Snap Inc. | Flexible eyewear device with dual cameras for generating stereoscopic images |
US11259008B2 (en) * | 2019-12-06 | 2022-02-22 | Snap Inc. | Sensor misalignment compensation |
US11412132B2 (en) * | 2018-07-27 | 2022-08-09 | Huawei Technologies Co., Ltd. | Camera switching method for terminal, and terminal |
Families Citing this family (50)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5961506B2 (en) * | 2012-09-27 | 2016-08-02 | 日立オートモティブシステムズ株式会社 | Stereo camera device |
US10298815B1 (en) | 2012-10-18 | 2019-05-21 | Altia Systems, Inc. | Chassis and mounting arrangement for a panoramic camera |
US9241103B2 (en) * | 2013-03-15 | 2016-01-19 | Voke Inc. | Apparatus and method for playback of multiple panoramic videos with control codes |
US20140300691A1 (en) * | 2013-04-04 | 2014-10-09 | Panasonic Corporation | Imaging system |
US9451162B2 (en) | 2013-08-21 | 2016-09-20 | Jaunt Inc. | Camera array including camera modules |
US11019258B2 (en) | 2013-08-21 | 2021-05-25 | Verizon Patent And Licensing Inc. | Aggregating images and audio data to generate content |
WO2015038976A1 (en) * | 2013-09-13 | 2015-03-19 | 3D-4U, Inc. | Video production sharing apparatus and method |
US20150271471A1 (en) * | 2014-03-19 | 2015-09-24 | Htc Corporation | Blocking detection method for camera and electronic apparatus with cameras |
US9330436B2 (en) | 2014-04-01 | 2016-05-03 | Gopro, Inc. | Multi-camera array with adjacent fields of view |
US9911454B2 (en) | 2014-05-29 | 2018-03-06 | Jaunt Inc. | Camera array including camera modules |
US9503623B2 (en) | 2014-06-03 | 2016-11-22 | Applied Minds, Llc | Color night vision cameras, systems, and methods thereof |
US11108971B2 (en) | 2014-07-25 | 2021-08-31 | Verzon Patent and Licensing Ine. | Camera array removing lens distortion |
US10701426B1 (en) | 2014-07-28 | 2020-06-30 | Verizon Patent And Licensing Inc. | Virtual reality system including social graph |
US9774887B1 (en) | 2016-09-19 | 2017-09-26 | Jaunt Inc. | Behavioral directional encoding of three-dimensional video |
US9363569B1 (en) | 2014-07-28 | 2016-06-07 | Jaunt Inc. | Virtual reality system including social graph |
US10440398B2 (en) | 2014-07-28 | 2019-10-08 | Jaunt, Inc. | Probabilistic model to compress images for three-dimensional video |
US9392188B2 (en) * | 2014-08-10 | 2016-07-12 | Corephotonics Ltd. | Zoom dual-aperture camera with folded lens |
JP6372788B2 (en) * | 2014-08-26 | 2018-08-15 | カシオ計算機株式会社 | Imaging apparatus, imaging system, imaging method, and program |
EP3232899A4 (en) * | 2014-12-18 | 2018-11-07 | EndoChoice, Inc. | Multiple viewing element endoscope system having multiple sensor motion synchronization |
KR20190136117A (en) * | 2015-07-31 | 2019-12-09 | 에이치에스엔아이 엘엘씨 | Virtual Three Dimensional Video Creation and Management System and Method |
US10043237B2 (en) | 2015-08-12 | 2018-08-07 | Gopro, Inc. | Equatorial stitching of hemispherical images in a spherical image capture system |
US10033928B1 (en) | 2015-10-29 | 2018-07-24 | Gopro, Inc. | Apparatus and methods for rolling shutter compensation for multi-camera systems |
US10628983B2 (en) * | 2015-12-18 | 2020-04-21 | Digital Domain 3.0, Inc. | Systems and methods for multi-sensor image capture |
US10419666B1 (en) * | 2015-12-29 | 2019-09-17 | Amazon Technologies, Inc. | Multiple camera panoramic images |
US10110813B1 (en) * | 2016-04-27 | 2018-10-23 | Ambarella, Inc. | Multi-sensor camera using rolling shutter sensors |
GB2550372B (en) | 2016-05-17 | 2022-01-19 | Nctech Ltd | Imaging system having multiple imaging sensors and an associated method of operation |
US10652517B2 (en) * | 2016-06-07 | 2020-05-12 | Visbit Inc. | Virtual reality 360-degree video camera system for live streaming |
DE102016210712A1 (en) * | 2016-06-15 | 2017-12-21 | I-Mmersive Gmbh | Image capture device, image acquisition system, image projection device, image transfer system, method for capturing a 360 ° object region and method for projecting an image |
KR102520225B1 (en) | 2016-06-30 | 2023-04-11 | 삼성전자주식회사 | Electronic device and image capturing method thereof |
US10200608B1 (en) * | 2016-07-25 | 2019-02-05 | 360fly, Inc. | Panoramic image processing system, camera, and method therefor using multiple image processors |
US10805600B2 (en) | 2016-07-29 | 2020-10-13 | Applied Minds, Llc | Methods and associated devices and systems for enhanced 2D and 3D vision |
US10085006B2 (en) * | 2016-09-08 | 2018-09-25 | Samsung Electronics Co., Ltd. | Three hundred sixty degree video stitching |
US11032535B2 (en) | 2016-09-19 | 2021-06-08 | Verizon Patent And Licensing Inc. | Generating a three-dimensional preview of a three-dimensional video |
US11032536B2 (en) | 2016-09-19 | 2021-06-08 | Verizon Patent And Licensing Inc. | Generating a three-dimensional preview from a two-dimensional selectable icon of a three-dimensional reality video |
US10681341B2 (en) | 2016-09-19 | 2020-06-09 | Verizon Patent And Licensing Inc. | Using a sphere to reorient a location of a user in a three-dimensional virtual reality video |
KR101809727B1 (en) * | 2016-09-27 | 2017-12-15 | 주식회사 켐트로닉스 | Surround View Monitoring System and Image Signal Processing Method thereof |
CN106534787A (en) * | 2016-11-16 | 2017-03-22 | 北京明泰朗繁精密设备有限公司 | Video display system |
CN106791377B (en) * | 2016-11-29 | 2019-09-27 | Oppo广东移动通信有限公司 | Control method, control device and electronic device |
US11412134B2 (en) * | 2016-11-30 | 2022-08-09 | Laduma, Inc. | Underwater digital camera systems |
US10861359B2 (en) * | 2017-05-16 | 2020-12-08 | Texas Instruments Incorporated | Surround-view with seamless transition to 3D view system and method |
US10477064B2 (en) * | 2017-08-21 | 2019-11-12 | Gopro, Inc. | Image stitching with electronic rolling shutter correction |
US10062414B1 (en) * | 2017-08-22 | 2018-08-28 | Futurewei Technologies, Inc. | Determining a future field of view (FOV) for a particular user viewing a 360 degree video stream in a network |
US10878536B1 (en) * | 2017-12-29 | 2020-12-29 | Gopro, Inc. | Apparatus and methods for non-uniform downsampling of captured panoramic images |
KR102470465B1 (en) * | 2018-02-19 | 2022-11-24 | 한화테크윈 주식회사 | Apparatus and method for image processing |
DE102018202707A1 (en) * | 2018-02-22 | 2019-08-22 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Generation of panoramic pictures |
CN109285309A (en) * | 2018-09-30 | 2019-01-29 | 国网黑龙江省电力有限公司电力科学研究院 | A kind of intrusion target real-time detecting system based on transmission system |
TWI693578B (en) * | 2018-10-24 | 2020-05-11 | 緯創資通股份有限公司 | Image stitching processing method and system thereof |
US10694167B1 (en) | 2018-12-12 | 2020-06-23 | Verizon Patent And Licensing Inc. | Camera array including camera modules |
CN112308783B (en) | 2019-07-24 | 2024-06-28 | 株式会社理光 | Roller shutter effect correction method, roller shutter effect correction device and computer readable storage medium |
CZ309023B6 (en) * | 2020-05-20 | 2021-12-01 | České vysoké učení technické v Praze | Method of using effects arising in images due to the relative movement of the image capture device relative to the scene or part of the scene and the device for this |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6864911B1 (en) * | 2000-10-26 | 2005-03-08 | Hewlett-Packard Development Company, L.P. | Linkable digital cameras for an image capture system |
US20090135245A1 (en) | 2007-11-27 | 2009-05-28 | Jiafu Luo | Camera system with multiple pixel arrays on a chip |
US20090153710A1 (en) | 2007-12-13 | 2009-06-18 | Motorola, Inc. | Digital imager with dual rolling shutters |
US20100097443A1 (en) * | 2008-10-16 | 2010-04-22 | Peter Lablans | Controller in a Camera for Creating a Panoramic Image |
US20100245539A1 (en) | 2009-03-30 | 2010-09-30 | Hon Hai Precision Industry Co., Ltd. | Panoramic camera with a plurality of camera modules |
US20110157317A1 (en) * | 2009-12-24 | 2011-06-30 | Koji Kamiya | Camera system and camera control method |
US20120063637A1 (en) | 2010-09-15 | 2012-03-15 | Microsoft Corporation | Array of scanning sensors |
US8988509B1 (en) * | 2014-03-20 | 2015-03-24 | Gopro, Inc. | Auto-alignment of image sensors in a multi-camera system |
US20150278988A1 (en) * | 2014-04-01 | 2015-10-01 | Gopro, Inc. | Image Taping in a Multi-Camera Array |
US20180070003A1 (en) * | 2016-09-07 | 2018-03-08 | Peau Productions, Inc. | Multiple camera control system |
-
2012
- 2012-09-11 US US13/610,753 patent/US9204041B1/en not_active Expired - Fee Related
-
2015
- 2015-10-29 US US14/926,325 patent/US10659683B2/en not_active Expired - Fee Related
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6864911B1 (en) * | 2000-10-26 | 2005-03-08 | Hewlett-Packard Development Company, L.P. | Linkable digital cameras for an image capture system |
US20090135245A1 (en) | 2007-11-27 | 2009-05-28 | Jiafu Luo | Camera system with multiple pixel arrays on a chip |
US20090153710A1 (en) | 2007-12-13 | 2009-06-18 | Motorola, Inc. | Digital imager with dual rolling shutters |
US20100097443A1 (en) * | 2008-10-16 | 2010-04-22 | Peter Lablans | Controller in a Camera for Creating a Panoramic Image |
US20100245539A1 (en) | 2009-03-30 | 2010-09-30 | Hon Hai Precision Industry Co., Ltd. | Panoramic camera with a plurality of camera modules |
US20110157317A1 (en) * | 2009-12-24 | 2011-06-30 | Koji Kamiya | Camera system and camera control method |
US20120063637A1 (en) | 2010-09-15 | 2012-03-15 | Microsoft Corporation | Array of scanning sensors |
US8988509B1 (en) * | 2014-03-20 | 2015-03-24 | Gopro, Inc. | Auto-alignment of image sensors in a multi-camera system |
US20150278988A1 (en) * | 2014-04-01 | 2015-10-01 | Gopro, Inc. | Image Taping in a Multi-Camera Array |
US20180070003A1 (en) * | 2016-09-07 | 2018-03-08 | Peau Productions, Inc. | Multiple camera control system |
Non-Patent Citations (3)
Title |
---|
Ait-Aider et al., Structure and Kinematics Triangulation with a Rolling Shutter Stereo Rig, 2009, IEEE 12th International Conference on Computer Vision (ICCV), 1835-1840. |
Bradley et al., Synchronization and Rolling Shutter Compensation for Consumer Video Camera Arrays, 2009, Computer Vision and Pattern Recognition Workshops, 2009. CVPR Workshops 2009. IEEE Computer Society Conference, 1-8. |
Office Action for U.S. Appl. No. 13/610,753, dated Jun. 3, 2015, 19 Pages. |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11412132B2 (en) * | 2018-07-27 | 2022-08-09 | Huawei Technologies Co., Ltd. | Camera switching method for terminal, and terminal |
US11595566B2 (en) | 2018-07-27 | 2023-02-28 | Huawei Technologies Co., Ltd. | Camera switching method for terminal, and terminal |
US11785329B2 (en) | 2018-07-27 | 2023-10-10 | Huawei Technologies Co., Ltd. | Camera switching method for terminal, and terminal |
US11212509B2 (en) | 2018-12-20 | 2021-12-28 | Snap Inc. | Flexible eyewear device with dual cameras for generating stereoscopic images |
US11575872B2 (en) | 2018-12-20 | 2023-02-07 | Snap Inc. | Flexible eyewear device with dual cameras for generating stereoscopic images |
US11856179B2 (en) | 2018-12-20 | 2023-12-26 | Snap Inc. | Flexible eyewear device with dual cameras for generating stereoscopic images |
US12108019B2 (en) | 2018-12-20 | 2024-10-01 | Snap Inc. | Flexible eyewear device with dual cameras for generating stereoscopic images |
US11259008B2 (en) * | 2019-12-06 | 2022-02-22 | Snap Inc. | Sensor misalignment compensation |
US11575874B2 (en) | 2019-12-06 | 2023-02-07 | Snap Inc. | Sensor misalignment compensation |
Also Published As
Publication number | Publication date |
---|---|
US20160050370A1 (en) | 2016-02-18 |
US9204041B1 (en) | 2015-12-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10659683B2 (en) | Rolling shutter synchronization | |
US11259009B2 (en) | Modular configurable camera system | |
US20210144356A1 (en) | Auto-Alignment of Image Sensors in a Multi-Camera System | |
US11611824B2 (en) | Microphone pattern based on selected image of dual lens image capture device | |
US10187569B2 (en) | Portable device capable of generating panoramic file | |
US9374529B1 (en) | Enabling multiple field of view image capture within a surround image mode for multi-LENS mobile devices | |
KR101259559B1 (en) | Method and apparatus for automatic controlling of multi cameras | |
JP6455474B2 (en) | Image processing apparatus, image processing method, and program | |
JP2008129439A (en) | Complex eye imaging device | |
JP2014529930A (en) | Selective capture and display of a portion of a native image | |
JP2010252046A (en) | Image pickup apparatus | |
WO2015198675A1 (en) | Image capture equipment | |
JP2012222471A (en) | Multi-eye imaging apparatus and multi-eye imaging method, and mobile information terminal device | |
JP2006033476A (en) | Imaging device, display device, and imaging display device | |
KR20160021706A (en) | Playing method and the system of 360 degree spacial video | |
JP4565909B2 (en) | camera | |
CN103339948B (en) | 3D video playing device, 3D imaging device, and 3D video playing method | |
JP6312426B2 (en) | Imaging apparatus and control method thereof | |
US11399129B2 (en) | Image capture device with extended depth of field | |
JP2010245691A (en) | Compound-eye imaging device | |
JP2011035642A (en) | Multiple eye photographing device, and adjustment method and program thereof | |
WO2020238312A1 (en) | Photographing method and apparatus, storage medium and electronic device | |
US10931868B2 (en) | Methods and apparatus for instant capture of content | |
JP6836306B2 (en) | Imaging control device, its control method, program and recording medium | |
JP2016036081A (en) | Image processing device, method and program, and recording medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: WOODMAN LABS, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CAMPBELL, SCOTT PATRICK;REEL/FRAME:036997/0486 Effective date: 20120821 Owner name: GOPRO, INC., CALIFORNIA Free format text: CHANGE OF NAME;ASSIGNOR:WOODMAN LABS, INC.;REEL/FRAME:037078/0783 Effective date: 20140204 |
|
AS | Assignment |
Owner name: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT, ILLINOIS Free format text: SECURITY AGREEMENT;ASSIGNOR:GOPRO, INC.;REEL/FRAME:038184/0779 Effective date: 20160325 Owner name: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT Free format text: SECURITY AGREEMENT;ASSIGNOR:GOPRO, INC.;REEL/FRAME:038184/0779 Effective date: 20160325 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
ZAAA | Notice of allowance and fees due |
Free format text: ORIGINAL CODE: NOA |
|
ZAAB | Notice of allowance mailed |
Free format text: ORIGINAL CODE: MN/=. |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT, NEW YORK Free format text: SECURITY INTEREST;ASSIGNOR:GOPRO, INC.;REEL/FRAME:054113/0594 Effective date: 20201016 |
|
AS | Assignment |
Owner name: GOPRO, INC., CALIFORNIA Free format text: RELEASE OF PATENT SECURITY INTEREST;ASSIGNOR:JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:055106/0434 Effective date: 20210122 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20240519 |