CN108012073B - Method and device for realizing panoramic shooting - Google Patents
Method and device for realizing panoramic shooting Download PDFInfo
- Publication number
- CN108012073B CN108012073B CN201610962352.4A CN201610962352A CN108012073B CN 108012073 B CN108012073 B CN 108012073B CN 201610962352 A CN201610962352 A CN 201610962352A CN 108012073 B CN108012073 B CN 108012073B
- Authority
- CN
- China
- Prior art keywords
- shooting
- panoramic
- image
- panoramic shooting
- angle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 72
- 230000033001 locomotion Effects 0.000 claims description 25
- 238000012163 sequencing technique Methods 0.000 claims description 25
- 238000006243 chemical reaction Methods 0.000 claims description 13
- 230000008569 process Effects 0.000 abstract description 45
- 230000008859 change Effects 0.000 description 28
- 230000006870 function Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 108091026890 Coding region Proteins 0.000 description 5
- 238000004891 communication Methods 0.000 description 5
- 230000006837 decompression Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 239000004973 liquid crystal related substance Substances 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/2228—Video assist systems used in motion picture production, e.g. video cameras connected to viewfinders of motion picture cameras or related video signal processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
Abstract
A method and a device for realizing panoramic shooting comprise the following steps: recording shooting track information during panoramic shooting through a preset sensor; and splicing the image frames of the panoramic shooting according to the recorded shooting track information to obtain a panoramic shooting image. According to the embodiment of the invention, through the recorded shooting track information, the time consumption in the splicing process is reduced, the unnatural splicing process is avoided, and the quality and the user experience of the panoramic shooting image are improved.
Description
Technical Field
The present disclosure relates to, but not limited to, image processing technologies, and more particularly, to a method and an apparatus for panoramic shooting.
Background
Panoramic photography is to take a certain angle (for example, 360-degree horizontal photography or 360-degree horizontal and 180-degree vertical photography) with a set point as the center, and splice a plurality of taken pictures into a panoramic image. The basic principle of splicing the panoramic images is to search the edge parts of two pictures, coincide the areas with the closest imaging effect and splice the non-coincident areas to obtain the panoramic images.
The area that above-mentioned panoramic picture's concatenation needs to be the closest with the formation of image effect before coincides, and its realization mainly realizes through feature matching technique, and feature matching is consuming time and is caused the concatenation process long, in addition, at the connection area, when adopting the feature matching to splice, because the feature matching precision problem, still has the unnatural problem of joining region, has influenced the quality of panoramic photography image.
Disclosure of Invention
The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.
The embodiment of the invention provides a method and a device for realizing panoramic shooting, which can reduce the time consumption in the splicing process and improve the quality of panoramic shot images.
The embodiment of the invention provides a device for realizing panoramic shooting, which comprises: a recording unit and a splicing unit; wherein,
the recording unit is used for recording the shooting track information during panoramic shooting through a preset sensor;
and the splicing unit is used for splicing the image frames of the panoramic shooting according to the recorded shooting track information so as to obtain the panoramic shooting image.
Optionally, the recording unit is specifically configured to,
respectively recording the shooting angle of each image frame during panoramic shooting through a gyroscope sensor, and respectively converting the shooting angle of each image frame during panoramic shooting into corresponding coding information according to a preset coding mode;
and identifying each image frame corresponding to panoramic shooting by using each piece of coding information obtained by conversion, and taking all pieces of coding information for identifying the image frames as the shooting track information.
Optionally, the apparatus further comprises: the direction processing unit is used for processing the direction of the object,
determining the motion direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and continuing the panoramic shooting when the motion duration of the second direction is less than a preset duration threshold;
and determining the moving direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and stopping the panoramic shooting when the moving time length of the second direction is greater than or equal to the preset time length threshold value.
Optionally, the splicing unit is specifically configured to,
determining a sorting rule of the coded information according to the preset coding mode;
determining coding information which does not accord with the sequencing rule, and deleting the image frame corresponding to the coding information which does not accord with the sequencing rule;
and splicing the image frames corresponding to the coding information according with the ordering rule to obtain the panoramic shot image.
Optionally, the apparatus further comprises:
the cache display unit is used for analyzing the panoramic shot image according to the coding information for splicing the panoramic shot image and caching the analyzed panoramic shot image; and reading the cached and analyzed panoramic shot image according to the terminal moving angle so as to display the panoramic shot image.
On the other hand, an embodiment of the present invention further provides a method for implementing panoramic shooting, including:
recording shooting track information during panoramic shooting through a preset sensor;
and splicing the image frames of the panoramic shooting according to the recorded shooting track information to obtain a panoramic shooting image.
Optionally, the recording of the shooting track information during panoramic shooting by the preset sensor includes:
respectively recording the shooting angle of each image frame during panoramic shooting through a gyroscope sensor, and respectively converting the shooting angle of each image frame during panoramic shooting into corresponding coding information according to a preset coding mode;
and identifying each image frame corresponding to panoramic shooting by using each piece of coding information obtained by conversion, and taking all pieces of coding information for identifying the image frames as the shooting track information.
Optionally, the method further includes:
determining the motion direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and continuing the panoramic shooting when the motion duration of the second direction is less than a preset duration threshold;
and determining the moving direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and stopping the panoramic shooting when the moving time length of the second direction is greater than or equal to the preset time length threshold value.
Optionally, the stitching processing of the image frames of the panoramic shooting according to the recorded shooting track information includes:
determining a sorting rule of the coded information according to the preset coding mode;
determining coding information which does not accord with the sequencing rule, and deleting the image frame corresponding to the coding information which does not accord with the sequencing rule;
and splicing the image frames corresponding to the coding information according with the ordering rule to obtain the panoramic shot image.
Optionally, the method further includes:
analyzing the panoramic shot image according to the coding information of the spliced panoramic shot image, and caching the analyzed panoramic shot image;
and reading the cached and analyzed panoramic shot image according to the terminal moving angle so as to display the panoramic shot image.
Compared with the related art, the technical scheme of the application comprises the following steps: recording shooting track information during panoramic shooting through a preset sensor; and splicing the image frames of the panoramic shooting according to the recorded shooting track information to obtain a panoramic shooting image. According to the embodiment of the invention, through the recorded shooting track information, the time consumption in the splicing process is reduced, the unnatural splicing process is avoided, and the quality and the user experience of the panoramic shooting image are improved.
Other aspects will be apparent upon reading and understanding the attached drawings and detailed description.
Drawings
FIG. 1 is a schematic hardware configuration of an alternative mobile terminal implementing various embodiments of the present invention;
FIG. 2 is a block diagram of the main electrical structure of a camera of an embodiment of the present invention;
FIG. 3 is a flowchart of a method for implementing panoramic shooting according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of operating coordinates of a gyroscope sensor according to an embodiment of the invention;
fig. 5 is a schematic view of a panoramic image of an undeleted image frame in the related art;
FIG. 6 is a schematic view of a panoramic image after image frames are deleted according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of adjusting an angle ratio according to an embodiment of the present invention;
FIG. 8 is a flowchart of a method for performing panorama shooting according to another embodiment of the present invention;
fig. 9 is a block diagram of an apparatus for implementing panorama shooting according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.
The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.
Fig. 1 is a schematic hardware configuration of an alternative mobile terminal implementing various embodiments of the present invention.
The mobile terminal 100 may include an a/V (audio/video) input unit 120, a user input unit 130, an output unit 150, a memory 160, a controller 180, a power supply unit 190, and the like. Fig. 2 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.
The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium), and two or more cameras 1210 may be provided according to the construction of the mobile terminal.
The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 151 in the form of a layer, a touch screen may be formed.
The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151.
The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.
Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The display unit 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.
The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.
The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.
The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.
Up to this point, mobile terminals have been described in terms of their functionality. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.
Fig. 2 is a block diagram of the main electrical structure of the camera of the embodiment of the present invention. The photographing lens 701 is composed of a plurality of optical lenses for forming an object image, and is a single focus lens or a zoom lens, wherein the photographing lens 701 is two in the present embodiment. The photographing lens 701 can be moved in the optical axis direction by the lens driving unit 711, and the focal position of the photographing lens 701 is controlled based on a control signal from the lens driving control unit 712. The lens drive control circuit 712 performs drive control of the lens drive section 711 in accordance with a control command from the microcomputer 707.
An image pickup device 702 is disposed on the optical axis of the photographing lens 701 in the vicinity of a position where an object image is formed by the photographing lens 701. The image pickup device 702 functions as an image pickup unit that picks up an object image and acquires picked-up image data. Photodiodes constituting each pixel are two-dimensionally arranged in a matrix on the image pickup element 702. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, and the photoelectric conversion current is charged by a capacitor connected to each photodiode. A bayer RGB color filter is disposed on the front surface of each pixel.
The image pickup device 702 is connected to an image pickup circuit 703, and the image pickup circuit 703 performs charge accumulation control and image signal reading control in the image pickup device 702, reduces reset noise in the read image signal (analog image signal), performs waveform shaping, and further performs gain improvement or the like so as to obtain an appropriate signal level. The image pickup circuit 703 is connected to an analog-to-digital (a/D) converter 704, and the a/D converter 704 performs analog-to-digital conversion on an analog image signal and outputs a digital image signal (hereinafter referred to as image data) to the bus 199.
The bus 199 is a transmission path for transmitting various data read out or generated inside the camera. The a/D converter 704 is connected to the bus 199, and further connected to an image processor 705, a JPEG processor 706, a microcomputer 707, a dynamic random access memory (SDRAM) 708, a memory interface (hereinafter referred to as memory I/F)709, and a Liquid Crystal Display (LCD) driver 710.
The image processor 705 performs various image processing such as OB subtraction processing, white balance adjustment, color matrix operation, gamma conversion, color difference signal processing, noise removal processing, synchronization processing, and edge processing on image data output from the image pickup device 702. When recording the image data in the recording medium 715, the JPEG processor 706 compresses the image data read from the SDRAM708 in accordance with the JPEG compression method. The JPEG processor 706 decompresses JPEG image data for image reproduction and display. When decompression is performed, a file recorded in the recording medium 715 is read out, decompression processing is performed in the JPEG processor 706, and the decompressed image data is temporarily stored in the SDRAM708 and displayed on the LCD 716. In the present embodiment, the JPEG system is used as the image compression/decompression system, but the compression/decompression system is not limited to this, and other compression/decompression systems such as MPEG, TIFF, and h.264 may be used.
The microcomputer 707 functions as a control unit for the entire camera, and collectively controls various processing sequences of the camera. The microcomputer 707 is connected to an operation unit 713 and a flash memory 714.
The operation unit 713 includes, but is not limited to, physical keys or virtual keys, which may be various input buttons such as a power button, a photographing key, an editing key, a moving image button, a reproducing button, a menu button, a cross key, an OK button, a delete button, an enlargement button, and various operation members such as various input keys, and detects operation states of these operation members.
The detection result is output to the microcomputer 707. A touch panel is provided on the front surface of the LCD716 as a display unit, and a touch position of the user is detected and output to the microcomputer 707. The microcomputer 707 executes various processing sequences corresponding to the user's operation based on the detection result of the operation member from the operation unit 713. Also, here, the computer 707 may execute various processing sequences corresponding to the user's operation based on the detection result of the touch panel in front of the LCD 716. )
The flash memory 714 stores programs for executing various processing sequences of the microcomputer 707. The microcomputer 707 controls the entire camera according to the program. The flash memory 714 stores various adjustment values of the camera, and the microcomputer 707 reads out the adjustment values and controls the camera in accordance with the adjustment values.
The SDRAM708 is an electrically rewritable volatile memory for temporarily storing image data and the like. The SDRAM708 temporarily stores the image data output from the a/D conversion section 704 and the image data processed by the image processor 705, JPEG processor 706, and the like.
The memory interface 709 is connected to the recording medium 715, and performs control for writing and reading image data and data such as a file header added to the image data to and from the recording medium 715. The recording medium 715 is, for example, a recording medium such as a memory card that can be attached to and detached from the camera body, but is not limited thereto, and may be a hard disk or the like built in the camera body.
The LCD driver 710 is connected to the LCD716, and stores the image data processed by the image processor 705 in SDRAM, and when display is required, reads the image data stored in SDRAM and displays it on the LCD716, or the image data compressed by the JPEG processor 706 is stored in SDRAM, and when display is required, the JPEG processor 706 reads the compressed image data from SDRAM and decompresses it, and displays the decompressed image data through the LCD 716.
The LCD716 is disposed on the back surface of the camera body, for example, and displays an image. The LCD716 is provided with a touch panel that detects a touch operation by a user. In addition, although the liquid crystal display panel (LCD716) is disposed as the display unit in the present embodiment, the present invention is not limited to this, and various display panels such as organic EL may be used.
Based on the above mobile terminal hardware structure and camera, various embodiments of the method of the present invention are provided.
Fig. 3 is a flowchart of a method for implementing panorama shooting according to an embodiment of the present invention, as shown in fig. 3, including:
300, recording shooting track information during panoramic shooting through a preset sensor;
optionally, in the embodiment of the present invention, recording the shooting track information during panoramic shooting by using the preset sensor includes:
respectively recording the shooting angle of each image frame during panoramic shooting through a gyroscope sensor, and respectively converting the shooting angle of each image frame during panoramic shooting into corresponding coding information according to a preset coding mode;
and identifying each image frame corresponding to panoramic shooting by using each piece of coding information obtained by conversion, and taking all pieces of coding information for identifying the image frames as shooting track information.
Optionally, the embodiment of the present invention further includes:
after the camera is started, when the accumulated change degree of the shooting angle of the camera in the first direction is determined to be larger than a preset trigger threshold value according to the shooting track information, starting panoramic shooting;
wherein starting the panorama shooting comprises: and panoramic shooting started according to the first direction as the moving direction of the camera.
It should be noted that the trigger threshold implemented by the present invention may include a horizontal angle change threshold and/or a vertical angle change threshold. Fig. 4 is a schematic diagram of working coordinates of a gyro sensor according to an embodiment of the present invention, where, as shown in fig. 4, the X-axis represents the horizontal direction and the Y-axis represents the vertical direction. Taking 360 degree shots around M as an example, the trigger threshold may be a horizontal direction angle change threshold. Here, the trigger threshold in the embodiment of the present invention may be an angle value between 3 degrees and 20 degrees, the size of the trigger threshold may be determined according to an actual situation, and the smaller the trigger threshold is, the more the image frames are generally acquired; when the trigger threshold is large, fewer image frames are collected.
Optionally, the method in the embodiment of the present invention further includes:
determining the motion direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and continuing the panoramic shooting when the motion duration of the second direction is less than a preset duration threshold;
and determining the moving direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and stopping the panoramic shooting when the moving time length in the second direction is greater than or equal to a preset time length threshold value.
Optionally, the embodiment of the present invention may further include: and stopping panoramic shooting when a preset shooting stopping instruction is received.
Optionally, the stitching processing of the image frames of the panoramic shooting according to the recorded shooting track information includes:
determining a sorting rule of the coded information according to a preset coding mode;
determining coding information which does not accord with the sequencing rule, and deleting the image frame corresponding to the coding information which does not accord with the sequencing rule;
and splicing the image frames corresponding to the coding information according with the ordering rule to obtain the panoramic shot image.
It should be noted that, the order compliance is to refer to the encoding mode and order according to a fixed size or order according to a fixed encoding order; assuming that image frames are encoded according to positive integers of 1, 2, 3, 4, 5, 6, 7, 8 … … N, if the moving direction of the camera is always moved along the first direction during panorama shooting, the encoding order of the image frames during panorama shooting is 1, 2, 3, 4, 5, 6, 7, 8 … … N; if the camera moves to a second direction opposite to the first direction by a certain angle after the image frame numbered 5 due to error in operation in the process of moving to the first direction, and then returns to the first direction, the movement of the second direction is assumed that the angle of the movement of the second direction corresponds to three image frames, the coding sequence of the image frames in the panoramic shooting process is 1, 2, 3, 4, 5, 4, 3, 2, 3, 4, 5 … … N; fig. 5 is a schematic view of a panoramic image in which image frames are not deleted in the related art, and as shown in fig. 5, a portion where a second frame image is not overlapped with a first frame image is represented by a rectangle numbered 2, except that the image frame numbered 1 is a complete image; similarly, the part of the third frame image which is not overlapped with the second frame image is represented by a rectangle with the number of 3; the part of the fourth frame image which is not overlapped with the third frame image is represented by a rectangle with the number of 4; the part of the fifth frame image which is not overlapped with the fourth frame image is represented by a rectangle with the number of 5; because the camera moves three image frames towards the second direction, the rectangle with the number 5, the rectangle with the number 4 and the rectangle with the number 3 are sequentially spliced and displayed according to the coding sequence; then, after the camera recovers the movement in the first direction, continuing to code the rectangle with the number 3, the rectangle with the number 4 and the rectangle with the number 5; fig. 6 is a schematic view of a panoramic image after image frames are deleted, as shown in fig. 6, except that the image frame with reference number 1 is a complete image, and the non-overlapping portion of the second frame image and the first frame image is represented by a rectangle with reference number 2; the part of the third frame image which is not overlapped with the second frame image is represented by a rectangle with the number of 3; the part of the fourth frame image which is not overlapped with the third frame image is represented by a rectangle with the number of 4; the part of the fifth frame image which is not overlapped with the fourth frame image is represented by a rectangle with the number of 5; because the image frame corresponding to the coding information which does not accord with the sequencing rule is deleted after the coding information which does not accord with the sequencing rule, after the deletion processing, the coding information accords with the sequencing rule: 1. 2, 3, 4, 5, 6, 7, 8 … … N; that is, after the portion numbered 5 is stitched, the portion where the sixth frame image and the fifth frame image do not overlap, which is indicated by the rectangle numbered 6, and the portion where the seventh frame image and the sixth frame image do not overlap, which is indicated by the rectangle numbered 7, are stitched continuously … …. By adopting the embodiment of the invention for splicing, the condition of unnatural splicing caused by the change of the moving direction of the camera in the process of shooting the panoramic image is avoided, and the image quality of panoramic shooting is improved.
Optionally, the embodiment of the present invention further includes:
and displaying the panoramic shot image according to the terminal moving angle according to the coding information of the spliced panoramic shot image.
It should be noted that, in the embodiment of the present invention, when displaying the panoramic image, the panoramic image may be played according to the moving angle in the playing process; the ratio of the moving angle to the shooting angle can be 1, namely when the panoramic shooting image moves by 1 degree, the panoramic shooting image is subjected to 1-degree change display; in the embodiment of the invention, the accumulative change of the shooting angle is more than 360 degrees, the ratio of the moving angle to the shooting angle can be less than 1, and the display of panoramic shooting images of all shooting angles is completed when the general moving angle reaches 360 degrees; the ratio of the moving angle to the shooting angle can be adjusted according to actual conditions. Fig. 7 is a schematic diagram of adjusting an angle ratio according to an embodiment of the present invention, and as shown in fig. 7, the angle ratio indicates a ratio between a moving angle and a shooting angle, and the angle ratio can be increased according to a preset step length by an upright triangular virtual key; the angle ratio can be reduced according to the preset step length through the inverted triangular virtual key; the preset step size may be a preset fixed value, for example, 0.05; if the required angle ratio cannot be obtained through the adjustment of the preset step length, the preset step length can be modified or the numerical value of the angle ratio can be determined through a manual input mode.
Optionally, the method in the embodiment of the present invention further includes:
and analyzing the panoramic shot images according to the coding information of the spliced panoramic shot images, caching the analyzed panoramic shot images, and reading the cached analyzed panoramic shot images according to the terminal moving angle so as to display the panoramic shot images.
It should be noted that, in the related art, displaying a panoramic image generally includes the following procedures: acquiring a panoramic shot image, analyzing the panoramic shot image and outputting the panoramic shot image; according to the embodiment of the invention, after the panoramic shooting image is analyzed, the analyzed panoramic shooting image is cached, and when the panoramic shooting image is displayed, the cached data is directly read, so that the display efficiency is improved; in addition, if audio information is generated when the panoramic image is generated, the audio information does not affect the implementation of the above process, and only an audio processing process needs to be added in the process from analysis to output.
According to the embodiment of the invention, through the recorded shooting track information, the time consumption in the splicing process is reduced, the unnatural splicing process is avoided, and the quality and the user experience of the panoramic shooting image are improved.
Fig. 8 is a flowchart of a method for implementing panorama shooting according to another embodiment of the present invention, as shown in fig. 8, including:
optionally, recording the shooting track information during panoramic shooting through a preset sensor includes:
respectively recording the shooting angle of each image frame during panoramic shooting through a gyroscope sensor, and respectively converting the shooting angle of each image frame during panoramic shooting into corresponding coding information according to a preset coding mode;
and identifying each image frame corresponding to panoramic shooting by using each piece of coding information obtained by conversion, and taking all pieces of coding information for identifying the image frames as shooting track information.
Optionally, the embodiment of the present invention further includes:
after the camera is started, when the accumulated change degree of the shooting angle of the camera in the first direction is determined to be larger than a preset trigger threshold value according to the shooting track information, starting panoramic shooting;
starting the panorama shooting includes: and panoramic shooting started according to the first direction as the moving direction of the camera.
It should be noted that the trigger threshold implemented by the present invention may include a horizontal angle change threshold and/or a vertical angle change threshold. Taking 360 degree shots around M as an example, the trigger threshold may be a horizontal direction angle change threshold. Here, the triggering threshold may be an angle value between 3 degrees and 20 degrees, the size of the triggering threshold may be determined according to an actual situation, and the smaller triggering threshold is that the number of collected image frames is generally large; when the trigger threshold is large, fewer image frames are collected.
Optionally, the method in the embodiment of the present invention further includes:
determining the motion direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and continuing the panoramic shooting when the motion duration of the second direction is less than a preset duration threshold;
and determining the moving direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and stopping the panoramic shooting when the moving time length in the second direction is greater than or equal to a preset time length threshold value.
Optionally, the embodiment of the present invention may further include: and stopping panoramic shooting when a preset shooting stopping instruction is received.
Optionally, the splicing processing of the image frames of the panoramic shooting according to the recorded shooting track information in the embodiment of the present invention includes:
determining a sorting rule of the coded information according to a preset coding mode;
determining coding information which does not accord with the sequencing rule, and deleting the image frame corresponding to the coding information which does not accord with the sequencing rule;
and splicing the image frames corresponding to the coding information according with the sorting rule to obtain a panoramic shot image.
It should be noted that, the order compliance is to refer to the encoding mode and order according to a fixed size or order according to a fixed encoding order; assuming that image frames are encoded according to positive integers of 1, 2, 3, 4, 5, 6, 7, 8 … … N, if the moving direction of the camera is always moved along the first direction during panorama shooting, the encoding order of the image frames during panorama shooting is 1, 2, 3, 4, 5, 6, 7, 8 … … N; if the camera moves to a second direction opposite to the first direction by a certain angle after the image frame numbered 5 due to error in operation in the process of moving to the first direction, and then returns to the first direction, the movement of the second direction is assumed that the angle of the movement of the second direction corresponds to three image frames, the coding sequence of the image frames in the panoramic shooting process is 1, 2, 3, 4, 5, 4, 3, 2, 3, 4, 5 … … N; after deleting the coding information which does not accord with the sequencing rule, the coding information which accords with the sequencing rule is as follows: 1. 2, 3, 4, 5, 6, 7, 8 … … N; by adopting the embodiment of the invention for splicing, the condition of unnatural splicing caused by the change of the moving direction of the camera in the process of shooting the panoramic image is avoided, and the image quality of panoramic shooting is improved.
And 802, displaying the panoramic shot image according to the terminal moving angle according to the coding information of the spliced panoramic shot image.
It should be noted that, in the embodiment of the present invention, when displaying the panoramic image, the panoramic image may be played according to the moving angle in the playing process; the ratio of the moving angle to the shooting angle can be 1, namely when the panoramic shooting image moves by 1 degree, the panoramic shooting image is subjected to 1-degree change display; in the embodiment of the invention, the accumulative change of the shooting angle is more than 360 degrees, the ratio of the moving angle to the shooting angle can be less than 1, and the display of panoramic shooting images of all shooting angles is completed when the general moving angle reaches 360 degrees; the ratio of the moving angle to the shooting angle can be adjusted according to actual conditions. The embodiment of the invention expresses the ratio of the moving angle to the shooting angle by the angle ratio, and the angle ratio can be adjusted according to the preset step length; the preset step size may be a preset fixed value, for example, 0.05; if the required angle ratio cannot be obtained through the adjustment of the preset step length, the preset step length can be modified or the numerical value of the angle ratio can be determined through a manual input mode.
Optionally, displaying the panoramic image according to the terminal movement angle includes:
and analyzing the panoramic shot images according to the coding information of the spliced panoramic shot images, caching the analyzed panoramic shot images, and reading the cached analyzed panoramic shot images according to the terminal moving angle so as to display the panoramic shot images.
It should be noted that the display of the panoramic image in the related art generally includes the following procedures: acquiring a panoramic shot image, analyzing the panoramic shot image and outputting the panoramic shot image; according to the embodiment of the invention, after the panoramic shooting image is analyzed, the analyzed panoramic shooting image is cached, and when the panoramic shooting image is displayed, the cached data is directly read, so that the display efficiency is improved; in addition, if audio information is generated when the panoramic image is generated, the audio information does not affect the implementation of the above process, and only an audio processing process needs to be added in the process from analysis to output.
According to the embodiment of the invention, through the recorded shooting track information, the time consumption in the splicing process is reduced, the unnatural splicing process is avoided, and the quality and the user experience of the panoramic shooting image are improved.
Fig. 9 is a block diagram of a device for implementing panoramic shooting according to an embodiment of the present invention, and as shown in fig. 9, the device includes: a recording unit and a splicing unit; wherein,
the recording unit is used for recording the shooting track information during panoramic shooting through a preset sensor;
optionally, the recording unit is specifically configured to,
respectively recording the shooting angle of each image frame during panoramic shooting through a gyroscope sensor, and respectively converting the shooting angle of each image frame during panoramic shooting into corresponding coding information according to a preset coding mode;
and identifying each image frame corresponding to panoramic shooting by using each piece of coding information obtained by conversion, and taking all pieces of coding information for identifying the image frames as shooting track information.
Optionally, the embodiment of the present invention further includes:
after the camera is started, when the accumulated change degree of the shooting angle of the camera in the first direction is determined to be larger than a preset trigger threshold value according to the shooting track information, starting panoramic shooting;
starting the panorama shooting includes: and panoramic shooting started according to the first direction as the moving direction of the camera.
It should be noted that the trigger threshold implemented by the present invention may include a horizontal angle change threshold and/or a vertical angle change threshold. Taking 360 degree shots around M as an example, the trigger threshold may be a horizontal direction angle change threshold. Here, the trigger threshold in the embodiment of the present invention may be an angle value between 3 degrees and 20 degrees, the size of the trigger threshold may be determined according to an actual situation, and the smaller the trigger threshold is, the more the image frames are generally acquired; when the trigger threshold is large, fewer image frames are collected.
And the splicing unit is used for splicing the image frames of the panoramic shooting according to the recorded shooting track information so as to obtain the panoramic shooting image.
Optionally, the apparatus in the embodiment of the present invention further includes: the direction processing unit is used for processing the direction of the object,
determining the motion direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and continuing the panoramic shooting when the motion duration of the second direction is less than a preset duration threshold;
and determining the moving direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and stopping the panoramic shooting when the moving time length in the second direction is greater than or equal to a preset time length threshold value.
Optionally, the embodiment of the present invention may further include: and stopping panoramic shooting when a preset shooting stopping instruction is received.
Optionally, the splicing unit is specifically configured to,
determining a sorting rule of the coded information according to a preset coding mode;
determining coding information which does not accord with the sequencing rule, and deleting the image frame corresponding to the coding information which does not accord with the sequencing rule;
and splicing the image frames corresponding to the coding information according with the sorting rule to obtain a panoramic shot image.
It should be noted that, the ordering rule includes ordering according to a fixed size or ordering according to a fixed coding order; assuming that image frames are encoded according to positive integers of 1, 2, 3, 4, 5, 6, 7, 8 … … N, if the moving direction of the camera is always moved along the first direction during panorama shooting, the encoding order of the image frames during panorama shooting is 1, 2, 3, 4, 5, 6, 7, 8 … … N; if the camera moves to a second direction opposite to the first direction by a certain angle after the image frame numbered 5 due to error in operation in the process of moving to the first direction, and then returns to the first direction, the movement of the second direction is assumed that the angle of the movement of the second direction corresponds to three image frames, the coding sequence of the image frames in the panoramic shooting process is 1, 2, 3, 4, 5, 4, 3, 2, 3, 4, 5 … … N; after deleting the coding information which does not accord with the sequencing rule, the coding information which accords with the sequencing rule is as follows: 1. 2, 3, 4, 5, 6, 7, 8 … … N; by adopting the embodiment of the invention for splicing, the condition of unnatural splicing caused by the change of the moving direction of the camera in the process of shooting the panoramic image is avoided, and the image quality of panoramic shooting is improved.
Optionally, the embodiment of the present invention further includes:
and displaying the panoramic shot image according to the terminal moving angle according to the coding information of the spliced panoramic shot image.
It should be noted that, in the embodiment of the present invention, when displaying the panoramic image, the panoramic image may be played according to the moving angle in the playing process; the ratio of the moving angle to the shooting angle can be 1, namely when the panoramic shooting image moves by 1 degree, the panoramic shooting image is subjected to 1-degree change display; in the embodiment of the invention, the accumulative change of the shooting angle is more than 360 degrees, the ratio of the moving angle to the shooting angle can be less than 1, and the display of panoramic shooting images of all shooting angles is completed when the general moving angle reaches 360 degrees; the ratio of the moving angle to the shooting angle can be adjusted according to actual conditions. The embodiment of the invention expresses the ratio of the moving angle to the shooting angle by the angle ratio, and the angle ratio can be adjusted according to the preset step length; the preset step size may be a preset fixed value, for example, 0.05; if the required angle ratio cannot be obtained through the adjustment of the preset step length, the preset step length can be modified or the numerical value of the angle ratio can be determined through a manual input mode.
Optionally, the apparatus in this embodiment of the present invention further includes a cache display unit, configured to parse the panoramic images according to the coding information ordering of the spliced panoramic images, cache the parsed panoramic images, and read the cached parsed panoramic images according to the terminal movement angle, so as to display the panoramic images.
It should be noted that, in the related art, displaying a panoramic image generally includes the following procedures: acquiring a panoramic shot image, analyzing the panoramic shot image and outputting the panoramic shot image; according to the embodiment of the invention, after the panoramic shooting image is analyzed, the analyzed panoramic shooting image is cached, and when the panoramic shooting image is displayed, the cached data is directly read, so that the display efficiency is improved; in addition, if audio information is generated when the panoramic image is generated, the audio information does not affect the implementation of the above process, and only an audio processing process needs to be added in the process from analysis to output.
According to the embodiment of the invention, through the recorded shooting track information, the time consumption in the splicing process is reduced, the unnatural splicing process is avoided, and the quality and the user experience of the panoramic shooting image are improved.
The embodiment of the invention also provides a device for realizing panoramic shooting, which comprises: the device comprises a recording unit, a direction processing unit, a splicing unit and a cache display unit; wherein,
the recording unit is used for recording the shooting track information during panoramic shooting through a preset sensor;
optionally, the recording unit is specifically configured to,
respectively recording the shooting angle of each image frame during panoramic shooting through a gyroscope sensor, and respectively converting the shooting angle of each image frame during panoramic shooting into corresponding coding information according to a preset coding mode;
and identifying each image frame corresponding to panoramic shooting by using each piece of coding information obtained by conversion, and taking all pieces of coding information for identifying the image frames as shooting track information.
Optionally, the embodiment of the present invention further includes:
after the camera is started, when the accumulated change degree of the shooting angle of the camera in the first direction is determined to be larger than a preset trigger threshold value according to the shooting track information, starting panoramic shooting;
starting the panorama shooting includes: and panoramic shooting started according to the first direction as the moving direction of the camera.
It should be noted that the trigger threshold implemented by the present invention may include a horizontal angle change threshold and/or a vertical angle change threshold. Taking 360 degree shots around M as an example, the trigger threshold may be a horizontal direction angle change threshold. Here, the trigger threshold in the embodiment of the present invention may be an angle value between 3 degrees and 20 degrees, the size of the trigger threshold may be determined according to an actual situation, and the smaller the trigger threshold is, the more the image frames are generally acquired; when the trigger threshold is large, fewer image frames are collected.
And the splicing unit is used for splicing the image frames of the panoramic shooting according to the recorded shooting track information so as to obtain the panoramic shooting image.
Optionally, the splicing unit is specifically configured to,
determining a sorting rule of the coded information according to a preset coding mode;
determining coding information which does not accord with the sequencing rule, and deleting the image frame corresponding to the coding information which does not accord with the sequencing rule;
and splicing the image frames corresponding to the coding information according with the sorting rule to obtain a panoramic shot image.
It should be noted that, the ordering rule includes ordering according to a fixed size or ordering according to a fixed coding order; assuming that image frames are encoded according to positive integers of 1, 2, 3, 4, 5, 6, 7, 8 … … N, if the moving direction of the camera is always moved along the first direction during panorama shooting, the encoding order of the image frames during panorama shooting is 1, 2, 3, 4, 5, 6, 7, 8 … … N; if the camera moves to a second direction opposite to the first direction by a certain angle after the image frame numbered 5 due to error in operation in the process of moving to the first direction, and then returns to the first direction, the movement of the second direction is assumed that the angle of the movement of the second direction corresponds to three image frames, the coding sequence of the image frames in the panoramic shooting process is 1, 2, 3, 4, 5, 4, 3, 2, 3, 4, 5 … … N; after deleting the coding information which does not accord with the sequencing rule, the coding information which accords with the sequencing rule is as follows: 1. 2, 3, 4, 5, 6, 7, 8 … … N; by adopting the embodiment of the invention for splicing, the condition of unnatural splicing caused by the change of the moving direction of the camera in the process of shooting the panoramic image is avoided, and the image quality of panoramic shooting is improved.
The direction processing unit is used for determining the moving direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and continuing the panoramic shooting when the moving time length in the second direction is less than a preset time length threshold value; and determining the moving direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and stopping the panoramic shooting when the moving time length in the second direction is greater than or equal to a preset time length threshold value.
Optionally, the embodiment of the present invention may further include: and stopping panoramic shooting when a preset shooting stopping instruction is received.
Optionally, the embodiment of the present invention further includes:
and displaying the panoramic shot image according to the terminal moving angle according to the coding information of the spliced panoramic shot image.
It should be noted that, in the embodiment of the present invention, when displaying the panoramic image, the panoramic image may be played according to the moving angle in the playing process; the ratio of the moving angle to the shooting angle can be 1, namely when the panoramic shooting image moves by 1 degree, the panoramic shooting image is subjected to 1-degree change display; in the embodiment of the invention, the accumulative change of the shooting angle is more than 360 degrees, the ratio of the moving angle to the shooting angle can be less than 1, and the display of panoramic shooting images of all shooting angles is completed when the general moving angle reaches 360 degrees; the ratio of the moving angle to the shooting angle can be adjusted according to actual conditions. The embodiment of the invention expresses the ratio of the moving angle to the shooting angle by the angle ratio, and the angle ratio can be adjusted according to the preset step length; the preset step size may be a preset fixed value, for example, 0.05; if the required angle ratio cannot be obtained through the adjustment of the preset step length, the preset step length can be modified or the numerical value of the angle ratio can be determined through a manual input mode.
And the cache display unit is used for analyzing the panoramic shooting images according to the coded information sequence of the spliced panoramic shooting images, caching the analyzed panoramic shooting images, and reading the cached analyzed panoramic shooting images according to the terminal moving angle so as to display the panoramic shooting images.
It should be noted that, in the related art, displaying a panoramic image generally includes the following procedures: acquiring a panoramic shot image, analyzing the panoramic shot image and outputting the panoramic shot image; according to the embodiment of the invention, after the panoramic shooting image is analyzed, the analyzed panoramic shooting image is cached, and when the panoramic shooting image is displayed, the cached data is directly read, so that the display efficiency is improved; in addition, if audio information is generated when the panoramic image is generated, the audio information does not affect the implementation of the above process, and only an audio processing process needs to be added in the process from analysis to output.
According to the embodiment of the invention, through the recorded shooting track information, the time consumption in the splicing process is reduced, the unnatural splicing process is avoided, and the quality and the user experience of the panoramic shooting image are improved.
It will be understood by those skilled in the art that all or part of the steps of the above methods may be implemented by a program instructing associated hardware (e.g., a processor) to perform the steps, and the program may be stored in a computer readable storage medium, such as a read only memory, a magnetic or optical disk, and the like. Alternatively, all or part of the steps of the above embodiments may be implemented using one or more integrated circuits. Accordingly, each module/unit in the above embodiments may be implemented in hardware, for example, by an integrated circuit to implement its corresponding function, or in software, for example, by a processor executing a program/instruction stored in a memory to implement its corresponding function. The present invention is not limited to any specific form of combination of hardware and software.
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (8)
1. An apparatus for implementing panorama shooting, comprising: the device comprises a recording unit, a splicing unit and a direction processing unit; wherein,
the recording unit is used for recording the shooting track information during panoramic shooting through a preset sensor;
the splicing unit is used for splicing the image frames of the panoramic shooting according to the recorded shooting track information to obtain a panoramic shooting image;
the direction processing unit is used for processing the direction of the object,
determining the motion direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and continuing the panoramic shooting when the motion duration of the second direction is less than a preset duration threshold;
and determining the moving direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and stopping the panoramic shooting when the moving time length of the second direction is greater than or equal to the preset time length threshold value.
2. The device according to claim 1, characterized in that the recording unit is specifically configured to,
respectively recording the shooting angle of each image frame during panoramic shooting through a gyroscope sensor, and respectively converting the shooting angle of each image frame during panoramic shooting into corresponding coding information according to a preset coding mode;
and identifying each image frame corresponding to panoramic shooting by using each piece of coding information obtained by conversion, and taking all pieces of coding information for identifying the image frames as the shooting track information.
3. The device according to claim 2, characterized in that the splicing unit is in particular adapted to,
determining a sorting rule of the coded information according to the preset coding mode;
determining coding information which does not accord with the sequencing rule, and deleting the image frame corresponding to the coding information which does not accord with the sequencing rule;
and splicing the image frames corresponding to the coding information according with the ordering rule to obtain the panoramic shot image.
4. The apparatus of claim 3, further comprising:
the cache display unit is used for analyzing the panoramic shot image according to the coding information for splicing the panoramic shot image and caching the analyzed panoramic shot image; and reading the cached and analyzed panoramic shot image according to the terminal moving angle so as to display the panoramic shot image.
5. A method for realizing panoramic shooting is characterized by comprising the following steps:
recording shooting track information during panoramic shooting through a preset sensor;
determining the motion direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and continuing the panoramic shooting when the motion duration of the second direction is less than a preset duration threshold;
determining the moving direction of the camera to be a second direction different from the first direction for carrying out panoramic shooting according to the shooting track information, and stopping the panoramic shooting when the moving time length of the second direction is greater than or equal to the preset time length threshold value;
and splicing the image frames of the panoramic shooting according to the recorded shooting track information to obtain a panoramic shooting image.
6. The method of claim 5, wherein the recording of the photographing trajectory information at the time of the panorama photographing through a preset sensor comprises:
respectively recording the shooting angle of each image frame during panoramic shooting through a gyroscope sensor, and respectively converting the shooting angle of each image frame during panoramic shooting into corresponding coding information according to a preset coding mode;
and identifying each image frame corresponding to panoramic shooting by using each piece of coding information obtained by conversion, and taking all pieces of coding information for identifying the image frames as the shooting track information.
7. The method according to claim 6, wherein the stitching processing of the image frames of the panorama shooting according to the recorded shooting track information comprises:
determining a sorting rule of the coded information according to the preset coding mode;
determining coding information which does not accord with the sequencing rule, and deleting the image frame corresponding to the coding information which does not accord with the sequencing rule;
and splicing the image frames corresponding to the coding information according with the ordering rule to obtain the panoramic shot image.
8. The method of claim 7, further comprising:
analyzing the panoramic shot image according to the coding information of the spliced panoramic shot image, and caching the analyzed panoramic shot image;
and reading the cached and analyzed panoramic shot image according to the terminal moving angle so as to display the panoramic shot image.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610962352.4A CN108012073B (en) | 2016-10-28 | 2016-10-28 | Method and device for realizing panoramic shooting |
| PCT/CN2017/101125 WO2018076941A1 (en) | 2016-10-28 | 2017-09-08 | Method and device for implementing panoramic photographing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610962352.4A CN108012073B (en) | 2016-10-28 | 2016-10-28 | Method and device for realizing panoramic shooting |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108012073A CN108012073A (en) | 2018-05-08 |
| CN108012073B true CN108012073B (en) | 2020-05-19 |
Family
ID=62024342
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610962352.4A Active CN108012073B (en) | 2016-10-28 | 2016-10-28 | Method and device for realizing panoramic shooting |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108012073B (en) |
| WO (1) | WO2018076941A1 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110874699B (en) * | 2018-08-31 | 2024-02-09 | 杭州海康机器人股份有限公司 | Method, device and system for recording logistics information of article |
| CN112683244B (en) * | 2020-12-18 | 2023-01-24 | 广东电网有限责任公司 | Cable channel positioning method and system based on panoramic photos |
| CN114007056A (en) * | 2021-10-28 | 2022-02-01 | 幻境虚拟现实科技(广州)有限公司 | Method and device for generating three-dimensional panoramic image |
| CN114827472B (en) * | 2022-04-29 | 2023-05-30 | 北京城市网邻信息技术有限公司 | Panoramic shooting method and device, electronic equipment and storage medium |
| CN114945088A (en) * | 2022-05-11 | 2022-08-26 | 北京有竹居网络技术有限公司 | Three-dimensional model generation method and device, shooting terminal and terminal equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102207674A (en) * | 2010-03-30 | 2011-10-05 | 鸿富锦精密工业（深圳）有限公司 | Panorama image shooting apparatus and method |
| CN102385747A (en) * | 2010-09-06 | 2012-03-21 | 佳能株式会社 | Method for generating panoramic image |
| CN102420898A (en) * | 2011-09-27 | 2012-04-18 | 惠州Tcl移动通信有限公司 | Panoramic photographing implementation method based on mobile phone and mobile phone |
| CN103176347A (en) * | 2011-12-22 | 2013-06-26 | 百度在线网络技术（北京）有限公司 | Method and device for shooting panorama and electronic device |
| CN105120155A (en) * | 2015-08-21 | 2015-12-02 | 小米科技有限责任公司 | Panoramic photograph generation method and device |
| CN105262948A (en) * | 2015-10-14 | 2016-01-20 | 广东欧珀移动通信有限公司 | Panorama capturing method and mobile terminal |
| CN105847673A (en) * | 2016-03-21 | 2016-08-10 | 广东欧珀移动通信有限公司 | Photograph display method, device and mobile terminal |
| CN105847851A (en) * | 2016-04-19 | 2016-08-10 | 北京金山安全软件有限公司 | Panoramic video live broadcast method, device and system and video source control equipment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070081081A1 (en) * | 2005-10-07 | 2007-04-12 | Cheng Brett A | Automated multi-frame image capture for panorama stitching using motion sensor |
| KR101663321B1 (en) * | 2010-07-30 | 2016-10-17 | 삼성전자주식회사 | Method for photographing panorama picture |
| US9282242B2 (en) * | 2011-08-24 | 2016-03-08 | Htc Corporation | Method and electric device for taking panoramic photograph |
| CN104660897A (en) * | 2013-11-20 | 2015-05-27 | 浪潮乐金数字移动通信有限公司 | Acquisition method of 360-degree panoramic image based on mobile terminal |
| CN103795924B (en) * | 2014-02-07 | 2018-06-15 | 宇龙计算机通信科技(深圳)有限公司 | Panorama camera arrangement and method |
-
2016
- 2016-10-28 CN CN201610962352.4A patent/CN108012073B/en active Active
-
2017
- 2017-09-08 WO PCT/CN2017/101125 patent/WO2018076941A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102207674A (en) * | 2010-03-30 | 2011-10-05 | 鸿富锦精密工业（深圳）有限公司 | Panorama image shooting apparatus and method |
| CN102385747A (en) * | 2010-09-06 | 2012-03-21 | 佳能株式会社 | Method for generating panoramic image |
| CN102420898A (en) * | 2011-09-27 | 2012-04-18 | 惠州Tcl移动通信有限公司 | Panoramic photographing implementation method based on mobile phone and mobile phone |
| CN103176347A (en) * | 2011-12-22 | 2013-06-26 | 百度在线网络技术（北京）有限公司 | Method and device for shooting panorama and electronic device |
| CN105120155A (en) * | 2015-08-21 | 2015-12-02 | 小米科技有限责任公司 | Panoramic photograph generation method and device |
| CN105262948A (en) * | 2015-10-14 | 2016-01-20 | 广东欧珀移动通信有限公司 | Panorama capturing method and mobile terminal |
| CN105847673A (en) * | 2016-03-21 | 2016-08-10 | 广东欧珀移动通信有限公司 | Photograph display method, device and mobile terminal |
| CN105847851A (en) * | 2016-04-19 | 2016-08-10 | 北京金山安全软件有限公司 | Panoramic video live broadcast method, device and system and video source control equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018076941A1 (en) | 2018-05-03 |
| CN108012073A (en) | 2018-05-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108012073B (en) | Method and device for realizing panoramic shooting | |
| US10659675B2 (en) | Terminal, shooting method thereof and computer storage medium | |
| US10419661B2 (en) | Shooting method and shooting device | |
| CN105959543B (en) | It is a kind of to remove reflective filming apparatus and method | |
| US10171753B2 (en) | Shooting method, shooting device and computer storage medium | |
| CN105827964A (en) | Image processing method and mobile terminal | |
| CN105611166A (en) | Image photographing method and terminal | |
| US9413922B2 (en) | Photographing apparatus and method for synthesizing images | |
| CN105791701B (en) | Image capturing device and method | |
| CN105245777A (en) | Method and device for generating video image | |
| US10257417B2 (en) | Method and apparatus for generating panoramic images | |
| WO2016008359A1 (en) | Object movement track image synthesizing method, device and computer storage medium | |
| CN105744170A (en) | Picture photographing device and method | |
| KR20210101009A (en) | Method for Recording Video using a plurality of Cameras and Device thereof | |
| CN107071277B (en) | Optical drawing shooting device and method and mobile terminal | |
| US20110187903A1 (en) | Digital photographing apparatus for correcting image distortion and image distortion correcting method thereof | |
| CN105426081B (en) | Interface switching device and method of mobile terminal | |
| US9948867B2 (en) | Apparatus, method, and computer-readable storage device for generating composite image | |
| CN113891018A (en) | Shooting method and device and electronic equipment | |
| JP2006339784A (en) | Imaging apparatus, image processing method, and program | |
| CN116188343B (en) | Image fusion method and device, electronic equipment, chip and medium | |
| WO2016019786A1 (en) | Object motion trajectory photographing method and system, and computer storage medium | |
| CN107085841B (en) | Picture zooming processing method and terminal | |
| CN105357447B (en) | Picture processing method and device | |
| US8928764B2 (en) | Method and device for correcting user's hand tremor in imaging device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |