Multi-mode space optical camera with on-orbit reconstruction
Technical Field
The invention relates to the technical field of multi-mode space optical imaging, in particular to an on-orbit reconstruction multi-mode space optical camera.
Background
Visible light space optical cameras are distinguished according to imaging modes, and generally comprise a linear array camera and an area array camera, wherein the linear array camera realizes linear array scanning imaging on the ground by utilizing the ground relative motion of a low-orbit satellite, and for a high-resolution camera, long-time exposure can be realized by a Time Delay Integration (TDI) technology; the area-array camera is mainly used in the fields with low image shift speed, such as static orbit area-array imaging or low-orbit staring area-array imaging, and the like, so as to realize long-time exposure. Due to the limitation of the characteristics of the sensor, only one mode can be realized by a single camera in the prior art, and the compatibility of the two modes is difficult to realize.
Disclosure of Invention
The invention provides a multi-mode space optical camera with in-orbit reconstruction, which mainly aims to realize various modes of linear array color push-broom, linear array luminous push-broom, area array staring video, area array staring luminous and the like in a single camera and realize all-day multi-mode imaging of a visible light camera, and the invention provides the following technical scheme:
an in-orbit reconstructed multi-mode spatial optical camera, the camera comprising an image sensor component, a digital processing unit and a memory;
the digital processing unit comprises a time sequence driving module, a selection module, a communication control module, a data receiving module, a digital domain TDI module and an image frame group module;
the time sequence driving module drives the image sensor assembly, the selection module is used for selecting different processes in the memory to realize different working modes, the data receiving module receives image data of the image sensor assembly, the communication control module receives an upper computer control instruction and returns telemetering parameters, the digital domain TDI module is used for enabling the digital domain TDI integral equivalent exposure time to reach hundred milliseconds, and the image frame group module is used for imaging.
Preferably, the image sensor assembly comprises a multi-spectral filter and a planar array image sensor.
Preferably, the area array image sensor adopts a high-speed area array CMOS image sensor to realize multispectral imaging of five spectral bands.
Preferably, the memory stores a guiding process, a multispectral push-broom process, a video imaging process and a noctilucent imaging process.
Preferably, the digital processing unit adopts an FPGA, and each mode monopolizes all hardware resources of the FPGA through a workflow switching mechanism.
Preferably, the bootstrap process calls a selection module and a communication control module; and when the communication control module receives a flow switching instruction, the selection module guides a start address corresponding to the flow mapping to be loaded into the FPGA to realize mode switching.
Preferably, the multispectral push-broom process calls a time sequence driving module, a data receiving module, a digital domain TDI module, a communication control module and an image frame group module;
the multispectral push-broom process realizes discrete multi-window windowing driving, digital domain delay integral accumulation with adjustable multi-spectral segment series, telemetering remote control communication and image data frame formatting and sending of the image sensor, and TDI push-broom imaging of a plurality of spectral segments is realized on the high-speed area array CMOS image sensor.
Preferably, the video imaging process calls a time sequence driving module, a data receiving module, a digital domain TDI module, a communication control module and an image frame group module;
the video imaging process realizes large-area array full-open window driving of the image sensor, caching and data stream arrangement of large-area array large-area images, telemetering remote control communication and image data frame formatting and sending, and is used for large-area array video imaging.
Preferably, the noctilucent imaging process calls a time sequence driving module, a data receiving module, a digital domain TDI module, a communication control module and an image frame group module;
the noctilucent imaging process realizes single-line-array high-series windowing driving of the image sensor, digital domain delay integral accumulation with adjustable high-series number, telemetering remote control communication and image data frame formatting and sending, and is used for noctilucent high-series digital domain TDI imaging.
The invention has the following beneficial effects:
the invention is used for multi-mode space optical imaging, and can realize multiple imaging modes such as push-broom, video, noctilucence and the like on the same set of imaging system hardware through software reconstruction. The most advantage of integrating multiple imaging modes in other single versions is that different imaging modes can monopolize all resources of the FPGA, the time sequence convergence of the whole configuration item cannot be influenced by the increase of the modes, theoretically, various imaging modes can be realized only by expanding the capacity of a memory, and the function of the optical camera has the advantage of software definition.
Drawings
FIG. 1 is a schematic diagram of an in-orbit reconstructed multimode spatial optical camera configuration;
FIG. 2 is a schematic view of multi-mode windowing;
fig. 3 is a memory schematic.
Detailed Description
The present invention will be described in detail with reference to specific examples.
The first embodiment is as follows:
referring to fig. 1 to 3, the present invention provides an on-track reconfigurable multimode spatial optical camera, specifically:
an in-orbit reconstructed multi-mode spatial optical camera, the camera comprising an image sensor component, a digital processing unit and a memory;
the digital processing unit comprises a time sequence driving module, a selection module, a communication control module, a data receiving module, a digital domain TDI module and an image frame group module;
the time sequence driving module drives the image sensor assembly, the selection module is used for selecting different processes in the memory to realize different working modes, the data receiving module receives image data of the image sensor assembly, the communication control module receives an upper computer control instruction and returns telemetering parameters, the digital domain TDI module is used for enabling the digital domain TDI integral equivalent exposure time to reach hundred milliseconds, and the image frame group module is used for imaging. The image sensor assembly comprises a multi-spectral filter and a planar array image sensor, and can realize three service modes of multispectral push-scanning, panchromatic video and panchromatic noctilucence.
The multi-mode windowing method is characterized in that different windowing modes are realized on an image sensor assembly consisting of the same sensor and a color filter by modifying control logic of the image sensor, and three windowing modes of multispectral push-scanning, panchromatic video and panchromatic noctilucence are realized. In the multispectral push-broom mode, small windowing is adopted in five spectral band regions of panchromatic, RGB and near infrared to realize digital domain time delay integration, the number of windowing lines is matched with the number of integration stages, the total number of windowing lines is greatly reduced, the frame period is shortened to hundred microseconds, and the method can be used for sub-meter-level high-resolution color push-broom imaging; under a full-color video mode, a window as large as possible is opened in the range of a full-color spectrum band, the staring attitude of a satellite is matched, the exposure time can reach several milliseconds, and large-area-array video imaging is realized; under the full-color noctilucent mode, the windowing line is set to be the medium-sized windowing size of hundreds of lines, high-level digital domain TDI integration is achieved by using a high-capacity cache of a digital processing part, and the equivalent exposure time reaches the level of hundreds of milliseconds.
The storage device stores a guide flow, a multispectral push-broom flow, a video imaging flow and a noctilucent imaging flow.
The digital processing unit adopts an FPGA, and each mode monopolizes all hardware resources of the FPGA through a work flow switching mechanism.
The guide flow calls a selection module and a communication control module; and when the communication control module receives a flow switching instruction, the selection module guides a start address corresponding to the flow mapping to be loaded into the FPGA to realize mode switching.
The multispectral push-broom process calls a time sequence driving module, a data receiving module, a digital domain TDI module, a communication control module and an image frame group module;
the multispectral push-broom process realizes discrete multi-window windowing driving, digital domain delay integral accumulation with adjustable multi-spectral segment series, telemetering remote control communication and image data frame formatting and sending of the image sensor, and TDI push-broom imaging of a plurality of spectral segments is realized on the high-speed area array CMOS image sensor.
The video imaging process calls a time sequence driving module, a data receiving module, a digital domain TDI module, a communication control module and an image frame group module;
the video imaging process realizes large-area array full-open window driving of the image sensor, caching and data stream arrangement of large-area array large-area images, telemetering remote control communication and image data frame formatting and sending, and is used for large-area array video imaging.
The noctilucent imaging process calls a time sequence driving module, a data receiving module, a digital domain TDI module, a communication control module and an image frame group module;
the noctilucent imaging process realizes single-line-array high-series windowing driving of the image sensor, digital domain delay integral accumulation with adjustable high-series number, telemetering remote control communication and image data frame formatting and sending, and is used for noctilucent high-series digital domain TDI imaging.
Three different imaging modes are realized by online switching, and FPGA hardware resources of the digital processing unit are multiplexed. The present invention utilizes the function of the multi-version program memory in the market to realize the storage and the switching of the software configuration items of different imaging modes, thereby realizing the software definition of the optical camera function. And after the power is on, a guide flow is automatically loaded, the FPGA in the digital processing unit generates a version switching signal through a version switching instruction, and a specified software module is loaded to complete the switching of the imaging mode.
The area array image sensor adopts a high-speed area array CMOS image sensor to realize multispectral imaging of five spectral bands. By adopting a certain type high-speed area array CMOS image sensor, a Xilinx K7 FPGA and an MCF256P multi-version memory, five-spectrum multispectral imaging (panchromatic + red green blue + near infrared) is realized, a gazing video of 9344 pixels multiplied by 4096 pixels and an integration level reach 200 levels, the equivalent exposure time reaches panchromatic noctilucent remote sensing imaging of more than 100ms, and the multi-mode and all-day imaging capability of the visible light camera is realized. When the program file is written, writing is carried out according to the planned version flow initial address, and the mutual independence of flow address spaces is ensured;
the three imaging modes have huge expenditure on the cache resources of the FPGA, the traditional method cannot carry out multi-mode integration, and each mode can completely occupy the hardware resources of the FPGA without conflict through time-sharing version switching, so that the problem of preemption of the hardware resources among the modes is solved.
The above description is only a preferred embodiment of the on-rail reconfigurable multi-mode spatial optical camera, and the protection scope of the on-rail reconfigurable multi-mode spatial optical camera is not limited to the above-mentioned embodiments, and all technical solutions belonging to the idea belong to the protection scope of the present invention. It should be noted that modifications and variations which do not depart from the gist of the invention will be those skilled in the art to which the invention pertains and which are intended to be within the scope of the invention.