Nothing Special   »   [go: up one dir, main page]

CN109189723A - A kind of distributed satellites data center multi- source Remote Sensing Data data processing method - Google Patents

A kind of distributed satellites data center multi- source Remote Sensing Data data processing method Download PDF

Info

Publication number
CN109189723A
CN109189723A CN201810730220.8A CN201810730220A CN109189723A CN 109189723 A CN109189723 A CN 109189723A CN 201810730220 A CN201810730220 A CN 201810730220A CN 109189723 A CN109189723 A CN 109189723A
Authority
CN
China
Prior art keywords
data
remote sensing
center
data center
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810730220.8A
Other languages
Chinese (zh)
Inventor
王力哲
马艳
阎继宁
焦阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Remote Sensing and Digital Earth of CAS
Original Assignee
Institute of Remote Sensing and Digital Earth of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Remote Sensing and Digital Earth of CAS filed Critical Institute of Remote Sensing and Digital Earth of CAS
Priority to CN201810730220.8A priority Critical patent/CN109189723A/en
Publication of CN109189723A publication Critical patent/CN109189723A/en
Pending legal-status Critical Current

Links

Landscapes

  • Image Processing (AREA)

Abstract

The invention discloses a kind of distributed satellites data center multi- source Remote Sensing Data data processing methods, including step 1: the data processing of distributed satellites data center;Step 2: distributed satellites data center converges to primary data center data;Step 3: the data intake of primary data center;It further include the conversion of multi-source remote sensing metadata format;Beneficial effects of the present invention: a kind of distributed satellites data center multi- source Remote Sensing Data data processing method of the present invention passes through distributed satellites data center multi- source Remote Sensing Data data integrated technology, it can be effectively for the multi-source data in distributed satellites data center heterogeneous system, under the background of remote sensing big data, effectively integrate and manage.

Description

A kind of distributed satellites data center multi- source Remote Sensing Data data processing method
Technical field
The present invention relates to Remote Sensing Data Processing technical fields, it particularly relates to which a kind of distributed satellites data center is more Source Remote Sensing Data Processing method.
Background technique
It is a series of that there is high spectral resolution, high spatial resolution, high time resolution with the development of earth observation technology The sensor emission lift-off of rate, multipolarization, multi-angle causes remotely-sensed data and obtains and shortens with the update cycle, and timeliness is more next It is stronger, so as to cause the explosive growth of the data scale of construction.Currently, China has possessed towards meteorology, land, ocean, resource, environment Etc. multiple fields satellite data center, the remotely-sensed data quantity in stock at each satellite data center has reached PB grades: by the end of On June 1st, 2017, Chinese wind and cloud satellite data center filing remotely-sensed data total amount have reached 4.277 PBs (wind and cloud satellite remote sensing Data service net, 2017);And China Resource Satellite Applied Center (China Center for Resources Satellite Data and Application, CCRSDA) also file more than 16,000,000 scape remote sensing image data (Chinese Resources satellite applications Center, 2017).
The remotely-sensed data of sustainable growth is voluntarily catalogued by different data centers, is stored due to the restriction of the factors such as system With management;These data centers mainly include large-scale synthesis data center, university and the scientific research institution of satellite data production mechanism Special data department, international data integrated organization and commercial undertaking etc..Each data center using respective data due to being stored System can not be linked up so as to cause information each other, and data association degree is low, and application form is single, so that these are independent distant Which kind of feel data system to be formed one by one " information island ", therefore using mode to these isolated or poor connectivity numbers It is efficiently integrated according to system, and carry out more stellar associations to seem especially urgent with processing and integrated application.
Remotely-sensed data integrated technology can substantially be divided into data integration mode based on federative database, based on data warehouse Data integration mode, the data integration mode three types based on middleware:
1, the data integration mode based on federative database
Federated database systems (Federated Database System, FDBS) are coordination with one another but mutually independent different The set of structure member database, it by integrating in various degree, integrally provides isomery member database system the system The software of control and cooperating is called federal data base management system (FDBMS).Data after integrated can be considered as a list One data source is accessed and is managed, and data federation can provide the integrated of structuring and non-structured data simultaneously.
2, the data integration mode based on data warehouse
Data warehouse method is a kind of typical data copy method.This method copies to the data of each data source same Place, i.e. data warehouse.User then directly accesses data warehouse as access general data library.Data warehouse technology is to have Effect ground provides manipulation type data integration into unified environment the various technologies of decision type data access and the general name of module. All done are provided to that user is allowed faster, more easily to inquire required information, provide decision support.Traditional data Bottom storage in warehouse mostly uses row storage mode, and column memory technology is physically split the tuple in relationship by attribute, comes From the data Coutinuous store of same attribute, this storage mode greatly improves the efficiency of analytic type inquiry.
3, the data integration mode based on middleware
Middleware integrated approach is data integrating method popular at present, and middleware mode passes through unified global data mould Type is come the database, Legacy System, web resource etc. that access isomery.Middleware is located at heterogeneous data source system (data Layer) and answers With between program (application layer), coordinate each data source systems downwards, provides uniform data upwards for the application of Access Integration data The general-purpose interface of mode and data access;Their task is still completed in the application of each data source, and middleware system then mainly collects In for heterogeneous data source provide a high-level retrieval service.
The multi- source Remote Sensing Data data that the present invention is directed under distributed satellites data center architecture integrates and problem of management, passes through Further investigation to wherein key technology realizes multi- source Remote Sensing Data data integrated technology under distributed satellites data center architecture, It cooperates with processing and production to provide data for multiple data centers multi- source Remote Sensing Data data to support.
Summary of the invention
For above-mentioned technical problem in the related technology, the present invention provides a kind of for distributed satellites data center architecture Under multi- source Remote Sensing Data data integrated technology, by the way that the multi- source Remote Sensing Data data of distributed satellites data center is integrated, and base In unified satellite metadata standard, by actively or passively mode, it is continuous or by certain time interval from data sub-central to Main center junction metadata, the process of thumbnail.Wherein, unified satellite metadata standard refers to ISO 19115-2:2009 Geographic information metadata standard, the remote sensing metadata of each distributed satellites data center is to will carry out before main center junction Reference format conversion, in order to unified metadata retrieval and management.
The technical scheme of the present invention is realized as follows:
A kind of distributed satellites data center multi- source Remote Sensing Data data processing method, comprising the following steps:
Step 1: distributed satellites data center data processing: among each satellite data center construction data integration processing Part, in which: the middleware includes crawler component, data processing support system and network service;The data distribution of data center Newly-increased satellite data is distributed to data working area by device;By main or passive starter at the crawler component sending of middleware Reason request;Crawler component is in pretreatment checking process, first by the text in correlation data working area and open data server Part catalogue simultaneously increases data file progress type checking and filtering newly to data working area by preset target file type collection, increases Amount handles newly-increased data;In data processing, crawler component can call has determined in data processing support system The customized process flow for different satellite data centre data formats of justice, calling Apache Tika or other are customized Tool set extracts or production remote sensing image thumbnail, remote sensing metadata, and the thumbnail file extracted, metadata are stored in In satellite data open center server;
Step 2: distributed satellites data center converges to primary data center data: " push-and-pull " component of primary data center is by the period Property start background process, and according to the external network interface of each distributed satellites data center open server, call not Same Data Transport Protocol (FTP, SFTP, HTTP, HTTPS etc.), which initiates long-range crawler task to each satellite data center, asks It asks, while the long-range crawler task management and scheduling of multiple data centers is carried out by main center background management of process component;Wherein: long-range Crawler task start rule is " prerequisite variable " queue sequence, and only one long-range crawler task is permitted within the same time Perhaps it executes;
During primary data center is by pulling divided data centre data, " push-and-pull " component can be communicated with file manager, The remote sensing image metadata and thumbnail data whether are filed by the more main center of MD5 file verification;Wherein: when in master The remote sensing image thumbnail information is had existed in heart data filing container, then enters the comparison procedure of next image file;When It is not present, then enters real data downloading and transmission process, meta data file and remote sensing image thumbnail are passed by " push-and-pull " component It is defeated to be absorbed in working area to primary data center, wait main centre data to absorb;
Step 3: the data intake of primary data center: data capture process is carried out absorbing in advance first and be checked, passes through preset first number According to file type collection newly data file is increased to data intake working area and carry out type checking and filtering, and according to customized first number Multi-source heterogeneous meta data file type, which is adapted to, according to mapping ruler carries out data intake;In addition, to prevent the repetition for having filed data Intake, crawler manager still by with file manager assembly communication, whether filed by MD5 file verification, if not Filing then files remote sensing image thumbnail file into image archiving container, and establishes full-text index by SolrCloud cluster And fragment stores, and realizes the distributed fragment index of metadata;
It further, further include the conversion of multi-source remote sensing metadata format: based on ISO 19115-2:2009 geography information-metadata Standard establishes unified remote sensing metadata format, and the remote sensing metadata of each distributed satellites data center is before data integration It requires to be converted to the remote sensing metadata format.
Further, that newly-increased satellite data is distributed to data is temporary for the data distributor of data center in the step 1 Deposit area;Processing request is issued to the crawler component of middleware by main or passive starter:
Wherein, the activly request refers to that the data strip mesh number transmitted when data distributor to data working area has reached at triggering The request for handling newly-increased data is actively issued when the critical value of reason to crawler component;The passive request refers to be existed by timer Regular time point passively trigger data treatment process.
Further, primary data center crawler module data intake mode includes periodically automatic carries out in the step 3 Data intake two ways is absorbed and carried out manually by data administrator to data.
Beneficial effects of the present invention:, can be effective by distributed satellites data center multi- source Remote Sensing Data data integrated technology For the multi-source data in distributed satellites data center heterogeneous system, under the background of remote sensing big data, carry out effective Integrated and management.
Detailed description of the invention
It in order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, below will be to institute in embodiment Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the invention Example, for those of ordinary skill in the art, without creative efforts, can also obtain according to these attached drawings Obtain other attached drawings.
Fig. 1 is distributed satellites data center multi- source Remote Sensing Data data integrated technology architecture diagram according to an embodiment of the present invention;
Fig. 2 is distributed satellites data center according to embodiments of the present invention flow chart of data processing figure;
Fig. 3, which is distributed satellites data center according to embodiments of the present invention, converges flow chart to primary data center data;
Fig. 4 is the data intake flow chart of primary data center according to embodiments of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, those of ordinary skill in the art's every other embodiment obtained belong to what the present invention protected Range.
According to an embodiment of the invention, providing a kind of distributed satellites data center multi- source Remote Sensing Data data processing method.
As shown in Figs 1-4, a kind of distributed satellites data center multi- source Remote Sensing Data data processing according to an embodiment of the present invention Method, comprising the following steps:
Step 1: distributed satellites data center data processing: among each satellite data center construction data integration processing Part, middleware include crawler component, data processing support system and network service.The data distributor of data center can will increase newly Satellite data be distributed to data working area.Processing request is issued to the crawler component of middleware by main or passive starter, Activly request herein refers to that the data strip mesh number transmitted when data distributor to data working area has reached facing for triggering processing The request for handling newly-increased data is actively issued when dividing value to crawler component;Passive request refers to through timer at a fixed time Put passively trigger data treatment process.Crawler component correlation data working area and can be held first in pretreatment checking process Put the file directory in data server and by preset target file type collection to data working area increase newly data file into Row type checking and filtering, increment handle newly-increased data.In data processing, crawler component can call data The defined customized process flow for different satellite data centre data formats in support system is handled, Apache is called Tika or other customization tool collection extract or production remote sensing image thumbnail, remote sensing metadata, and the thumbnail that will be extracted File, metadata are stored in satellite data open center server.
Step 2: distributed satellites data center converges to primary data center data: " push-and-pull " component of primary data center (Push-Pull) it can be periodically turned on background process (Deamon Thread), and according to each distributed satellites data center The external network interface of open server calls different Data Transport Protocol (FTP, SFTP, HTTP, HTTPS etc.) to each Long-range crawler task requests are initiated at satellite data center, while remote by main center background management of process component progress multiple data centers Journey crawler task management and scheduling.Long-range crawler task start rule is " prerequisite variable " queue sequence, and in the same time Only one interior long-range crawler task is allowed to execute.During primary data center is by pulling divided data centre data, " push-and-pull " component can be communicated with file manager, whether file the remote sensing image by the more main center of MD5 file verification Metadata and thumbnail data.If having existed the remote sensing image thumbnail information in main centre data filing container, enter The comparison procedure of next image file;If it does not exist, then enter real data downloading and transmission process, meta data file and remote sensing Image thumbnail is transferred in primary data center intake working area by " push-and-pull " component, and main centre data is waited to absorb.
Step 3: the intake of the data of primary data center: primary data center crawler component both can be periodically automatic, can also be with Data intake is carried out by data administrator manually, data capture process will do it pre- intake first and check, pass through preset first number According to file type collection newly data file is increased to data intake working area and carry out type checking and filtering, and according to customized first number Multi-source heterogeneous meta data file type, which is adapted to, according to mapping ruler carries out data intake.In addition, to prevent the repetition for having filed data Intake, crawler manager still by with file manager assembly communication, whether filed by MD5 file verification, if not Filing then files remote sensing image thumbnail file into image archiving container, and establishes full-text index by SolrCloud cluster And fragment stores, and realizes the distributed fragment index of metadata.
In addition, multi-source remote sensing metadata format is converted: it is based on ISO 19115-2:2009 geography information-metadata standard, The characteristics of for remotely-sensed data, establishes a unified remote sensing metadata format, the remote sensing of each distributed satellites data center Metadata requires to be converted to the reference format before data integration, the remote sensing metadata schema (portion based on ISO 19115 Point) as shown in table 1:
Remote sensing metadata schema (part) of the table 1 based on ISO 19115
ISO 19115 is International Organization for standardization (International Standardization Organization, ISO) Geography information-metadata standard of publication, ISO 19115-2 are increased in the extension of image and raster data ISO 19115 Description to acquisition, band class information etc. on Data Star, extends data quality element and spatial description;Domestic series of satellites member Data and 19115 remote sensing metadata schema conversion table (part) of ISO are as shown in table 2: in table 2: "-" indicates that the field is not present;
The domestic series of satellites metadata of table 2 and 19115 remote sensing metadata schema conversion table (part) of ISO
By the multi-source heterogeneous remotely-sensed data of definition and 19115 standard metadata transformation rule of ISO, the information of wherein redundancy is deleted, The information of some no records can be set to it is default, to realize the standardization of remote sensing metadata.
Beneficial effects of the present invention:, can be effective by distributed satellites data center multi- source Remote Sensing Data data integrated technology For the multi-source data in distributed satellites data center heterogeneous system, under the background of remote sensing big data, carry out effective Integrated and management.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention Within mind and principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.

Claims (4)

1. a kind of distributed satellites data center multi- source Remote Sensing Data data processing method, which comprises the following steps:
Step 1: distributed satellites data center data processing: among each satellite data center construction data integration processing Part, in which: the middleware includes crawler component, data processing support system and network service;The data distribution of data center Newly-increased satellite data is distributed to data working area by device;By main or passive starter at the crawler component sending of middleware Reason request;Crawler component is in pretreatment checking process, first by the text in correlation data working area and open data server Part catalogue simultaneously increases data file progress type checking and filtering newly to data working area by preset target file type collection, increases Amount handles newly-increased data;In data processing, crawler component can call has determined in data processing support system The customized process flow for different satellite data centre data formats of justice, calling Apache Tika or other are customized Tool set extracts or production remote sensing image thumbnail, remote sensing metadata, and the thumbnail file extracted, metadata are stored in In satellite data open center server;
Step 2: distributed satellites data center converges to primary data center data: " push-and-pull " component of primary data center is by the period Property start background process, and according to the external network interface of each distributed satellites data center open server, call not Same Data Transport Protocol initiates long-range crawler task requests to each satellite data center, while by main center background process pipe It manages component and carries out the long-range crawler task management and scheduling of multiple data centers;Wherein: long-range crawler task start rule is " first first Service " queue sequence, and only one long-range crawler task is allowed to execute within the same time;
During primary data center is by pulling divided data centre data, " push-and-pull " component can be communicated with file manager, The remote sensing image metadata and thumbnail data whether are filed by the more main center of MD5 file verification;Wherein: when in master The remote sensing image thumbnail information is had existed in heart data filing container, then enters the comparison procedure of next image file;When It is not present, then enters real data downloading and transmission process, meta data file and remote sensing image thumbnail are passed by " push-and-pull " component It is defeated to be absorbed in working area to primary data center, wait main centre data to absorb;
Step 3: the data intake of primary data center: data capture process is carried out absorbing in advance first and be checked, passes through preset first number According to file type collection newly data file is increased to data intake working area and carry out type checking and filtering, and according to customized first number Multi-source heterogeneous meta data file type, which is adapted to, according to mapping ruler carries out data intake;In addition, to prevent the repetition for having filed data Intake, crawler manager still by with file manager assembly communication, whether filed by MD5 file verification, if not Filing then files remote sensing image thumbnail file into image archiving container, and establishes full-text index by SolrCloud cluster And fragment stores, and realizes the distributed fragment index of metadata.
2. a kind of distributed satellites data center multi- source Remote Sensing Data data processing method according to claim 1, feature exist In further including the conversion of multi-source remote sensing metadata format: based on ISO 19115-2:2009 geography information-metadata standard, establishing Unified remote sensing metadata format, the remote sensing metadata of each distributed satellites data center require to convert before data integration For the remote sensing metadata format.
3. a kind of distributed satellites data center multi- source Remote Sensing Data data processing method according to claim 1, feature exist In newly-increased satellite data is distributed to data working area by the data distributor of data center in the step 1;By it is main or by Dynamic starter issues processing request to the crawler component of middleware:
Wherein, the activly request refers to that the data strip mesh number transmitted when data distributor to data working area has reached at triggering The request for handling newly-increased data is actively issued when the critical value of reason to crawler component;The passive request refers to be existed by timer Regular time point passively trigger data treatment process.
4. a kind of distributed satellites data center multi- source Remote Sensing Data data processing method according to claim 1, feature exist In primary data center crawler module data intake mode includes periodically carrying out data intake automatically and by counting in the step 3 Carry out data intake two ways manually according to administrator.
CN201810730220.8A 2018-07-05 2018-07-05 A kind of distributed satellites data center multi- source Remote Sensing Data data processing method Pending CN109189723A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810730220.8A CN109189723A (en) 2018-07-05 2018-07-05 A kind of distributed satellites data center multi- source Remote Sensing Data data processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810730220.8A CN109189723A (en) 2018-07-05 2018-07-05 A kind of distributed satellites data center multi- source Remote Sensing Data data processing method

Publications (1)

Publication Number Publication Date
CN109189723A true CN109189723A (en) 2019-01-11

Family

ID=64948897

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810730220.8A Pending CN109189723A (en) 2018-07-05 2018-07-05 A kind of distributed satellites data center multi- source Remote Sensing Data data processing method

Country Status (1)

Country Link
CN (1) CN109189723A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109831244A (en) * 2019-03-19 2019-05-31 福建紫辰信息科技有限公司 A kind of real-time controllable transmission of satellite data based on all-in-one machine and system
CN109828972A (en) * 2019-01-18 2019-05-31 四川长虹电器股份有限公司 A kind of data integrating method based on digraph structure
CN109933587A (en) * 2019-02-26 2019-06-25 厦门市美亚柏科信息股份有限公司 Data processing method, device, system and storage medium based on catalogue registration
CN110110107A (en) * 2019-03-18 2019-08-09 中国地质大学(武汉) A kind of Methods on Multi-Sensors RS Image various dimensions method for organizing based on cloud storage
CN110362618A (en) * 2019-06-26 2019-10-22 山东省科学院海洋仪器仪表研究所 The real time aggregation system and polymerization of a kind of distribution ocean online monitoring data
CN110377617A (en) * 2019-06-11 2019-10-25 中国平安财产保险股份有限公司 Data processing method, device, computer equipment and storage medium
CN111752946A (en) * 2020-06-22 2020-10-09 上海众言网络科技有限公司 Method and device for preprocessing research data based on fragmentation mode
CN113641765A (en) * 2021-10-13 2021-11-12 浙江大学 Unified logic model organization method and device for massive multi-source remote sensing data
CN115858835A (en) * 2022-09-28 2023-03-28 中国水利水电科学研究院 System and method for processing remote sensing image full chain

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902782A (en) * 2012-09-27 2013-01-30 浙江大学 Mass multisource heterogeneous spatial information data seamless integration management method
CN103198137A (en) * 2013-04-15 2013-07-10 武汉大学 Access protocol transfer method and system for multi-source heterogeneous remote sensing data system
CN103281351A (en) * 2013-04-19 2013-09-04 武汉方寸科技有限公司 Cloud service platform for high-efficiency remote sensing data processing and analysis
CN105049493A (en) * 2015-06-29 2015-11-11 中国科学院遥感与数字地球研究所 Virtual networking distributed satellite data service system
US20180024982A1 (en) * 2016-07-22 2018-01-25 International Business Machines Corporation Real-time dynamic visual aid implementation based on context obtained from heterogeneous sources

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902782A (en) * 2012-09-27 2013-01-30 浙江大学 Mass multisource heterogeneous spatial information data seamless integration management method
CN103198137A (en) * 2013-04-15 2013-07-10 武汉大学 Access protocol transfer method and system for multi-source heterogeneous remote sensing data system
CN103281351A (en) * 2013-04-19 2013-09-04 武汉方寸科技有限公司 Cloud service platform for high-efficiency remote sensing data processing and analysis
CN105049493A (en) * 2015-06-29 2015-11-11 中国科学院遥感与数字地球研究所 Virtual networking distributed satellite data service system
US20180024982A1 (en) * 2016-07-22 2018-01-25 International Business Machines Corporation Real-time dynamic visual aid implementation based on context obtained from heterogeneous sources

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JIAXING QU等: "Multi-Source Remote Sensing Heterogeneous Data Management Application Based On Metadata", 《IOP CONFERENCE SERIES: MATERIALS SCIENCE AND ENGINEERING》 *
阎继宁: "多数据中心架构下遥感云数据管理及产品生产关键技术研究", 《中国博士学位论文全文数据库信息科技辑》 *

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109828972B (en) * 2019-01-18 2022-03-22 深圳易嘉恩科技有限公司 Data integration method based on directed graph structure
CN109828972A (en) * 2019-01-18 2019-05-31 四川长虹电器股份有限公司 A kind of data integrating method based on digraph structure
CN109933587A (en) * 2019-02-26 2019-06-25 厦门市美亚柏科信息股份有限公司 Data processing method, device, system and storage medium based on catalogue registration
CN109933587B (en) * 2019-02-26 2023-04-11 厦门市美亚柏科信息股份有限公司 Data processing method, device and system based on directory registration and storage medium
CN110110107A (en) * 2019-03-18 2019-08-09 中国地质大学(武汉) A kind of Methods on Multi-Sensors RS Image various dimensions method for organizing based on cloud storage
CN109831244B (en) * 2019-03-19 2020-09-22 福建紫辰信息科技有限公司 Satellite data real-time controllable transmission method and system based on all-in-one machine
CN109831244A (en) * 2019-03-19 2019-05-31 福建紫辰信息科技有限公司 A kind of real-time controllable transmission of satellite data based on all-in-one machine and system
CN110377617A (en) * 2019-06-11 2019-10-25 中国平安财产保险股份有限公司 Data processing method, device, computer equipment and storage medium
CN110377617B (en) * 2019-06-11 2024-02-02 中国平安财产保险股份有限公司 Data processing method, device, computer equipment and storage medium
CN110362618A (en) * 2019-06-26 2019-10-22 山东省科学院海洋仪器仪表研究所 The real time aggregation system and polymerization of a kind of distribution ocean online monitoring data
CN111752946A (en) * 2020-06-22 2020-10-09 上海众言网络科技有限公司 Method and device for preprocessing research data based on fragmentation mode
CN113641765A (en) * 2021-10-13 2021-11-12 浙江大学 Unified logic model organization method and device for massive multi-source remote sensing data
CN113641765B (en) * 2021-10-13 2022-02-18 浙江大学 Unified logic model organization method and device for massive multi-source remote sensing data
CN115858835A (en) * 2022-09-28 2023-03-28 中国水利水电科学研究院 System and method for processing remote sensing image full chain
CN115858835B (en) * 2022-09-28 2023-08-08 中国水利水电科学研究院 Remote sensing image full-chain processing system and method

Similar Documents

Publication Publication Date Title
CN109189723A (en) A kind of distributed satellites data center multi- source Remote Sensing Data data processing method
Zhou et al. ROSCC: an efficient remote sensing observation-sharing method based on cloud computing for soil moisture mapping in precision agriculture
CN110309264B (en) Method and device for acquiring geographic product data based on knowledge graph
CN108292323A (en) Use the database manipulation of the metadata of data source
CN109446252B (en) Unified access method and system for power grid regulation and control
CN103198097B (en) A kind of magnanimity earth science data method for parallel processing based on distributed file system
CN109299298A (en) Construction method, device, application method and the system of image fusion model
CN107247799A (en) Data processing method, system and its modeling method of compatible a variety of big data storages
Karmas et al. Geospatial big data for environmental and agricultural applications
CN115238015A (en) Space-time big data platform based on micro-service
CN112199528A (en) Online acquisition method for large-scale remote sensing data
Alsubaiee et al. Asterix: scalable warehouse-style web data integration
CN109189873A (en) A kind of Meteorological Services big data monitoring analysis system platform
CN105049343A (en) Distributed satellite data center efficient and cooperative lightweight high-flux gateway system
CN114185698A (en) Remote sensing data processing system based on micro-service and RPC communication
Lettich et al. A general methodology for building multiple aspect trajectories
US11719857B1 (en) System and method for providing a reanalysis ensemble service
de Souza Baptista et al. Using OGC Services To Interoperate Spatial Data Stored In SQL And NoSQL Databases.
Hobona et al. Workflow enactment of grid-enabled geospatial web services
Xiong et al. HiGIS: An open framework for high performance geographic information system
CN107908652A (en) A kind of Sequence implementation methods for distributed data base system
CN101639531B (en) Method for acquiring remote sensing data and device thereof
Xiang A grid-based distributed database solution for large astronomy datasets
Gan et al. The operational application of Chinese high-resolution satellite in the investigation of land and resources
Zhang et al. Construction of distributed and heterogeneous data sharing platform

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190111