CN103927252A - Cross-component log recording method, device and system - Google Patents
Cross-component log recording method, device and system Download PDFInfo
- Publication number
- CN103927252A CN103927252A CN201410158838.3A CN201410158838A CN103927252A CN 103927252 A CN103927252 A CN 103927252A CN 201410158838 A CN201410158838 A CN 201410158838A CN 103927252 A CN103927252 A CN 103927252A
- Authority
- CN
- China
- Prior art keywords
- daily record
- log
- list
- service end
- services end
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a cross-component log recording method, device and system. The cross-component log recording method includes the steps of obtaining logs from a temporary log buffer area after the logs are written into the temporary log buffer area, extracting session key words in the logs, mapping a unique log service end from a current service end list according to the session key words, sending the logs to the log service end after mapping, and gathering the logs to a log file with the session key words as indexes through the log service end. No matter whether components are distributed on different machines, different network segments and even different regions or not, logs of the components can be recombined and gathered according to the session key words, one log file is set for each session, and then data supporting is provided with system problem analysis, system optimization and the service use situation.
Description
Technical field
The present invention relates to log recording field, relate in particular to a kind of across assembly log recording method, Apparatus and system.
Background technology
Along with the high development of internet, the continuous expansion of user's request, software system function constantly perfect, the assembly of internal system is also more and more.At present, most software systems need to arrive various function with business integration together with, therefore, and increasing assembly, the function becoming increasingly complex, has brought certain challenge to the collection of internal system data and the location of problem.
For example the log pattern that log4cxx, log4c, IceLog etc. increase income for the log recording of assembly at present, these log patterns have higher performance and stability, the information that each assembly need to be able to be recorded is recorded in respectively in the individual log file that each assembly is corresponding independently, therefore, the daily record of these assemblies is all separate, and content is relatively numerous and jumbled.
The system of a function complexity includes numerous assemblies, each assembly is process independently, these assemblies may be distributed in different machines, the different network segments, or even different area, if according to the method for current log recording, to be difficult on the basis of the separate journal file from each assembly collecting, according to business association, some valuable log informations are gathered, like this, developer just cannot extract all data flows of a road session fast, cannot there is one to hold clearly to the operation conditions of overall service line, cause a lot of valuable data cannot utilize at all, cause the loss of resource, in addition, current log recording mode also can cause disk I/O operation comparatively frequently, makes the performance of assembly be subject to certain loss.
Summary of the invention
It is a kind of across assembly log recording method, Apparatus and system that the embodiment of the present invention provides, can be to reconfiguring and gather from the daily record of each assembly, journal file of Wei Mei road session establishment, for system problem analysis, system optimization, business service condition provide Data support.
For achieving the above object, the technical solution used in the present invention is: a kind of across assembly log recording method, comprising:
At interim log buffer, district is written into after daily record, from described interim log buffer district, obtains described daily record;
Extract the conversation key in described daily record;
Map out a log services end according to described conversation key is unique from the list of current service end;
Described Log Sender, to the described log services end mapping out, is gathered described daily record to a journal file taking described conversation key as index for described log services end.
Preferably, describedly map out a log services end and comprise according to described conversation key is unique from the list of current service end:
By hash algorithm, map out a log services end according to described conversation key is unique from the list of current service end.
Preferably, described method also comprises: download the list of latest services end from configuration service end, to upgrade the list of described current service end, wherein, described log services end is sent to the information on services of self described configuration service end after startup, safeguards the list of described latest services end for described configuration service end.
Preferably, described from the list of configuration service end download latest services end, comprise to upgrade the list of described current service end:
Download the list of latest services end with the very first time interval of setting from configuration server, to upgrade the list of described current service end, wherein, described log services end is sent to described configuration service end with second time interval of setting by the information on services of self after startup, safeguards the list of described latest services end for described configuration service end.
Preferably, described method also comprises:
In the time that described Log Sender to described log services end is sent unsuccessfully, described daily record is write to retry buffer area;
Be written into after described daily record in described retry buffer area, from described retry buffer area, obtain described daily record;
Again extract the conversation key in described daily record;
Again map out a log services end according to described conversation key is unique from the list of described current service end;
Described daily record is sent to again to the described log services end mapping out.
Preferably, described log services end gathers described daily record to a journal file taking described conversation key as index and comprises:
Described log services end is receiving after described daily record, taking the conversation key of described daily record as index gathers described daily record to a temporary file of local cache, makes described temporary file record the session being made up of the daily record with described conversation key;
Described log services end is crossed after date in described session, loads conversation key and resolves scheme, to obtain the store path of described session;
According to described store path, by a journal file of described session one-time write this locality, and by described conversation key, described journal file is identified.
Preferably, described method also comprises: described log services end checks with the 3rd time interval of setting whether the time of origin of the last daily record occurring in described session exceedes the time threshold of setting, and as described in judging as exceeded, session is expired.
Preferably, described method also comprises: in described temporary file, the sequencing that described log services end occurs according to daily record described daily record sorts, and the daily record that makes to come end is the last daily record occurring in described session.
A kind of across assembly log recording apparatus, comprising:
Log acquisition module for being written into after daily record in interim log buffer district, is obtained described daily record from described interim log buffer district;
Keyword extraction module, for extracting the conversation key of described daily record;
Mapping block, for mapping out a log services end according to described conversation key from the list of current service end is unique; And,
Sending module, for by described Log Sender to the described log services end mapping out, for described log services end, described daily record is gathered to a journal file taking described conversation key as index.
Preferably, described mapping block is also for by hash algorithm, maps out a log services end according to described conversation key is unique from the list of current service end.
Preferably, described device also comprises:
List update module, for download the list of latest services end from configuration service end, to upgrade the list of described current service end, wherein, described log services end is sent to the information on services of self described configuration service end after startup, safeguards the list of described latest services end for described configuration service end.
Preferably, described list update module is also downloaded the list of latest services end for the very first time interval to set from configuration server, to upgrade the list of described current service end, wherein, described log services end is sent to described configuration service end with second time interval of setting by the information on services of self after startup, safeguards the list of described latest services end for described configuration service end.
Preferably, described device also comprises:
Rewrite module, in the time that described Log Sender to described log services end is sent unsuccessfully, described daily record is write to retry buffer area;
The heavy acquisition module of daily record for being written into after described daily record in described retry buffer area, obtains described daily record from described retry buffer area;
The heavy extraction module of key word, for again extracting the conversation key of described daily record;
Remap module, for again mapping out a log services end according to described conversation key from the list of described current service end is unique; And,
Retransmit module, for being sent to described daily record again the described log services end mapping out.
One, across assembly diary record system, comprises daily record client and log services end, and described daily record client comprises:
Log acquisition module for being written into after daily record in interim log buffer district, is obtained described daily record from described interim log buffer district;
Keyword extraction module, for extracting the conversation key of described daily record;
Mapping block, for mapping out a log services end according to described conversation key from the list of current service end is unique; And,
Sending module, for by described Log Sender to the described log services end mapping out;
Described log services end is for gathering described daily record to a journal file taking described conversation key as index.
Preferably, log services end comprises:
Index module, for receiving after described daily record, taking the conversation key of described daily record as index gathers described daily record to a temporary file of local cache, makes described temporary file record the session being made up of the daily record with described conversation key;
Path acquisition module, for crossing after date in described session, loads conversation key and resolves scheme, to obtain the store path of described session; And,
Memory module, for according to described store path, by a journal file of described session one-time write this locality, and identifies described journal file by described conversation key.
Preferably, described log services end also comprises:
Whether expired judge module, exceed the time threshold of setting for the time of origin that checks the last daily record occurring of described session with the 3rd time interval of setting, and as described in judging as exceeded, session is expired.
Preferably, described index module is also at described temporary file, and the sequencing that described daily record is occurred according to daily record sorts, and the daily record that makes to come end is the last daily record occurring in described session.
Preferably, described system also comprises configuration service end, and described log services end also comprises information on services reporting module, and described information on services reporting module for being sent to the information on services of self described configuration service end after startup; Described daily record client also comprises list update module, and described list update module is for download the list of latest services end from configuration service end, to upgrade the list of described current service end.
Preferably, described information on services reporting module also for being sent to described configuration service end with second time interval of setting by the information on services of self after startup; Described list update module is also downloaded the list of latest services end for the very first time interval to set from configuration server, to upgrade the list of described current service end.
Preferably, described daily record client also comprises:
Rewrite module, in the time that described Log Sender to described log services end is sent unsuccessfully, described daily record is write to retry buffer area;
The heavy acquisition module of daily record, is written into after described daily record in described retry buffer area, obtains described daily record from described retry buffer area;
The heavy extraction module of key word, for again extracting the conversation key of described daily record;
Remap module, for again mapping out a log services end according to described conversation key from the list of described current service end is unique; And,
Retransmit module, for being sent to described daily record again the described log services end mapping out.
Beneficial effect of the present invention is, of the present inventionly whether be distributed in different machines across assembly log recording method, the no matter each assembly of Apparatus and system, the different network segments, or even different area, can utilize conversation key to reconfiguring and gather from the daily record of each assembly, journal file of Wei Mei road session establishment, and then provide Data support for system problem analysis, system optimization, business service condition.
Brief description of the drawings
Fig. 1 shows according to the process flow diagram of the first embodiment of log recording method of the present invention;
Fig. 2 shows according to the process flow diagram of the second embodiment of log recording method of the present invention;
Fig. 3 shows according to the process flow diagram of the 3rd embodiment of log recording method of the present invention;
Fig. 4 shows according to the structural representation of the first embodiment of log recording apparatus of the present invention;
Fig. 5 shows according to the structural representation of the second embodiment of log recording apparatus of the present invention;
Fig. 6 shows according to the structural representation of the 3rd embodiment of log recording apparatus of the present invention;
Fig. 7 shows according to the structural representation of a kind of embodiment of diary record system of the present invention.
Embodiment
Describe embodiments of the invention below in detail, the example of described embodiment is shown in the drawings, and wherein same or similar label represents same or similar element or has the element of identical or similar functions from start to finish.Be exemplary below by the embodiment being described with reference to the drawings, only for explaining the present invention, and can not be interpreted as limitation of the present invention.
As shown in Figure 1, of the present invention conversation-based across assembly log recording method, after being for example to write interim log buffer district by application programming interfaces (API) by daily record, carry out following steps:
Step S11: obtain daily record from interim log buffer district.
Step S12: extract the conversation key in daily record, wherein every daily record generally includes the information such as conversation key, log content, writing time, daily record size, daily record rank, conversation key is wherein preset by assembly, and assembly can preset and operations conversation key one to one, this conversation key can be code, also can be language performance form, user can be known the operation occurring writing time according to the conversation key in daily record.
Step S13: map out a log services end according to conversation key is unique from the list of current service end; Be that the daily record that conversation key is identical will be mapped to same log services end, adaptable algorithm is for example Hash (hash) algorithm, consistance hash algorithm, hash table etc. here.
Step S14: Log Sender, to the log services end mapping out, is gathered daily record to a journal file taking conversation key as index for log services end, get back to afterwards step S11 and process next daily record in extra buffer.
Correspondingly, log services end is received after described daily record, and daily record is gathered to a journal file taking conversation key as index.
In order to make log recording method of the present invention be applicable to the occasion that log services end cluster can change, method of the present invention also can comprise: download the list of latest services end from configuration service end, to upgrade the list of above-mentioned current service end, wherein, each log services end in log services end cluster can be sent to configuration service end by the information on services of self after startup, safeguard the list of latest services end for configuration service end, this information on services comprises IP address, port numbers and disk I/O performance etc.
Further, can there is the occasion of conversion in order to make method of the present invention adapt to log services end, above-mentioned from the list of configuration service end download latest services end, can specifically comprise to upgrade the list of current service end:
Download the list of latest services end with the very first time interval of setting from configuration server, to upgrade the list of current service end, wherein, log services end is sent to configuration service end with second time interval of setting by the information on services of self after startup, safeguards the list of latest services end for configuration service end.
In order to increase the processing to sending failed daily record, as shown in Figure 2, method of the present invention, after above-mentioned steps S14, is also carried out following steps:
Step S15: judge whether daily record sends successfully, perform step S16 as unsuccessful, if sent successfully, wait for and judge whether next daily record sends successfully.
Step S16: daily record is write to retry buffer area.
Step S17: obtain daily record from retry buffer area.
Step S18: again extract the conversation key in daily record.
Step S19: again map out a log services end according to conversation key is unique from the list of current service end, at this, owing to adopting identical algorithm to shine upon, therefore in different processes, same daily record is shone upon, will map out same log services end.
Step S110: daily record is sent to again to the log services end mapping out, gets back to afterwards step 17 next daily record in retry buffer area is processed.
If resending of daily record is still not successful, daily record can be write in local file, wait for that obtaining daily record from local file resends again.
As shown in Figure 3, above-mentioned log services end gathers daily record to a journal file taking conversation key as index and can specifically comprise the steps:
Step S21: daily record is gathered to a temporary file of local cache taking the conversation key of daily record as index, make described temporary file record the session being formed by the daily record with described conversation key, at this, each temporary file can identify in conversation key name, so that carry out index; At this, in local cache when not corresponding with this conversation key temporary file, by a first newly-built temporary file taking this conversation key as index, and this daily record is gathered to newly-built temporary file.
Step S22: cross after date in session, load conversation key and resolve scheme, to obtain the store path of session, at this, log services end can be for each conversation key configuration store path corresponding thereto, user can be as required at the store path of the self-defined each conversation key corresponding thereto of log services end, wherein, each log services end can be only for storing the session of a corresponding conversation key, also can be for storing the session of corresponding multiple conversation key.
Step S23: according to store path, by a journal file of session one-time write this locality, and by conversation key, journal file is identified, so that search in the future.
Whether expired in order effectively to judge session, method of the present invention can also comprise: log services end checks with the 3rd time interval of setting whether the time of origin (current time checking and the mistiming between the writing time of daily record) of the last daily record occurring in session exceedes the time threshold of setting, judge that session is expired as exceeded, after this can be understood as the identical Yi of conversation key road session and exceedes above-mentioned time threshold and do not upgrade, judge that this road session finishes, this time threshold can be set with application scenario as required.
Whether expired for the ease of judging session, method of the present invention also can comprise: in temporary file, the sequencing that log services end occurs according to daily record daily record sorts, the daily record that makes to come end is the last daily record occurring in session, like this, only need regularly judge whether the time of origin of end daily record exceedes the time threshold of setting, compared to the daily record of obtaining last generation the writing time of daily record without the whole temporary file of traversal.
Corresponding with above-mentioned log recording method, as shown in Figure 4, of the present inventionly conversation-basedly comprise log acquisition module 11, keyword extraction module 12, mapping block 13 and sending module 14 across assembly log recording apparatus, wherein, log acquisition module 11, for being written into after daily record in interim log buffer district, is obtained daily record from interim log buffer district; Keyword extraction module 12 is for extracting the conversation key of daily record; Mapping block 13 is for for example mapping out a log services end according to conversation key from the list of current service end is unique by hash algorithm; Sending module 14 for by Log Sender to the log services end 2 mapping out, for log services end 2, described daily record is gathered to a journal file taking described conversation key as index.
As shown in Figure 5, device of the present invention can also comprise list update module 15, it is for downloading the list of latest services end from configuration service end, to upgrade the list of current service end, wherein, log services end 2 is sent to the information on services of self described configuration service end after startup, safeguards the list of latest services end for configuration service end.
Above-mentioned list update module is also downloaded the list of latest services end for the very first time interval to set from configuration server, to upgrade the list of described current service end, wherein, log services end 2 is sent to described configuration service end with second time interval of setting by the information on services of self after startup, safeguards the list of described latest services end for configuration service end.
As shown in Figure 6, device of the present invention can also comprise rewriting module 16, the heavy acquisition module 17 of daily record, the heavy extraction module 18 of key word, remap module 19 and retransmit module 110, this rewriting module 16, in the time that Log Sender to daily record service end is sent unsuccessfully, writes retry buffer area by daily record; The heavy acquisition module 17 of this daily record, for being written in retry buffer area after described daily record, obtains described daily record from retry buffer area; The heavy extraction module 18 of this key word is for again extracting the conversation key of daily record; This remaps module 19 for again mapping out a log services end according to conversation key from the list of current service end is unique; This retransmit module 110 is for being sent to daily record again the described log services end 2 mapping out.
As shown in Figure 7, of the present inventionly conversation-basedly comprise daily record client 1 and log services end 2 across assembly diary record system, daily record client 1 comprises above-mentioned log acquisition module 11, keyword extraction module 12, mapping block 13 and sending module 14; Log services end 2 is for gathering daily record to a journal file taking conversation key as index.
This log services end 2 can further comprise index module 21, path acquisition module 22 and memory module 23, this index module 21 is for receiving after described daily record, taking the conversation key of daily record as index gathers daily record to a temporary file of local cache, make temporary file record the session being formed by the daily record with conversation key; This path acquisition module 22, for crossing after date in session, loads conversation key and resolves scheme, to obtain the store path of described session; This memory module 23, for according to store path, by a journal file of session one-time write this locality, and identifies described journal file by conversation key.
This log services end 2 also can comprise expired judge module, and whether it exceedes the time threshold of setting for the time of origin that checks the last daily record occurring of described session with the 3rd time interval of setting, and as described in judging as exceeded, session is expired.
Above-mentioned index module 21 is also used in temporary file, and the sequencing that daily record is occurred according to daily record sorts, and the daily record that makes to come end is the last daily record occurring in described session.
Described system also can comprise configuration service end, and log services end 2 also can comprise information on services reporting module, and information on services reporting module for being sent to configuration service end by the information on services of self after startup; Daily record client 1 also comprises above-mentioned list update module 15.
This information on services reporting module also for being sent to described configuration service end with second time interval of setting by the information on services of self after startup; Accordingly, this list update module 15 is also downloaded the list of latest services end for the very first time interval to set from configuration server, to upgrade the list of current service end.
In addition, this log services end 1 also can comprise the heavy acquisition module 17 of above-mentioned rewriting module 16, daily record, the heavy extraction module 18 of key word, remap module 19 and retransmit module 110.
Above daily record client 1, configuration service end and log services end 2 can be configured on same server, also can be configured on different servers.The time interval of above-mentioned each setting can be according to the characteristic default settings of whole system, and can be set to the form that user can need to revise according to self.
Describe structure of the present invention, feature and action effect in detail according to the embodiment shown in graphic above; the foregoing is only preferred embodiment of the present invention; but the present invention does not limit practical range with shown in drawing; every change of doing according to conception of the present invention; or be revised as the equivalent embodiment of equivalent variations; when not exceeding yet instructions and illustrating contain spiritual, all should be in protection scope of the present invention.
Claims (20)
1. across an assembly log recording method, it is characterized in that, comprising:
At interim log buffer, district is written into after daily record, from described interim log buffer district, obtains described daily record;
Extract the conversation key in described daily record;
Map out a log services end according to described conversation key is unique from the list of current service end;
Described Log Sender, to the described log services end mapping out, is gathered described daily record to a journal file taking described conversation key as index for described log services end.
2. method according to claim 1, is characterized in that, describedly maps out a log services end and comprises according to described conversation key is unique from the list of current service end:
By hash algorithm, map out a log services end according to described conversation key is unique from the list of current service end.
3. method according to claim 1, is characterized in that, described method also comprises:
Download the list of latest services end from configuration service end, to upgrade the list of described current service end, wherein, described log services end is sent to the information on services of self described configuration service end after startup, safeguards the list of described latest services end for described configuration service end.
4. method according to claim 3, is characterized in that, described from the list of configuration service end download latest services end, comprises to upgrade the list of described current service end:
Download the list of latest services end with the very first time interval of setting from configuration server, to upgrade the list of described current service end, wherein, described log services end is sent to described configuration service end with second time interval of setting by the information on services of self after startup, safeguards the list of described latest services end for described configuration service end.
5. according to the method described in any one in claim 1 to 4, it is characterized in that, described method also comprises:
In the time that described Log Sender to described log services end is sent unsuccessfully, described daily record is write to retry buffer area;
Be written into after described daily record in described retry buffer area, from described retry buffer area, obtain described daily record;
Again extract the conversation key in described daily record;
Again map out a log services end according to described conversation key is unique from the list of described current service end;
Described daily record is sent to again to the described log services end mapping out.
6. according to the method described in any one in claim 1 to 4, it is characterized in that, described log services end gathers described daily record to a journal file taking described conversation key as index and comprises:
Described log services end is receiving after described daily record, taking the conversation key of described daily record as index gathers described daily record to a temporary file of local cache, makes described temporary file record the session being made up of the daily record with described conversation key;
Described log services end is crossed after date in described session, loads conversation key and resolves scheme, to obtain the store path of described session;
According to described store path, by a journal file of described session one-time write this locality, and by described conversation key, described journal file is identified.
7. method according to claim 6, is characterized in that, described method also comprises:
Described log services end checks with the 3rd time interval of setting whether the time of origin of the last daily record occurring in described session exceedes the time threshold of setting, and as described in judging as exceeded, session is expired.
8. method according to claim 7, is characterized in that, described method also comprises:
In described temporary file, the sequencing that described log services end occurs according to daily record described daily record sorts, and the daily record that makes to come end is the last daily record occurring in described session.
9. across an assembly log recording apparatus, it is characterized in that, comprising:
Log acquisition module for being written into after daily record in interim log buffer district, is obtained described daily record from described interim log buffer district;
Keyword extraction module, for extracting the conversation key of described daily record;
Mapping block, for mapping out a log services end according to described conversation key from the list of current service end is unique; And,
Sending module, for by described Log Sender to the described log services end mapping out, for described log services end, described daily record is gathered to a journal file taking described conversation key as index.
10. device according to claim 9, is characterized in that, described mapping block is also for by hash algorithm, maps out a log services end according to described conversation key is unique from the list of current service end.
11. devices according to claim 9, is characterized in that, described device also comprises:
List update module, for download the list of latest services end from configuration service end, to upgrade the list of described current service end, wherein, described log services end is sent to the information on services of self described configuration service end after startup, safeguards the list of described latest services end for described configuration service end.
12. devices according to claim 11, it is characterized in that, described list update module is also downloaded the list of latest services end for the very first time interval to set from configuration server, to upgrade the list of described current service end, wherein, described log services end is sent to described configuration service end with second time interval of setting by the information on services of self after startup, safeguards the list of described latest services end for described configuration service end.
13. according to the device described in any one in claim 9 to 12, it is characterized in that, described device also comprises:
Rewrite module, in the time that described Log Sender to described log services end is sent unsuccessfully, described daily record is write to retry buffer area;
The heavy acquisition module of daily record for being written into after described daily record in described retry buffer area, obtains described daily record from described retry buffer area;
The heavy extraction module of key word, for again extracting the conversation key of described daily record;
Remap module, for again mapping out a log services end according to described conversation key from the list of described current service end is unique; And,
Retransmit module, for being sent to described daily record again the described log services end mapping out.
14. 1 kinds across assembly diary record system, it is characterized in that, comprise daily record client and log services end, described daily record client comprises:
Log acquisition module for being written into after daily record in interim log buffer district, is obtained described daily record from described interim log buffer district;
Keyword extraction module, for extracting the conversation key of described daily record;
Mapping block, for mapping out a log services end according to described conversation key from the list of current service end is unique; And,
Sending module, for by described Log Sender to the described log services end mapping out;
Described log services end is for gathering described daily record to a journal file taking described conversation key as index.
15. systems according to claim 14, is characterized in that, described log services end comprises:
Index module, for receiving after described daily record, taking the conversation key of described daily record as index gathers described daily record to a temporary file of local cache, makes described temporary file record the session being made up of the daily record with described conversation key;
Path acquisition module, for crossing after date in described session, loads conversation key and resolves scheme, to obtain the store path of described session; And,
Memory module, for according to described store path, by a journal file of described session one-time write this locality, and identifies described journal file by described conversation key.
16. systems according to claim 15, is characterized in that, described log services end also comprises:
Whether expired judge module, exceed the time threshold of setting for the time of origin that checks the last daily record occurring of described session with the 3rd time interval of setting, and as described in judging as exceeded, session is expired.
17. systems according to claim 16, is characterized in that, described index module is also at described temporary file, and the sequencing that described daily record is occurred according to daily record sorts, and the daily record that makes to come end is the last daily record occurring in described session.
18. according to claim 14 to the system described in any one in 17, it is characterized in that, described system also comprises configuration service end, described log services end also comprises information on services reporting module, and described information on services reporting module for being sent to the information on services of self described configuration service end after startup; Described daily record client also comprises list update module, and described list update module is for download the list of latest services end from configuration service end, to upgrade the list of described current service end.
19. systems according to claim 18, is characterized in that, described information on services reporting module also for being sent to described configuration service end with second time interval of setting by the information on services of self after startup; Described list update module is also downloaded the list of latest services end for the very first time interval to set from configuration server, to upgrade the list of described current service end.
20. according to claim 14 to the system described in any one in 17, it is characterized in that, described daily record client also comprises:
Rewrite module, in the time that described Log Sender to described log services end is sent unsuccessfully, described daily record is write to retry buffer area;
The heavy acquisition module of daily record, is written into after described daily record in described retry buffer area, obtains described daily record from described retry buffer area;
The heavy extraction module of key word, for again extracting the conversation key of described daily record;
Remap module, for again mapping out a log services end according to described conversation key from the list of described current service end is unique; And,
Retransmit module, for being sent to described daily record again the described log services end mapping out.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410158838.3A CN103927252A (en) | 2014-04-18 | 2014-04-18 | Cross-component log recording method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410158838.3A CN103927252A (en) | 2014-04-18 | 2014-04-18 | Cross-component log recording method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103927252A true CN103927252A (en) | 2014-07-16 |
Family
ID=51145477
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410158838.3A Pending CN103927252A (en) | 2014-04-18 | 2014-04-18 | Cross-component log recording method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103927252A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106126730A (en) * | 2016-07-01 | 2016-11-16 | 百势软件(北京)有限公司 | A kind of method and device of Mass production warning information |
| CN106357371A (en) * | 2016-10-31 | 2017-01-25 | 聚好看科技股份有限公司 | Cross-machine-room data transmission method and servers |
| CN106844139A (en) * | 2016-12-19 | 2017-06-13 | 广州视源电子科技股份有限公司 | Log file analysis method and device |
| CN107798099A (en) * | 2017-10-27 | 2018-03-13 | 努比亚技术有限公司 | A kind of log information grasping means, terminal and computer-readable recording medium |
| CN109861843A (en) * | 2018-11-28 | 2019-06-07 | 阿里巴巴集团控股有限公司 | Complete acquisition confirmation method, device and the equipment of journal file |
| CN111309694A (en) * | 2018-12-12 | 2020-06-19 | 北京奇虎科技有限公司 | Log file acquisition method, server, device and system |
| CN112486777A (en) * | 2020-12-11 | 2021-03-12 | 深圳前瞻资讯股份有限公司 | Big data service program log processing method and system |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1770691A (en) * | 2001-12-27 | 2006-05-10 | 富士施乐株式会社 | Network system, information management server and information management method |
| CN101425034A (en) * | 2008-08-11 | 2009-05-06 | 深圳市金蝶中间件有限公司 | Log recording method and log system |
| US20090228701A1 (en) * | 2008-03-04 | 2009-09-10 | Industrial Technology Research Institute | Logging system and method based on one-way hash function |
| CN102064969A (en) * | 2010-12-27 | 2011-05-18 | 大唐移动通信设备有限公司 | Method and equipment for processing logs |
| CN102480489A (en) * | 2010-11-30 | 2012-05-30 | 北京千橡网景科技发展有限公司 | Log recording method and device used in distributed environment |
| CN102724063A (en) * | 2012-05-11 | 2012-10-10 | 北京邮电大学 | Log collection server, data packet delivering and log clustering methods and network |
| CN103412893A (en) * | 2013-07-24 | 2013-11-27 | 广东电子工业研究院有限公司 | A log collection system and its collection method |
| CN103425750A (en) * | 2013-07-23 | 2013-12-04 | 国云科技股份有限公司 | A cross-platform and cross-application log collection system and its collection management method |
| CN103455411A (en) * | 2013-08-01 | 2013-12-18 | 百度在线网络技术（北京）有限公司 | Log classification model building and action log classifying method and device |
| CN103559120A (en) * | 2013-11-13 | 2014-02-05 | 北京网秦天下科技有限公司 | Log recording method and server |
-
2014
- 2014-04-18 CN CN201410158838.3A patent/CN103927252A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1770691A (en) * | 2001-12-27 | 2006-05-10 | 富士施乐株式会社 | Network system, information management server and information management method |
| US20090228701A1 (en) * | 2008-03-04 | 2009-09-10 | Industrial Technology Research Institute | Logging system and method based on one-way hash function |
| CN101425034A (en) * | 2008-08-11 | 2009-05-06 | 深圳市金蝶中间件有限公司 | Log recording method and log system |
| CN102480489A (en) * | 2010-11-30 | 2012-05-30 | 北京千橡网景科技发展有限公司 | Log recording method and device used in distributed environment |
| CN102064969A (en) * | 2010-12-27 | 2011-05-18 | 大唐移动通信设备有限公司 | Method and equipment for processing logs |
| CN102724063A (en) * | 2012-05-11 | 2012-10-10 | 北京邮电大学 | Log collection server, data packet delivering and log clustering methods and network |
| CN103425750A (en) * | 2013-07-23 | 2013-12-04 | 国云科技股份有限公司 | A cross-platform and cross-application log collection system and its collection management method |
| CN103412893A (en) * | 2013-07-24 | 2013-11-27 | 广东电子工业研究院有限公司 | A log collection system and its collection method |
| CN103455411A (en) * | 2013-08-01 | 2013-12-18 | 百度在线网络技术（北京）有限公司 | Log classification model building and action log classifying method and device |
| CN103559120A (en) * | 2013-11-13 | 2014-02-05 | 北京网秦天下科技有限公司 | Log recording method and server |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106126730A (en) * | 2016-07-01 | 2016-11-16 | 百势软件(北京)有限公司 | A kind of method and device of Mass production warning information |
| CN106126730B (en) * | 2016-07-01 | 2019-10-11 | 百势软件(北京)有限公司 | A kind of method and device of Mass production warning information |
| CN106357371A (en) * | 2016-10-31 | 2017-01-25 | 聚好看科技股份有限公司 | Cross-machine-room data transmission method and servers |
| CN106357371B (en) * | 2016-10-31 | 2019-09-17 | 聚好看科技股份有限公司 | Across computer room data transmission method and server |
| CN106844139A (en) * | 2016-12-19 | 2017-06-13 | 广州视源电子科技股份有限公司 | Log file analysis method and device |
| CN107798099A (en) * | 2017-10-27 | 2018-03-13 | 努比亚技术有限公司 | A kind of log information grasping means, terminal and computer-readable recording medium |
| CN109861843A (en) * | 2018-11-28 | 2019-06-07 | 阿里巴巴集团控股有限公司 | Complete acquisition confirmation method, device and the equipment of journal file |
| CN109861843B (en) * | 2018-11-28 | 2021-11-23 | 阿里巴巴集团控股有限公司 | Method, device and equipment for completely collecting and confirming log files |
| CN111309694A (en) * | 2018-12-12 | 2020-06-19 | 北京奇虎科技有限公司 | Log file acquisition method, server, device and system |
| CN112486777A (en) * | 2020-12-11 | 2021-03-12 | 深圳前瞻资讯股份有限公司 | Big data service program log processing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103927252A (en) | Cross-component log recording method, device and system | |
| US8886700B2 (en) | Content sharing with limited cloud storage | |
| US8290994B2 (en) | Obtaining file system view in block-level data storage systems | |
| US7584201B2 (en) | Management of mobile-device data | |
| KR101743191B1 (en) | Application program management method and apparatus, server, terminal device, program, and recording medium | |
| US20120272102A1 (en) | Redirecting Data Generated by Network Devices | |
| CN104951474A (en) | Method and device for acquiring MySQL binlog incremental logs | |
| CN109829287A (en) | Api interface permission access method, equipment, storage medium and device | |
| CN109600385B (en) | Access control method and device | |
| US20140358868A1 (en) | Life cycle management of metadata | |
| US10540325B2 (en) | Method and device for identifying junk picture files | |
| CN111240892B (en) | Data backup method and device | |
| US20170371894A1 (en) | Samba configuration management method and system for network device | |
| US9858152B2 (en) | Collaborative information source recovery | |
| CN113704790A (en) | Abnormal log information summarizing method and computer equipment | |
| CN109726039B (en) | Method and apparatus for managing virtual machines | |
| CN112559463A (en) | Method and device for processing compressed file | |
| CN111753141B (en) | Data management method and related equipment | |
| CN108133026B (en) | Multi-data processing method, system and storage medium | |
| CN110083509B (en) | Method and device for arranging log data | |
| EP2819028A2 (en) | Content management system | |
| US9002788B2 (en) | System for configurable reporting of network data and related method | |
| CN107844491B (en) | Method and equipment for realizing strong consistency read operation in distributed system | |
| CN105338021B (en) | The exchange method and system and client and server of client and server | |
| US20150143192A1 (en) | Application server and method of error recovery when downloading data files |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Wangjiang Road high tech Development Zone Hefei city Anhui province 230088 No. 666 Applicant after: Iflytek Co., Ltd. Address before: Wangjiang Road high tech Development Zone Hefei city Anhui province 230088 No. 666 Applicant before: Anhui USTC iFLYTEK Co., Ltd. |
|
| COR | Change of bibliographic data | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140716 |