Disclosure of Invention
The invention provides an intelligent traffic management system reliability evaluation method, an intelligent traffic management system reliability evaluation device and an intelligent traffic management system reliability evaluation system, and solves the problem that the reliability evaluation of the intelligent traffic management system is lacked in the related technology.
As a first aspect of the present invention, there is provided an intelligent traffic management system reliability evaluation method, including:
acquiring comprehensive data information of an intelligent traffic management system to be evaluated;
when the operating condition of the intelligent traffic management system to be evaluated is determined to be normal, carrying out reliability analysis and evaluation on the comprehensive data information of the intelligent traffic management system to be evaluated according to a preset evaluation system rule;
outputting a reliability evaluation comprehensive score and a corresponding evaluation grade of the intelligent traffic management system to be evaluated;
wherein the preset evaluation system rule comprises:
determining an evaluation index of the intelligent traffic management system to be evaluated according to the evaluation dimension;
determining the evaluation score of each evaluation index corresponding to the comprehensive data information of the intelligent traffic management system to be evaluated according to the index evaluation rule;
obtaining a calculation comprehensive score according to the evaluation of each evaluation index;
and determining the evaluation grade according to the comprehensive score.
Further, when it is determined that the operation condition of the intelligent traffic management system to be evaluated is normal, performing reliability analysis evaluation on the comprehensive data information of the intelligent traffic management system to be evaluated according to a preset evaluation system rule, including:
carrying out data processing on the comprehensive data information of the intelligent traffic management system to be evaluated, and extracting the data information to be evaluated, which is related to road monitoring, traffic control, illegal handling and information service, in the comprehensive data information;
and carrying out evaluation analysis on the extracted data information to be evaluated according to a preset evaluation system.
Further, the evaluation analysis of the extracted data information to be evaluated according to a preset evaluation system includes:
and respectively carrying out evaluation analysis on the data information to be evaluated according to three evaluation dimensions of data acquisition, data transmission and data application.
Further, the evaluation analysis of the to-be-evaluated data information is respectively performed according to three evaluation dimensions of data acquisition, data transmission and data application, and includes:
decomposing the three evaluation dimensions of data acquisition, data transmission and data application into a plurality of evaluation indexes, wherein each evaluation index comprises a plurality of evaluation items;
performing evaluation analysis on the information to be evaluated according to the decomposed multiple evaluation indexes and the scoring rule corresponding to each evaluation index, and obtaining an evaluation score corresponding to each evaluation index of the information to be evaluated;
and performing weighted calculation on the evaluation score corresponding to each evaluation index to obtain a comprehensive score of the data information to be evaluated, and determining the evaluation grade according to the comprehensive score.
Further, decomposing the three evaluation dimensions of data acquisition, data transmission and data application into a plurality of evaluation indexes, wherein each evaluation index comprises a plurality of evaluation items, and the method comprises the following steps:
performing primary evaluation index decomposition and secondary evaluation index decomposition on the data acquisition, data transmission and data application evaluation dimensions, wherein each level of evaluation index comprises a plurality of evaluation items;
and determining the weight corresponding to each evaluation item.
Further, the evaluation index decomposition corresponding to the three evaluation dimensions of data acquisition, data transmission and data application and the weight corresponding to each evaluation item include:
further, the weighting calculation of the evaluation score corresponding to each evaluation index to obtain a comprehensive score of the data information to be evaluated, and determining the evaluation grade according to the comprehensive score includes:
and carrying out weighted calculation on the evaluation score corresponding to each evaluation index according to a weighted calculation formula to obtain a comprehensive score, wherein the weighted calculation formula is as follows:
wherein n represents the number of the evaluation dimension grading primary index, AijRepresents the j-th primary index score, W, in the ith dimensionijRepresents the jth primary index weight under the ith dimension, the sum value in brackets represents the dimension index score, WiRepresenting the dimension index weight under the ith dimension;
determining the evaluation level of the data information to be evaluated according to the corresponding relation of the comprehensive scores and the evaluation levels, wherein the corresponding relation of the comprehensive scores and the evaluation levels is as follows:
further, the scoring rule corresponding to each evaluation index includes:
and quantizing each evaluation index according to a scoring rule corresponding to a quantization method, wherein the quantization method comprises a control type, a grade type and an additive type.
As another aspect of the present invention, an intelligent traffic management system reliability evaluation device is provided for implementing the intelligent traffic management system reliability evaluation method described above, wherein the intelligent traffic management system reliability evaluation device includes:
the acquisition module is used for acquiring comprehensive data information of the intelligent traffic management system to be evaluated;
the system comprises an analysis evaluation module, a reliability analysis module and a reliability analysis module, wherein the analysis evaluation module is used for carrying out reliability analysis evaluation on the comprehensive data information of the intelligent traffic management system to be evaluated according to a preset evaluation system rule when the operating condition of the intelligent traffic management system to be evaluated is determined to be normal;
the output module is used for outputting the reliability evaluation comprehensive score and the corresponding evaluation grade of the intelligent traffic management system to be evaluated;
wherein the preset evaluation system rule comprises:
determining an evaluation index of the intelligent traffic management system to be evaluated according to the evaluation dimension;
determining the evaluation score of each evaluation index corresponding to the comprehensive data information of the intelligent traffic management system to be evaluated according to the index evaluation rule;
obtaining a calculation comprehensive score according to the evaluation of each evaluation index;
and determining the evaluation grade according to the comprehensive score.
As another aspect of the present invention, there is provided an intelligent traffic management system reliability evaluation system, including: the application end is in communication connection with the server end, the server end comprises the intelligent traffic management system reliability evaluation device, and the application end is used for realizing communication connection with an intelligent traffic management system to be evaluated.
According to the reliability evaluation method for the intelligent traffic management system, provided by the embodiment of the invention, the comprehensive data information of the intelligent traffic management system is evaluated according to the preset evaluation index rule, so that the reliability evaluation grade of the intelligent traffic management system can be obtained, the reliability of the intelligent traffic management system is evaluated and analyzed, the problem that the reliability evaluation of the intelligent traffic management system is lacked in the prior art is solved, and the reliability evaluation method has the advantages of high evaluation accuracy and high evaluation efficiency.
Detailed Description
It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict. The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged under appropriate circumstances in order to facilitate the description of the embodiments of the invention herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In this embodiment, a method for evaluating reliability of an intelligent traffic management system is provided, and fig. 1 is a flowchart of a method for evaluating reliability of an intelligent traffic management system according to an embodiment of the present invention, as shown in fig. 1, including:
s110, acquiring comprehensive data information of the intelligent traffic management system to be evaluated;
in the embodiment of the invention, in order to realize the reliability evaluation analysis of the intelligent traffic management system, static evaluation needs to be performed under the working condition that the intelligent traffic management system is in normal operation, and most of devices and subsystems of the intelligent traffic management system are approved by product quality detection and system acceptance, so the narrow reliability (such as average failure-free working time) of a single device and system is taken as a precondition rather than an evaluation concern, and the reliability evaluation indexes are screened from the aspects of reliability identification of key devices and system components and construction conditions, operation conditions, efficiency exertion and the like which are more concerned in the reliable operation of the intelligent traffic management system.
S120, when the operating condition of the intelligent traffic management system to be evaluated is determined to be normal, carrying out reliability analysis and evaluation on the comprehensive data information of the intelligent traffic management system to be evaluated according to a preset evaluation system rule;
in the embodiment of the invention, specifically, the comprehensive data information of the intelligent traffic management system to be evaluated is subjected to data processing, and the data information to be evaluated, which is related to road monitoring, traffic control, illegal handling and information service, in the comprehensive data information is extracted;
and carrying out evaluation analysis on the extracted data information to be evaluated according to a preset evaluation system.
And further specifically, the evaluation analysis is respectively carried out on the data information to be evaluated according to three evaluation dimensions of data acquisition, data transmission and data application.
Further specifically, the data acquisition, the data transmission and the data application are decomposed into a plurality of evaluation indexes in three evaluation dimensions, and each evaluation index comprises a plurality of evaluation items;
performing evaluation analysis on the information to be evaluated according to the decomposed multiple evaluation indexes and the scoring rule corresponding to each evaluation index, and obtaining an evaluation score corresponding to each evaluation index of the information to be evaluated;
and performing weighted calculation on the evaluation score corresponding to each evaluation index to obtain a comprehensive score of the data information to be evaluated, and determining the evaluation grade according to the comprehensive score.
Further specifically, performing primary evaluation index decomposition and secondary evaluation index decomposition on the data acquisition, data transmission and data application three evaluation dimensions, wherein each level of evaluation index comprises a plurality of evaluation items;
and determining the weight corresponding to each evaluation item.
As shown in fig. 2 and fig. 3, for a schematic diagram of evaluation dimension and evaluation index decomposition, the evaluation index decomposition corresponding to the three evaluation dimensions and the weight corresponding to each evaluation item applied to data acquisition, data transmission and data application include:
TABLE 1 first-level and second-level evaluation index weight distribution table
It should be noted that all weighted index standard scores are 100. And calculating the scores of the first-level index and the second-level index by adopting an arithmetic weighting method. Under the calculation method, the indexes at the same level can compensate each other, and the functions of the indexes with larger evaluation score values and larger weights are highlighted. Table 6 shows the four-level to two-level index summation calculation formula and the weighting calculation formula of the first-level index.
From the above table, it can be seen that the implementation of the secondary index specifically includes:
1) the first-level index of the coverage is decomposed into 2 second-level indexes of data types and acquisition ranges. The data type is used for evaluating the coverage condition of the data type of the intelligent traffic management system; the acquisition range is used for evaluating the coverage of various information acquisition devices adopted by the call management system.
2) The first-level index of the acquisition capacity is decomposed into 2 second-level indexes of standard conformity and technical advancement. The standard conformity is used for evaluating the conformity condition of the functions and the performances of the key equipment adopted by the traffic management system with the corresponding standards and specifications; the technical advancement is used for evaluating the intelligent and automatic conditions of various front-end devices adopted by the traffic management system.
3) The primary index of the communication network is decomposed into 4 secondary indexes of network operation rate, bandwidth redundancy rate, network isolation and intrusion prevention. The network operation rate is used for evaluating the actual operation condition of the intelligent traffic management system communication network; the bandwidth redundancy rate is used for evaluating the performance of the urban management system communication network; the network isolation is used for evaluating the implementation situation of physical isolation and logical isolation measures of the intelligent traffic management system communication network; the intrusion prevention is used for evaluating the prevention condition of the intelligent traffic management system communication network to the intrusion attack.
4) The primary index of data processing is decomposed into 3 secondary indexes of processing environment, data management and algorithm model. The processing environment is used for evaluating the advancement and reliability of the intelligent traffic management system data resource pool; the data management is used for evaluating the data access, data management and data organization conditions of the digital resource pool of the intelligent traffic management system; the algorithm model is used for evaluating the richness degree of the algorithm model adopted by the intelligent traffic management system and the supporting condition of the intelligent traffic management system on the service.
5) The first-level index of transmission quality is decomposed into 3 second-level indexes of online rate, response time and networking quality. The online rate is used for evaluating the real-time online conditions of various front-end devices adopted by the intelligent traffic management system; the response time is used for evaluating the reaction condition of the intelligent traffic management system to the input or request of the user; the networking quality is used for evaluating the accuracy of data collected by various front-end equipment adopted by the traffic management system.
6) The first-level index of the system quality is decomposed into 2 second-level indexes of system function and interactivity. The system function is used for evaluating the conformity condition of the intelligent traffic management system function and the relevant standard; interactivity is used to evaluate the daily usage of the system by the intelligent traffic management system user.
7) The data service primary index is decomposed into 2 secondary indexes of data visualization and data sharing. The data visualization is used for evaluating the abundance degree and the display performance condition of the data display content of the intelligent traffic management system; the data sharing is used for evaluating the condition that the intelligent traffic management system shares data to an external unit for business application.
And continuously decomposing the indexes with the second-level index to the third-level to the fifth-level index to form a tree-shaped evaluation system. Taking the data type secondary index as an example, the decomposition process shown in fig. 4 is illustrated, and the complete index decomposition term is shown in table 2:
TABLE 2 complete list of secondary index data type index subentries
By analogy, according to the decomposition method shown in fig. 4, the index itemization results of all secondary indexes are shown in table 3.
TABLE 3 statistics of the number of the three-to five-level index items
Taking the data type two-level index of the collected dimension as an implementation example, at the level of a test evaluation point (the same three-level index), the data is divided into 3 evaluation points of road monitoring data, traffic control data and illegal handling data according to the traffic police service field, and taking the road monitoring data evaluation point as an example, 4 test evaluation elements (the same four-level index) of video pictures, vehicle passing information, road flow data, parking lot dynamic and static data and road surrounding meteorological data are decomposed. Taking the video picture and the vehicle passing information evaluation element as an example, 3 evaluation items (with the same five-level index) which can be used for checking the traffic video picture, the video within not less than 7 days and the vehicle passing information can be decomposed.
In the embodiment of the invention, after the data information to be evaluated is determined, the evaluation indexes adopted by the data information to be evaluated can be quantized, and then the corresponding scores are determined according to the quantization results.
Specifically, the scoring rule corresponding to each evaluation index includes:
and quantizing each evaluation index according to a scoring rule corresponding to a quantization method, wherein the quantization method comprises a control type, a grade type and an additive type.
Aiming at the characteristics of different index data, a control type quantization method, a hierarchical quantization method and an additive type quantization method are respectively adopted to give a binary, discrete or continuous score value-taking rule, and a table 4 shows a derivation example of the quantization method and the score rule.
TABLE 4 quantification method and derivation example of scoring rules
Taking the second-level index of the acquisition range as an example, the second-level index is decomposed to the fourth-level index step by step, and the indexes are sorted and ordered according to the importance of the second-level index in the reliability of the intelligent traffic management system to obtain 4 key indexes, as shown in table 5.
Table 5 example of Key attributes for four levels of metrics
Specifically, the standard scores of the first-level index and the second-level index are 100 points, the index weight is determined by adopting a subjective weighting method, the first-level index score is the arithmetic weighting of the second-level index score, and the third-level index and the following indexes are directly summarized and summed without setting weight values.
For convenient formula expression, the code of the evaluation item is X, the code of the evaluation element is E, the code of the evaluation point is P, the code of the secondary index is L, and the code of the primary index is A. The calculation formula of each level of index is shown as the following table:
TABLE 6 calculation formula for second-level to fourth-level index score
Specifically, the weighting calculation of the evaluation score corresponding to each evaluation index to obtain a comprehensive score of the data information to be evaluated, and determining the evaluation grade according to the comprehensive score includes:
and carrying out weighted calculation on the evaluation score corresponding to each evaluation index according to a weighted calculation formula to obtain a comprehensive score, wherein the weighted calculation formula is as follows:
wherein n represents the number of the evaluation dimension grading primary index, AijRepresents the j-th primary index score, W, in the ith dimensionijIs shown asThe jth primary index weight under the i dimension, the sum value in parentheses represents the dimension index score, WiRepresenting the dimension index weight under the ith dimension;
it should be noted that the weights of the three dimensions of data acquisition, data transmission and data application are W1=20%、W2=50%、W3=30%。
And (4) dividing score intervals to which different result grades belong, and giving grade judgment results (A grade, B grade and C grade). And giving an overall evaluation grade according to the final total evaluation score. For a class a decision, all key indicators must be scored in full, in addition to the total score requirement.
Determining the evaluation level of the data information to be evaluated according to the corresponding relation of the comprehensive scores and the evaluation levels, wherein the corresponding relation of the comprehensive scores and the evaluation levels is as follows:
TABLE 7 comprehensive score and evaluation level correspondence table
S130, outputting a reliability evaluation comprehensive score and a corresponding evaluation grade of the intelligent traffic management system to be evaluated;
wherein the preset evaluation system rule comprises:
determining an evaluation index of the intelligent traffic management system to be evaluated according to the evaluation dimension;
determining the evaluation score of each evaluation index corresponding to the comprehensive data information of the intelligent traffic management system to be evaluated according to the index evaluation rule;
obtaining a calculation comprehensive score according to the evaluation of each evaluation index;
and determining the evaluation grade according to the comprehensive score.
It should be noted that, in the embodiment of the present invention, each level index score, the composite score, and the corresponding evaluation level of the intelligent traffic management system may be output in the form of a visual evaluation report, and the visual evaluation report may not only embody the composite score and the corresponding evaluation level, but also include the existing problem analysis of the intelligent traffic management system, the corresponding improvement suggestion, and the like, and may also include the system configuration, the function profile, and the like of the intelligent traffic management system, and the specific content of the evaluation report may be set according to the requirement of the evaluator, which is not limited herein.
According to the reliability evaluation method for the intelligent traffic management system, provided by the embodiment of the invention, the comprehensive data information of the intelligent traffic management system is evaluated according to the preset evaluation index rule, so that the reliability evaluation grade of the intelligent traffic management system can be obtained, the reliability of the intelligent traffic management system is evaluated and analyzed, the problem that the reliability evaluation of the intelligent traffic management system is lacked in the prior art is solved, and the reliability evaluation method has the advantages of high evaluation accuracy and high evaluation efficiency.
The following describes in detail a specific implementation process of calculating the index score in the reliability evaluation method of the intelligent traffic management system by taking data acquisition as an example.
From the scoring rules described above, one can derive:
TABLE 8 example of calculation of the scores of the grade-II index data type grade-III to grade-V index
As shown in table 8, according to the 1 st calculation formula of table 6, a four-level index "video screen and vehicle passage information" score S ═ 20 (5+10 +5) ═ 20 is obtained. By analogy, the rest 3 four-level index scores are 10, 10 and 0.
As shown in table 8, according to the 2 nd calculation formula of table 6, a three-level index "road monitoring data" score S ═ 40 (20+10+10+0) is obtained. By analogy, the other 2 three-level indexes are divided into 30 and 20.
As shown in table 8, according to the 3 rd calculation formula in table 6, a secondary index "data type" score S ═ 40+30+20 ═ 90 points is obtained. By analogy, the scores of the remaining 17 secondary indices are shown in table 10.
As shown in table 8, 7 primary index scores were obtained according to the 4 th calculation formula of table 6 as shown in table 10.
TABLE 9 example calculation of Primary and Secondary index scores
On the basis of the 7 first-level index scores obtained, as shown in the example of calculating the composite score and the evaluation level in table 10, the composite score is 78.7, and the evaluation level is level B, which is not described herein again.
TABLE 10 example of calculation of composite score and evaluation level
As another embodiment of the present invention, an intelligent traffic management system reliability evaluation device is provided for implementing the intelligent traffic management system reliability evaluation method described above, wherein the intelligent traffic management system reliability evaluation device includes:
the acquisition module is used for acquiring comprehensive data information of the intelligent traffic management system to be evaluated;
the system comprises an analysis evaluation module, a reliability analysis module and a reliability analysis module, wherein the analysis evaluation module is used for carrying out reliability analysis evaluation on the comprehensive data information of the intelligent traffic management system to be evaluated according to a preset evaluation system rule when the operating condition of the intelligent traffic management system to be evaluated is determined to be normal;
the output module is used for outputting the reliability evaluation comprehensive score and the corresponding evaluation grade of the intelligent traffic management system to be evaluated;
wherein the preset evaluation system rule comprises:
determining an evaluation index of the intelligent traffic management system to be evaluated according to the evaluation dimension;
determining the evaluation score of each evaluation index corresponding to the comprehensive data information of the intelligent traffic management system to be evaluated according to the index evaluation rule;
obtaining a calculation comprehensive score according to the evaluation of each evaluation index;
and determining the evaluation grade according to the comprehensive score.
According to the reliability evaluation device for the intelligent traffic management system, provided by the embodiment of the invention, the comprehensive data information of the intelligent traffic management system is evaluated according to the preset evaluation index rule, so that the reliability evaluation grade of the intelligent traffic management system can be obtained, the reliability of the intelligent traffic management system is evaluated and analyzed, the problem that the reliability evaluation of the intelligent traffic management system is lacked in the prior art is solved, and the reliability evaluation device has the advantages of high evaluation accuracy and high evaluation efficiency.
For the specific operation principle of the reliability evaluation device for an intelligent traffic management system provided by the present invention, reference may be made to the foregoing description of the reliability evaluation method for an intelligent traffic management system, and details thereof are not repeated herein.
As another embodiment of the present invention, there is provided an intelligent traffic management system reliability evaluation system, including: the application end is in communication connection with the server end, the server end comprises the intelligent traffic management system reliability evaluation device, and the application end is used for realizing communication connection with an intelligent traffic management system to be evaluated.
In the embodiment of the present invention, the application end may specifically include two parts, namely, a WEB application program at a PC computer end and an APP program at a mobile terminal, and project data at both ends are synchronized. Meanwhile, deployment in two modes is supported, wherein the application terminal and the server terminal are deployed locally, and the application terminal and the server terminal are deployed remotely and separately. And field records required to be reserved in the implementation process are evaluated and uploaded in an attachment form. The attachment types include photographs taken on site, document scans provided by the unit under test, and the like. There are two types of attachment uploading. The mobile terminal is used for shooting and importing, and the local path is used for uploading and importing. And for mobile terminal uploading, the APP program is in butt joint with the main program of the PC terminal, and the index items corresponding to automatic association are recorded.
When the reliability evaluation system of the intelligent traffic management system provided by the embodiment of the invention is used for evaluation, the specific operation flow is as follows:
1) firstly, a project is newly built, and project base information such as a tested project name, a contact person, a contact way, a project place, evaluation time and the like is input.
2) And selecting a project to generate a project evaluation index, importing the input index into the project, and generating the project evaluation index bound with the project.
3) And entering project evaluation. The method comprises the steps of sequentially inputting project introduction and system composition, carrying out classified quantitative calculation on pre-input basic data, sampling investigation calculation data, data of butt joint tested system software and a database and tool acquisition data of the system composition in a field evaluation link, automatically calculating indexes such as formula calculation by using evaluation system software to obtain results and scores, and manually inputting the results and the scores, wherein the results and the scores cannot be automatically quantized. After the four-level and five-level indexes input the field evaluation data, the evaluation system automatically calculates the upper-level index score according to a formula until the comprehensive score is calculated and the evaluation grade is given. The statistical analysis module visualizes a score result, and the visualized result is automatically imported into an evaluation report; the problem analysis module automatically analyzes and summarizes the problems according to the failure condition of each level of indexes, the problem content can be edited manually, and the problem content is automatically imported into the evaluation report. And finally, generating an evaluation report, wherein the evaluation report comprises the item information, the evaluation process information and the evaluation result information. The evaluation process can be rolled back for many times to correct some errors of the field evaluation until a correct evaluation report is given.
4) And exiting the item evaluation. At any stage of entering the project evaluation, the project evaluation may be exited.
5) And finishing the project and filing the data. When the project evaluation report is finalized and the project is finished, all project data are filed. The filed project data only needs to be browsed and can not be edited and modified.
After the reliability evaluation of the intelligent traffic management system is carried out in multiple places, the statistical analysis can be carried out by taking indexes as units, the analysis content comprises the score distribution condition of the indexes of each tested system, the transverse and longitudinal score-loss correlation analysis of the indexes, the content of problem reasons, improvement suggestions and the like, the improvement optimization work of an evaluation index system can be further carried out based on the analysis result, and the construction and application work of the intelligent traffic management system in each place can be further guided.
For the specific working principle of the reliability evaluation system of the intelligent traffic management system provided by the embodiment of the present invention, reference may be made to the foregoing description of the reliability evaluation method of the intelligent traffic management system, and details are not described here.
It will be understood that the above embodiments are merely exemplary embodiments taken to illustrate the principles of the present invention, which is not limited thereto. It will be apparent to those skilled in the art that various modifications and improvements can be made without departing from the spirit and substance of the invention, and these modifications and improvements are also considered to be within the scope of the invention.