Nothing Special   »   [go: up one dir, main page]

WO2020134392A1 - 数据分发方法、装置及存储介质 - Google Patents

数据分发方法、装置及存储介质 Download PDF

Info

Publication number
WO2020134392A1
WO2020134392A1 PCT/CN2019/111799 CN2019111799W WO2020134392A1 WO 2020134392 A1 WO2020134392 A1 WO 2020134392A1 CN 2019111799 W CN2019111799 W CN 2019111799W WO 2020134392 A1 WO2020134392 A1 WO 2020134392A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
cache area
area
distribution key
distributed
Prior art date
Application number
PCT/CN2019/111799
Other languages
English (en)
French (fr)
Inventor
黄小龙
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2020134392A1 publication Critical patent/WO2020134392A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • H04W24/08Testing, supervising or monitoring using real traffic
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W28/00Network traffic management; Network resource management
    • H04W28/02Traffic management, e.g. flow control or congestion control
    • H04W28/08Load balancing or load distribution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W28/00Network traffic management; Network resource management
    • H04W28/02Traffic management, e.g. flow control or congestion control
    • H04W28/10Flow control between communication endpoints
    • H04W28/14Flow control between communication endpoints using intermediate storage
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • the present disclosure relates to the field of communication technologies, and in particular, to a data distribution method, device, and storage medium.
  • Wireless soft data collection refers to the user terminal defined by the LTE (Long Term Evolution) specification, and is the control specification protocol data that needs to be used when transmitting user data between devices such as base stations and base station controllers.
  • LTE Long Term Evolution
  • These protocols mainly involve the LTE air interface protocol RRC (Radio Resource Control), X2AP protocol (X2 Application Protocol, application protocol) and base station measurement report data (MR).
  • RRC Radio Resource Control
  • X2AP protocol X2 Application Protocol, application protocol
  • MR base station measurement report data
  • the data of the same base station needs to be distributed to the same device or module. That is to say, when distributing data to the front-end distribution module, not only must the data be distributed to each module as evenly as possible, but also to ensure that the data of the same protocol of the same base station needs to be distributed to a specific module, otherwise the business Association analysis may be wrong.
  • the base station ID can be obtained from the header of the signaling message, and each base station is unique.
  • Protocol type information can also be obtained from the signaling message header of a protocol TYPE (type) field.
  • an initial KEY value of a data distribution (hereinafter also referred to as distribution) can be formed. Use this KEY to distribute the data of the same protocol of the same base station into the overload algorithm to the same module.
  • the above KEY value can be divided into different modules by modulo or hash operation.
  • due to the uneven data of different base stations or the inconsistent performance of the back-end modules it may cause uneven distribution or even if the distribution is uniform, but some back-end modules have low performance, and the performance of each module cannot be maximized.
  • the present disclosure provides a data distribution method, device, and storage medium to solve the problem that data distribution cannot be performed according to the actual congestion situation of the back-end module in the related art.
  • a data distribution method including: receiving data sent by a traffic aggregation adapter SCA; determining a first distribution key value KEY according to the base station identification ID and protocol type information corresponding to the data; The first distribution KEY distributes the data to each primary cache area; according to the base station ID corresponding to the data to be distributed in the primary cache area, protocol type information, and the data to be processed in each secondary cache area A second distribution KEY is determined according to the amount of data; according to the second distribution KEY, the data to be distributed in the primary cache area is distributed to each secondary cache area.
  • a data distribution apparatus including: a receiving module for receiving data sent by a traffic aggregation adapter SCA; a first determining module for a base station identification ID corresponding to the data and The protocol type information determines the first distribution key value KEY; the first distribution module is used to distribute the data to each level one cache area according to the first distribution key; the second determination module is used to determine the first level cache The second distribution KEY is determined by the base station ID corresponding to the data to be distributed in the area, the protocol type information, and the data volume of the data to be processed in each secondary cache area; the second distribution module is used to The data to be distributed in the first-level cache area is distributed to each of the second-level cache areas.
  • a device for determining data distribution including: a processor; a memory for storing processor-executable instructions; when the instructions are executed by the processor, the following operations are performed: receiving traffic The data sent by the aggregation adapter SCA; the first distribution key value KEY is determined according to the base station identification ID and the protocol type information corresponding to the data; the data is distributed to each level one cache area according to the first distribution KEY; according to the The second distribution KEY is determined by the base station ID corresponding to the data to be distributed in the first-level cache area, protocol type information, and the data volume of the data to be processed in each second-level cache area; the first-level cache is cached according to the second distribution KEY The data to be distributed in the area is distributed to each of the secondary cache areas.
  • a non-transitory computer-readable storage medium which, when instructions in the storage medium are executed by a processor, enables the processor to execute the description according to the first aspect of the present disclosure Data distribution method.
  • Figure 1 is a schematic diagram of a wireless soft system
  • Fig. 2 is a flowchart of a data distribution method according to an exemplary embodiment
  • Fig. 3 is a flowchart of a data distribution method according to an exemplary embodiment
  • Fig. 4 is a flow chart showing distributing data to be distributed in a first-level cache area to each second-level cache area according to a second distribution KEY according to an exemplary embodiment
  • Fig. 5 is a block diagram of a data distribution device according to an exemplary embodiment
  • Fig. 6 is a block diagram of a data distribution device according to an exemplary embodiment.
  • FIG. 1 is a schematic diagram of a wireless soft system.
  • the system involves an SCA (Traffic Convergence Adapter) and a data collection module , Data processing modules, data distribution modules, databases, files, and third parties.
  • the data collection module, the data processing module and the data distribution module constitute a soft mining protocol machine, and the data distribution method of the present disclosure can be executed by the soft mining protocol machine.
  • the data collection module can receive data from multiple SCA devices through SDTP (Serial Data Transport Protocol), aggregate the collected data, and distribute the data to each thread in the data processing module for processing and data processing. After the module processes the data, it distributes the data to the data distribution module according to the configuration.
  • the data distribution module then distributes the data to a write file, stores it in a database, or sends it to a third party.
  • SDTP Serial Data Transport Protocol
  • Fig. 2 is a flowchart of a data distribution method according to an exemplary embodiment. As shown in Fig. 2, the method includes the following steps:
  • Step 201 Receive data sent by SCA
  • a large amount of service signaling data of SCA equipment can be collected through the SDTP protocol multi-interface.
  • Step 202 Determine the first distribution key value KEY according to the base station ID corresponding to the data and the protocol type information;
  • the header of the signaling carrying the data can be analyzed to extract the protocol type of the data.
  • Data of different protocol types can extract different key value information.
  • base station ID in the RRC (Radio Resource Control) protocol MME_UE_S1AP_ID, S1APID in X2AP, base station ID in MR, CellID, etc.
  • the base station ID and the protocol type identifier corresponding to the data can be used as two input quantities of the hash function, so as to obtain the first distribution KEY corresponding to the data. After obtaining the first distribution KEY, according to the number of the second buffer area in the back end Modulo the first KEY to distribute data to different second buffers.
  • the first distribution KEY corresponding to the data of the RRC protocol can be calculated by the following formula:
  • RRC_KEY Hash(ENBID, MME_UE_S1AP_ID);
  • the first distribution KEY corresponding to the data of the X2AP protocol can be calculated by the following formula:
  • X2AP_KEY Hash(ENBID, CELLID);
  • the first distribution KEY corresponding to the data of the S1AP protocol can be calculated by the following formula:
  • UU_EXTERN_KEY Hash(ENBID, MME_UE_S1AP_ID, MME_GROUP_ID);
  • Step 203 Distribute the data to each primary cache area according to the first distribution KEY;
  • the first-level cache area is used for temporarily storing data and distributing data.
  • the ID of the first-level cache area can be obtained according to the following formula, so that the data to be distributed can be distributed to the corresponding to the ID First-level cache area:
  • the DISTRIBUTE_ID in the above formula indicates the ID of the first-level cache area
  • KEY is the first-level distribution KEY
  • MODULE_NUM indicates the modulus operation.
  • Step 204 Determine the second distribution KEY according to the base station ID corresponding to the data to be distributed in the primary cache area, protocol type information, and the data amount of the data to be processed in each secondary cache area;
  • a distribution KEY can be calculated according to the base station ID and protocol type information corresponding to the data to be distributed in the primary cache area, and then the data to be processed in the secondary cache area corresponding to the primary cache area The value of the distribution KEY is adjusted to obtain the second distribution KEY.
  • the second-level cache area corresponding to the first-level cache area is at least two second-level cache areas for distributing data by the first-level cache area.
  • Step 205 Distribute the data to be distributed in the primary cache area to each secondary cache area according to the second distribution KEY.
  • the first-level cache area and the second-level cache area may be the buffer area in the data acquisition module in the above soft mining protocol machine.
  • the second-level cache area may send the data to the corresponding in the data processing module Threads are processed, and each secondary cache area can correspond to different threads.
  • Protocol type information and the amount of data to be processed in the secondary cache area determines the second distribution KEY, according to the second distribution key to distribute the data to be distributed in the primary cache area to the secondary cache area, so as to achieve
  • the data backlog of the end processing module dynamically adjusts the amount of data distributed to each back-end processing module, so that load balancing can be better performed.
  • the determining the second distribution KEY according to the base station ID corresponding to the data to be distributed in the primary cache area, the protocol type information, and the data amount of the data to be processed in each secondary cache area may include:
  • the value of the adjustment factor is determined according to the data amount of the data to be processed in the first cache area and the second cache area; for example, an initial adjustment factor may be preset, and by adjusting the value of the initial adjustment factor, the current primary cache area will be determined
  • the data to be distributed is distributed to the first buffer area or the second buffer area corresponding to the buffer area, which can be adjusted in a positive direction, that is, increase the preset value on the basis of the original adjustment factor, or negatively adjusted, that is, in the original Based on the adjustment factor, the preset value is decreased to determine whether the data will be distributed to the first cache area or the second cache area.
  • Using the adjustment factor to adjust the second distribution KEY to be adjusted may be, for example, adding or subtracting the adjustment factor on the basis of the calculated second distribution KEY.
  • the second distribution KEY to be adjusted is calculated according to the base station ID and protocol type information corresponding to the data to be distributed in the first-level buffer area; wherein the calculation method of the second distribution KEY to be adjusted may be the same as the calculation method of the first distribution KEY described above, I won't repeat them here. Adjust the second distribution KEY to be adjusted using the adjustment factor to obtain the second distribution KEY.
  • the first cache area and the second cache area are a pair of second-level cache areas pre-configured corresponding to a first-level cache area.
  • the first-level cache area is a first-level cache module
  • the secondary buffer area takes the secondary buffer module as an example.
  • 31, 32, 33, 34, and 35 shown in FIG. 3 are primary buffer modules, and the pair of secondary buffer modules corresponding to 31 are: 311 and 312, a pair of secondary buffer modules corresponding to 32 are 321 and 322, a pair of secondary buffer modules corresponding to 33 are 331 and 332, and a pair of secondary buffer modules corresponding to 34 are 341 and 342, a pair of secondary buffer modules corresponding to 35 are 351 and 352, respectively.
  • the signaling header is analyzed, the information required to distribute the KEY is extracted, and the first-level distribution KEY is generated according to The number of the back-end first-level buffer modules performs modulus operation according to the above calculation formula for calculating the first-level buffer area, and distributes the data to different first-level buffer modules according to the calculation results.
  • the primary buffer module receives the data, it distributes the data to the secondary buffer module again according to the secondary distribution key.
  • the secondary buffer module passes the data to the corresponding thread in the data processing module for processing.
  • determining the value of the adjustment factor according to the data amount of the data to be processed in the first cache area and the second cache area may include: determining the first cache area and the second cache area respectively Whether the number of data packets to be processed is greater than a first threshold; the number of data packets to be processed in the first cache area is greater than the first threshold, and the number of data packets to be processed in the second cache area
  • the value of the adjustment factor is adjusted so that The amount of data distributed by the primary cache area to the second cache area is greater than the amount of data distributed to the first cache area.
  • the following is an example of the processing flow for determining the value of the adjustment factor according to the data amount of the data to be processed in the first cache area and the second cache area.
  • the first distribution key is selected to be distributed to the first cache Whether the number of unprocessed data packets in the zone reaches the set threshold M (an example of the first threshold).
  • the threshold M may be determined according to the size of the first-level cache area and the size of the data flow received by the first cache area, for example, the threshold may be positively related to the size of the first-level cache area, and the size of the threshold may be related to the received data The size of the traffic is negatively correlated.
  • the threshold value M the number of unprocessed data packets in the first cache area is not greater than the threshold value M, it means that the first cache area is relatively free, and the first cache area can process data normally, then when the data is subsequently distributed, you can choose to send the data packets To the cache. If the number of unprocessed data packets in the first cache area is greater than the threshold value M, indicating that there are more data packets in the cache, you can further determine whether the number of unprocessed data packets in the second cache area exceeds the threshold Value M.
  • the number of unprocessed data packets in the second cache area is not greater than the threshold M, indicating that the second cache area is relatively free, you can change the value of the adjustment factor so that the data is distributed to the second cache area, if the second cache The number of unprocessed data packets in the area is greater than the threshold value M, indicating that the number of data packets in the second buffer area is also large. Then, the difference between the number of unprocessed data packets in the two first buffers and the number of unprocessed data packets in the second buffer can be further calculated. If the difference between the two unprocessed data packets is greater than the threshold N (which is an example of the above second threshold). Then, the value of the adjustment factor is changed, so that the data to be distributed this time is distributed to the second-level cache area with a small amount to be processed.
  • the threshold N which is an example of the above second threshold
  • distributing the data to be distributed in the primary cache area to each secondary cache area according to the second distribution KEY may include: according to the data corresponding to the data to be distributed in the primary cache area The base station ID, the protocol type field, and the adjustment factor generate the second distribution KEY; determine whether the value of the adjustment factor occurred last time when data was distributed for a pair of second-level cache areas corresponding to the first-level cache area Change, the pair of secondary cache areas include a first cache area and a second cache area; when the value of the adjustment factor changes, the data to be distributed in the primary cache area is distributed according to the second distribution KEY Distribute to the first cache area or the second cache area; when the value of the adjustment factor changes, distribute the data to be distributed in the primary cache area to the first cache area according to the second distribution KEY The first cache area and the second cache area; the value of the adjustment factor has not changed, and the adjustment needs to be adjusted according to the amount of data to be processed in the first cache area and the second cache area When the value of the value of the
  • the second distribution KEY can be directly used to distribute the data to be distributed .
  • the process of distributing the data to be distributed in the primary cache area to each secondary cache area according to the second distribution KEY will be described below through an example in conjunction with FIG. 4.
  • a data packet is read from the primary buffer area S, the base station ID and the protocol type identifier are determined according to the packet header information, and the second distribution KEY is generated based on the base station ID, the protocol type identifier and the adjustment factor,
  • the secondary cache area A or the secondary cache area B corresponding to the primary cache area S is selected as the target cache area for sending data packets. Determine whether the value of the adjustment factor has been modified.
  • the adjustment factor has been modified, it means that when the data was previously distributed for the buffer area A or the buffer area B, the adjustment factor has been based on the amount of data to be processed in the buffer area A or the buffer area B. The value has been adjusted, so there is no need to adjust the adjustment factor. If the adjustment factor has not been modified, it is determined whether the adjustment factor value needs to be adjusted according to the amount of data to be processed in the buffer area A and the buffer area B. The determination of the value of the adjustment factor according to the data amount of the data to be processed in the first buffer area and the second buffer area is described in detail, so it will not be repeated here. In the data distribution process shown in FIG.
  • the value of the second distribution KEY is automatically adjusted according to the backlog of data in the back-end module to realize dynamic feedback adjustment and form a positive direction Feedback loop, which can ensure the balance of the distribution data, and also guarantee the need for business data distribution and rent-free business rules, and can fully utilize the performance of the back-end module.
  • the data distribution method of the embodiment of the present disclosure can distribute the data, which can improve the performance of the back-end processing module by about five times. And can improve the performance of receiving data to a certain extent.
  • Fig. 5 is a block diagram of a data distribution device according to an exemplary embodiment. As shown in Fig. 5, the device 50 includes the following components:
  • the receiving module 51 is used to receive the data sent by the traffic aggregation adapter SCA;
  • the first determining module 52 is configured to determine a first distribution key value KEY according to the base station identification ID and protocol type information corresponding to the data;
  • the first distribution module 53 is configured to distribute data to each level one cache area according to the first distribution KEY;
  • the second determination module 54 is configured to determine the second distribution KEY according to the base station ID corresponding to the data to be distributed in the primary cache area, protocol type information, and the data amount of the data to be processed in each secondary cache area;
  • the second distribution module 55 is configured to distribute the data to be distributed in the first-level cache area to each second-level cache area according to the second distribution KEY.
  • the second determining module may include: a first determining unit, configured to determine the value of the adjustment factor according to the data amount of the data to be processed in the first buffer area and the second buffer area, wherein, The first cache area and the second cache area are a pair of pre-configured second-level cache areas corresponding to a first-level cache area; a calculation unit is used to determine the base station ID corresponding to the data to be distributed in the first-level cache area 3.
  • the protocol type information is calculated to obtain a second distribution KEY to be adjusted; a first adjustment unit is used to adjust the second distribution KEY to be adjusted using the adjustment factor to obtain the second distribution KEY.
  • the first determining unit is configured to separately determine whether the number of data packets to be processed in the first cache area and the second cache area is greater than a first threshold; The number of data packets to be processed in the first buffer is greater than the first threshold, the number of data packets to be processed in the second buffer is not greater than the first threshold, and the first buffer And when the difference between the data packets to be sent in the second buffer area is greater than the second threshold, the value of the adjustment factor is adjusted so that the first-level buffer area distributes the data to be distributed to the second buffer area .
  • the second distribution module includes: a second determination unit, configured to determine the location based on the base station ID, the protocol type field, and the adjustment factor corresponding to the data to be distributed in the first-level cache area The second distribution KEY; a judgment unit for judging whether the value of the adjustment factor has changed when the data was distributed for a pair of secondary cache areas corresponding to the primary cache area last time.
  • the area includes a first cache area and a second cache area; a first distribution unit is used to distribute the data to be distributed in the first-level cache area according to the second distribution KEY when the value of the adjustment factor changes To the first cache area or the second cache area; a third determination unit, which is used when the value of the adjustment factor has not changed, and according to the first cache area and the second cache area
  • a target adjustment factor is determined according to the amount of data to be processed in the first buffer area and the second buffer area;
  • a second adjustment unit is used to use the A target adjustment factor adjusts the second distribution KEY to obtain a target distribution KEY;
  • a second distribution unit is used to distribute the data to be distributed in the first-level cache area to the first cache area according to the target distribution KEY Or the second cache area.
  • Fig. 6 is a block diagram of a device 600 for determining data distribution according to an exemplary embodiment.
  • the device 600 may be provided as a server. 6
  • the device 600 includes a processor 622, the number of which may be one or more, and a memory 632, which is used to store a computer program executable by the processor 622.
  • the computer program stored in the memory 632 may include one or more modules each corresponding to a set of instructions.
  • the processor 622 may be configured to execute the computer program to perform the above-described method of determining data distribution.
  • the device 600 may further include a power component 626 and a communication component 650, which may be configured to perform power management of the device 600, and the communication component 650 may be configured to implement communication of the device 600, for example, wired or wireless communication .
  • the device 600 may also include an input/output (I/O) interface 658.
  • the device 600 can operate an operating system based on the memory 632, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, and so on.
  • a non-transitory computer-readable storage medium including program instructions for example, a memory 632 including program instructions
  • the program instructions may be executed by the processor 622 of the device 600 to complete the above Determine the method of data distribution.
  • the data distribution method of the embodiment of the present disclosure after obtaining the first distribution KEY according to the base station ID corresponding to the data to be distributed and the protocol type information and distributing the data to the first-level cache area, then according to the data corresponding to the data to be distributed in the first-level cache area.
  • the base station ID, protocol type information and the amount of data to be processed in the secondary cache area determine the second distribution KEY, and according to the second distribution KEY, the data to be distributed in the primary cache area is distributed to the secondary cache area, thereby realizing
  • the purpose of dynamically adjusting the amount of data distributed to each back-end processing module according to the data backlog of the back-end processing module can better load balance.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

本公开提供一种数据分发方法、装置及存储介质,用以解决相关技术中无法根据线程的实际拥堵情况进行数据分发的问题。该方法包括:接收流量汇聚适配器SCA发送的数据;根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;根据所述第一分发KEY将数据分发至各一级缓存区;根据一级缓存区中待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;根据所述第二分发KEY将所述一级缓存区中待分发数据分发至各二级缓存区。

Description

数据分发方法、装置及存储介质
本公开要求享有2018年12月26日提交的名称为“数据分发方法、装置及存储介质”的中国专利申请CN201811606877.X的优先权,其全部内容通过引用并入本文中。
技术领域
本公开涉及通信技术领域,特别是涉及一种数据分发方法、装置及存储介质。
背景技术
无线软采集数据是指LTE(Long Term Evolution,长期演进)规范定义的用户终端,是基站以及基站控制器等设备之间传输用户数据时需要使用的控制规范协议数据。这些协议主要涉及LTE空口协议RRC(Radio Resource Control,无线资源控制),X2AP协议(X2Application Protocol,应用协议)和基站测量报告数据(MR)。根据业务关联处理的规则,需要将同一个基站的数据分发到相同的设备或者模块。也即前端分发模块在对数据进行分发时,不仅需要使数据尽可能均衡的分发到每个模块,同时还要保证同一个基站的同一个协议的数据需要分到某个特定的模块,否则业务关联分析可能会出错。其中,可以从信令消息的头部获取到基站ID,每个基站唯一。协议类型信息也可以从信令消息头部获取到一个协议的TYPE(类型)字段。根据基站ID以及协议类型信息可组成一个数据分流(以下也称分发)的初始KEY值。使用这个KEY将同一个基站的相同协议的数据进过负载算法分发到同一个模块。通常可将上述KEY值通过取模或者进行哈希运算的方式把数据分到不同模块。但是由于不同基站的数据可能不均衡或者后端模块性能不一致等原因,可能会导致分流不均或者即使分流均匀但是某些后端模块性能较低,不能最大化使用各个模块的性能。
发明内容
本公开提供一种数据分发方法、装置及存储介质,用以解决相关技术中无法根据后端模块的实际拥堵情况进行数据分发的问题。
根据本公开的第一个方面,提供了一种数据分发方法,包括:接收流量汇聚适配器 SCA发送的数据;根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;根据所述第一分发KEY将所述数据分发至各一级缓存区;根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区。
根据本公开的第二个方面,提供了一种数据分发装置,包括:接收模块,用于接收流量汇聚适配器SCA发送的数据;第一确定模块,用于根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;第一分发模块,用于根据所述第一分发KEY将所述数据分发至各一级缓存区;第二确定模块,用于根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;第二分发模块,用于根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区。
根据本公开的第三个方面,提供了一种确定数据分发装置,包括:处理器;用于存储处理器可执行指令的存储器;当所述指令被处理器执行时,执行如下操作:接收流量汇聚适配器SCA发送的数据;根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;根据所述第一分发KEY将所述数据分发至各一级缓存区;根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区。
根据本公开的第四个方面,提供了一种非临时性计算机可读存储介质,当所述存储介质中的指令由处理器执行时,使得处理器能够执行根据本公开第一个方面所述的数据分发方法。
附图说明
图1是无线软系统的示意图;
图2是根据一示例性实施例示出的一种数据分发方法的流程图;
图3是根据一示例性实施例示出的一种数据分发方法的流程图;
图4是根据一示例性实施例示出的根据第二分发KEY将一级缓存区中待分发的数据分发至各二级缓存区的流程图;
图5是根据一示例性实施例示出的一种数据分发装置的框图;
图6是根据一示例性实施例示出的一种数据分发装置的框图。
具体实施方式
下面将结合本公开实施例中的附图,对本公开的实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本公开一部分实施例,而不是全部的实施例。基于本公开中的实施例,本领域普通技术人员在没有作出创造性劳动的前提下所获得的所有其他实施例,都属于本公开保护的范围。
在对本公开的数据分发方法进行说明之前,首先对该方法的实施环境进行简要介绍,图1是无线软系统的示意图,如图1所示,该系统涉及SCA(流量汇聚适配器)、数据采集模块、数据处理模块、数据分发模块、数据库、文件以及第三方。其中,数据采集模块、数据处理模块以及数据分发模块构成软采协议机,本公开的数据分发方法可由该软采协议机执行。数据采集模块可通过SDTP(Serial Data Transport Protocol,串行数据传输协议)接收多个SCA设备的数据,对采集到的数据进行汇聚后将数据分发到数据处理模块中的各个线程进行处理,数据处理模块对数据进行处理完成后再根据配置将数据分发至数据分发模块,数据分发模块再将数据分发至写文件,存入数据库或送给第三方。
图2是根据一示例性实施例示出的一种数据分发方法的流程图,如图2所示,该方法包括如下步骤:
步骤201:接收SCA发送的数据;
例如,可通过SDTP协议多接口采集SCA设备的大量的业务信令数据。
步骤202:根据所述数据对应的基站ID以及协议类型信息确定第一分发关键值KEY;
例如,可对携带所述数据的信令的头部进行分析,提取出数据的协议类型。不同协议类型的数据可以提取不同关键值信息。例如,RRC(Radio Resource Control,无线资源控制)协议中的基站ID,MME_UE_S1AP_ID,X2AP中的S1APID,MR中的基站ID,CellID等等。可将数据对应的基站ID以及协议类型标识符作为哈希函数的两个输入量,从而得到该数据对应的第一分发KEY,在得到第一分发KEY后,根据后端第二缓存区的个数,对该第一KEY进行取模,从而将数据分发到不同的第二缓存区。
例如,RRC协议的数据对应的第一分发KEY可通过下式计算得到:
RRC_KEY=Hash(ENBID,MME_UE_S1AP_ID);
X2AP协议的数据对应的第一分发KEY可通过下式计算得到:
X2AP_KEY=Hash(ENBID,CELLID);
S1AP协议的数据对应的第一分发KEY可通过下式计算得到:
UU_EXTERN_KEY=Hash(ENBID,MME_UE_S1AP_ID,MME_GROUP_ID);
步骤203:根据所述第一分发KEY将数据分发至各一级缓存区;
其中,一级缓存区用于暂存数据以及分发数据,在确定出第一分发KEY后,可根据下式得出一级缓存区的ID,从而可将待分发的数据分发至该ID对应的一级缓存区:
DISTRIBUTE_ID=KEY%MODULE_NUM;
上式中的DISTRIBUTE_ID表示一级缓存区的ID,KEY为一级分发KEY,MODULE_NUM表示取模运算。
步骤204:根据一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;
在步骤204中,可根据一级缓存区中的待分发数据对应的基站ID、协议类型信息先计算出一个分发KEY,然后再根据该一级缓存区对应的二级缓存区中待处理的数据量对该分发KEY的值进行调整,得到第二分发KEY。其中,与一级缓存区对应的二级缓存区为被该一级缓存区分发数据的至少两个二级缓存区。
步骤205:根据所述第二分发KEY将所述一级缓存区中待分发数据分发至各二级缓存区。
其中,一级缓存区以及二级缓存区可以是上述软采协议机中的数据采集模块中的缓存区,二级缓存区在接收到分发数据后,可将数据发送至数据处理模块中对应的线程进行处理,各二级缓存区可对应不同的线程。
本公开的数据分发方法,在根据待分发数据对应的基站ID以及协议类型信息得到第一分发KEY将数据分发至一级缓存区之后,再根据一级缓存区中待分发的数据对应的基站ID、协议类型信息以及二级缓存区中待处理的数据量确定出第二分发KEY,根据该第二分发KEY将一级缓存区中待分发的数据分发至二级缓存区,从而实现了根据后端处理模块的数据积压情况动态调节分发至各后端处理模块的数据量的目的,能够更好的进行负载均衡。
在一种可实现方式中,所述根据一级缓存区中待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY,可包括:根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值;例如,可预先设置一个初始调节因子,通过调整该初始调节因子的值可决定当前一级缓存区将待分发数据分发给与该以及缓存区对应的第一缓存区或第二缓存区,可通过正向调节,即在原始调节因子 的基础上增大预设数值,或负向调节,即在原始调节因子的基础上减小预设数值来确定数据将被分发至第一缓存区还是第二缓存区。使用调节因子对待调节的第二分发KEY进行调节例如可以是在计算得到的第二分发KEY的基础上加上或减去调节因子。根据一级缓存区中待分发数据对应的基站ID、协议类型信息计算得到待调节的第二分发KEY;其中,待调节的第二分发KEY的计算方式可同上述第一分发KEY的计算方式,此处不再赘述。使用所述调节因子对所述待调节的第二分发KEY进行调节,得到所述第二分发KEY。
其中,所述第一缓存区以及所述第二缓存区为预先配置的与一个一级缓存区对应的一对二级缓存区,如图3中所示,一级缓存区以一级缓冲模块为例,二级缓存区以二级缓冲模块为例,其中,图3中所示的31、32、33、34以及35为一级缓冲模块,与31对应的一对二级缓冲模块分别为311以及312,与32对应的一对二级缓冲模块分别为321以及322,与33对应的一对二级缓冲模块分别为331以及332,与34对应的一对二级缓冲模块分别为341以及342,与35对应的一对二级缓冲模块分别为351以及352。在图3所示的数据分发流程中,在通过SDTP传送协议接口程序,汇聚接收到的所有SCA的数据后,分析信令头部,提取分发KEY所需要的信息,生成一级分发KEY,根据后端一级缓冲模块的数量,根据上述计算一级缓存区的算式进行取模运算,根据运算结果将数据分发到不同的一级缓冲模块。一级缓冲模块接收到数据后,根据二级分发KEY再次把数据分发到二级缓冲模。二级缓冲模块再把数据传递给数据处理模块中对应的线程进行处理。
在一种可实现方式中,根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值可包括:分别确定所述第一缓存区以及所述第二缓存区中待处理的数据包的个数是否大于第一阈值;在所述第一缓存区中待处理的数据包的个数大于所述第一阈值,所述第二缓存区中待处理的数据包的个数不大于所述第一阈值,且所述第一缓存区以及所述第二缓存区中待发的送数据包之差大于第二阈值时,调整所述调节因子的值,以使由所述一级缓存区分发至所述第二缓存区的数据量大于分发至所述第一缓存区的数据量。以下通过一个例子对根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值的处理流程,在该例子中,判断根据第一分发KEY选择被分发到第一缓存区还未处理的数据包的数量是否达到设定的阀值M(为第一阈值的一个示例)。该阀值M可根据一级缓存区的大小以及第一缓存区接收数据的流量的大小进行确定,例如,该阈值可以与一级缓存区的大小呈正相关关系,该阈值的大小可以与接收数据的流量的大小呈负相关关系。如果第一缓存区中还未处理的数据包的数量不大于阈值M,说明该第一缓存区比较空闲,该第一缓存区可以正常处理数据,则后续分发数据时,可选择将数据包发送到该缓 存区。如果第一缓存区中还未处理的数据包的数量大于阀值M,说明该缓存中数据包个数较多,则可进一步判断第二缓存区中未处理的数据包的个数是否超过阀值M。如果第二缓存区中未处理的数据包的个数不大于阀值M,说明第二缓存区比较空闲,则可改变调节因子的值,使数据被分发至第二缓存区,如果第二缓存区中未处理的数据包的个数大于阀值M,说明第二缓存区中的数据包的个数也较多。则可进一步计算两个第一缓存区中未处理的数据包数量与第二缓存区中未处理的数据包数量之间的差值。若二者未处理数据包之差大于阀值N(为上述第二阈值的一个示例)。则改变调节因子的值,从而使得本次待分发的数据被分发至待处理数量较少的二级缓存区。
在一种可实现方式中,根据所述第二分发KEY将所述一级缓存区中待分发的数据分发至各二级缓存区可包括:根据所述一级缓存区中待分发数据对应的基站ID、协议类型字段以及所述调节因子生成所述第二分发KEY;判断上一次为与所述一级缓存区对应的一对二级缓存区分发数据时,所述调节因子的值是否发生更改,该一对二级缓存区包括第一缓存区以及第二缓存区;在所述调节因子的值发生更改时,根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区或所述第二缓存区;在所述调节因子的值发生更改时,根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区以及所述第二缓存区;在所述调节因子的值未发生更改,且根据所述第一缓存区以及所述第二缓存区中待处理的数据量确定需调整所述调节因子的值时,根据所述第一缓存区以及所述第二缓存区中待处理的数据量确定目标调节因子;使用所述目标调节因子对所述第二分发KEY进行调节,得到目标分发KEY;根据所述目标分发KEY将所述一级缓存区的待分发数据分发至所述第一缓存区或所述第二缓存区。在根据第一缓存区以及第二缓存区中待处理的数据量确定无需调整调节因子的值时,则无需对第二分发KEY进行调节,可直接使用所述第二分发KEY对待分发数据进行分发。
以下结合图4通过一个例子对根据第二分发KEY将一级缓存区中待分发的数据分发至各二级缓存区的处理过程进行描述。如图4所示,从一级缓存区S读取一个数据包,根据数据包头部信息确定基站ID以及协议类型标识符,根据基站ID、协议类型标识符以及调节因子,生成第二分发KEY,根据第二分发KEY,选择与一级缓存区S对应的二级缓存区A或二级缓存区B,作为发送数据包的目标缓存区。判断调节因子的值是否修改过,如果调节因子修改过,则说明在之前为缓存区A或缓存区B分发数据时,已经基于缓存区A或缓存区B中待处理的数据量对调节因子的值进行调节过,故无需再对该调节因子进行调节,如果调节因子没有修改过,则根据缓存区A以及缓存区B中待处理的数 据量判断是否需要调整调节因子的值,鉴于上文已经对根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值进行了详细的说明,故此处不再赘述。在图4所示的数据分发流程中,考虑到后端模块的处理能力不同,根据后端模块中数据的积压情况对第二分发KEY的值进行自动调整,实现了动态反馈调节,形成正向的反馈环,从而可保证分发数据的均衡性,同时也保证了业务数据的分发免租业务规则的需要,以及可充分利用后端模块的性能。
相关实验数据表明,在系统采用相同的后端模块的情况下,通过本公开实施例的数据分发方法对数据进行分发,可使后端的处理模块的性能提升大概五倍。且可在一定程度上提升接收数据的性能。
图5是根据一示例性实施例示出的一种数据分发装置的框图,如图5所示,该装置50包括如下组成部分:
接收模块51,用于接收流量汇聚适配器SCA发送的数据;
第一确定模块52,用于根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;
第一分发模块53,用于根据所述第一分发KEY将数据分发至各一级缓存区;
第二确定模块54,用于根据一级缓存区中待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;
第二分发模块55,用于根据所述第二分发KEY将所述一级缓存区中待分发数据分发至各二级缓存区。
在一种可实现方式中,所述第二确定模块可包括:第一确定单元,用于根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值,其中,所述第一缓存区以及所述第二缓存区为预先配置的与一个一级缓存区对应的一对二级缓存区;计算单元,用于根据一级缓存区中待分发数据对应的基站ID、协议类型信息计算得到待调节的第二分发KEY;第一调节单元,用于使用所述调节因子对所述待调节的第二分发KEY进行调节,得到所述第二分发KEY。
在一种可实现方式中,所述第一确定单元用于:分别确定所述第一缓存区以及所述第二缓存区中待处理的数据包的个数是否大于第一阈值;在所述第一缓存区中待处理的数据包的个数大于所述第一阈值,所述第二缓存区中待处理的数据包的个数不大于所述第一阈值,且所述第一缓存区以及所述第二缓存区中待发的送数据包之差大于第二阈值时,调整所述调节因子的值,以使所述一级缓存区将待分发数据分发至所述第二缓存区。
在一种可实现方式中,所述第二分发模块,包括:第二确定单元,用于根据所述一级缓存区中待分发数据对应的基站ID、协议类型字段以及所述调节因子确定所述第二分发KEY;判断单元,用于判断上一次为与所述一级缓存区对应的一对二级缓存区分发数据时,所述调节因子的值是否发生更改,该一对二级缓存区包括第一缓存区以及第二缓存区;第一分发单元,用于在所述调节因子的值发生更改时,根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区或所述第二缓存区;第三确定单元,用于在所述调节因子的值未发生更改,且根据所述第一缓存区以及所述第二缓存区中待处理的数据量确定需调整所述调节因子的值时,根据所述第一缓存区以及所述第二缓存区中待处理的数据量确定目标调节因子;第二调节单元,用于使用所述目标调节因子对所述第二分发KEY进行调节,得到目标分发KEY;第二分发单元,用于根据所述目标分发KEY将所述一级缓存区的待分发数据分发至所述第一缓存区或所述第二缓存区。
图6是根据一示例性实施例示出的一种确定数据分发的装置600的框图。例如,装置600可以被提供为一服务器。参照图6,装置600包括处理器622,其数量可以为一个或多个,以及存储器632,用于存储可由处理器622执行的计算机程序。存储器632中存储的计算机程序可以包括一个或一个以上的每一个对应于一组指令的模块。此外,处理器622可以被配置为执行该计算机程序,以执行上述的确定数据分发的方法。
另外,装置600还可以包括电源组件626和通信组件650,该电源组件626可以被配置为执行装置600的电源管理,该通信组件650可以被配置为实现装置600的通信,例如,有线或无线通信。此外,该装置600还可以包括输入/输出(I/O)接口658。装置600可以操作基于存储在存储器632的操作系统,例如Windows ServerTM,Mac OS XTM,UnixTM,LinuxTM等等。
在另一示例性实施例中,还提供了一种包括程序指令的非临时性计算机可读存储介质,例如包括程序指令的存储器632,上述程序指令可由装置600的处理器622执行以完成上述的确定数据分发的方法。
本公开实施例的数据分发方法,在根据待分发数据对应的基站ID以及协议类型信息得到第一分发KEY将数据分发至一级缓存区之后,再根据一级缓存区中待分发的数据对应的基站ID、协议类型信息以及二级缓存区中待处理的数据量确定出第二分发KEY,根据该第二分发KEY将一级缓存区中待分发的数据分发至二级缓存区,从而实现了根据后端处理模块的数据积压情况动态调节分发至各后端处理模块的数据量的目的,能够更好的进行负载均衡。
尽管为示例目的,已经公开了本公开的优选实施例,本领域的技术人员将意识到各种改进、增加和取代也是可能的,因此,本公开的范围应当不限于上述实施例。

Claims (10)

  1. 一种数据分发方法,其中,包括:
    接收流量汇聚适配器SCA发送的数据;
    根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;
    根据所述第一分发KEY将所述数据分发至各一级缓存区;
    根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;
    根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区。
  2. 根据权利要求1所述的方法,其中,根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY,包括:
    根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值,其中,所述第一缓存区以及所述第二缓存区为预先配置的与一个所述一级缓存区对应的一对二级缓存区;
    根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息确定待调节的第二分发KEY;
    使用所述调节因子对所述待调节的第二分发KEY的值进行调整,得到所述第二分发KEY。
  3. 根据权利要求2所述的方法,其中,根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值,包括:
    分别确定所述第一缓存区以及所述第二缓存区中待处理的数据包的个数是否大于第一阈值;
    在所述第一缓存区中待处理的数据包的个数大于所述第一阈值,所述第二缓存区中待处理的数据包的个数不大于所述第一阈值,且所述第一缓存区以及所述第二缓存区中待发的送数据包之差大于第二阈值时,调整所述调节因子的值,以使所述一级缓存区将待分发数据分发至所述第二缓存区。
  4. 根据权利要求1至3任一项所述的方法,其中,根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区,包括:
    根据所述一级缓存区中的待分发数据对应的基站ID、协议类型字段以及所述调节因 子确定所述第二分发KEY;
    判断上一次为与所述一级缓存区对应的一对二级缓存区分发数据时,所述调节因子的值是否发生更改,该一对二级缓存区包括第一缓存区以及第二缓存区;
    在所述调节因子的值发生更改时,根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区或所述第二缓存区;
    在所述调节因子的值未发生更改,且根据所述第一缓存区以及所述第二缓存区中待处理的数据的数据量确定需调整所述调节因子的值时,根据所述第一缓存区以及所述第二缓存区中待处理的数据的数据量确定目标调节因子;
    使用所述目标调节因子对所述第二分发KEY进行调节,得到目标分发KEY;
    根据所述目标分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区或所述第二缓存区。
  5. 一种数据分发装置,其中,包括:
    接收模块,用于接收流量汇聚适配器SCA发送的数据;
    第一确定模块,用于根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;
    第一分发模块,用于根据所述第一分发KEY将所述数据分发至各一级缓存区;
    第二确定模块,用于根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;
    第二分发模块,用于根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区。
  6. 根据权利要求5所述的装置,其中,所述第二确定模块,包括:
    第一确定单元,用于根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值,其中,所述第一缓存区以及所述第二缓存区为预先配置的与一个所述一级缓存区对应的一对二级缓存区;
    计算单元,用于根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息确定得到待调节的第二分发KEY;
    第一调节单元,用于使用所述调节因子对所述待调节的第二分发KEY的值进行调整,得到所述第二分发KEY。
  7. 根据权利要求6所述的装置,其中,所述第一确定单元用于:
    分别确定所述第一缓存区以及所述第二缓存区中待处理的数据包的个数是否大于第 一阈值;
    在所述第一缓存区中待处理的数据包的个数大于所述第一阈值,所述第二缓存区中待处理的数据包的个数不大于所述第一阈值,且所述第一缓存区以及所述第二缓存区中待发的送数据包之差大于第二阈值时,调整所述调节因子的值,以使所述一级缓存区将待分发数据分发至所述第二缓存区。
  8. 根据权利要求5至7任一项所述的装置,其中,所述第二分发模块,包括:
    第二确定单元,用于根据所述一级缓存区中的待分发数据对应的基站ID、协议类型字段以及所述调节因子确定所述第二分发KEY;
    判断单元,用于判断上一次为与所述一级缓存区对应的一对二级缓存区分发数据时,所述调节因子的值是否发生更改,该一对二级缓存区包括第一缓存区以及第二缓存区;
    第一分发单元,用于在所述调节因子的值发生更改时,根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区或所述第二缓存区;
    第三确定单元,用于在所述调节因子的值未发生更改,且根据所述第一缓存区以及所述第二缓存区中待处理的数据的数据量确定需调整所述调节因子的值时,根据所述第一缓存区以及所述第二缓存区中待处理的数据的数据量确定目标调节因子;
    第二调节单元,用于使用所述目标调节因子对所述第二分发KEY进行调节,得到目标分发KEY;
    第二分发单元,用于根据所述目标分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区或所述第二缓存区。
  9. 一种数据分发装置,其中,包括:
    处理器;
    用于存储处理器可执行指令的存储器;
    当所述指令被处理器执行时,执行如下操作:
    接收流量汇聚适配器SCA发送的数据;
    根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;
    根据所述第一分发KEY将所述数据分发至各一级缓存区;
    根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;
    根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区。
  10. 一种存储介质,当所述存储介质中的指令由处理器执行时,能够实现根据权利要 求1至4中任一项所述的方法的步骤。
PCT/CN2019/111799 2018-12-26 2019-10-18 数据分发方法、装置及存储介质 WO2020134392A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811606877.XA CN111372277B (zh) 2018-12-26 2018-12-26 数据分发方法、装置及存储介质
CN201811606877.X 2018-12-26

Publications (1)

Publication Number Publication Date
WO2020134392A1 true WO2020134392A1 (zh) 2020-07-02

Family

ID=71126834

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/111799 WO2020134392A1 (zh) 2018-12-26 2019-10-18 数据分发方法、装置及存储介质

Country Status (2)

Country Link
CN (1) CN111372277B (zh)
WO (1) WO2020134392A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115134767B (zh) * 2021-03-11 2024-02-09 上海大唐移动通信设备有限公司 提升信令软采集设备性能的方法、装置及存储介质
CN114363198B (zh) * 2022-01-14 2023-07-21 深圳市优网科技有限公司 数据采集方法及装置、存储介质及电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101420462A (zh) * 2008-12-11 2009-04-29 中国移动通信集团北京有限公司 一种数据分发方法及系统
CN105095109A (zh) * 2014-05-21 2015-11-25 华为技术有限公司 缓存访问方法、缓存访问路由器和计算机系统
CN105681864A (zh) * 2015-12-31 2016-06-15 惠州市伟乐科技股份有限公司 一种基于ip的传输流抖动去除方法及装置
CN107193909A (zh) * 2017-05-08 2017-09-22 杭州东方通信软件技术有限公司 数据处理方法及系统
CN107526816A (zh) * 2017-08-28 2017-12-29 阿里巴巴集团控股有限公司 一种流式分发记录的保存方法、装置及电子设备

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101277477B (zh) * 2008-04-29 2012-04-04 华为技术有限公司 一种均衡流量的方法、装置及系统
CN101605123A (zh) * 2008-06-11 2009-12-16 中兴通讯股份有限公司 一种scsi分布式通信模型
CN103347075B (zh) * 2013-07-02 2016-06-08 北京金和软件股份有限公司 一种数据多级缓存处理方法
CN103365691B (zh) * 2013-07-12 2016-07-06 中国人民解放军总参谋部第六十三研究所 基于分布式存储的sca组件加载装置及加载方法
CN104427534B (zh) * 2013-09-06 2018-06-12 中国移动通信集团公司 长期演进软采的检测方法及可移动检测装置
WO2015156758A1 (en) * 2014-04-07 2015-10-15 Hitachi, Ltd. Method and apparatus of cache promotion between server and storage system
CN104539475B (zh) * 2014-12-09 2018-02-23 上海大唐移动通信设备有限公司 一种确定sca采集数据正确性的方法及装置
CN105183394B (zh) * 2015-09-21 2018-09-04 北京奇虎科技有限公司 一种数据存储处理方法和装置
CN105512216A (zh) * 2015-11-30 2016-04-20 青岛海尔智能家电科技有限公司 数据存储和读取方法、装置及系统
CN106598882B (zh) * 2016-12-09 2019-09-20 武汉斗鱼网络科技有限公司 一种安全的内存数据保护方法及装置
CN107622115B (zh) * 2017-09-19 2019-11-26 武大吉奥信息技术有限公司 一种面向wfs服务的空间查询结果缓存方法
CN108256088A (zh) * 2018-01-23 2018-07-06 清华大学 一种基于键值数据库的时序数据的存储方法及系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101420462A (zh) * 2008-12-11 2009-04-29 中国移动通信集团北京有限公司 一种数据分发方法及系统
CN105095109A (zh) * 2014-05-21 2015-11-25 华为技术有限公司 缓存访问方法、缓存访问路由器和计算机系统
CN105681864A (zh) * 2015-12-31 2016-06-15 惠州市伟乐科技股份有限公司 一种基于ip的传输流抖动去除方法及装置
CN107193909A (zh) * 2017-05-08 2017-09-22 杭州东方通信软件技术有限公司 数据处理方法及系统
CN107526816A (zh) * 2017-08-28 2017-12-29 阿里巴巴集团控股有限公司 一种流式分发记录的保存方法、装置及电子设备

Also Published As

Publication number Publication date
CN111372277B (zh) 2023-07-14
CN111372277A (zh) 2020-07-03

Similar Documents

Publication Publication Date Title
US10511535B2 (en) Data transmission control node, communications system, and data transmission management method
US10841815B2 (en) Link control node and method, and communications system
EP3611962B1 (en) Quality of service control method and device
US11172399B2 (en) Default quality of service (QoS) control method and device
WO2017070970A1 (zh) 一种确定路由的方法、对应装置及系统
US12022320B2 (en) Data processing method and apparatus
US20230413103A1 (en) Quality of service implementations for separating user plane
US20190260827A1 (en) Edge computing system, edge server, and system control method
EP3138319B1 (en) Insertion and use of application or radio information in network data packet headers
US20200359255A1 (en) Quality of service (qos) control method and related device
WO2020134392A1 (zh) 数据分发方法、装置及存储介质
EP4236446A2 (en) Data distribution method, device and system
US20210328887A1 (en) Method for performing task processing on common service entity, common service entity, apparatus and medium for task processing
JP2024026066A (ja) 通信端末、及びプログラム
CN112188553B (zh) 一种5g系统的数据传输方法及装置
WO2020088543A1 (zh) 网络接入方法及装置
US10582410B2 (en) Predicting downlink throughput
JP2011045046A (ja) スイッチング方法及び装置
WO2018018641A1 (zh) 数据业务的数据传输方法和装置
JP6298013B2 (ja) ポリシー制御システム、および、ポリシー制御方法
CN109475007A (zh) 数据分发方法、用户终端及计算机可读存储介质
WO2017166031A1 (zh) 区分接入网的方法、装置及计算机可读存储介质
US11496397B2 (en) Transparent quantitative congestion control
CN117580110A (zh) 数据包的处理方法、系统、用户面功能及应用功能网元
JP2014241552A (ja) 圧縮指示装置、配信システム、圧縮指示方法、及び、圧縮指示プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19904290

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16/11/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19904290

Country of ref document: EP

Kind code of ref document: A1