CN112463573A - Method, device, terminal and storage medium for testing application - Google Patents
Method, device, terminal and storage medium for testing application Download PDFInfo
- Publication number
- CN112463573A CN112463573A CN201910843592.6A CN201910843592A CN112463573A CN 112463573 A CN112463573 A CN 112463573A CN 201910843592 A CN201910843592 A CN 201910843592A CN 112463573 A CN112463573 A CN 112463573A
- Authority
- CN
- China
- Prior art keywords
- test
- application
- terminal
- installation information
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 394
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000009434 installation Methods 0.000 claims abstract description 119
- 238000010998 test method Methods 0.000 claims abstract description 17
- 238000004891 communication Methods 0.000 claims description 40
- 230000004044 response Effects 0.000 claims description 13
- 230000008569 process Effects 0.000 abstract description 9
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 14
- 230000006870 function Effects 0.000 description 9
- 238000004590 computer program Methods 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 5
- 238000005259 measurement Methods 0.000 description 4
- 238000012423 maintenance Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000001186 cumulative effect Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present disclosure relates to the field of computer technologies, and in particular, to a method, an apparatus, a terminal, and a storage medium for testing an application. The method for testing the application comprises the following steps: firstly, acquiring installation information of an application, secondly, designating a terminal meeting a preset condition as a test terminal and sending the installation information to the test terminal, and finally, receiving a test result and clustering the test result after the test is finished. Therefore, the application test method provided by the disclosure can screen out the test users meeting the conditions and cluster the test results, can acquire and maintain the test users at low cost, and can conveniently and quickly process the test feedback of the users.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a method, an apparatus, a terminal, and a storage medium for testing an application.
Background
The application test is an important link in the life cycle of an application program, the existing application test platform is high in cost and long in time consumption, the distribution channel of an application test packet is not sufficiently controlled, the maintenance difficulty of a test user is finally high, no matter from-end monitoring data collection or user feedback collection is realized, an effective sample set cannot be formed, and the application test packet cannot be exposed in a short time.
Disclosure of Invention
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
In one aspect, the present disclosure provides a method of testing an application, the method comprising:
acquiring installation information of a first application, wherein the first application is a test version application of an application to be tested;
designating a terminal meeting a preset condition as a test terminal;
sending the installation information to the test terminal;
receiving a test result of the first application returned by the test terminal;
and clustering the test results.
In a second aspect, the present disclosure provides an apparatus for testing an application, the apparatus comprising:
the information acquisition unit is configured to acquire installation information of a first application, wherein the first application is a test version application of an application to be tested;
a terminal determining unit configured to designate a terminal satisfying a preset condition as a test terminal;
an information sending unit configured to send the installation information to the test terminal;
a feedback receiving unit configured to receive a test result of the first application returned by the test terminal;
and the feedback classification unit is configured to cluster the test results.
In a third aspect, the present disclosure provides a server for testing an application, the server comprising:
the device comprises a first communication unit, a second communication unit and a third communication unit, wherein the first communication unit is configured to receive installation information and a white list of a first application, the first application is a test version application of an application to be tested, and the white list comprises a device number of a test terminal;
the second communication unit is configured to receive a test request sent by the test terminal, and the test request comprises the equipment number;
and the control unit is configured to control the second communication unit to send the installation information to the test terminal when the device number of the test request is the device number in the white list.
In a fourth aspect, the present disclosure provides a system for testing an application, the system comprising:
the above-mentioned device for testing applications, and
the server for testing the application.
In a fifth aspect, the present disclosure provides a terminal, wherein the test terminal includes:
at least one memory and at least one processor;
the memory is used for storing program codes, and the processor is used for calling the program codes stored in the memory to execute the method of the test application.
In a sixth aspect, the present disclosure provides a non-transitory computer storage medium characterized in that the computer storage medium stores program code for executing the method of the test application described above.
The method for testing the application comprises the following steps: firstly, acquiring installation information of an application, secondly, designating a terminal meeting a preset condition as a test terminal and sending the installation information to the test terminal, and finally, receiving a test result and clustering the test result after the test is finished. Therefore, the application test method provided by the disclosure can screen out the test users meeting the conditions and cluster the test results, can acquire and maintain the test users at low cost, and can conveniently and quickly process the test feedback of the users.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.
FIG. 1 is a flow chart of a method of testing an application provided by an embodiment of the present disclosure;
fig. 2 is a flowchart of a method for determining a test terminal according to an embodiment of the present disclosure;
fig. 3 is a signal flow diagram of a system for testing an application provided by an embodiment of the present disclosure;
FIG. 4 is a signal flow diagram of a system for testing an application provided by another embodiment of the present disclosure;
FIG. 5 is a signal flow diagram of a system for testing an application provided by yet another embodiment of the present disclosure;
FIG. 6 is a signal flow diagram of a system for testing applications provided by yet another embodiment of the present disclosure;
FIG. 7 is a schematic structural diagram of an apparatus for testing applications provided by an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of an apparatus for determining a test terminal according to an embodiment of the present disclosure;
FIG. 9 is a schematic structural diagram of a system for testing applications according to an embodiment of the present disclosure;
fig. 10 is a schematic structural diagram of an electronic device for implementing an embodiment of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
Referring to fig. 1, a method 100 for testing an application provided by an embodiment of the present disclosure is shown, including steps S101-S105:
step S101: acquiring installation information of a first application, wherein the first application is a test version application of an application to be tested. The installation information is information which is used for directly or helping to obtain a page or a way which can download or test the first application, and comprises an invitation code required for downloading the application, a link of an application program installation package, and a link of a detail page of the first application in a third-party application program, wherein the third-party application program is used for downloading or testing the first application. The user can download the first application or enter a download page of the application through the installation information of the first application, taking an Android platform as an example, the installation information may be an apk link of an installation package or an invitation link of Google Play, and the user can directly download the installation package of the first application or enter a detail page of the first application in Google Play by clicking the link. The installation information may be entered manually, for example, by entering a configuration file containing the installation information, or by receiving installation information transmitted by another server. In addition, the installation information is usually sent to the test mailbox by a third-party application program through a mail, so the installation information can be received by setting a special mailbox service, and then the installation information is obtained by performing batch analysis on the mail in the mailbox service through executing a script program. It should be noted that the above-mentioned obtaining manner of the installation information is intended to exemplarily describe the embodiment of the present disclosure, and the installation information may also be obtained by other manners, which is not limited to this embodiment of the present disclosure.
Step S102: and designating the terminal meeting the preset condition as a test terminal. The test terminal is a user terminal selected to participate in the application test, and corresponding conditions can be set according to specific requirements of the application test to screen out a suitable test terminal.
Step S103: and sending the installation information to the test terminal. Among them, the manner of transmitting the installation information includes directly transmitting the installation information through an end-to-end, and transmitting the installation information through a third terminal such as a server.
Step S104: and receiving a test result of the first application returned by the test terminal. The way for the receiving terminal to return the test result includes directly receiving the test result sent by the terminal, and receiving the test result sent by the terminal and transmitted through a third terminal such as a server.
Step S105: and clustering the test results. The test results fed back by the user usually have lower normativity and comprise redundant information which is not needed by related tests, and the workload of subsequent manual examination can be greatly reduced by clustering the test results. The test results can be clustered according to the device number of the test terminal, the activity of the first application and the associated application thereof on the terminal, or the similarity of the semantic units in the test results or the complete meaning units formed by combining the semantic units. It should be noted that the above clustering manner is intended to exemplarily illustrate the embodiment of the present disclosure, and clustering may also be performed in other manners, which is not limited to this in the embodiment of the present disclosure.
Therefore, the application test method provided by the disclosure can screen out the test users meeting the conditions and cluster the test results, can acquire and maintain the test users at low cost, and can conveniently and quickly process the test feedback of the users.
As shown in fig. 2, in some embodiments of the present disclosure, step S102 may further include:
step S201: and receiving the equipment number and the active information of the terminal of the client terminal provided with the second application, wherein the active information is the information of using the second application by the terminal.
Step S202: designating a terminal with active information meeting preset conditions as a test terminal;
step S203: a white list is created containing the device numbers of the test terminals.
The second application may be a formal application published before the application to be tested, or may be a related application of the first application, for example, applications developed or published by the same company or related companies. The device number of the terminal is a unique ID generated for the terminal, and each device number corresponds to a unique client of the second application. The active information is information that the terminal uses the second application, and mainly includes information about frequency or duration of use of the second application on a specific terminal, for example, the number of times the second application is clicked within a period of time on the user terminal, the screen use duration, and the like. The device number and the active information may be generated by an SDK built in the client and acquired via a relevant server, and the device number may also be generated by a specific server and assigned to the client.
In this way, in the embodiment of the present disclosure, the test terminal (user) whose active information meets the preset condition is regarded as a faithful user to help the application test, and the created white list may include some or all user terminals meeting the preset condition, which may be used not only as a basis for determining the test terminal at this time, but also as a dedicated user pool to be applied to the test of the application of the subsequent version, so that the application test efficiency may be improved, and the test user may be maintained.
On the basis of the above technical solution, step S103 includes:
step B1: and sending the installation information to the client of the second application installed on the test terminal.
Further, step B1 includes:
step B10: receiving a test request sent by a client, wherein the test request comprises a device number;
step B20: and when the equipment number of the test request is the equipment number in the white list, sending installation information to the client.
The method comprises the steps of detecting a device number in a test request sent by a client to determine whether the client is a client on a test terminal.
When the installation information can be commonly used for a plurality of test terminals, that is, a plurality of test terminals can use the same installation information, step B20 may include:
step B201: and sending a test invitation to the client, wherein the test invitation comprises installation information.
After receiving the test invitation, the client may display the test invitation in the form of an application popup, for example, the application popup may include a "lovely user, honestly invite you to participate in the first internal test of the application", a new function introduction, an internal test step guidance, a reward plan, and other documents, a control for agreeing to participate in or canceling the popup, and the like; the installation information can be contained in the test invitation or issued to the user together with the test invitation, and after the user clicks 'participate in internal test', the installation package of the first application can be directly downloaded or a related download page can be entered.
When the installation information is a private link, i.e. can only be used by the same test terminal, step B20 may include:
step B211: and sending a test invitation to the client.
Step B212: receiving an execution request which is sent by a client and responds to the test invitation;
step B213: and sending the installation information to the client in response to the execution request.
Therefore, when the installation information is the private link, the installation information can be effectively and timely utilized by sending the installation information to the test terminal after the user determines to execute the test, and the waste of the installation information is avoided.
In some embodiments, the step S103 includes uploading the installation information and the white list to the server, so that the server sends the installation information to the terminal according to the white list.
In some embodiments, the preset conditions of the present disclosure include one or more of: whether the installation time of the second application exceeds the set duration, whether the second application is active within the set time period, whether the terminal participates in the test of the second application, whether the number of times that the terminal participates in the test of the second application exceeds a specific number, whether the terminal rejects the test of the second application, and whether the number of times that the terminal rejects the test of the second application exceeds the specific number. And judging whether the second application is active in the set time period according to the use times and/or the use time of the second application in the set time period. For example, a terminal that has an installation time of more than 1 year, a cumulative use time of more than 4 hours in the past 48 hours, and participates in the second application test may be designated as a test terminal.
In some embodiments, clustering the test results may include: by tagging the test results; and clustering the test results according to the labels. The semantic recognition may be to perform keyword search on the test result, and read one or more specific keywords, such as "card", "Bug", "delay", and the like. Furthermore, semantic recognition may also be recognition of a complete meaning unit formed by a semantic unit or a combination of semantic units, wherein the semantic unit includes a combination of words, phrases and phrases, which reflects core meanings in a text, for example, in the sentence "Bug often appears every time a user slides to the left on a certain picture", key points which the user wants to express are "slide to the left a certain picture" and "certain picture Bug", that is, a semantic unit. In the embodiment, core contents of the test results can be better captured through recognition of the semantic units, so that the test results are accurately classified. In addition, semantic units of the text can be extracted through a convolutional neural network algorithm or semantic recognition can be carried out through machine learning. The labels of the disclosed embodiment may be recognized keywords or semantic units and their approximate meanings, and the corresponding label of each test result may contain one or more.
Specific implementations of the embodiments of the present disclosure will be described in detail below.
Embodiment of the System
Referring to fig. 3, an inline system 300 provided according to an embodiment of the present disclosure is illustrated, including an inline platform 10 and a terminal 20.
In step S301, the internal test platform 10 obtains installation information of a first application, where the first application is a testboard application of an application to be tested.
In step S302, the internal test platform 10 creates a white list including the device number of the test terminal according to the preset condition. The specific implementation process of creating the white list may refer to the related description in the foregoing embodiments, and details are not repeated here.
In step S303, the terminal 20 sends a test request to the internal test platform 10, where the test request includes a device number; accordingly, the internal test platform 10 accepts the test request.
In step S304, the internal test platform 10 determines whether the device number in the test request is a device number in the white list; if yes, step S305 is executed, and the internal test platform 10 sends a test invitation to the terminal 20, where the test invitation includes the installation information.
In step S306, the terminal 20 jumps to the download interface of the first application according to the installation information in response to the instruction of the user to execute the test invitation.
In step S307, after the test is completed, the terminal 20 sends the test result of the first application to the internal test platform 10, and accordingly, the internal test platform 10 receives the test result of the first application.
In step 308, the internal test platform 10 automatically classifies the test results.
Second embodiment of the System
Referring to fig. 4, an inline system 400 provided in another embodiment of the present disclosure is shown, which includes an inline platform 10 and a terminal 20.
In step S401, the internal test platform 10 acquires installation information of the first application.
In step S402, the internal test platform 10 creates a white list including the device number of the test terminal according to the preset condition. The specific implementation process of creating the white list may refer to the related description in the foregoing embodiments, and details are not repeated here.
In step S403, the terminal 20 sends a test request to the internal test platform 10, where the test request includes a device number; accordingly, the internal test platform 10 receives the test request.
In step S404, the internal test platform 10 determines whether the device number in the test request is a device number in the white list; if yes, step S405 is executed, where the internal test platform 10 sends a test invitation to the terminal 20, and the terminal 20 may display the test invitation in a popup mode.
In step S406, the terminal 20 sends an execution request to the internal test platform 10 in response to the instruction of the user to execute the test invitation, and accordingly, the internal test platform 10 receives the execution request.
In step S407, the internal test platform 10 sends installation information to the terminal 20 in response to the execution request, and accordingly, the terminal 20 receives the installation information.
In step S408, the terminal 20 jumps to the download interface of the first application according to the installation information.
In step S409, after the test is completed, the terminal 20 sends the test result of the first application to the internal test platform 10, and accordingly, the internal test platform 10 receives the test result of the first application.
In step S410, the internal test platform 10 automatically classifies the test results.
Embodiment three of the System
Referring to fig. 5, it shows an internal test system 500 provided by another embodiment of the present disclosure, which includes the internal test platform 10, the terminal 20, and the server 30.
In step S501, the internal measurement platform 10 acquires installation information of the first application;
in step S502, the internal test platform 10 configures a white list including the device number of the test terminal according to a preset condition. The specific implementation process of creating the white list may refer to the related description in the foregoing embodiments, and details are not repeated here.
In step S503, the internal test platform 10 uploads the installation information and the white list to the server 30,
in step S504, the terminal 20 sends a test request to the server 30, where the test request includes a device number, and correspondingly, the server 30 receives the test request;
in step S505, the server 30 determines whether the device number in the test request is a device number in the white list; if yes, step S506 is executed, and the server 30 sends a test invitation to the terminal 50, where the test invitation includes the installation information.
In step S507, the terminal 50 jumps to the download interface of the first application according to the installation information in response to the instruction of the user to execute the test invitation.
In step S508, after the test is completed, the terminal 20 sends the test result of the first application to the internal test platform 10, and accordingly, the internal test platform 10 receives the test result of the first application.
In step S508, the internal test platform 10 automatically classifies the test results.
Therefore, the white list containing the number of the test terminal equipment and the installation information are sent to the server, so that the server can issue the installation information to the test terminal, the construction and maintenance cost of the internal test platform can be reduced, and the efficiency of test application can be improved.
Example four System
Referring to fig. 6, a signal flow diagram of the internal test platform 10, the terminal 20, and the service 30 according to another embodiment of the present disclosure is provided.
In step S601, the internal measurement platform 10 acquires installation information of the first application;
in step S602, the internal test platform 10 creates a white list including the device number of the test terminal according to the preset condition.
In step S603, the internal test platform 10 uploads the installation information and the white list to the server 30.
In step S604, the terminal 20 sends a test request to the internal test platform 10, where the test request includes a device number; accordingly, the internal test platform 10 receives the test request.
In step S605, the server 30 determines whether the device number in the test request is a device number in the white list; if yes, step S606 is executed, and the server 30 sends a test invitation to the terminal 20.
In step S607, the terminal 20 sends an execution request to the server 30 in response to the instruction of the user to execute the test invitation, and accordingly, the server 30 receives the execution request;
in step S608, the terminal 20 transmits installation information to the terminal 20 in response to the execution request, and accordingly, the terminal 20 receives the installation information;
in step S609, the terminal 20 jumps to the download interface of the first application according to the installation information.
In step S610, after the test is completed, the terminal 20 sends the test result of the first application to the internal test platform 10, and accordingly, the internal test platform 10 receives the test result of the first application.
In step S6111, the internal test platform 10 automatically classifies the test results.
As shown in fig. 7, an apparatus 700 for controlling application startup provided in the present disclosure includes an information obtaining unit 701, a terminal determining unit 702, an information sending unit 703, a feedback receiving unit 704, and a feedback classifying unit 705, where:
an information obtaining unit 701, configured to obtain installation information of a first application, where the first application is a testboard application of an application to be tested;
a terminal determining unit 702 configured to designate a terminal satisfying a preset condition as a test terminal;
an information sending unit 703 configured to send installation information to the test terminal;
a feedback receiving unit 704 configured to receive a test result of the first application returned by the test terminal;
a feedback classification unit 705 configured to cluster the test results.
Therefore, the application test method provided by the disclosure can screen out the test users meeting the conditions and cluster the test results, can acquire and maintain the test users at low cost, and can conveniently and quickly process the test feedback of the users.
In some embodiments, as shown in fig. 8, the terminal determining unit 702 further includes a receiving sub-unit 7021, a determining sub-unit 7022, and a white list sub-unit 7023, wherein: a receiving subunit 7021, configured to receive a device number and active information of a terminal of the client that has installed the second application, where the active information is information that the terminal uses the second application; a determining subunit 7022 configured to designate a terminal whose active information meets a preset condition as a test terminal; a white list subunit 7023 configured to create a white list containing the device number of the test terminal.
Referring to fig. 9, it illustrates an internal test system 900 provided in an embodiment of the present disclosure, which includes an internal test apparatus 910, an internal test server 920, a terminal 930, and an intermediate server 940, where:
the internal measurement apparatus 910 includes an information acquisition unit 911, a terminal determination unit 912, an information transmission unit 913, a feedback reception unit 914, and a feedback classification unit 915, the internal measurement server 920 includes a first communication unit 921, a control unit 922, and a second communication unit 923, and the terminal 930 includes a creation unit 931 and a third communication unit 932, in which:
the information obtaining unit 911 obtains installation information of a first application, which is a testboard application of an application to be tested; the terminal determining unit 912 further includes a receiving sub-unit 9121 and a determining sub-unit 9122 and a whitelist sub-unit 9123, wherein: the receiving subunit 9121 receives the device number and the active information of the terminal of the client that has installed the second application, and the active information is information that the terminal uses the second application; determining that the terminal of which the active information meets the preset condition is a test terminal by the subunit 9122; the white list subunit 9123 creates a white list containing the device number of the test terminal; the information transmitting unit 913 uploads the installation information and the white list to the first communication unit 801 of the internal test server 920.
The creating unit 931 of the terminal 930 creates a device number of the terminal; the third communication unit 932 sends a test request to the second communication unit 923 of the instrumentation server 920, where the test request includes the device number.
After the second communication unit 923 of the internal test server 920 receives the test request, when the control unit 922 detects that the device number in the test request is the device number in the white list, the second communication unit 923 is controlled to send the installation information to the third communication unit 932 of the terminal 930.
When the testing of the first application is completed, the third communication unit 932 sends the testing result of the first application to the feedback receiving unit 914 via the intermediate server 940. After the feedback receiving unit 914 receives the test result of the first application returned by the test terminal 930, the feedback classifying unit 915 clusters the test result.
Referring now to FIG. 6, a schematic diagram of an electronic device (e.g., the internal device, terminal, or server of FIG. 9) 600 suitable for implementing embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 6, electronic device 600 may include a processing means (e.g., central processing unit, graphics processor, etc.) 601 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)602 or a program loaded from storage 606 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data necessary for the operation of the electronic apparatus 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
Generally, the following devices may be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 607 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 606 including, for example, magnetic tape, hard disk, etc.; and a communication device 609. The communication means 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. While fig. 6 illustrates an electronic device 600 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such embodiments, the computer program may be downloaded and installed from a network through the communication device 609, or installed from the storage device 606, or installed from the ROM 602. The computer program, when executed by the processing device 601, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring installation information of a first application, wherein the first application is a test version application of an application to be tested; designating a terminal meeting a preset condition as a test terminal; sending the installation information to the test terminal; receiving a test result of the first application returned by the test terminal; and clustering the test results.
Alternatively, the computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring installation information of a first application, wherein the first application is a test version application of an application to be tested; designating a terminal meeting a preset condition as a test terminal; sending the installation information to the test terminal; receiving a test result of the first application returned by the test terminal; and clustering the test results.
Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Here, the name of the unit does not constitute a limitation of the unit itself in some cases, and for example, the information acquisition unit may also be described as "a unit that acquires installation information of the first application".
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
In accordance with one or more embodiments of the present disclosure, there is provided a method of testing an application, the method including: acquiring installation information of a first application, wherein the first application is a test version application of an application to be tested; designating a terminal meeting a preset condition as a test terminal; sending the installation information to the test terminal; receiving a test result of the first application returned by the test terminal; and clustering the test results.
According to the method for testing the application provided by one or more embodiments of the present disclosure, the specifying the terminal satisfying the preset condition as the test terminal includes: receiving a device number and active information of a terminal of a client terminal provided with a second application, wherein the active information is information of the terminal using the second application; appointing the terminal with the active information meeting the preset condition as the test terminal; and creating a white list containing the equipment number of the test terminal.
According to the method for testing the application provided by one or more embodiments of the present disclosure, the sending the installation information to the test terminal includes: and sending the installation information to the client of the second application installed on the test terminal.
According to the method for testing the application provided by one or more embodiments of the present disclosure, the sending the installation information to the client of the second application installed on the test terminal includes: receiving a test request sent by the client, wherein the test request comprises the equipment number; and when the equipment number of the test request is the equipment number in the white list, sending the installation information to the client.
According to a method provided by one or more embodiments of the present disclosure, the sending the installation information to the client includes: and sending a test invitation to the client, wherein the test invitation comprises the installation information.
According to one or more embodiments of the present disclosure, the sending the installation information to the client includes: sending a test invitation to the client; receiving an execution request which is sent by the client and responds to the test invitation; and sending the installation information to the client in response to the execution request.
According to the method for testing the application provided by one or more embodiments of the present disclosure, the sending the installation information to the test terminal includes: and uploading the installation information and the white list to a server so that the server sends the installation information to the test terminal according to the white list.
According to one or more embodiments of the present disclosure, there is provided a method for testing an application, the preset condition including one or more of: whether the installation time of the second application exceeds a set time length, whether the second application is active within a set time period, whether the terminal participates in the test of the second application, whether the number of times that the terminal participates in the second application exceeds a specific number, whether the terminal rejects the test of the second application, and whether the number of times that the terminal rejects the second application exceeds a specific number.
According to one or more embodiments of the present disclosure, the clustering the test results includes: adding labels to the test results through semantic recognition; and clustering the test results according to the labels.
In accordance with one or more embodiments of the present disclosure, there is provided an apparatus for testing an application, the apparatus including: the information acquisition unit is configured to acquire installation information of a first application, wherein the first application is a test version application of an application to be tested; a terminal determining unit configured to designate a terminal satisfying a preset condition as a test terminal; an information sending unit configured to send the installation information to the test terminal; a feedback receiving unit configured to receive a test result of the first application returned by the test terminal; and the feedback classification unit is configured to cluster the test results.
According to an apparatus for testing an application provided in one or more embodiments of the present disclosure, the terminal determining unit includes: the receiving subunit is configured to receive a device number and active information of a terminal of a client terminal on which a second application is installed, wherein the active information is information that the terminal uses the second application; a determining subunit, configured to designate the terminal for which the active information meets a preset condition as the test terminal; and the white list subunit is configured to create a white list containing the equipment number of the test terminal.
According to the apparatus for testing an application provided in one or more embodiments of the present disclosure, the information sending unit is further configured to upload the installation information and the white list to a server, so that the server sends the installation information to the test terminal according to the white list.
According to one or more embodiments of the present disclosure, there is provided a server for testing an application, the server including: the device comprises a first communication unit, a second communication unit and a third communication unit, wherein the first communication unit is configured to receive installation information and a white list of a first application, the first application is a test version application of an application to be tested, and the white list comprises a device number of a test terminal; the second communication unit is configured to receive a test request sent by the test terminal, and the test request comprises the equipment number; and the control unit is configured to control the second communication unit to send the installation information to the test terminal when the device number of the test request is the device number in the white list.
According to the server for testing the application provided by one or more embodiments of the present disclosure, the control unit is further configured to control the second communication unit to send a test invitation to the test terminal, where the test invitation includes the installation information.
According to the server of the test application provided by one or more embodiments of the disclosure, the control unit is further configured to send a test invitation to the test terminal; the second communication unit is further configured to receive an execution request sent by the test terminal and responding to the test invitation; the control unit is further configured to send the installation information to the test terminal in response to the execution request.
In accordance with one or more embodiments of the present disclosure, there is provided a system for testing an application, the system including: apparatus for testing an application as described above, and a server as described in any of the above.
According to one or more embodiments of the present disclosure, a system for testing an application is provided, the system further including a terminal, the terminal including: a creation unit configured to create a device number of a terminal; a third communication unit configured to send a test request to the server and receive the installation information sent by the server in response to the test request; wherein the test request includes the device number.
According to one or more embodiments of the present disclosure, there is provided a terminal, the test terminal including: at least one memory and at least one processor; wherein the memory is configured to store program code and the processor is configured to call the program code stored in the memory to perform any of the above methods of testing an application.
According to one or more embodiments of the present disclosure, there is provided a non-transitory computer storage medium having stored thereon program code for executing the method of testing an application of any one of the above.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims (19)
1. A method of testing an application, the method comprising:
acquiring installation information of a first application, wherein the first application is a test version application of an application to be tested;
designating a terminal meeting a preset condition as a test terminal;
sending the installation information to the test terminal;
receiving a test result of the first application returned by the test terminal;
and clustering the test results.
2. The method for testing applications according to claim 1, wherein the designating the terminal satisfying the preset condition as a test terminal comprises:
receiving a device number and active information of a terminal of a client terminal provided with a second application, wherein the active information is information of the terminal using the second application;
appointing the terminal with the active information meeting the preset condition as the test terminal;
and creating a white list containing the equipment number of the test terminal.
3. The method of testing an application of claim 2, wherein said sending the installation information to the test terminal comprises:
and sending the installation information to the client of the second application installed on the test terminal.
4. The method of testing an application of claim 3, wherein said sending the installation information to the client of the second application installed on the test terminal comprises:
receiving a test request sent by the client, wherein the test request comprises the equipment number;
and when the equipment number of the test request is the equipment number in the white list, sending the installation information to the client.
5. The method of testing an application of claim 4, wherein said sending the installation information to the client comprises:
and sending a test invitation to the client, wherein the test invitation comprises the installation information.
6. The method of testing an application of claim 4, wherein said sending the installation information to the client comprises:
sending a test invitation to the client;
receiving an execution request which is sent by the client and responds to the test invitation;
and sending the installation information to the client in response to the execution request.
7. The method of testing an application of claim 2, wherein said sending the installation information to the test terminal comprises:
and uploading the installation information and the white list to a server so that the server sends the installation information to the test terminal according to the white list.
8. The method of testing an application of claim 2, wherein the preset conditions include one or more of:
whether the installation time of the second application exceeds a set time length, whether the second application is active within a set time period, whether the terminal participates in the test of the second application, whether the number of times that the terminal participates in the second application exceeds a specific number, whether the terminal rejects the test of the second application, and whether the number of times that the terminal rejects the second application exceeds a specific number.
9. The method of testing an application of claim 1, wherein said clustering the test results comprises:
adding labels to the test results through semantic recognition;
and clustering the test results according to the labels.
10. An apparatus for testing an application, the apparatus comprising:
the information acquisition unit is configured to acquire installation information of a first application, wherein the first application is a test version application of an application to be tested;
a terminal determining unit configured to designate a terminal satisfying a preset condition as a test terminal;
an information sending unit configured to send the installation information to the test terminal;
a feedback receiving unit configured to receive a test result of the first application returned by the test terminal;
and the feedback classification unit is configured to cluster the test results.
11. The apparatus for testing an application of claim 10, wherein the terminal determining unit comprises:
the receiving subunit is configured to receive a device number and active information of a terminal of a client terminal on which a second application is installed, wherein the active information is information that the terminal uses the second application;
a determining subunit, configured to designate the terminal for which the active information meets a preset condition as the test terminal;
and the white list subunit is configured to create a white list containing the equipment number of the test terminal.
12. The apparatus for testing applications according to claim 11, wherein the information sending unit is further configured to upload the installation information and the white list to a server, so that the server sends the installation information to the test terminal according to the white list.
13. A server for testing an application, the server comprising:
the device comprises a first communication unit, a second communication unit and a third communication unit, wherein the first communication unit is configured to receive installation information and a white list of a first application, the first application is a test version application of an application to be tested, and the white list comprises a device number of a test terminal;
the second communication unit is configured to receive a test request sent by the test terminal, and the test request comprises the equipment number;
and the control unit is configured to control the second communication unit to send the installation information to the test terminal when the device number of the test request is the device number in the white list.
14. The test application server of claim 13, wherein the control unit is further configured to control the second communication unit to send a test invitation to the test terminal, the test invitation including the installation information.
15. The server of the test application of claim 13, wherein the control unit is further configured to send a test invitation to the test terminal;
the second communication unit is further configured to receive an execution request sent by the test terminal and responding to the test invitation;
the control unit is further configured to send the installation information to the test terminal in response to the execution request.
16. A system for testing an application, the system comprising:
apparatus for testing applications according to claim 12, and
a server according to any one of claims 13-15.
17. The system for testing applications of claim 16, wherein the system further comprises a terminal, the terminal comprising:
a creation unit configured to create a device number of a terminal;
a third communication unit configured to send a test request to the server and receive the installation information sent by the server in response to the test request;
wherein the test request includes the device number.
18. A terminal, characterized in that the test terminal comprises:
at least one memory and at least one processor;
wherein the memory is for storing program code and the processor is for calling the program code stored by the memory to perform a method of a test application of any of claims 1 to 9.
19. A non-transitory computer storage medium, characterized in that the computer storage medium stores program code for executing the method of testing an application of any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910843592.6A CN112463573A (en) | 2019-09-06 | 2019-09-06 | Method, device, terminal and storage medium for testing application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910843592.6A CN112463573A (en) | 2019-09-06 | 2019-09-06 | Method, device, terminal and storage medium for testing application |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112463573A true CN112463573A (en) | 2021-03-09 |
Family
ID=74806801
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910843592.6A Pending CN112463573A (en) | 2019-09-06 | 2019-09-06 | Method, device, terminal and storage medium for testing application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112463573A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113986770A (en) * | 2021-12-27 | 2022-01-28 | 深圳市明源云科技有限公司 | User system upgrading method, device, equipment and medium based on artificial intelligence |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104603753A (en) * | 2014-03-19 | 2015-05-06 | 华为技术有限公司 | Method, system and server for recommending application |
| CN107861871A (en) * | 2017-11-02 | 2018-03-30 | 百度在线网络技术（北京）有限公司 | A kind of gray scale dissemination method, device, server and storage medium |
| CN108959087A (en) * | 2018-06-29 | 2018-12-07 | 百度在线网络技术（北京）有限公司 | test method and device |
| CN108959000A (en) * | 2018-06-20 | 2018-12-07 | 深圳市腾讯网络信息技术有限公司 | A kind of server stress test method, system and terminal |
| CN109684227A (en) * | 2018-12-28 | 2019-04-26 | 北京微播视界科技有限公司 | Applied program testing method, device and electronic equipment |
| CN109828906A (en) * | 2018-12-15 | 2019-05-31 | 中国平安人寿保险股份有限公司 | UI automated testing method, device, electronic equipment and storage medium |
-
2019
- 2019-09-06 CN CN201910843592.6A patent/CN112463573A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104603753A (en) * | 2014-03-19 | 2015-05-06 | 华为技术有限公司 | Method, system and server for recommending application |
| CN107861871A (en) * | 2017-11-02 | 2018-03-30 | 百度在线网络技术（北京）有限公司 | A kind of gray scale dissemination method, device, server and storage medium |
| CN108959000A (en) * | 2018-06-20 | 2018-12-07 | 深圳市腾讯网络信息技术有限公司 | A kind of server stress test method, system and terminal |
| CN108959087A (en) * | 2018-06-29 | 2018-12-07 | 百度在线网络技术（北京）有限公司 | test method and device |
| CN109828906A (en) * | 2018-12-15 | 2019-05-31 | 中国平安人寿保险股份有限公司 | UI automated testing method, device, electronic equipment and storage medium |
| CN109684227A (en) * | 2018-12-28 | 2019-04-26 | 北京微播视界科技有限公司 | Applied program testing method, device and electronic equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113986770A (en) * | 2021-12-27 | 2022-01-28 | 深圳市明源云科技有限公司 | User system upgrading method, device, equipment and medium based on artificial intelligence |
| CN113986770B (en) * | 2021-12-27 | 2022-04-22 | 深圳市明源云科技有限公司 | User system upgrading method, device, equipment and medium based on artificial intelligence |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112597047B (en) | Test method, test device, electronic equipment and computer readable medium | |
| CN110084317B (en) | Method and device for recognizing images | |
| CN111813685B (en) | Automatic test method and device | |
| CN111263176A (en) | Loading method, device, terminal, server and storage medium for live broadcast room page | |
| CN111291071A (en) | Data processing method and device and electronic equipment | |
| CN116225600A (en) | Application program recording method, playback method, device, medium and electronic equipment | |
| CN111857720A (en) | Method and device for generating user interface state information, electronic equipment and medium | |
| CN113392018B (en) | Traffic distribution method and device, storage medium and electronic equipment | |
| CN113033707B (en) | Video classification method and device, readable medium and electronic equipment | |
| CN111209432A (en) | Information acquisition method and device, electronic equipment and computer readable medium | |
| CN113033680B (en) | Video classification method and device, readable medium and electronic equipment | |
| CN112596738B (en) | Method and device for determining front-end page to be tested, storage medium and electronic equipment | |
| CN112463573A (en) | Method, device, terminal and storage medium for testing application | |
| CN116909539A (en) | Visual programming method, device, equipment and storage medium | |
| CN116796233A (en) | Data analysis method, data analysis device, computer readable medium and electronic equipment | |
| CN116756615A (en) | Data analysis method, data analysis device, computer readable medium and electronic equipment | |
| CN116204740A (en) | Label determining method, information recommending method, device, equipment and storage medium | |
| CN116483891A (en) | Information prediction method, device, equipment and storage medium | |
| CN113222050B (en) | Image classification method and device, readable medium and electronic equipment | |
| CN116092092A (en) | Matching method, device, medium and electronic equipment | |
| CN112669816B (en) | Model training method, voice recognition method, device, medium and equipment | |
| CN110941683B (en) | Method, device, medium and electronic equipment for acquiring object attribute information in space | |
| CN112910855A (en) | Sample message processing method and device | |
| CN111787043A (en) | Data request method and device | |
| CN110543491A (en) | Search method, search device, electronic equipment and computer-readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |