CN115868938B - Subject terminal for fNIRS-based brain function assessment system - Google Patents

Abstract

The present application provides a subject terminal for an fnrs-based brain function assessment system. In the training mode, on a screen, following the stage arrangement of the target task to a testee, and executing training subtasks of corresponding stages in sequence by text prompt; presenting an exercise subtask initiation prompt at a beginning period of each stage, wherein the exercise subtask initiation prompt at least comprises names of the exercise subtasks of each stage together with an execution description prompt; and stopping presenting the exercise subtask initiation prompt after the start period of each stage on the screen, and continuously presenting an execution content prompt shorter than the execution description prompt for prompting the subject of the execution content of the exercise subtask. Therefore, the testee can be familiar with the target task in advance, and when the target task is executed, the voice instructions entering different task stages are reacted to meet the current brain function conditions, more accurate near infrared data are acquired, and the brain function conditions of the testee are better estimated.

Description

Subject terminal for fNIRS-based brain function assessment system

Technical Field

The application relates to the technical field of near infrared brain function imaging, in particular to a subject terminal for an fNIRS-based brain function assessment system.

Background

Currently, functional near infrared spectroscopy (fNIRS) is a non-invasive brain function imaging technique that has emerged in recent years. The fNIRS mainly utilizes the difference characteristic of the absorption rate of the near infrared light of different wavelengths of oxyhemoglobin and deoxyhemoglobin in brain tissues to directly detect the hemodynamic activity of the cerebral cortex in real time. By observing such hemodynamic changes, the neuro-activity of the brain can be reversed by neurovascular coupling laws. In recent years, fNIRS has been increasingly used in research in the field of cognitive neuroscience. The technology can be used for safely, noninvasively and low-cost monitoring of the functional activities of different areas of the cerebral cortex, and provides a useful reference for evaluation of cognitive dysfunction and research on pathogenesis of neuropsychiatric diseases.

In the fNIRS experiment, a subject performs tasks according to a psychological paradigm (such as VFT), near infrared data in the process of performing the paradigm by the subject is collected by using a near infrared brain function imaging system, and concentration changes of the whiteness of the hemoglobin at different positions of the brain are observed, so that the method can be used for diagnosing and evaluating various diseases.

The existing near infrared brain function imaging system is used for collecting near infrared data when a tested person executes the VFT, an operator terminal sends a voice command related to the execution of the VFT to the tested person, and the tested person executes corresponding tasks based on the voice command. In the process, the task of a plurality of stages is required to be executed by the testee, but the voice command sent by the operator terminal is sent only before each stage starts, the testee can suddenly receive the voice command for executing the next stage when executing the task of the current stage, the testee is required to immediately interrupt the current task and execute the task of the next stage, the response of the testee to the connection between the tasks of the different stages is relatively slow, even the rapid state switching can cause the physiological state change of some testees, the acquired near infrared data cannot reflect the brain function condition of the testee relatively accurately and reasonably, and the psychological acceptance degree of the testee for the mode is relatively poor, so that the use experience of the testee is affected. In fact, for the model including the VFT without interaction, the subject does not need to interact with the terminal, and the detection device collects physiological data of the subject under the task execution and can be used for brain function assessment, so that no one considers the familiarity problem of the subject with the VFT under the condition that the subject executes the non-interactive model, i.e. the VFT, and the problem that the collected near infrared data cannot accurately and reasonably assess the brain function condition of the subject due to the lower coordination degree of the subject is solved.

Disclosure of Invention

The present application is directed to the above-mentioned technical problems existing in the prior art. The application aims to provide a subject terminal for an fNIRS-based brain function assessment system, which can enable a subject to be familiar with a target task in advance, can enable the subject to make natural, normal and response to a voice instruction entering different task stages to meet the current brain function condition of the subject when the subject executes the target task, and can acquire more accurate near infrared data while improving the coordination degree of the subject executing the target task, so that the brain function condition of the subject can be better assessed.

According to a first aspect of the present application, there is provided a subject terminal for an fnrs-based brain function assessment system, comprising at least one processor configured to be capable of providing an exercise mode of a target task of a VFT to provide the subject with an exercise of the target task before the subject performs the target task to collect near infrared data, in particular comprising, in the exercise mode: on a screen, performing training subtasks of corresponding stages in sequence with text prompts to the testee according to the stage arrangement of the target tasks, so that the strength of the training subtasks of each stage is lower than that of the target subtasks of the corresponding stages; presenting an exercise subtask initiation prompt on the screen at the beginning time of each stage, wherein the exercise subtask initiation prompt at least comprises the names of the exercise subtasks of each stage together with an execution instruction prompt to provide instructions for the testee, and prompting the testee to send out voices according to the instructions to execute each exercise subtask; and stopping presenting the exercise subtask initiation prompt after the start period of each stage on the screen, and continuously presenting an execution content prompt shorter than the execution description prompt for prompting the subject of execution content of the exercise subtask.

According to a second aspect of the present application, there is provided an fnrs-based brain function assessment system comprising a subject terminal according to various embodiments of the present application; and an operator terminal configured to: near infrared data is collected when the subject performs the target task of the VFT in response to the operator indicating the interactive operation of the collection.

According to a third aspect of the present application, there is provided a computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to perform the following processing to provide an exercise mode of a target task of a VFT: on the screen, the training subtasks of the corresponding stages are sequentially executed by text prompts to the testee according to the stage arrangement of the target tasks, so that the strength of the training subtasks of each stage is lower than that of the target subtasks of the corresponding stages; presenting an exercise subtask initiation prompt on the screen at the beginning time of each stage, wherein the exercise subtask initiation prompt at least comprises the names of the exercise subtasks of each stage together with an execution instruction prompt to provide instructions for the testee, and prompting the testee to send out voices according to the instructions to execute each exercise subtask; and stopping presenting the exercise subtask initiation prompt after the start period of each stage on the screen, and continuously presenting an execution content prompt shorter than the execution description prompt for prompting the subject of execution content of the exercise subtask.

Compared with the prior art, the beneficial effects of the embodiment of the application are that:

the subject terminal according to the embodiment of the application can provide the training mode of the target task of the VFT, and the subject can train according to the visual prompt displayed on the screen of the subject terminal before executing the target task of the VFT to acquire the near infrared data so as to be familiar with the target task of the VFT in advance. And displaying text prompts for executing the exercise subtasks of the corresponding stages to the testee on a display screen of the testee terminal, so that the testee can know the task content of the corresponding stages based on the text prompts. Wherein the intensity of the training subtasks of each stage is lower than the intensity of the target subtasks of the corresponding stage, thus being beneficial to avoiding that the high-intensity training consumes the patience of the testee excessively. And further displaying an exercise subtask initiation prompt on the screen, wherein the initiation prompt comprises the names and the execution description prompts of the exercise subtasks of each stage, and the testee can clearly know the task requirements and the execution modes of the exercise subtasks of each stage based on the initiation prompt. The content and the execution requirement of the target task of the VFT can be fully known by the testee through each visual prompt presented on the terminal screen of the testee, so that the testee can smoothly enter the next task stage when the testee really executes the target task of the VFT to acquire near infrared data, and the problem that the transition of different task stages generates an anti-sense emotion is avoided. Various prompts presented by the subject terminal in the training mode are controlled in a reasonable range, so that a subject can practice a target task familiar with the VFT, and the tolerance and the attention of the subject cannot be excessively consumed, the subject can keep higher attention and coordination degree when the subject executes the target task of the VFT to acquire near infrared data, and further, more effective, real and accurate near infrared data can be acquired, and the brain function condition of the subject can be better evaluated.

The foregoing description is merely an overview of the technical solutions of the present application, and may be implemented according to the content of the specification in order to make the technical means of the present application more clearly understood, and in order to make the above description and other objects, features and advantages of the present application more clearly understood, the following detailed description of the present application will be given.

Drawings

In the drawings, which are not necessarily drawn to scale, like numerals may describe similar components in different views. Like reference numerals with letter suffixes or different letter suffixes may represent different examples of similar components. The drawings illustrate generally, by way of example, and not by way of limitation, various embodiments, and together with the description and claims serve to explain the disclosed embodiments. Such embodiments are illustrative and exemplary, and are not intended to be exhaustive or exclusive embodiments of the present system or non-transitory computer readable medium having instructions for implementing the steps performed by the processor of the subject terminal.

Fig. 1 (a) shows a schematic diagram of an fnrs-based brain function assessment system according to an embodiment of the present application.

Fig. 1 (b) shows a schematic diagram of a near infrared data acquisition device according to an embodiment of the present application.

Fig. 2 (a) shows a schematic diagram of a subject terminal for an fnrs-based brain function assessment system according to an embodiment of the present application.

Fig. 2 (b) shows a schematic diagram of the operation of the subject terminal of the fNIRS-based brain function assessment system in the exercise mode according to the embodiment of the present application.

Fig. 3 (a) shows a flowchart of a subject terminal for an fnrs-based brain function assessment system in an exercise mode according to an embodiment of the present application.

Fig. 3 (b) shows a diagram of a screen presentation process in the exercise mode for the subject terminal of the fnrs-based brain function assessment system according to the embodiment of the present application.

Fig. 4 (a) shows a flowchart of a subject terminal in acquisition mode for an fnrs-based brain function assessment system according to an embodiment of the present application.

Fig. 4 (b) shows a diagram of a screen presentation process in acquisition mode for a subject terminal of an fNIRS-based brain function assessment system according to an embodiment of the present application.

Detailed Description

In order to better understand the technical solutions of the present application, the following detailed description of the present application is provided with reference to the accompanying drawings and the specific embodiments. Embodiments of the present application will now be described in further detail with reference to the accompanying drawings and specific examples, but are not intended to be limiting of the present application.

The terms "first," "second," and the like, as used herein, do not denote any order, quantity, or importance, but rather are used to distinguish one element from another. As used in this application, the word "comprising" or "comprises" and the like means that elements preceding the word encompass the elements recited after the word, and that no other elements are excluded from the possible coverage. In the present application, the arrows shown in the figures of the respective steps are merely examples of the execution sequence, and the technical solution of the present application is not limited to the execution sequence described in the embodiments, and the respective steps in the execution sequence may be performed in a combined manner, may be performed in a split manner, and may be exchanged in order as long as the logical relationship of the execution content is not affected.

All terms (including technical or scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs unless specifically defined otherwise. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein. Methods, systems known to those of ordinary skill in the relevant art may not be discussed in detail, but should be considered part of the specification where appropriate.

Fig. 1 (a) shows a schematic diagram of an fnrs-based brain function assessment system according to an embodiment of the present application. The subject terminal of the various embodiments of the present application represents a terminal on the subject side as a subject of brain function evaluation, which can be applied to the fnrs-based brain function evaluation system shown in fig. 1 (a).

As shown in fig. 1 (a), the fnrs-based brain function assessment system includes a subject terminal 100, an operator terminal 101, and a near infrared data acquisition device 102. As shown in fig. 1 (b), the near infrared data collection device 102 has at least a headgear 103, the headgear 103 being for wearing on the subject's head 105. For example, the headgear 103 may have a plurality of probes 104 for transmitting near infrared light and/or receiving near infrared light. For another example, the headgear 103 may be provided with a plurality of mounting locations for detachably mounting the respective probes 104, and in use, the probes 104 may be mounted to the headgear 103 by the mounting locations. Wherein each of the plurality of probes 104 may be configured as either a transmitting probe (S) or a receiving probe (D), each pair of paired probes 104 forming a channel. In some embodiments, one transmitting probe may correspond to multiple receiving probes, or vice versa, with a pairing relationship corresponding to the specific requirements of the probe 104 layout location, brain function area to be detected, etc.

In acquisition mode, subject terminal 100 may cooperate with operator terminal 101 to sequentially direct the subject to perform the target task of VFT via an on-screen graphical user interface and voice prompts. In response to the operator's interaction with the instruction acquisition of the operator terminal 101, the operator terminal 101 may control the near infrared data acquisition device 102 to acquire near infrared data for a target brain function region (e.g., whole brain, temporal lobe, etc.) when the subject performs a target task of the VFT, thereby acquiring near infrared data when the subject performs a target task of the VFT in order to perform brain function evaluation. The brain function evaluation results may include, for example, but not limited to, hbO profile, hbR profile, functional connection map, etc., which may be used to evaluate and diagnose the brain function condition of the subject.

In this application, "target task of VFT" is intended to mean VerbalFluency Test, the word fluency test, VFT finds application in clinical and scientific research for diagnosis and assessment of a variety of brain functional disorders.

Fig. 2 (a) shows a schematic diagram of a subject terminal for an fnrs-based brain function assessment system according to an embodiment of the present application. As shown in fig. 2 (a), the subject terminal 200 includes at least one processor 201, the at least one processor 201 being configured to be capable of providing an exercise mode of a target task of the VFT to provide the subject with an exercise of the target task before the subject performs the target task to collect near infrared data. The subject terminal 200 may also include a display 202 for presenting text prompts or the like of exercise content to the subject. In some embodiments, the subject terminal 200 may further include a speaker 203 for issuing voice instructions to the subject regarding the performance of the exercise. The subject terminal 200, as a constituent of the fnrs-based brain function assessment system, and also as an exercise terminal, can conveniently provide exercise to the subject immediately before the subject performs the target task of the VFT and acquires near infrared data, for example, several minutes to 10 minutes in advance, as shown in fig. 2 (b), so that the subject is quickly familiar with the circulation sequence of each stage of the target task of the VFT, and knows and grasps the execution manner of the task of each stage based on the relevant prompt information provided by the display interface of the subject terminal 200. Such a practice mode can keep the practice result (proficiency in the target task of VFT) to the enabled acquisition mode even for mental disease patients, alzheimer's disease patients, etc., so that the subject's mind is more relaxed, and can react to the functional status of his own brain even if the operator terminal provides only voice instructions without interface interactive cues for instructions to enter different task phases. Therefore, the situation that the psychological acceptability is poor and anxiety is disordered because the examinee cannot understand the flow of the target task of the command and is unfamiliar with the VFT can be avoided, and the acquired experimental data can accurately and reasonably reflect the brain function condition of the examinee.

Further, the subject terminal 200, which is a constituent of the fnigs-based brain function assessment system, is used as an exercise terminal, which can enable an operator, such as a doctor or other professional, to conveniently and directly initiate exercises several minutes in advance in a clinical examination item of brain function assessment, so that it can be avoided that additional medical items are added for the exercises, facilitating the execution and popularization of the exercises. Compared with the practice mode of oral explanation in advance by doctors, the practice mode has better practice effect and obviously reduces the workload of the doctors.

The processor 201 may be a processing device including one or more general-purpose processing devices, such as a microprocessor, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), and the like. More specifically, the processor 201 may be a Complex Instruction Set Computing (CISC) microprocessor, a Reduced Instruction Set Computing (RISC) microprocessor, a Very Long Instruction Word (VLIW) microprocessor, a processor running other instruction sets, or a processor running a combination of instruction sets. The processor 201 may also be one or more special purpose processing devices such as an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), a system on a chip (SoC), or the like.

As described above, the subject performs the VFT task, and near infrared data during the VFT performed by the subject is collected using an fNIRS (near infrared brain function imaging technique) -based brain function assessment system, and the concentration changes of hemoglobin levels at different locations of the brain are observed for assessment and detection of brain dysfunction. The subject terminal 200 provided in the embodiments of the present application is used in an fnrs-based brain function assessment system, and a subject may perform a practice of a VFT target task based on the subject terminal 200.

Fig. 3 (a) shows a flowchart of a subject terminal for an fnrs-based brain function assessment system in an exercise mode according to an embodiment of the present application.

In step S301, in the exercise mode, on the screen, the exercise subtasks of the corresponding stages are sequentially executed with text prompts to the subject following the stage arrangement of the target tasks, so that the intensity of the exercise subtasks of each stage is lower than that of the target subtasks of the corresponding stages. Specifically, the target task such as the VFT includes three stages, namely, a first stage number, a second stage word group, and a third stage number. The stage arrangement requirements of the target task of the VFT are followed on the screen of the subject terminal, and text prompts corresponding to the respective task stages of the VFT are sequentially presented on the screen. Fig. 3 (b) shows display interfaces sequentially displayed on the screen of the subject terminal in the exercise mode, and arrows are used to indicate replacement of the display interfaces on the screen, for example, after the first display interface 304 is displayed, the second display interface 305 is displayed, and the third display interface 306 and the fourth display interface 307 are sequentially displayed … …. The ellipses in fig. 3 (b) indicate that there are still other display interfaces between the two display interfaces, before the first display interface or after the last display interface, which are omitted here. Wherein the first display 304 does not represent the first display presented on the screen of the subject terminal in the actual exercise mode, the first display 304 is only used to distinguish from the different display shown in fig. 3 (b), for example, the second display 305 and the third display 306. That is, the terms "first", "second", "third", and the like in this application are not limited to the order, but are merely used for distinction. On the screen of the subject terminal, the exercise subtask of "number digit" is performed with the text prompt of "please open repetition number 12 3 4 5" as shown in the first display interface 304, the exercise subtask of "group word" is performed with the text prompt of "please use" to group words "as much as possible as shown in the fifth display interface 308, and so on. After seeing the visual cues such as characters on the screen of the subject terminal, the subject can know the exercise content of the corresponding stage.

In acquisition mode, the subject performs the target task of the VFT and acquires near infrared data. In acquisition mode, the target subtasks for each task phase of the VFT are presented sequentially on the screen of the subject terminal. In the training mode, the intensity of training subtasks at each stage displayed on the screen of the terminal of the subject is lower than the intensity of target subtasks at the corresponding stage, where the intensity may refer to the intensity of each stage, for example, for the group words at the second stage, the intensity may refer to the difficulty of word group, the duration of word group, and so on. Taking the time-consuming long representation as an example, in the exercise mode, the word-grouping stage of the second stage may include only the exercise subtask of please use "how much" to group words as possible and the word-grouping stage takes 15 seconds. However, in the collection mode, the word-forming phase of the second phase may include three target subtasks, namely, please form words as many as possible with "white", please form words as many as possible with "north", and please form words as many as possible with "big", each of which takes 20 seconds, and the word-forming phase takes 60 seconds, and the time consumption of the target subtasks of the word-forming phase in the collection mode is much higher than the time consumption of the word-forming phase exercise subtasks in the exercise mode. In other embodiments, the difficulty of word grouping and the duration of word grouping may also be combined to make the intensity of the training subtask of each stage of the subject terminal lower than the intensity of the target subtask of the corresponding stage in the training mode, which is not particularly limited in this application.

The intensity of the training subtasks in each stage is lower than that of the target subtasks in the corresponding stage, so that a subject can know the task content and the flow of each stage, excessive time and energy of the subject can not be wasted, and the subject can still keep good attention and coordination degree when collecting.

In step S302, in the exercise mode, an exercise subtask initiation prompt is presented on the screen at a start period of each stage, the exercise subtask initiation prompt including at least a name of an exercise subtask of each stage together with an execution instruction prompt to provide an instruction to the subject, and prompt the subject to issue a voice to execute each exercise subtask according to the instruction. Specifically, as shown in the first display interface 304 of fig. 3 (b), the content is an initiation prompt for presenting a digital exercise subtask at the beginning of the first stage, where the initiation prompt includes at least the name "digital" of the exercise subtask of the first stage, and executing the instruction prompt "please open repeat number 1 2 3 4 5" to prompt the subject to make a voice to repeat the number 1 2 3 4 5. The fourth display interface 307 of fig. 3 (b) shows that the start period of the second stage presents an initiation prompt of the exercise subtask of the group word, which includes the name "group word" of the exercise subtask of the second stage and the execution instruction prompt "please open the group word with the prompted word as much as possible", based on which the subject can know the task content of the second stage and know that the task of which the opening is required to utter a voice to perform the group word.

In step S303, on the screen, presentation of the exercise subtask initiation prompt is stopped after the start period of each stage, but an execution content prompt shorter than the execution description prompt is continuously presented for prompting the subject of the execution content of the exercise subtask. Specifically, the fourth display interface 307 in fig. 3 (b) presents the second stage of the exercise subtask initiation prompt, after which presentation of the initiation prompt is stopped, and a shorter execution content prompt is presented continuously, i.e., please use "world" as many words as possible (as shown in the fifth display interface 308). The execution content prompt comprises a material "generation" and a task executed by using the material "generation" as word forming, and after watching the exercise subtask initiation prompt, the guidance assistance of the shorter execution content prompt is also sufficient for the testee to clearly grasp the task content to be executed, so that the psychological bearing capacity of the testee in executing the exercise and later executing the VFT target task is improved, the redundant prompt information quantity can be reduced, and the testee is helped to maintain the attention.

In some embodiments of the present application, the at least one processor is further configured to perform an acquisition mode of the target task of the VFT in which the subject performs the target task of the VFT and acquires near infrared data using the brain function evaluation system. Specifically, for example, after the operator terminal views and acquires the IP address of the operator terminal and then inputs the IP address to the subject terminal, the communication connection between the operator terminal and the subject terminal is implemented, and the subject terminal may be a portable smart device such as a tablet. After the operator terminal and the subject terminal are communicatively connected, the subject terminal then displays accordingly in response to the configuration of the operator terminal.

Fig. 4 (a) shows a flowchart of a subject terminal in acquisition mode for an fnrs-based brain function assessment system according to an embodiment of the present application.

As shown in fig. 4 (a), in the acquisition mode, on the screen, a gaze point is kept presented to the subject and a target sub-task of a corresponding stage is prompted to be executed in synchronization with a voice prompt of an operator terminal following a stage arrangement of the target task. The gaze point may be presented in the middle of the screen or in the middle and upper part of the screen, and the presentation position of the gaze point is not specifically limited in the present application. In the acquisition mode, the gaze point is always kept on the screen of the terminal of the subject, which is beneficial to the subject to focus the gaze point, and the interference of other peripheral things on the subject is avoided, so that the subject is prevented from dispersing the attention, and the brain function evaluation result is influenced. It will be appreciated that there are a variety of ways in which the gaze point may be presented, and the application is described in terms of "+" for example, but the application is not so limited, and may be presented in the form of dots, for example, in some embodiments.

When the acquisition is started, when a loading progress bar is presented on the screen of the operator terminal, the operator terminal sends out a voice prompt of about to start, and simultaneously, a text prompt of about to start is presented on the screen of the subject terminal. At the moment, after the testee sees the character prompt of 'about to start', on one hand, the testee can know that the task is about to start, so that the testee is ready to execute the task; on the other hand, the subject's attention can be focused on the current task. After the configuration loading on the operator terminal is completed, the operator terminal begins to collect near infrared data during the subject's task. After the operator terminal has loaded the configuration information, a voice prompt "inspection start" is presented, at this time, in response to the operator terminal, on the screen of the subject terminal, a text prompt "inspection start" to inform the subject that the task is about to be started. In the acquisition mode, the screen of the subject terminal follows the phase arrangement of the target task of the VFT, such as the digital phase of the first phase, the word group phase of the second phase, and the digital phase of the third phase. The operator terminal performs voice prompt on the subject in the acquisition mode, such as the first display interface 404 of fig. 4 (b), and in the first stage, the operator terminal plays the repetition number 12 3 4 5, and in response to the operator terminal, a prompt of "repetition number 12 3 4 5" is presented on the screen of the subject terminal in synchronization with the voice prompt of the operator terminal. In the second phase, the operator terminal voice plays "white daytime" and then, as shown in the fourth display interface 407 of fig. 4 (b), in response to the voice prompt of the operator terminal, the corresponding presentation on the screen of the subject terminal requests to group as many words as possible with "white" to synchronize with the voice of the operator terminal to prompt execution of the target subtask of the corresponding phase. In this way, the subject can improve the attention and coordination of performing the VFT task based on the voice prompt of the operator terminal and the text prompt on the screen of the subject terminal.

In step S402, on the screen, at the start period of each stage, execution content cues of each target subtask are presented below the vicinity of the gaze point. In step S403, on the screen, presentation of the execution content cue of the target subtask is stopped after the start period of each stage and only the gaze point is presented. In the first display interface 404 shown in fig. 4 (b), the execution content indicator "please repeat number 12 3 4 5" of the target subtask of the first stage is presented below the position adjacent to the gaze point "+", and after the start period of the first stage, the execution content indicator of the first stage is not presented, but only the gaze point "+" (e.g. the second display interface 405 and the third display interface 406 of fig. 4 (b)). The execution content prompt is only presented below the neighborhood of the gaze point in the beginning period of each stage, and the execution content prompt is not presented but only the gaze point is presented after the beginning period, so that excessive text prompts are prevented from being used as a stimulus to influence the brain function state of the testee, the testee can make natural, normal and response according with the current brain function state of the testee when the testee executes the target task, the effectiveness of the acquired near infrared data is improved, and a more accurate brain function state assessment result can be obtained based on the acquired near infrared data.

In this way, the subject terminal provides the subject with the stepwise visual interactive prompt matched with the complete process of the target task of the VFT in the acquisition mode, and compared with the case that the operator terminal only provides the stepwise audio prompt of the complete process of the target task of the VFT, the subject can more relax, smoothly and attentively complete the target task of the VFT, thereby remarkably reducing the interference caused by hearing deviation, unfamiliar process, anxiety caused by rapid engagement of task stages and the like, and ensuring that the acquired near infrared data can accurately and reasonably reflect the brain function condition of the subject.

In some embodiments of the present application, the at least one processor is further configured to, in the exercise mode, present a gaze point immediately above while presenting the execution content cue, such as gaze point "+" and "please repeat number 12 3 4 5" presented in the second display interface 305 of fig. 3 (b), by presenting the execution content cue and gaze point simultaneously, so that the subject can understand the task he is about to perform while maintaining attention in the vicinity of the gaze point. The gaze point is not presented while the practice subtask initiation prompt is presented, and the name of the practice subtask is made more pronounced than the execution instruction hint font, as shown in the first display interface 304 of fig. 3 (b), "the first stage number please open repeat number 12 3 4 5", at which point the gaze point is not presented so that too many elements are distracted from the subject, so that the subject can freely read the practice subtask initiation prompt, including the name of the practice subtask along with the execution instruction hint, and fully understand the digestion. The "first stage number" is made more remarkable than the font of the execution description prompt "please open repeat number 12 3 4 5" by thickening or font amplification, so that the subject can obviously notice the names of the respective task stages, and has general knowledge of the task content of the respective task stages, and the impression of the names of the respective task stages in the brain of the subject is deepened.

In some embodiments of the present application, the at least one processor is further configured to, in the acquisition mode: on the screen of the subject terminal, a gaze point is kept presented to the subject and the target subtasks of the corresponding stage are prompted to be executed in synchronization with the voice prompt of the operator terminal following the stage arrangement of the target task so that the subject focuses attention on the gaze point. On the screen, at the beginning period of each stage, presenting the execution content prompt of the target subtask below the neighborhood of the gaze point. Specifically, the execution content cue "please use" white "as many words as possible is presented below the gaze point" + "in the fourth display interface 407 in the acquisition mode as shown in fig. 4 (b). The visual appearance and the position of the execution content prompt and the gaze point of the training subtask in the training mode are the same as those of the corresponding execution content prompt and the gaze point of the target subtask in the acquisition mode. For example, the execution content cue "please use" to group words as many as possible "is presented below the gaze point" + "in the fifth display interface 308 in the exercise mode of fig. 3 (b), which is the same as the visual appearance and position of the font size, thickness, etc. of" please use "to group words as many as possible" and the gaze point "+" in the fourth display interface 407 in the acquisition mode shown in fig. 4 (b). After the testee exercises, the task of executing the VFT is started to enter the acquisition mode at a short time interval, and the visual appearance and the position of the execution content prompt and the gaze point are the same in the exercise mode and the acquisition mode, so that the visual and psychological impact of the testee caused by the difference of the visual appearance and the position is avoided, the psychological and emotional state of the testee can be kept stable, and the testee can be naturally and smoothly transited from the exercise mode to the acquisition mode.

In some embodiments of the present application, the at least one processor is further configured to present, in the exercise mode, on a screen of the subject terminal, a countdown cue for a later period of each exercise subtask, the countdown cue presented with the gaze point and an execution content cue of a current exercise subtask, the countdown cue for a time to prompt for a next stage or a next exercise subtask. In addition, the countdown prompt comprises stage information of the next stage or execution content information of the next exercise subtask. Specifically, for example, the first stage number includes only one exercise subtask, and the second display interface 305 in fig. 3 (b) displays a point of gaze "+" and a request repetition number 12 3 4 5 "for executing the content alert, and in a later period of the first stage exercise subtask, for example, 3 seconds may remain from the end of the first stage exercise subtask, a countdown alert" about to enter word group stage 3s "is displayed on the third display interface 306. The subject knows that the second stage word group stage will be entered after 3 seconds based on the countdown prompt for "about to enter word group stage 3 s". If the second phase includes two exercise subtasks, such as please use "world" to group as many words as possible and "small" to group as many words as possible, then a countdown prompt is displayed for "3 s from the next word group" during the later period of the exercise subtask, which requires "world" to group as many words as possible, to prompt the subject that he will go to the next exercise subtask.

On one hand, the countdown prompt is not scattered to the attention of the testee due to the fact that the countdown prompt exists all the time, and the fact that the attention of the testee is kept in the current exercise subtask is facilitated; on the other hand, the testee can know the remaining time of entering the next stage or the next exercise subtask based on the countdown prompt, so that sufficient psychological preparation is made before entering the next stage or the next exercise subtask, and physiological state changes such as conflicted emotion, severe psychological fluctuation and the like caused by abrupt entering from one task stage to the next task stage are avoided. Therefore, the detected person can keep higher matching degree, and further, near infrared data which can accurately and effectively reflect the current brain function condition of the detected person can be collected.

Further, the countdown cue is further and less significant from the gaze point than the execution content cue of the exercise subtask. For example, as shown in the third display interface 306 of fig. 3 (b), the countdown indicator "about to enter the word forming stage 3s" is farther from the gaze point "+" than the execution content indicator "please repeat the number 12 3 4 5" is from the gaze point "+" and the countdown indicator "about to enter the word forming stage 3s" is smaller in font. In this way, the subject is not disturbed by the countdown cue, and still can keep more attention in the task that he is currently performing, while knowing to some extent the content of the next stage or next exercise subtask. Further, the at least one processor is further configured to present the display content on the screen in a white background and black foreground manner, thereby highlighting the content displayed on the screen of the subject terminal.

In some embodiments of the present application, the duration of the exercise subtask for each stage is shorter than the duration of the target subtask for the corresponding stage. For example, for a first phase number, in the exercise mode, the duration of the exercise subtask for the number may be only 15 seconds, while in the acquisition mode, the duration of the target subtask for the number may be 20 seconds. In particular, in the exercise mode, the second stage group word may include only one exercise subtask, and one exercise subtask has a duration of 15 seconds. In the acquisition mode, the second stage group word may include three target subtasks, each of which has a duration of 20 seconds, and the second stage group word takes at least 60 seconds. Doing exercises prior to performing the target task of the VFT may allow the subject to become familiar with the VFT task in advance. In the case where the duration of the exercise subtask is shorter than the corresponding stage target subtask, the subject is able to exercise the familiar VFT task without being distracted during the acquisition stage due to excessive effort expended during the exercise stage.

In some embodiments of the present application, the at least one processor is further configured to prompt, in an execution content prompt of the exercise subtask, a first material of execution content use in an exercise mode, the first material not being duplicated with a second material of use in an acquisition mode. As shown in fig. 3 (b), in the exercise mode, the first material used by the second phase group word is "world", and as shown in fig. 4 (b), in the collection mode, the second material used by the second phase group word is "white" which is not repeated with "world", or may be "north", "big", etc. The first material used for word grouping by the testee in the training mode is not repeated with the second material used for word grouping in the acquisition mode, so that the real cognitive ability of the testee in the process of executing the VFT task can be reflected, and the problem that the acquired near infrared data are not objective and accurate enough and fail due to the fact that the testee knows and exercises the second material used in the acquisition mode in advance is avoided.

In some embodiments of the present application, the at least one processor is further configured to highlight the first material in comparison to other text in an execution prompt of the exercise subtask in an exercise mode to enable the subject to focus on the first material. At least one of double quotation marks, underlines, bolded or enlarged fonts can be used for the way of highlighting. The first material "white" is highlighted with a double quote as shown in the fourth display interface 407 in the acquisition mode of fig. 4 (b) to enable the subject to pay significant attention to the first material to be used for word formation being "white" as many words as possible.

In some embodiments of the present application, the subject terminal further comprises a communication interface configured to communicatively connect with an operator terminal, the at least one processor is further configured to obtain, via the communication interface, a setting of a target task from the VFT in an acquisition mode of the operator terminal, such as setting, at the operator terminal, a second material used by the target task of the VFT to be "white", "north", "large". The subject terminal provides an exercise mode of the set target task of the VFT according to the set target task of the VFT at the operator terminal. That is, the exercise mode provided by the subject terminal is to follow the target task of the VFT set by the operator terminal, for example, to be consistent with the task phase of the target task of the VFT, the exercise content substantially follows the target task of the VFT, and the like. Therefore, before the target task of the VFT is executed for collecting near infrared data, the examinee can practice based on the examinee terminal to be familiar with the target task of the VFT in advance, so that the coordination degree of the examinee in executing the target task of the VFT is improved. Specifically, the target task of the VFT is configured at the operator terminal, the subject terminal is communicatively coupled to the operator terminal, and the subject terminal enters the acquisition mode in response to the operator terminal.

Alternatively, based on the communication interface receiving a setting of a target task for a VFT from an operator at the subject terminal, an exercise mode of the set target task for the VFT is provided in accordance with the target task for the VFT set at the subject terminal. The operator may also set the training mode of the target task of the VFT at the subject terminal, e.g., the operator sets different task phases at the subject terminal, or sets training content of each training subtask, e.g., sets materials for performing word groups or sets word group phases including several training subtasks, etc. After the setting is completed, the mode of exercise can be started to be entered at the subject terminal, so that the subject terminal can provide the subject with the mode of exercise in the stand-alone mode.

In some embodiments of the present application, the at least one processor is further configured to provide a voice prompt to the subject in the exercise mode in synchronization and in compliance with the on-screen text prompt. That is, in the exercise mode, a voice prompt is issued to the subject by the subject terminal. And the voice prompt sent by the subject terminal is synchronous and consistent with the text prompt displayed on the screen of the subject terminal. The examinee can fully understand the contents to be exercised through the text prompt and the voice prompt provided by the examinee terminal screen, and can impress task contents of each task stage so as to acquire effective near infrared data in an acquisition mode.

In some embodiments of the present application, the at least one processor is further configured to not provide a voice prompt to the subject in the acquisition mode, specifically, in the acquisition mode, in turn, the operator terminal may issue a voice prompt without the need for the voice prompt to be issued by the subject terminal. In addition, the voice prompt provided by the operator terminal is not affected by the terminal of the tested person, for example, the communication of the terminal of the tested person is disconnected or other problems occur, the operator terminal can still carry out voice prompt according to the self setting, so that the tested person can still continue to execute the target task of the VFT according to the voice prompt of the operator terminal under the condition that the terminal of the tested person is disconnected, and the sequential operation of the collection work is ensured.

In some embodiments of the present application, an fNIRS-based brain function assessment system is provided, including a subject terminal according to various embodiments of the present application, and an operator terminal configured to collect near infrared data of a subject while performing a target task of a VFT in response to an interactive operation of the operator indicating collection.

The present application describes various operations or functions that may be implemented or defined as software code or instructions. Such content may be source code or differential code ("delta" or "patch" code) ("object" or "executable" form) that may be executed directly. The software code or instructions may be stored in a computer readable storage medium and, when executed, may cause a machine to perform the functions or operations described and include any mechanism that stores information in a form accessible by a machine (e.g., computing device, electronic system, etc.), such as recordable or non-recordable media (e.g., read Only Memory (ROM), random Access Memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, etc.).

The exemplary methods described herein may be implemented at least in part by a machine or computer.

In some embodiments, a computer readable storage medium is provided, the computer readable storage medium storing a computer program which, when executed by a processor, causes the processor to perform the following processing to provide an exercise mode for a target task of a VFT: on the screen, the training subtasks of the corresponding stages are sequentially executed by text prompts to the testee according to the stage arrangement of the target tasks, so that the strength of the training subtasks of each stage is lower than that of the target subtasks of the corresponding stages; presenting an exercise subtask initiation prompt on the screen at the beginning time of each stage, wherein the exercise subtask initiation prompt at least comprises the names of the exercise subtasks of each stage together with an execution instruction prompt to provide instructions for the testee, and prompting the testee to send out voices according to the instructions to execute each exercise subtask; and stopping presenting the exercise subtask initiation prompt after the start period of each stage on the screen, and continuously presenting an execution content prompt shorter than the execution description prompt for prompting the subject of execution content of the exercise subtask.

The above-described processes performed by the processor may be implemented using software code, including, for example, microcode, assembly language code, higher-level language code, or the like. Various software programming techniques may be used to create various programs or program modules. For example, program portions or program modules may be designed in or with the aid of Java, python, C, C ++, assembly language, or any known programming language. One or more of such software portions or modules may be integrated into a computer system and/or computer readable medium. Such software code may include computer readable instructions for performing various methods. The software code may form part of a computer program product or a computer program module. Furthermore, in examples, the software code may be tangibly stored on one or more volatile, non-transitory, or non-volatile tangible computer-readable media, such as during execution or at other times. Examples of such tangible computer-readable media may include, but are not limited to, hard disks, removable magnetic disks, removable optical disks (e.g., optical disks and digital video disks), magnetic cassettes, memory cards or sticks, random Access Memories (RAMs), read Only Memories (ROMs), and the like.

Furthermore, although exemplary embodiments have been described herein, the scope thereof includes any and all embodiments having equivalent elements, modifications, omissions, combinations (e.g., of the various embodiments across), adaptations or alterations as pertains to the present application. Elements in the claims are to be construed broadly based on the language employed in the claims and are not limited to examples described in the present specification or during the practice of the present application, which examples are to be construed as non-exclusive. It is intended, therefore, that the specification and examples be considered as exemplary only, with a true scope and spirit being indicated by the following claims and their full scope of equivalents.

The above description is intended to be illustrative and not restrictive. For example, the above-described examples (or one or more aspects thereof) may be used in combination with each other. For example, other embodiments may be used by those of ordinary skill in the art upon reading the above description. In addition, in the above detailed description, various features may be grouped together to streamline the application. This is not to be interpreted as an intention that the disclosed features not being claimed are essential to any claim. Rather, the subject matter of the present application is capable of less than all of the features of a particular disclosed embodiment. Thus, the claims are hereby incorporated into the detailed description as examples or embodiments, with each claim standing on its own as a separate embodiment, and it is contemplated that these embodiments may be combined with one another in various combinations or permutations. The scope of the application should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.

The above embodiments are only exemplary embodiments of the present application and are not intended to limit the present application, the scope of which is defined by the claims. Various modifications and equivalent arrangements may be made to the present application by those skilled in the art, which modifications and equivalents are also considered to be within the scope of the present application.

Claims (15)

1. A subject terminal of a VFT for use in an fnigs-based brain function assessment system, comprising at least one processor configured to be capable of providing an exercise mode of a target task of the VFT to provide the subject with an exercise of the target task prior to the subject performing the target task to collect near infrared data, comprising, in particular, in the exercise mode:

on a screen, performing training subtasks of corresponding stages in sequence with text prompts to the testee according to the stage arrangement of the target tasks, so that the strength of the training subtasks of each stage is lower than that of the target subtasks of the corresponding stages;

presenting an exercise subtask initiation prompt on the screen at the beginning time of each stage, wherein the exercise subtask initiation prompt at least comprises the names of the exercise subtasks of each stage together with an execution instruction prompt to provide instructions for the testee, and prompting the testee to send out voices according to the instructions to execute each exercise subtask; and

On the screen, presentation of the exercise subtask initiation prompt is stopped after a start period of each stage, but an execution content prompt shorter than the execution description prompt is presented continuously for prompting the subject of execution content of the exercise subtask.

2. The subject terminal of claim 1, wherein the at least one processor is further configured to perform an acquisition mode of a target task of the VFT, in particular comprising, in the acquisition mode:

on the screen, maintaining a gaze point presented to the subject and following a phase arrangement of the target task, prompting execution of a target subtask of a corresponding phase in synchronization with a voice prompt of an operator terminal;

presenting, on the screen, execution content cues of respective target subtasks below the vicinity of the gaze point at a start period of respective phases; and

on the screen, presentation of the execution content cue of the target subtask is stopped after the start period of each stage and only the gaze point is presented.

3. The subject terminal of claim 1, wherein the at least one processor is further configured to, in the exercise mode: presenting a gaze point above the vicinity while presenting the execution content cue; the gaze point is not presented while the exercise subtask initiation prompt is presented, and the name of the exercise subtask is made more pronounced than executing the instruction hint font.

4. The subject terminal of claim 3, wherein the at least one processor is further configured to, in acquisition mode:

on the screen, maintaining a gaze point presented to the subject and following a phase arrangement of the target task, prompting execution of a target subtask of a corresponding phase in synchronization with a voice prompt of an operator terminal;

on the screen, at the beginning period of each stage, presenting the execution content cue of the target subtask under the vicinity of the gaze point,

the visual appearance and the position of the execution content prompt and the gaze point of the training subtask in the training mode are the same as those of the corresponding execution content prompt and the gaze point of the target subtask in the acquisition mode.

5. The subject terminal of claim 3, wherein the at least one processor is further configured to, in the exercise mode: and presenting a countdown prompt in a later period of each exercise subtask on the screen, wherein the countdown prompt is presented together with the gazing point and the execution content prompt of the current exercise subtask, and the countdown prompt is used for prompting the time of entering the next stage or the next exercise subtask.

6. The subject terminal of claim 5, wherein the countdown cue is further and less pronounced from the gaze point than an execution content cue of the exercise subtask.

7. The subject terminal of claim 1, wherein the duration of the exercise subtask for each stage is shorter than the duration of the target subtask for the corresponding stage.

8. The subject terminal of claim 1, wherein the at least one processor is further configured to: and in the training mode, prompting a first material used by the execution content in the execution content prompt of the training subtask, wherein the first material is not repeated with a second material used in the acquisition mode.

9. The subject terminal of claim 8, wherein the at least one processor is further configured to: in the training mode, the first material is marked with prominence compared with other words in the execution content prompt of the training subtask so that the first material can be focused by the testee.

10. The subject terminal of claim 1, further comprising a communication interface configured to: a communicably connected with an operator terminal;

The at least one processor is further configured to:

acquiring settings of target tasks of the VFT in an acquisition mode from the operator terminal via the communication interface, providing an exercise mode of the set target tasks of the VFT according to the target tasks of the VFT set at the operator terminal; or alternatively

Receiving a setting from an operator at the subject terminal regarding a target task of a VFT, providing an exercise mode of the set target task of the VFT according to the set target task of the VFT at the subject terminal.

11. The subject terminal of claim 1, wherein the at least one processor is further configured to: in the exercise mode, voice prompts are provided to the subject in synchronization and in compliance with the on-screen text prompts.

12. The subject terminal of claim 2, wherein the at least one processor is further configured to: in the acquisition mode, no voice prompt is provided to the subject.

13. The subject terminal of claim 5, wherein the countdown cue comprises phase information of a next phase or execution content information of a next exercise subtask.

14. An fNIRS-based brain function assessment system, comprising:

the subject terminal of a VFT according to any one of claims 1-13; and

an operator terminal configured to: near infrared data is collected when the subject performs the target task of the VFT in response to the operator indicating the interactive operation of the collection.

15. A computer readable storage medium, wherein the computer readable storage medium stores a computer program which, when executed by a processor, causes the processor to perform the following process to provide an exercise pattern for a target task of a VFT:

on the screen, the training subtasks of the corresponding stages are sequentially executed by text prompts to the testee according to the stage arrangement of the target tasks, so that the strength of the training subtasks of each stage is lower than that of the target subtasks of the corresponding stages;

presenting an exercise subtask initiation prompt on the screen at the beginning time of each stage, wherein the exercise subtask initiation prompt at least comprises the names of the exercise subtasks of each stage together with an execution instruction prompt to provide instructions for the testee, and prompting the testee to send out voices according to the instructions to execute each exercise subtask; and

On the screen, presentation of the exercise subtask initiation prompt is stopped after a start period of each stage, but an execution content prompt shorter than the execution description prompt is presented continuously for prompting the subject of execution content of the exercise subtask.

Images