JP3565936B2 - Exercise support system and exercise support method - Google Patents

Description

[0001]
[Industrial applications]
The present invention relates to an exercise support system and an exercise support method, and more particularly, to an exercise support system and an exercise support method for assisting a person to exercise correctly.
In general, patients who require rehabilitation have paralysis remaining in a part of their body due to cerebral hemorrhage, cerebral infarction, subarachnoid hemorrhage, head injury, brain tumor, and the like. Immediately after the onset of the disease, the patient is hospitalized, and after recovery is observed, training for functional recovery (rehabilitation) of paralyzed parts of the body is started at a rehabilitation facility. He is discharged from the hospital when function is almost restored, and will continue rehabilitation at home.
[0002]
In the rehabilitation facility, rehabilitation training such as physiotherapy for extending the range of operation by extending the joints of the limbs and performing gait training, and occupational therapy for performing handicrafts, coloring, jigsaw puzzles, etc., are performed. Then, perform physical rehabilitation training based on what the physiotherapist or occupational therapist explained to the patient and the attendant (family, etc.) before leaving the hospital, or book, TV broadcast, video (recording TV programs on video, etc.) ) And so on.
[0003]
However, once discharged from the hospital and returned home, many patients do not continue rehabilitation, and there are cases where the paralyzed part stops moving.
Therefore, a system that can reliably continue rehabilitation even at home is needed.
[0004]
[Prior art]
2. Description of the Related Art Conventionally, rehabilitation performed to recover motor function lost due to illness or the like is performed at a rehabilitation facility of a hospital under the guidance of a physiotherapist or occupational therapist. However, when the patient is discharged from the hospital and returns home, many patients do not continue rehabilitation, and often lose their motor function again. For this reason, in order to continue rehabilitation even at home, guidance was conventionally provided by books, videos, and the like.
[0005]
[Problems to be solved by the invention]
However, in the conventional rehabilitation guidance using books and videos, since the patient cannot grasp his or her exercise state, there has been a problem that appropriate rehabilitation is difficult to be performed, recovery is delayed, and conversely, the body is broken.
[0006]
The present invention has been made in view of the above points, and an object of the present invention is to provide an exercise support system and an exercise support method that allow one person to perform appropriate exercise.
[0007]
[Means for Solving the Problems]
FIG. 1 shows a principle diagram of the present invention.
The imaging unit 1 has a plurality of imaging units that image a user from different directions .
Storing means 2 stores a plurality of sets of video.
[0008]
The setting unit 3 sets the output order of a plurality of sets of moving images.
The control unit 4 reads a plurality of sets of images stored in the storage unit 2 in the order set by the setting unit 3 and uses the plurality of imaging units from the same direction as the direction of the image read from the storage unit 2 among the plurality of imaging units. The imaging unit is controlled so that an image is output from an imaging unit that captures a person.
The display unit 5 displays the image output from the imaging unit 1 by the control unit 4 and the moving image read by the storage unit 2.
[0009]
Claim 2 compares the movement of the user detected by the detection means with the movement of the user detected by the detection means and the movement of the image read from the storage means by the control means. And a determination unit for determining whether a correct operation is performed according to a difference between the image and the motion of the image, and outputting a determination result.
[0010]
According to a third aspect of the present invention, when the determination unit presets an allowable range of a difference between the motion of the user and the motion of the image, and the difference between the position and the speed is within the allowable range, the operation is correct. Is determined.
[0011]
According to a fourth aspect of the present invention, there is provided a voice output device for outputting a result of the determination made by the determination device as a voice.
According to a fifth aspect of the present invention, there is provided a determination content supply unit that supplies the determination result determined by the determination unit and the content of the image read from the storage unit by the control unit to another terminal device.
[0012]
Claim 6 is a motion support method for supporting correct execution of a predetermined motion of a user , wherein the plurality of sets of images are read out from a storage unit in which images are stored in a predetermined order, and are read from different directions. An image output step of outputting an image from the imaging unit that images the user in the same direction as the direction of the image read from the storage unit among the plurality of imaging units that image the user; and an imaging unit that is read in the image output procedure And a display procedure for displaying the image captured in the step (a) and the image read from the storage means.
[0013]
[Action]
According to the first aspect of the present invention, since a plurality of sets of images stored in the storage means can be read out by the control means in a preset order by the setting means and displayed on the display means, the display order of the plurality of sets of images can be set. It can be set freely by means, and images can be displayed in an order according to the user's exercise.
[0014]
Further, the set image and the image of the user are displayed on the display means, and the user can exercise while comparing his own movement with the set image.
Furthermore, by providing a plurality of imaging units for imaging the user from different directions, and by switching the imaging direction of the user according to the display direction of the set image, the image of the user from the direction corresponding to the set image can be obtained. Since the image can be displayed, the image is displayed from a direction characteristic of the operation, and therefore, a more accurate motion instruction can be performed.
[0015]
According to the second and third aspects, the movement of the user is detected by the detecting means, the movement of the user detected by the determining means is compared with the movement of the set image, and a correct movement is made from the difference. For example, if the difference between the position and the difference between the velocities are within a predetermined allowable range, it is determined that the operation is correct, and by outputting the determination result, the user and the rehabilitation The condition of rehabilitation can be notified to specialists, and guidance can be given to users to perform appropriate rehabilitation.
[0016]
According to the fourth aspect, since the user can be notified of the determination result by voice using the voice output unit, the user can know his or her own movement while concentrating on the image on the display unit.
According to the fifth aspect, since the determination result can be provided to another terminal device by the determination content providing means, the content of the rehabilitation at home of the user can be easily provided to the specialist of the medical institution.
[0017]
According to the sixth aspect, a plurality of imaging units for imaging the user from different directions are provided, and the imaging direction of the user is switched in accordance with the display direction of the set image, so that the imaging direction from the direction corresponding to the set image is changed. Since the image of the user can be displayed, the image is displayed from a direction characteristic of the operation, and therefore, a more accurate exercise instruction can be given.
[0018]
【Example】
FIG. 2 is a block diagram of an embodiment of the present invention, and FIG. 3 is a diagram for explaining a use state of the embodiment of the present invention. The rehabilitation support system 11 of the present embodiment includes a plurality of sets of moving images formed by a series of rehabilitation operations, reproduction order information for determining a reproduction order of the moving images, position information for determining a position of a video camera, zoom information for determining a zoom of a video camera, A storage unit 12 for storing the reproduction content, a comparison result of the motion of the user image from the video camera and the motion image, and the like, the reproduction of the moving image according to the information stored in the storage unit 12, camera control, rehabilitation diagnosis, A control unit 13 for performing control such as communication control and data processing; an input unit 14 for giving instructions to the control unit 13 such as a reproduction order of moving images; video camera devices 15 and 16 for imaging a user; , 16 which controls the switching of the video signals from the video signals, a moving image supplied from the control unit 13 and a display for displaying an image corresponding to the video signal 18, composed of a communication unit 20 for performing diagnostic results or the like which is diagnosed by the control unit 13 voice instruction section 19 instructs a voice, the communication with the medical institutions.
[0019]
The input unit 14 corresponds to the setting means, keyboard, is constituted by a mouse or the like, setting the reproduction start of controller selection and playback sequence information D ₂ of the processing functions of 13, an instruction of stopping the like.
The video camera 15 is attached to the upper part of the display unit 18 and configured to capture an image of the front of the user A.
[0020]
The video camera 16 is mounted on the mount 21 and is arranged on the left side of the user A so as to capture an image of the left side of the user A.
In addition, the video cameras 15 and 16 are provided with zoom control units 15a and 16a that can change the size of the imaging target, so that the scales of the imaging target and the moving image can be matched.
[0021]
The zoom control units 15a and 16a are connected to the video camera control unit 17, and the zoom is controlled according to a control signal from the video camera control unit 17.
The video camera control unit 17 controls the zoom control units 15 a and 16 a of the video cameras 15 and 16, and switches to supply of video signals from the video cameras 15 and 16 to the control unit 13 according to an instruction from the control unit 13. Perform control.
[0022]
The display unit 18 comprises a display device such as a cathode ray tube (CRT) or the like. The screen displays a moving image display unit 18a for displaying a moving image, a user display unit 18b for displaying a user, and a comparison result of both images and rehabilitation contents. It comprises a content display section 18c.
In this embodiment, as shown in FIG. 4A, the moving image display section 18a and the user display section 18b are displayed separately on the left and right sides of the screen. 4B, the screen may be vertically divided as shown in FIG. 4B, and the screen may be set so as to be easily recognized by the user according to the content of the rehabilitation.
[0023]
The storage unit 12 is composed of , for example, an information recording / reproducing device such as a flexible disk drive and a recording medium such as a flexible disk. The recording information should be reproduced from a plurality of sets of moving image information D1 relating to rehabilitation and a plurality of sets of moving image information. Playback order information D2 for outputting moving picture information in order, video camera position information D3 storing display angle information of each moving picture, video camera zoom information D4 storing information of a zoom amount of each moving picture, control unit 13 is composed of reproduction content information D5 which is the reproduction content of the moving image at 13 and comparison result information D6 which holds the comparison result between the moving image subjected to the comparison processing by the control unit 13 and the video image of the user.
[0024]
The communication unit 20 is provided between the control unit 13 and the telephone line 22 and connects the control unit 13 to the telephone line.
The control unit 13 is composed of an electronic computer or the like, playback order setting function 13a of setting reproduction sequence information D ₂ to determine the reproduction order of the stored moving image in the storage unit 12, reproduction order stored in the storage unit 12 information D ₂ based on the select video D _1, video playback processing function 13b of reproducing, the memory unit 12 selects the image of the video camera position data D ₃ and a video camera zoom information video camera 15 on the basis of the D _4, the zoom A camera control processing function 13c for performing control; a diagnosis processing function 13d for comparing images of the video cameras 15 and 16 with moving images in the storage unit 12 to determine whether correct rehabilitation is being performed; The communication function 13e for performing
[0025]
The moving image reproduction processing function reads the moving image D1 stored in the storage unit 12 in advance in the storage unit 12 or in accordance with the reproduction order information D2 set by the input unit 14, supplies the read moving image D1 to the display unit 18, and displays it.
FIG. 5 is an operation explanatory diagram of the reproduction order information setting function 13a according to one embodiment of the present invention.
[0026]
In this embodiment, in order to allow the patient to easily set the reproduction order information, the control unit 13 automatically sets the reproduction order information by selecting a symptom. When the reproduction order setting function 13a is selected by the input unit 14, as shown in FIG. 5A, the paralyzed side (left, right), the paralyzed part (neck, shoulder, arm, waist, foot), symptom (severe, moderate, A screen for selecting "Mild" is displayed.
[0027]
The user operates the input unit 14 to select a paralyzed side, a paralyzed part, and a symptom, and performs an input operation. For example, as shown in FIG. 5A, if the user selects the paralyzed side (right), the paralyzed part (shoulder), and the symptom (mild), the reproduction order information setting function 13a of the control unit 13 is selected. Exercise is set in a preset order according to the combination of information, and as shown in FIG. 5 (B), a neck effective for shoulder rehabilitation, initial exercise of right hemiplegia, right hemiplegia of shoulder The reproduction order information of the moving image is set in the order of the medium-term exercise and the like.
[0028]
Thus, the user simply inputs the paralyzed side, paralysis part, symptoms, can be set easily playback order.
FIG. 6 shows an operation flowchart of the moving image processing function 13b. At the time of moving image reproduction processing, the control unit 13 first reads the reproduction order information D2 set in advance from the storage unit 12 or by the input unit 14, and sets the reproduction order information D2-1 set first as reproduction information inside. (Steps S1-1 and S1-2).
[0029]
Next, the control unit 13 supplies to the display unit reads the video information _{D 1-1} corresponding to the reproduction order information _{D 2-1,} which is set from the storage unit 12 (step S1-3).
When the reproduction of the moving image is completed, the next reproduction order information D _2-2 is set as the reproduction information, and the moving image information D _1-2 corresponding to the reproduction order information D _2-2 set as the reproduction information is read from the storage unit 12. The data is supplied to the display unit 18 (steps S1-4 to S1-6). Repeated until no playback order information _{D 2-2} that is set to the above steps S1-3～S1-6.
[0030]
The camera control processing function 13c in accordance with a video camera zoom information set in advance in accordance with the degree of zoom preset video camera position information D ₃ and moving in accordance with the video of the angle in the storage unit 12 the video camera control unit 17 is controlled so that the image information supplied from the video cameras 15 and 16 and the moving image are displayed in substantially the same size and from the same direction.
[0031]
FIG. 7 shows an operation flowchart of the camera control processing function 13c according to one embodiment of the present invention.
Camera control processing function 13c in video playback function 13b of the control unit 13 starts reproduction order information when D ₂ is set, the video camera position data D ₃ corresponding to the reproduction order information D ₂ that is set from the storage section 12 and import video camera zoom information _{D 4} (step S2-1, S2-2).
[0032]
Next, the control unit 13 controls the video camera control unit 17 according to the video camera position information D ₃ and the video camera zoom information D ₄ read from the storage unit 12. Here, the control unit 13 Biteokamera controller to supply the video signal from the video camera 15, 16 being imaged from a direction matching the direction in which to display video according to a video camera position data D ₃ 17 and the zoom of the video cameras 15 and 16 is controlled according to the video camera zoom information (steps S2-3 and S2-4).
[0033]
The diagnostic processing function 13d compares the images from the video cameras 15 and 16 with the image of the moving image information stored in the storage unit 12, evaluates the rehabilitation training according to the difference between the two images, and gives a training instruction. The function to perform.
For example, if the motion of the images from the video cameras 15 and 16 is slower than the motion of the moving image, a message such as "Move faster" is displayed.
[0034]
FIG. 8 shows an operation flowchart of the diagnostic processing function 13d according to one embodiment of the present invention.
When the user selects the diagnostic processing function 13d by the input unit 14, the diagnostic processing function 13d of the control unit 13 inputs the reproduced moving image and the images from the video cameras 15 and 16 together with the reproduction of the moving image during the moving image reproduction process ( Steps S3-1 and S3-2).
[0035]
Next, the diagnostic processing function 13d extracts the outline of the moving image from the storage unit 12 and the outline of the image from the video cameras 15 and 16 by performing processing such as binarizing the input image (step S13). S3-3).
Next, the diagnostic processing function 13d superimposes the outlines of the two extracted images and compares the positions and the moving speeds of the two images (step S3-4).
[0036]
At this time, the diagnostic processing function 13d determines whether or not the difference between the positions of the two images is within a predetermined range, and determines whether or not the difference between the moving speeds of the two images is within a predetermined range. If the moving speed is within the predetermined range, it is determined that the same operation as that of the moving image is being performed, and the display unit 18 is controlled so as to display that a correct moving image is being performed (step S3). -5, S3-6).
[0037]
Further, when the difference between the positions of the two images exceeds a predetermined range, when the position of the user's image is at a position advanced from the position of the moving image, the movement amount is too large and at a position delayed. When the moving amount is determined to be small, further, if the image moving speed of the user is larger than the moving speed of the moving image, the moving speed is too fast, and if it is smaller, it is determined that the moving speed is too slow. The display unit 18 and the voice instructing unit 19 are controlled so that the display and the voice instruction are performed in accordance with the case of, and the exercise instruction corresponding to each case is performed.
[0038]
The above determination result is stored along with the video content information D ₇ at that time as the comparison result information D ₆ in the storage unit 12 (step S3-8).
The communication processing function 13e communicates with a medical institution such as a hospital through the communication control unit 20, instructs reproduction order information for setting a reproduction order of moving images from the medical institution, and sends a result of rehabilitation to the medical institution. It is a function that can give an appropriate instruction by an expert.
[0039]
FIG. 9 is an operation explanatory diagram of one embodiment of the present invention.
As shown in FIG. 9A, the moving image is displayed as a graphic in which human joints and the like can be easily recognized.
When the diagnosis processing function 13c is used, for example, when the arm Aa of the user A is slower than the arm Ba of the moving image B as shown in FIG. When the arm Aa of the user A and the arm Ba of the moving image B stop at a certain angle θ as shown in FIG. 9C, a display such as “Please move further” and a voice instruction are given. Done.
[0040]
In this embodiment, the movement of the user is detected from the images of the user captured by the video cameras 15 and 16. However, the present invention is not limited to this. , A detection device for detecting the movement of the user using the detection device may be provided, and the determination of the movement may be performed using the detection device. In this case, the movement of the user can be detected more accurately than that which detects the movement of the user from the image of the video camera, so that the movement can be accurately determined and an accurate instruction can be issued. Therefore, rehabilitation can be performed effectively.
[0041]
In the present embodiment, rehabilitation is described as the exercise to be supported. However, the present invention is not limited to this, and it is needless to say that the present invention can be applied to a case in which exercise for properly performing training exercise such as sports is supported.
[0042]
【The invention's effect】
As described above, according to the first aspect of the present invention, a plurality of sets of images stored in the storage unit can be read out in the order set in advance by the setting unit by the control unit and displayed on the display unit. The display order can be freely set by the setting means, images can be displayed in an order according to the user's symptoms, and appropriate rehabilitation can be performed continuously.
[0043]
In addition, a moving image and an image of the user are displayed on the display means, and the user can perform rehabilitation while comparing his own movement with the movement of the set image, so that the user can perform proper rehabilitation by himself / herself. Having.
Furthermore, by providing a plurality of imaging units for imaging the user from different directions and switching the imaging direction of the user according to the display direction of the setting image, an image of the user from a direction corresponding to the setting image can be displayed. Therefore, an image can be displayed from a direction having a characteristic in the operation, and therefore, there is a feature that a more accurate motion instruction can be given.
[0044]
According to claims 2 and 3, the movement of the user is detected by the detection means, the movement of the user detected by the determination means is compared with the movement of the moving image, and it is determined whether or not the correct movement is made based on the difference. Judgment, for example, if the difference between the position and the difference between the velocities are within a predetermined allowable range, it is judged that the operation is correct, and the judgment result is output to the user and the rehabilitation specialist. It can inform the user of the state of rehabilitation, and can provide guidance to the user to perform proper rehabilitation, and thus can provide effective rehabilitation.
[0045]
According to the fourth aspect, the determination result can be notified to the user by voice using the voice output means, so that the user can know his or her own movement while concentrating on the image on the display means. It has features such as the ability to perform rehabilitation.
[0046]
According to the fifth aspect, since the determination result can be provided to another terminal device by the determination content providing means, the content of the rehabilitation at home of the user can be easily provided to the specialist of the medical institution, and appropriate guidance can be provided. It has features such as being able to receive.
According to the sixth aspect, a plurality of imaging units for imaging the user from different directions are provided, and the imaging direction of the user is switched according to the display direction of the set image, so that the imaging direction from the direction corresponding to the set image is changed. Since the image of the user can be displayed, the image is displayed from a direction having a characteristic in the operation, and therefore, there is a feature that a more appropriate exercise instruction can be given .
[Brief description of the drawings]
FIG. 1 is a diagram illustrating the principle of the present invention.
FIG. 2 is a block diagram of one embodiment of the present invention.
FIG. 3 is a diagram for explaining a use state of one embodiment of the present invention.
FIG. 4 is a configuration diagram of a display screen according to an embodiment of the present invention.
FIG. 5 is an explanatory diagram of an operation of a reproduction order setting function according to an embodiment of the present invention.
FIG. 6 is an operation flowchart of a moving image reproduction processing function according to an embodiment of the present invention.
FIG. 7 is an operation flowchart of a camera control processing function according to an embodiment of the present invention.
FIG. 8 is an operation flowchart of a diagnostic processing function according to an embodiment of the present invention.
FIG. 9 is an operation explanatory diagram of one embodiment of the present invention.
[Explanation of symbols]
REFERENCE SIGNS LIST 1 imaging unit 2 storage unit 3 setting unit 4 control unit 5 display unit 11 rehabilitation support system 12 storage unit 13 control unit 14 input unit 15, 16 video camera 17 video camera control unit 18 display unit 19 voice instruction unit

Claims (6)

Imaging means having a plurality of imaging units for imaging the user from different directions ,
Storage means for storing a plurality of sets of images;
An imaging unit that reads the plurality of sets of images stored in the storage unit in a preset order and , among the plurality of imaging units, captures the user from the same direction as the direction of the image read from the storage unit Control means for controlling the image pickup means so that an image from is output,
An exercise support system comprising: a display unit configured to display , by the control unit, an image output from the imaging unit and an image read from the storage unit . Detection means for detecting the movement of the user;
Comparing the movement of the user detected by the detection means with the movement of the image read from the storage means by the control means, and according to a difference between the movement of the user and the movement of the image; The exercise support system according to claim 1, further comprising: a determination unit configured to determine whether or not a correct operation is being performed and to output a determination result. The determination unit sets an allowable range of a difference between the motion of the user and the motion of the image in advance, and determines that the operation is correct when the difference between the position and the speed is within the allowable range. The exercise support system according to claim 2, wherein the determination is made. The exercise support system according to claim 2 , further comprising a voice output unit that outputs the determination result determined by the determination unit as a voice. 3. The apparatus according to claim 2 , further comprising a determination content supply unit configured to supply the determination result determined by the determination unit and the content of the image read from the storage unit by the control unit to another terminal device. 5. The exercise support system according to claim 4. An exercise support method for supporting correct execution of a predetermined exercise of a user,
Images are read out from a storage unit in which a plurality of sets of images are stored in a predetermined order, and the image is read from the same direction as the direction of the image read out from the storage unit among a plurality of imaging units that image the user from different directions. An image output procedure for outputting an image from an imaging unit for imaging the user,
An exercise support method , comprising: a display step of displaying an image taken by the image pickup unit read in the image output step and an image read from the storage means .

Images