KR101988166B1 - Therapeutic apparatus for rehabilitation using vision system - Google Patents

Abstract

The present invention relates to a rehabilitation exercise machine using a vision system. A rehabilitation treatment apparatus, which is an aspect of the present invention, comprises: a fixing unit for fixing at least a part of a user′s body; a moving unit for moving at least a part of the fixed body to perform rehabilitation treatment; a camera for capturing an action of at least one of the fixed unit and the moving unit; and a control unit for determining first information related to the rehabilitation treatment using the image data photographed by the camera. A rehabilitation exercise machine using a vision system for determining information related to rehabilitation treatment using the photographed image data can be provided to a user.

Description

[0001] The present invention relates to a therapeutic apparatus for rehabilitation using vision system,

The present invention relates to a rehabilitation exercise machine using a vision system. More particularly, the present invention relates to a method for rehabilitating a subject by moving at least a part of a fixed body, capturing an action of at least one of a fixed part and a moving part, and determining information related to the rehabilitation treatment using the captured image data And a rehabilitation exercise machine using a vision system.

Due to the development of science and technology and medical technology, the aging of society is rapidly progressing not only in Korea but also in the whole world, and industrial trends are changing to prepare for aging society.

According to the National Health Insurance Corporation (NHIC), from 2005 to 2010, the total amount of medical expenses for geriatric diseases increased by 271% and that for public corporations increased by 272.5% And the importance of healthcare for older people.

One of the most representative of geriatric diseases is degenerative joint disease, which has recently occurred not only in the elderly, middle-aged, and younger.

The main causes for this are erroneous postural habits, excessive intake of sodium and sugars, weight gain, excessive work and stress, lack of exercise or joint injuries due to intense exercise.

Rehabilitation exercises are very important because the range of joint motion and the speed of recovery vary with subsequent recovery therapy.

However, since the joints rehabilitation exercise is accompanied by a lot of pain, it is difficult for the patient to exercise by himself or herself. Therefore, Limitation Of Motion (LOM) appears due to contracture and inflammation.

To prevent this, joint movement range exercise is performed. The most common joint movement is CPM (Continuous Passive Motion), which is a movement performed by a pure external force such as a therapist or a mechanical device. It provides restorative function by continually providing passive movement to on-patient or surgical patients.

Because CPM is a manual movement by a mechanical device, not by itself, it restores the range of motion (ROM) without fatigue and helps reduce pain and prevent complications. As a result, there have been a large number of companies that rent CPM devices to allow patients with joint diseases to exercise at home.

However, existing CPM devices have a problem that it is difficult to physically adjust the exercise angle, speed, and frequency of the exercise by the physiotherapist or the patient himself, and change the initial exercise setting in real time according to the patient's condition.

In addition, there is a problem that frequent occurrence of side effects due to excessive exercise or rehabilitation exercise due to too weak exercise is frequently caused by such problems.

In addition, since the CPM device alone can not grasp the recovery degree of the patient, there is a problem that it is impossible to realize the customized rehabilitation treatment unless the patient records the data of ROM, the number of times,

Therefore, there is a need for a rehabilitation apparatus, system, and control method that can solve such a problem.

Korean Intellectual Property Office Registration No. 10-1501838 Korean Intellectual Property Office Registration No. 10-1646914

The present invention intends to provide a user with a rehabilitation exercise device using a vision system.

More particularly, the present invention relates to a method for rehabilitating a subject by moving at least a part of a fixed body, capturing an action of at least one of a fixed part and a moving part, and determining information related to the rehabilitation treatment using the captured image data And to provide the user with a rehabilitation exercise device using the vision system.

It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are not intended to limit the invention to the precise form disclosed. It can be understood.

According to an aspect of the present invention, there is provided a rehabilitation treatment apparatus including: a fixing unit fixing at least a part of a user's body; A moving part for moving at least a part of the fixed body to perform rehabilitation treatment; A camera for capturing an action of at least one of the fixed portion and the motion portion; And a controller for determining first information related to the rehabilitation treatment using the image data photographed by the camera; . ≪ / RTI >

A communication unit for transmitting the first information to the outside; And a display unit displaying the second information when the second information corresponding to the first information is received through the communication unit.

In addition, at least a part of the motion unit may further include at least one identifier, and the control unit may determine the first information using the at least one identifier in the image data.

The at least one identifier may be at least one of a singular point included in at least a part of the motion unit and a marker included in at least a part of the motion unit.

The marker may include a first marker provided on at least a part of the fixing part and a second marker provided on at least a part of the moving part, and the control part controls the first marker and the second marker in the image data, And the first information can be determined using the positional change of the recognized first marker and the second marker.

The control unit extracts first vector information from the rotation of the first marker induced by the body fixing operation of the fixing unit, extracts second vector information of the first marker corresponding to the length of the motion unit, The first vector information may be compared with the second vector information to determine the first information.

The first marker may further include a fixed identifier indicating a degree of fixation of the fixed portion by a body fixing operation, and the control unit may extract the first vector information using the fixed identifier.

The control unit may determine the thickness of the fixed body based on the positional change of the fixed identifier, extract the first vector information based on the degree of rotation of the fixed identifier, The degree of fixation of the body can be determined from the rotation value of the first vector information.

The first information may include at least one of the thickness information, the fixed degree information, the length information of the fixed portion, the motion velocity information of the motion portion, and the motion frequency information of the motion portion.

The apparatus of claim 1, further comprising: a memory for storing a close loop connected with the at least one identifier, wherein the control unit controls the at least one of the at least one identifier, the at least one identifier, At least one of the identifiers can be recognized.

The present invention can provide a user with a rehabilitation exercise device using a vision system.

More particularly, the present invention relates to a method for rehabilitating a subject by moving at least a part of a fixed body, capturing an action of at least one of a fixed part and a moving part, and determining information related to the rehabilitation treatment using the captured image data A rehabilitation exercise device using the vision system can be provided to the user.

In addition, the present invention has the following disadvantages: (1) the angle of the patient is different from the angle of motion of the patient in measuring the angle of the device, (2) the conventional problem that the patient data record depends on the handwriting of the therapist, (3) (4) it is impossible to grasp the actual ROM of the patient, and (5) the problem that the wrong treatment is provided due to a mistake can be solved.

In addition, the data stored according to the present invention can be used as a big data by applying cloud computing technology according to the need in the future, so that it can be utilized as research data on treatment and recovery of joint diseases, Can also be used.

It should be understood, however, that the effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those skilled in the art to which the present invention belongs It will be possible.

1 is a view for explaining an example of degenerative arthritis of the knee related to the present invention.
Fig. 2 shows a conventional rehabilitation exercise device and an example of use related to the present invention.
3 is a block diagram of a rehabilitation exercise system proposed by the present invention.
FIG. 4 is a block diagram of a rehabilitation apparatus and a vision system in the rehabilitation exercise system proposed by the present invention.
FIG. 5 shows a specific example of a motion module of the exercise apparatus proposed by the present invention illustrated in FIG.
FIG. 6 illustrates a specific example of a motion module having a vision system in the exercise device proposed by the present invention illustrated in FIG.
FIG. 7 shows a specific example of acquiring an image through motion capture applied to the present invention.
FIG. 8 is a view for explaining an active marker system, a passive marker system, and a marker-free system applied to the present invention.
FIG. 9 shows a concrete example of a position of a target using a retroreflective sheet or the like, which is an example of a marker in the present invention.
FIG. 10 shows a concrete example of attaching a marker to an exercise device of a rehabilitation treatment system having a vision system proposed by the present invention.
11 is a flowchart for explaining a rehabilitation exercise method using a vision system proposed by the present invention.
Figs. 12 to 14 are diagrams for explaining at least necessary information and obtainable information for accurate measurement relating to rehabilitation motion. Fig.
Figure 15 is a flow chart illustrating a method for reducing processing load and time using a closed curve connecting multiple points of a marker.
FIGS. 16A to 16D are diagrams illustrating a process of reducing the processing load and time using a closed curve connecting the plurality of points described in FIG. 15. FIG.
Figs. 17A and 17B show an example of a rehabilitation apparatus according to the present invention, which can be transformed into CPM and CAM, for confirmation of ROM before or after a rehabilitation exercise.
18 is a flowchart illustrating a process of confirming and rehabilitating a range of motion (ROM) by using the CAM mechanism prior to the rehabilitation exercise, in the context of the present invention.
FIG. 19 is a flowchart illustrating the process of confirming the ROM and using the CAM mechanism after the rehabilitation exercise to inform the server for user management.
FIG. 20 is a flowchart illustrating a method of handling a pain event and a method of managing the user through the method according to the present invention.
21 is a flowchart illustrating a first method for identifying a user in a rehabilitation exercise platform service according to the present invention.
22 is a flowchart illustrating a second method for identifying a user in a rehabilitation exercise platform service according to the present invention.
23 is a flowchart illustrating a first method of providing user identification and advertisement contents in a rehabilitation exercise platform service according to the present invention.
24 is a flowchart illustrating a second method of providing user identification and advertisement contents in a rehabilitation exercise platform service according to the present invention.
FIG. 25 is a flowchart illustrating a first method relating to rehabilitation exercise and services in the rehabilitation exercise platform service according to the present invention.
26 is a flowchart illustrating a second method relating to rehabilitation exercise and services in the rehabilitation exercise platform service according to the present invention.
FIG. 27 is a flowchart illustrating a service utilization method after a database is constructed in a rehabilitation exercise platform service according to the present invention.

One of the most representative of geriatric diseases is degenerative joint disease, which has recently occurred not only in the elderly, middle-aged, and younger.

The main causes for this are erroneous postural habits, excessive intake of sodium and sugars, weight gain, excessive work and stress, lack of exercise or joint injuries due to intense exercise.

1 is a view for explaining an example of degenerative arthritis of the knee related to the present invention.

FIG. 1 (a) shows an example of a normal knee joint, FIG. 1 (b) shows an example of early degenerative arthritis, and FIG. 1 (c) shows an example of severe degenerative arthritis will be.

Rehabilitation exercises are very important because the range of joint motion and the speed of recovery vary with subsequent recovery therapy.

However, since the joints rehabilitation exercise is accompanied by a lot of pain, it is difficult for the patient to exercise by himself or herself. Therefore, Limitation Of Motion (LOM) appears due to contracture and inflammation.

To prevent this, joint movement range exercise is performed. The most common joint movement is CPM (Continuous Passive Motion), which is performed by pure external forces such as a therapist or a mechanical device. It is intended to restore joint function by providing continuous passive motion to patients or patients.

In addition, CAM (Continuous Active Motion) is also used for rehabilitation.

Joint movement range As a kind of movement, there is Passive Range of Motion (PROM).

Passive joint movements are joint movement range movements within the pain range due to external force (such as a therapist or mechanical device) without vasoconstriction.

In addition, passive joint movements are needed early in the fracture, and the primary goal is to prevent tissue formation and adhesion. It was introduced and used in the late 1970s.

Movement of the passive joint may cause additional damage due to the range of motion that crosses the pain range and should be carefully promoted according to the patient's endurance.

Another joint movement range movement is the active-assist range of motion (AAROM).

Joint movement is a form of active motion that is supplemented by external forces when the jerk is not sufficient to perform the full movement.

As another joint movement range movement, the Active Range of Motion (AROM) refers to joint movement range movement that is achieved by active contraction of the muscles without assistance or resistance.

Active joint movements are the next step in AAROM and are exercises that do not give the patient any assistance, but are done by themselves.

Because CPM is a manual movement by a mechanical device, not by itself, it restores the range of motion (ROM) without fatigue and helps reduce pain and prevent complications.

2 shows a CPM device for a knee joint and an example of its use according to the present invention.

The CPM device for the knee joint shown in FIGS. 2 (a) and 2 (b) can easily control the speed, the angle, the time, the number of times, and the like according to the state of the patient, and can confirm the motion state.

However, there is a large deviation between the maximum exercise angle designated on the CPM device and the actual range of motion of the patient, and the CPM device can not confirm or correct the difference, and thus there is a problem that the recovery degree of the patient is large.

In addition, physiotherapists or exercise prescribers believe ROM only on the CPM device and treat them unreasonably without consideration of patient's pain and actual ROM, resulting in post-exercise pain, side effects such as rupture and recurrence of the surgical site.

In addition, it is impossible to store individual exercise data in a CPM device commonly used by a large number of patients, such as a large hospital or a rehabilitation clinic, and it is possible to customize individual patients only when a physical therapist or an exercise prescriber records handwriting.

However, in reality, it is difficult to record the condition of the patient during the CPM exercise in real time, so that data management of the patient's exercise history and recovery degree is almost impossible.

In addition, as shown in FIG. 2 (b), in order to measure the actual ROM of the patient, a separate device such as a ROM goniometer or a joint motion range measuring device (ROM measuring device) should be used. There is still a limit to the accuracy of patient recovery and data management.

Accordingly, in this specification, in order to solve such a problem, at least a part of the fixed body is moved to perform rehabilitation treatment, the operation of at least one of the fixed part and the moving part is photographed, and the information related to the rehabilitation treatment To provide a user with a rehabilitation exercise device using a vision system.

Hereinafter, for the sake of convenience of explanation, the rehabilitation treatment for the knee will be described below. However, the present invention is not limited to the knee rehabilitation, but can be applied to various fields related to the patient's body rehabilitation .

Whole system

3 is a block diagram of a rehabilitation exercise system proposed by the present invention.

Referring to FIG. 3, the rehabilitation exercise system 1 proposed by the present invention comprises a rehabilitation system 10 and a server 20.

In addition, the rehabilitation system 10 according to the present invention may include the rehabilitation apparatus 100 and the vision system 200.

It is possible to exchange data between the rehabilitation system 10 and the server 20 by short-range communication or long-distance communication.

The local area communication may include Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and Wi-Fi (Wireless Fidelity).

Further, the long-distance communication may be performed by using a code division multiple access (CDMA), a frequency division multiple access (FDMA), a time division multiple access (TDMA), an orthogonal frequency division multiple access (OFDMA), a single carrier frequency division multiple access . ≪ / RTI >

The server 20 is capable of processing or storing data received from the rehabilitation system 10 and providing processed or stored data according to an external request.

Rehabilitation equipment and vision system

Hereinafter, the components of the rehabilitation apparatus 100 and the vision system 200 will be described in more detail with reference to FIG.

FIG. 4 is a block diagram of a rehabilitation apparatus and a vision system in the rehabilitation exercise system proposed by the present invention.

4, the rehabilitation apparatus 100 according to the present invention includes a wireless communication unit 110, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, a motion unit 170, A control unit 180, a power supply unit 190, and the like.

However, the components shown in Fig. 4 are not essential, and a terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the rehabilitation apparatus 100 and the wireless communication system or between the rehabilitation apparatus 100 and the network in which the rehabilitation apparatus 100 is located.

The wireless communication unit 110 transmits and receives wireless signals to at least one of the base station, the external rehabilitation apparatus 100, and the server 20 on the mobile communication network.

The wireless signal may include various types of data for transmitting and receiving a voice signal, an image signal, a video signal, and a text / multimedia message.

The wireless communication unit 110 may use a short range communication technology such as Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra-Wideband (UWB) , ZigBee, etc. can be used.

Also, the wireless communication unit 110 may operate as a module for acquiring the position of the rehabilitation apparatus 100, and a representative example thereof is a global positioning system (GPS) module.

Next, the user input unit 130 generates input data for controlling the operation of the rehabilitation apparatus 100 by the user. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the state of the rehabilitation apparatus 100 such as the opening and closing state of the rehabilitation apparatus 100, the position of the rehabilitation apparatus 100, the presence of the user, the orientation of the rehabilitation apparatus 100, And generates a sensing signal for controlling the operation of the rehabilitation apparatus 100.

In particular, the sensing unit 140 can sense at least one of a user's electrocardiogram, blood pressure, oxygen saturation, body temperature, respiration, blood, urine, and body fluids associated with the rehabilitation apparatus 100 and generate a sensing signal .

The output unit 150 generates an output related to the visual, auditory or tactile sense. The output unit 150 may include a display unit 151, an audio output module 152, and the like.

Here, the display unit 151 displays (outputs) information to be processed in the rehabilitation apparatus 100. When the rehabilitation apparatus 100 is in the photographing mode, the photographing and / or received image, UI, and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see the object located behind the body of the rehabilitation apparatus 100 through the area occupied by the display unit 151 of the rehabilitation apparatus 100 body.

There may be two or more display units 151 according to the embodiment of the rehabilitation apparatus 100. [ For example, in the rehabilitation apparatus 100, the plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Further, the display unit 151 may be provided separately from the rehabilitation apparatus, such as a bed, a sickroom wall in which the patient is hospitalized, and the like.

That is, information transmitted and received through the communication unit can be displayed on the display unit 151 provided in the rehabilitation apparatus or on the display unit 151 provided in another place separate from the rehabilitation apparatus, under the control of the control unit 180 Do.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a recording mode, a voice recognition mode, a video output mode, and the like. The sound output module 152 also outputs an acoustic signal related to a function performed in the rehabilitation apparatus 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The memory unit 160 may store programs for processing and control of the controller 180 and perform functions for temporarily storing input / output data (e.g., audio, still images, moving pictures, etc.) You may. The memory unit 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The rehabilitation apparatus 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The exercise unit 170 provides a function to support a rehabilitation exercise of a patient who needs rehabilitation.

The moving part 170 according to the present invention may include a seating part 171, a driving part 172, a moving part 173, and the like.

First, the seat portion 171 provides a function of seating and fixing at least a part of the body of a patient requiring rehabilitation.

Next, the moving part 173 receives the power from the driving part 172 and provides a function of performing a rehabilitation movement by moving a part of the patient's body fixed through the seating part 171.

FIG. 5 shows a concrete example of the exercise module of the rehabilitation apparatus 100 proposed by the present invention described in FIG.

Referring to FIG. 5, the seating portion 171 provides a function of seating and fixing a leg region of a patient requiring rehabilitation.

5, the moving unit 173 receives the power from the driving unit 172, and moves the patient's foot fixedly through the seating unit 171 back and forth to perform a rehabilitation exercise.

In addition, the controller 180 typically controls the overall operation of the rehabilitation apparatus 100.

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

In addition, the vision system 200 is a module for obtaining an image related to a patient through motion capture.

Typically, the vision system 200 may include a camera 210 or the like.

The camera 210 processes an image frame such as still image or moving image obtained by the image sensor in the photographing mode.

In addition, the processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 210 may be stored in the memory 160 or transmitted to the server 20 through the wireless communication unit 110. [

Here, two or more cameras 210 may be provided depending on the use environment.

FIG. 6 shows a specific example of a motion module having a vision system in the exercise device proposed by the present invention illustrated in FIG.

Referring to FIG. 6, a camera 210 is disposed on one side of the moving part 170, and the disposed camera 210 can acquire rehabilitation therapy moving image data of the patient through motion capturing.

In the present invention, in order to solve the conventional problem, when the vision system 200 acquires rehabilitation therapy motion image data of a patient through motion capturing, A rehabilitation apparatus, system, and control method for extracting and using information related to exercise can be provided to a user.

The inventors of the present application conducted an investigation of physician / physiotherapist requirements, and as a result of the interview, 100% of the respondents said that data recording was necessary, but only 40% of them recorded rehabilitation therapy data.

However, the reliability of the data was found to be very low, because there was no corresponding data in case of friction with patients due to erroneous CPM exercise or frequency treatment.

In addition, most of respondents said that CPM equipment is needed to manage and record systematically rehabilitation treatment and to prevent and resolve medical conflicts.

In addition, the inventor of the present application investigated the requirements of the patient and, in the rehabilitation exercise through the CPM device after the joint surgery, there is a large difference between the ROM on the device and the ROM of the actual patient. Of CPM devices that have good readability.

In addition, in severe cases, the ROM on the CPM device differs by more than 40 ° from the actual patient ROM, so the therapeutic effect is lowered. In such cases, the exercise therapist must perform manual frequency treatment and have ROM It was found that there was a lot of difficulty in finding the treatment tool and the degree of recovery of the patient. In the community of the joint disease patients and the joint surgery patients, the rehabilitation treatment period was found to be different between the angle and the angle of attack on the CPM device.

Therefore, the inventor of the present application has decided to combine image acquisition and image processing methods using motion capture technology to develop a CPM capable of accurately grasping real-time ROM in real time by grasping user's needs in advance.

In the present invention, the motion image of the patient is acquired through the vision H / W 200, and the motion image of the patient is analyzed using the image processing S / W according to the controller 180, And can store data such as a minimum ROM.

It is stored in the DB of the connected server 20 and can be confirmed through the application (APP), thereby facilitating the systematic preservation, management and utilization of the therapy data. Based on this, can do.

The rehabilitation system 10 including the vision system 200 enables real-time measurement during the exercise and allows the server 20 to measure the ROM / number of times / speed / time of the actual patient as well as the specified number of times / ). ≪ / RTI >

In addition, since it is automatically stored in the DB, it is easy to manage the treatment history and customize treatment for each patient.

In addition, since this technology is implemented by combining medical big data and cloud computing technology at the server 20, it is a creative technology that provides timely relevance to industry trends and market demands, and provides innovative functions and convenience.

The data such as the actual ROM of the patient and the motion speed, time and frequency can be extracted through the image processing S / W based on the rehabilitation system 10 provided with the vision system 200 proposed by the present invention, It is possible to prevent a problem that occurs due to the inconsistency of the CPM device and the actual exercise angle of the patient.

In other words, since the exercise data is left as an objective value in the treatment process, both the patient and the exercise therapist can accurately understand the degree of recovery and build a data infrastructure capable of tailor-made treatment for each patient.

In order to implement this technology proposed in the specification, basic CPM driving techniques such as mechanism design and control of a CPM device, motor control, and the like are applied to a vision H / W for an image acquisition and analysis, a cloud used for transmission to a S / W, Application development technology for computing and checking stored data, and big data construction technology for storing and storing transmitted data.

In order to fully realize this technology, all technologies must be closely integrated, thereby overcoming the limitations of existing products, greatly improving the convenience of the user and the functions of the product itself, further improving the quality of medical services, And contribute to the development of new medical devices.

Motion capture technology

Meanwhile, in the present invention, motion capture technology is applied in connection with image acquisition of the camera 210.

In this technology, motion capture technology applied for image acquisition is mostly used in entertainment fields such as games, movies, and animations, but this technology is used for acquiring medical images.

FIG. 7 shows a specific example of acquiring an image through motion capture applied to the present invention.

Referring to FIG. 7, the vision system 200 acquires data related to the rehabilitation apparatus 100 through motion capture, extracts information related to the rehabilitation therapy movement of the patient based on the positional change recognized through the image processing Each step used is shown.

7A to 7D, the motion capture method is a contact-type motion recognition technology for recognizing the motion of an object by attaching a sensor to an object. .

As a technique for such motion capture, an active marker system, a passive marker system, and a markerless system can be applied.

FIG. 8 is a view for explaining an active marker system, a passive marker system, and a marker-free system applied to the present invention.

Referring to Figure 8 (a), an active marker scheme is shown.

The active marker system can include mechanical (gyro), magnetic (magnetic), video (image tracking), and active optical (frequency).

Here, the mechanical method (gyro method) is a method in which a rotational joint of a mechanical joint is mounted on a joint and is measured and transmitted. However, since the attachment equipment is heavy, precision of the object is limited due to the low precision.

In addition, the magnetic field (magnetic) method radiates a magnetic field to measure and transmit the position of the sensor. The price and maintenance cost of the device is lower than that of the optical type. However, since the cable is used, There is a possibility of data loss due to metal objects or the like.

In addition, the video method (image tracking) is a method of calculating a position value by analyzing an image taken by a video.

The video consists of a series of video frames. There are temporal and spatial similarities (similar in location, size, and shape of objects in the video) between adjacent video frames. In tracking, history information is used to track specific objects, And there is no restriction on the operation and the shooting place, but there is a disadvantage that the precision of the data is degraded.

In addition, Active optical (frequency type) is a method in which optical sensor transmits its own frequency to many camera sensors. RED-LED is mainly used as marker, However, there is a limitation that the power pack is always carried.

Referring to FIG. 8 (b), a passive marker system is shown.

The passive marker system is passive optical (optical system) is typical, and the most widely used method is frequently used in which the camera takes a picture of each sensor and calculates its position.

That is, when you attach a Reflective marker to your body, capture it with an infrared camera that emits infrared light, and the markers provide a two-dimensional position, motion capture software calculates it as 3D data.

The actor can move freely and capture almost perfectly even if two or more people are fighting fast, but the equipment is expensive, and it is also affected by the ambient light.

Referring to FIG. 8 (c), a markerless method without a marker is shown.

The Markerless method uses a technique of detecting and tracking the position of the actor's head, torso, hands, and feet using a plurality of color video cameras and image processing techniques without a marker, and does not attach markers or sensors to the body It does not require any special lighting, and can be expanded to include animation interfaces as well as animation interfaces for the general public.

In the present invention, the active marker system, the passive marker system, and the markerless system can be applied to the present invention. However, for convenience of explanation, We propose a method to recognize the rehabilitation treatment behavior of the patient.

The marker 30 proposed by the present invention can be largely applied to three methods. However, the content of the marker 30 proposed by the present invention is not limited to only three methods, and various methods may be applied.

In the marker 30 proposed by the present invention, an element capable of diverging light to the outside is applied, and the following three methods are applied.

(1) Method using retroreflective sheet and light

(2) Self-luminous illumination system

(3) a method of scattering a single color corresponding to a specific frequency

First, the method of "(1) using a retroreflective sheet and illumination" is such that a camera portion 210 of the exercise device 100 is provided with an illumination portion separately, and a retroreflective sheet is attached to at least a portion of the exercise device 100 .

At this time, the retroreflective sheet, which receives the light output from the illumination unit, reflects the light, thereby allowing the camera 210 to photograph the position of the marker 30.

Next, the illumination method " " (2) itself emits light is a method in which the marker 30 itself acts as an illumination unit.

That is, the marker 30, which has been supplied power from the power supply unit 190, emits light itself, and the camera 210 can grasp the position and the positional change of the marker 30 by photographing the marker.

In the second method, the camera 210 does not need to have a separate illumination unit.

In addition, it is also possible to provide a separate illumination unit in the camera 210 in the method of (3) scattering monochromatic light corresponding to a specific frequency, and the marker 30 may scatter light using natural light without illumination unit It is possible.

That is, the marker 30 is made of a material that scatters light only at a specific frequency, and scatters specific light corresponding to the light or natural light received from the illumination unit of the camera 210, The position and the positional change of the marker 30 can be grasped.

On the other hand, as described above, the content of the present invention is not limited to the marker 30, and other methods, that is, an active marker system, a passive marker system, and a marker can be applied.

Hereinafter, (1) a method using a retroreflective sheet and illumination will be described in more detail with reference to the drawings.

FIG. 9 shows a concrete example of a position of a target using a retroreflective sheet or the like, which is an example of a marker in the present invention.

In the proposed technique, a motion capture system is applied and a rectangular, square and hemispherical target is to be manufactured using retroreflective paper instead of attaching the sensor and attached to the rehabilitation apparatus 100.

The retroreflective technology applied to the present invention is mainly used for measuring distances using light sources having different wavelengths. It is used for improving the recognizability of road markings / road signs, or for measuring three-dimensional positions of underground facilities.

Retroreflective reflects incident light back to the light source, and reflects light in the direction of the light source, no matter which direction the light enters.

Because of this characteristic, it is mainly used for signs of roads with severe bends, night signs, etc., and is widely used for safety articles for night workers.

9 (a) and 9 (b), an example of a road sign using a retroreflective sheet is shown.

9 (c) and 9 (d), when the sensor of the motion capturing method is replaced with a reflex reflection paper and the image is photographed using a camera, the motion is recognized An example of recognizing a golf operation is shown as an example that can be performed.

Reference is made to Fig. 10 for applying the image acquisition method and markers through model capture described in Fig.

FIG. 10 shows a concrete example of attaching a marker to an exercise device of a rehabilitation treatment system having a vision system proposed by the present invention.

10, an example of attaching the marker 30 to at least a part of the moving part 173 in addition to the camera 210 and the exercise device 170 described in FIG. 4 is shown.

In the present invention, a method of replacing a sensor in a conventional motion capturing method with a marker (reflex reflection paper) 30 and photographing the image using the camera 121 and performing image processing is applied.

As shown in Fig. 10, the markers 30 can be arranged in plural in the position of the moving part 173 corresponding to the joint part of the patient.

How to determine information related to rehabilitation treatment using captured image data

11 is a flowchart for explaining a rehabilitation exercise method using a vision system proposed by the present invention.

Referring to FIG. 11, the first step S11 of fixing at least a part of the user's body through the seat part 171 is proceeded.

Thereafter, at least a part of the fixed body is subjected to the power of the driving unit 172 and the moving unit 173 moves to perform the rehabilitation treatment (S12).

At this time, the camera 210 of the vision system 200 captures an action of the seat 171, the driving unit 172, the moving unit 173, and the like (S13).

Then, the control unit 180 determines first information related to the rehabilitation treatment (S14) using the photographed image data, and transmits the determined first information to the outside through the wireless communication unit 110 (S15).

Thereafter, when the rehabilitation apparatus 100 receives the second information corresponding to the first information from the server 20 or the like through the communication unit 110, the step of displaying the second information through the display unit 151 (S16 ).

At this time, the markers 30, which are at least one identifier, may be included in the seating part 171, the driving part 172, the moving part 173, and the like. In step S14, The first information is determined using one identifier (marker 30).

The at least one identifier includes at least a singular point and at least one of a seating part 171, a driving part 172, a moving part 173, and a moving part 173 provided in at least a part of the seating part 171, the driving part 172, 173, and the like.

That is, it is possible to perform analysis using a specific point or the like of the moving unit 173 as a singular point without separately attaching the marker 30.

The marker 30 may be divided into a first marker provided on at least a part of the fixing part such as the seating part 171 and a second marker provided on at least a part of the moving part 173. [

At this time, in step S14, the controller 180 recognizes the first marker and the second marker in the image data, and determines the first information using the positional change of the recognized first marker and the second marker.

5 and 6, the seating part 171 according to the present invention may include a configuration for pressing and fixing the user's thigh in addition to the shape associated with the sole.

Such a body fixing device for pressing the thighs can be utilized as a sensor for measuring the thickness of the user's body.

It is also possible to further apply an auxiliary movement mechanism to the rehabilitation apparatus 100 and determine the movement more accurately by attaching the marker 30 to the auxiliary movement mechanism.

In this case, even if the same angle and speed are used, the exercise may be different depending on the initial setting value (the height of the rehabilitation apparatus, etc.) and the body thickness (fixing mechanism) So that the patient's motion and degree of motion can be grasped.

Further, in the present invention, an effective range of motion range can be set through the maximum angle at which the patient can move.

The setting of the exercise range value can be used to grasp the operation range of the patient in advance before the rehabilitation apparatus 100 is applied.

Further, in the present invention, a method of controlling the operation of the external device by using the marker attached to the external device and the change of the position of the marker of the operation part can be also applied by using the marker attached to the operation device (external + operation part).

In the present invention, three markers 30 are attached to the fixing portion 171 so as to have a triangle having a different length in order to determine the degree of contact between the fixing portion 171 (the thigh, the calf, and the like) It is possible to grasp the shape of the rehabilitation patient using the change (position, angle, etc.) of the marker 30.

It is also possible to determine whether the arrangement between the camera 210 and the rehabilitation apparatus 100 is normal or not using the arrangement form and the separation distance of the marker 30 obtained through the camera 210, 210 may be changed.

Further, in the present invention, it is possible to additionally use a guide line along the leg line and additionally use a marker 30 attached to the guide line.

In addition, according to the present invention, it is possible to propose a solution in the case where the normal movement is not performed according to the adhesion error of the fixing portion 171 (thigh, calf, etc.).

In other words, if the motion value to be performed subsequently and the abnormal motion value are different from each other by a predetermined value or more, the result of the abnormal case is ignored (deleted).

In addition, the responsibility for the abnormal condition can be transferred to a physical therapist who is not in close contact with the government (not the responsibility of the hospital).

In step S14, the control unit 180 searches for the marker 30, identifies the marker 30, determines the body area corresponding to the marker 30, determines the virtual line, and tracks the virtual line The movement of the rehabilitation patient can be tracked.

Further, by attaching a plurality of identifiable markers 30 to the thigh or calf fixing part 171, information on the movement and thickness of the patient's body can be obtained at one time, and the number of markers attached to other points can be reduced .

Further, since a finder for the position of the marker 30 is required before grasping the contents of the marker 30, in the present invention, a technique for displaying the location of the marker 30 with three points may be applied.

Further, in the present invention, an angle of the device before the rehabilitation exercise of the patient is designated (for example, 0 degrees) and the alignment value is set based on the specific marker while the device is set according to the angle, It is possible.

Further, in the present invention, when a fixing portion 171 which does not corrugate with a large area is applied, a surface marker and detection method for a curved surface can be applied.

If an LED is used as the marker 30, it is also possible to increase the identification type of the marker by using a luminescent color, a blinking pattern, or the like.

Further, in the present invention, information about the legs before surgery is collected, information about the length of the artificial joint inserted into the human body during surgery is acquired, and the rehabilitation range is set by using the preoperative data and the artificial joint data together in the rehabilitation exercise It is possible.

The present invention accumulates and acquires information acquired through X-ray, CT, MRI, etc., accumulates and extracts coordinate information related to bones and body thickness based on the acquired information, The user's body position can be grasped accurately.

For example, it is possible to extract coordinate information related to a bone from user information obtained through X-ray, and to use the marker together with the coordinate information related to the bone to grasp the motion of the user.

Further, in the present invention, a method of locating the center of the marker by additionally arranging auxiliary markers around the marker 30 may be applied.

That is, the position can be determined using the shape (ID) of the marker, and the center can be found using the auxiliary marker.

The band-shaped fixing part 171 is made of a material having elasticity on the side not visible to the camera 210, and the area where the three-point marker and the like are disposed is not elastic and can be wrinkled.

In addition, it is possible to easily process the marker 30 by storing information about the marker 30 in the server 20 or the like and grasping the position of the marker 30 roughly based on the stored content, without requiring a large calculation.

A method of photographing only a predetermined area from the maximum point at which the motor 172 can move, with the camera 210, in addition to the method of always photographing with the camera 210, regarding the three-axis motor among the driving units 172 applied to the present invention Can be applied.

Hereinafter, referring to the drawings, the information used in the video data photographed by the control unit 180 in step S14 will be described, and the first information to be determined through such information will be described.

In addition, for setting the patient-specific accurate device, the second information is explained and a method for utilizing the measured data at the server 20 will be described in detail.

Figs. 12 to 14 are diagrams for explaining at least necessary information and obtainable information for accurate measurement relating to rehabilitation motion. Fig.

First, information used in the image data photographed by the control unit 180 in step S14 will be described.

,

값, 재활환자의 종아리 및 허벅지 두께가 될 수 있다.Referring to FIG. 12, the information used by the control unit includes L1, L2,

,

Value, rehabilitation calf and thigh thickness.

이 도출될 수 있다.Where L1 is the length that contains the point at which the device end line is variable,

Can be derived.

를 도출할 수 있다.L2 is a length including a variable point at another end of the device,

Can be derived.

,

값은 재활기기(100)의 위치를 기준으로 환자(사용자)에 의해 변화된 벡터값으로서, 도 12 상의

및

값이 될 수 있다.In addition,

,

The value is a vector value changed by the patient (user) based on the position of the rehabilitation apparatus 100,

And

Lt; / RTI >

In addition, calf and thigh thickness of rehabilitation patients are necessary for accurate rehabilitation.

값이 도출된다.In addition, referring to FIG. 13, the necessary information L1 can be derived through M1 in FIG. 13 and (M1 or M3 or M9)

Value is derived.

값이 도출된다.Referring to FIG. 13, the necessary information L2 is derived through M7 and (M5 or M6 or M9) shown in FIG. 13,

Value is derived.

Next, the necessary information, vector value and thickness information, is utilized for band markers located in thighs and calves.

과 L1과 BM2 를 이용하여 BL1은 도출 가능하고, BM1으로 두께정보 도출도 가능하다.That is, based on the thigh related band marker [BM1]

, BL1 can be derived using L1 and BM2, and thickness information can be derived from BM1.

와 BM2 를 이용하여 BL2 도출이 가능하고, BM2으로 두께정보 도출도 가능하다. Further, based on the calf-related band marker [BM2]

And BL2 can be derived using BM2, and thickness information can be derived from BM2.

Next, the first information determined by the control unit 180 will be described.

,

,

,

정보를 획득할 수 있다.Referring to FIG. 14, M1, M7, M8, M9, M10, BM1 and BM2 can be used as the minimum necessary information among the information obtained in FIGS. 12 and 13, , L1, L2,

,

,

,

Information can be obtained.

In the present invention, rotational motion can be grasped based on the obtained information.

Further, the second information for setting the patient-customized correct device will be described.

First, the second information may be patient recognition and patient-tailored rehabilitation information.

Here, a method of directly providing information to the patient terminal through patient authentication, providing the information to the physical therapist using a terminal or the like, and displaying the display 151 on the device 100 are applied.

In addition, the second information may be information for setting the rehabilitation apparatus 100. [

In this case, ① method of providing setting information directly to the patient through patient authentication or ② providing to a physical therapist using a terminal or the like is applied.

On the other hand, an element set through the second information may include L1 and L2 lengths.

Also, values of LL1 and LL2 may be included as shown in Table 1 below.

In addition, the second information may include (3) speed, number of times, (4) L1, L2, LL1, LL2, speed and frequency information.

In the case of setting the rehabilitation apparatus 100 through the second information, a method of setting the LEVEL when binding the user band can be used.

Further, in the present invention, the following events can be cited as a case of re-setting the rehabilitation apparatus 100.

First, the patient may press an emergency button to generate an error message.

As a result of checking through the vision system 200, if there is an error in the setting value or the difference from the past data, the pseudo prescription, or the like, the resetting can be performed and informed to the server 20 again.

Lastly, a method of utilizing measured data at the server 20 will be described.

Can be utilized as a method for modifying patient-related schedules and setting values, as shown in Table 2 below.

In addition, it can be used to identify the nature of negligence and accountability. It can be used to judge whether or not the information is negligent and responsible based on the video information + schedule information + execution information.

It is also possible to utilize the treatment method or the optimal treatment program based on the body information + PHR + operation information + artificial joint material as big data for development, derivation, and proposal.

Meanwhile, in the present invention, a service providing method for a rehabilitation patient during a rehabilitation time (15 minutes - 20 minutes), a method of switching the surroundings for pain, and a method of generating a profit through advertisements may be applied.

Typically, (1) it can provide contents such as music and movies in order to provide pleasure, (2) it can judge the present state of health (it is possible to judge the stroke through voice), and Explain the plan and guide the change in health status according to the rehabilitation process.

Also, ③ PHR information base, health food, equipment, medicines, etc. may be displayed as advertisements (billing to advertisers).

At this time, it is possible to determine the patient-customized contents based on the DB and to advertise.

In addition, it is possible to determine whether or not the rehabilitation patient is abnormal based on the input of the exercise program, the motion prediction of the device 100, the determination of the standard pattern according to the motion of the device 100, , And judging that there is an abnormality when taking off, measures may be applied.

2) display of advertisement contents; 3) display of guidance content for a physical therapist; and 4) remote medical treatment. A doctor's video call proceeding is displayed on the display unit 151. [ , 5) indication of the movement of the rehabilitation patient through the augmented reality.

In addition, a pressure sensor, a load cell, a gyro sensor, and the like can be additionally utilized as a strapping mechanism for a patient's body.

In relation to the placement of the camera 210 in relation to the rehabilitation apparatus 100, it is also possible to provide: 1) a separate space (for example, box, frame, etc.) for inserting the camera; 2) Size, and 3) application of a special camera that enhances the camera's depth.

In the present invention, it is most preferable to arrange the camera at the positions of the 10th marker and the 4th marker in FIGS. 12 through 14, but it is also possible to position the 7th marker.

In addition, in the case of placing in the marker No. 4, the display 151 may be disposed together.

In addition, with respect to the device shape and the position change of the camera, the rehabilitation apparatus 100 can be folded or unfolded, and it is possible to change the position of the camera by matching with the left / right hand or the left / right hand. In addition, a camera based on a specific hand or foot can be fixedly manufactured.

Meanwhile, the user information that the server 20 can acquire through the terminal used by the user includes ID (name), age, sex, surgery (rehabilitation) hospital, operation contents Surgery method, date of surgery, and the like.

In addition, the rehabilitation-related important information acquired by the server 20 includes a maximum number of pictures, a minimum number of pictures, a preset number of images / videos for a predetermined period, a start and end time, number of times, (such as the number of times the emergency button is pressed), and the like.

How to use closed curves

On the other hand, when the marker 30 is found and analyzed, the processing load and time may increase.

Therefore, in the present invention, it is desired to reduce the processing load and time by analyzing in a region using a closed curve connecting a plurality of points.

Fig. 15 is a flowchart for explaining a method for reducing a processing load and time using a closed curve connecting plural points of a marker, Fig. 16A to Fig. 16D are flowcharts for explaining a method for reducing processing load and time by using closed curves connecting plural points described in Fig. Figure 5 is a diagram of a process for reducing time.

Referring to FIG. 15, a step S21 of loading a close loop connecting at least one identifier is performed.

Referring to Fig. 16A, each point of the marker attached to the rehabilitation apparatus 100 is displayed, and referring to Figs. 16B and 16C, a closed loop connecting each point is shown.

In step S21, the closed loop as shown in FIG. 16C is loaded.

After step S21, the step S22 of recognizing at least one of the fixed part, the motion part and the at least one identifier in the video data is performed using the closed loop.

That is, as shown in FIG. 16D, the specific closed loop is used to identify the fixed portion, the motion portion, and the at least one identifier (marker 30) of rehabilitation apparatus 100, thereby reducing the processing load and time .

Thereafter, the step S23 of determining the first information using the identifier in the video data proceeds.

Therefore, in the present invention, it is possible to reduce the processing load and time by analyzing in the region using the closed curve connecting the plurality of points.

Further, in the present invention, a deep running technique can be additionally applied in using a closed curve.

For example, when deep running is performed by performing the marker identifying operation using dozens of repeated closed curves, even if two of the ten predetermined markers are not identified, they are not identified based on the information accumulated through the deep learning (Marker 30) based on the estimated information value, so that the processing load and time can be reduced.

In the present invention, a deep running technique may be further utilized. Deep learning is a machine learning technique built on an artificial neural network (ANN) to enable students to learn on their own, using a variety of data.

Deep Learning is a human brain that finds patterns in a lot of data, imitates information processing methods to distinguish objects, learns computers to distinguish objects, and applies deep learning techniques to determine all the criteria Even if you do not give it, the computer will be able to recognize, reason, and judge for itself.

Transform rehabilitation devices into CPM and CAM

Meanwhile, as an embodiment of the present invention, the rehabilitation apparatus 100 may be modified into CAM and CPM.

That is, the rehabilitation apparatus 100 can be operated as both CPM and CAM, and the state of the patient can be provided as a report through a game utilizing the CAM mode after the end of the CPM exercise.

Alternatively, it is possible to grasp the ROM of the patient through the CAM mode before the rehabilitation exercise, and to perform the patient-customized rehabilitation exercise program on the basis of the identified patient condition through the CPM.

More specifically, the present invention uses a motion part for performing rehabilitation treatment by moving at least a part of a fixed body at a predetermined speed and frequency at a predetermined interval, wherein the motion part can be driven by a force by at least a part of the fixed body The CPM method and the CAM method can be used together.

Figs. 17A and 17B show an example of a rehabilitation apparatus according to the present invention, which can be transformed into CPM and CAM, for confirmation of ROM before or after a rehabilitation exercise.

Referring to FIG. 17A, a CPM device is shown that is configured to articulate and move through a motor 174, a coupling 175, and a ball screw guide 176.

In the CPM equipment shown in Fig. 17A, the motor 174 and the ball screw guide 176 are connected (fixed) to act as a load.

As shown in FIG. 17A, the present invention proposes a rehabilitation apparatus 100 that can be used together with a CAM for expanding a ROM (ROM) before or after a rehabilitation exercise, rather than being used only as a CPM equipment.

17B, unlike the one shown in FIG. 17A, the motor 174 and the ball screw guide 176 can be separated by an electric force.

That is, instead of the coupling 175, the electromagnetic clutch 177 and the electromagnetic brake 178 are applied and used.

When the CPM is used as the CPM, the electromagnetic brake 178 is connected to move by the motor force. However, when the electromagnetic brake 178 is used as a CAM, the connection with the electromagnetic brake 178 is released so that the patient can move by the magnetic force.

As described above, it is possible to use CAM equipment for expansion of the ROM (ROM) before or after the rehabilitation movement.

18 is a flowchart illustrating a process of confirming and rehabilitating a range of motion (ROM) by using the CAM mechanism prior to the rehabilitation exercise, in the context of the present invention.

Referring to Fig. 18, a step S31 of determining a ROM (range of motion) of a fixed body based on a motion part capable of being driven by a force of at least a part of a fixed body is performed.

Thereafter, according to the determined ROM, the motion unit moves at least a part of the fixed body at a predetermined speed and a predetermined number of times to perform rehabilitation treatment (S32).

Therefore, prior to applying the CPM, the ROM (range of motion) of the patient is determined through the CAM, so that efficient exercise can be induced.

FIG. 19 is a flowchart illustrating the process of confirming the operation range (ROM) through use of the CAM mechanism after the rehabilitation exercise and informing the server for user management.

Referring to FIG. 19, a step S33 of performing rehabilitation treatment by moving at least a part of a fixed body at a predetermined speed and frequency at a predetermined interval is performed.

Thereafter, the ROM is determined (S34) based on the motion part that can be driven by the force of at least a part of the fixed body, and the determined ROM is transmitted to the outside (S35).

Therefore, after the CPM rehabilitation exercise, the degree of rehabilitation of the patient can be grasped and shared through the CAM, so that it can be effectively utilized for the rehabilitation of the patient.

How to deal with pain events and how to manage users

Meanwhile, since the pain and the problem of the patient can be grasped only by the operation of depressing the emergency switch of the patient, a method of coping with a pain event and a method of managing the user through it are required.

The method of stopping the device movement due to the wrong rehabilitation treatment may be ① a method of stopping manually by the user ② stopping automatically when the device 100 satisfies a certain condition ③ stopping the physical therapist.

In particular, in the present invention, information on rehabilitation therapy is transmitted to a server while moving at least a part of a fixed body to perform rehabilitation treatment, and feedback information received from a server, user body information sensed by a sensor, Command to determine that an emergency event has occurred, and to stop the rehabilitation treatment operation when the emergency event occurs.

FIG. 20 is a flowchart illustrating a method of handling a pain event and a method of managing the user through the method according to the present invention.

Referring to FIG. 20, at first, a step S41 is performed in which at least a part of the fixed body is moved to perform rehabilitation treatment.

As described above, the rehabilitation apparatus 100 transmits the first information on the rehabilitation treatment to the server 20 (S42).

At this time, the feedback information is received from the server, the user body related information is sensed or the user's command is inputted (S43), and an emergency event is generated using at least one of feedback information, sensing information, (S44).

When the emergency event occurs, the rehabilitation treatment operation of the exercise unit is interrupted (S45), and the information about the occurrence of the emergency event may be transmitted to the server 20 (S46).

Further, the re-setting information of the exercise unit according to the occurrence of the emergency event is received from the server 20 (S47), and the rehabilitation exercise can be performed at a later time.

Here, the feedback information received from the server 20 may include planning information related to the rehabilitation treatment.

Also, the control unit 180 determines that the emergency event is generated when the rehabilitation treatment performed by the exercise unit is different from the plan information.

The sensing unit 140 may sense at least one of electrocardiogram, blood pressure, oxygen saturation, body temperature, respiration, blood, urine, and body fluid components.

At this time, the controller 180 may determine that the emergency event has occurred when at least one factor sensed by the sensing unit 140 is out of a predetermined range.

In addition, the input information input through the user input unit 130 may be command information for the user to manually stop the rehabilitation operation of the exercise unit due to the pain.

Accordingly, the present invention transmits information about rehabilitation treatment to a server while moving at least a part of a fixed body to perform rehabilitation treatment, and transmits feedback information received from a server, user body information sensed by a sensor, And a rehabilitation exercise device related to a pain event for stopping the rehabilitation treatment operation when the emergency event occurs can be provided.

Rehabilitation exercise platform service

Hereinafter, a method for providing a platform service related to a rehabilitation exercise using the rehabilitation apparatus 100 and the server 20 of the present invention will be described.

Specifically, the present invention is a method for receiving an information transfer request related to a first user, which is at least one of a plurality of users, from an external device based on a server related to a rehabilitation movement of a plurality of users, When the rehabilitation device performs rehabilitation for the first user on the basis of the second information, the external device transmits the related information to the external device, and when the external device determines the second information using the information related to the first user, And a third information related to a rehabilitation exercise performed from at least one of the device and the rehabilitation device.

(1) User identification method

First, in the present invention, a process of confirming a user may be performed prior to providing a platform service related to a rehabilitation exercise.

Meanwhile, the server 20 proposed by the present invention can be divided into a server 1 (21) of a company providing rehabilitation equipment and a server 2 (22) used in a hospital.

In addition, the user identification method proposed by the present invention can be divided into a first method and a second method.

First, the first method will be described with reference to FIG.

21 is a flowchart illustrating a first method for identifying a user in a rehabilitation exercise platform service according to the present invention.

Referring to FIG. 21, the replaying apparatus 10 firstly transmits the user confirmation information input from the user to the server 2 22 (S51).

The server 2 22 confirms whether the user prescribing in the hospital is going to use the rehabilitation apparatus 10 based on the received user confirmation information (S52).

Thereafter, when the user confirmation is terminated, the server 2 22 transmits the prescription information related to the rehabilitation exercise to the rehabilitation apparatus 10 (S53).

After step S53, the rehabilitation apparatus 10 transmits rehabilitation exercise information related to the user including the prescription information to the server 1 (21) in order to construct a rehabilitation exercise platform service of the server 1 (21) (S54).

In addition, the rehabilitation apparatus 10 performs the rehabilitation exercise for the user according to the prescription information received from the server 2 (22) (S55).

In this embodiment, it is described that the step S54 is performed before the step S55, but the present invention is not limited thereto. It is also possible that the step S54 is performed after the step S55 is performed first.

Next, the second scheme will be described with reference to FIG.

22 is a flowchart illustrating a second method for identifying a user in a rehabilitation exercise platform service according to the present invention.

Referring to FIG. 22, the rehabilitation apparatus 10 can receive user confirmation information and prescription information from the server 2 (22) (S61).

Thereafter, when information is input from the user (S62), the rehabilitation device confirms whether the user is correct based on the user confirmation information received in advance, and if it is correct, the rehabilitation device can transmit the information that the user confirmation is completed to the server 1 (S63).

Thereafter, the server 1 21 can transmit the new prescription information associated with the user to the rehabilitation apparatus 10 (S64). The rehabilitation apparatus 10 receives the prescription information received from the server 1 21, (S65), and performs a rehabilitation exercise (S66).

However, although it is described in the present embodiment that step S65 is performed after step S63, step S65 may be performed before step S63.

(2) User identification and advertisement contents provision method

Next, a method for determining and providing advertisement contents to be provided to a user through a user confirmation process will be described.

Meanwhile, the server 20 proposed by the present invention can be divided into a server 1 21 of a company providing a rehabilitation device, a server 2 22 used by a hospital, and an advertisement server 23.

In addition, the user identification method proposed by the present invention can be divided into a first method and a second method.

First, the first method will be described with reference to FIG.

23 is a flowchart illustrating a first method of providing user identification and advertisement contents in a rehabilitation exercise platform service according to the present invention.

21, it is assumed that the server 1 (21) and the advertisement server (23) form a network in advance, and that the server (21) can receive contents related to the advertisement from the advertisement server (23).

Referring to FIG. 23, the replaying apparatus 10 firstly transmits the user confirmation information input from the user to the server 2 22 (S71).

The server 2 22 confirms whether the user prescribed by the hospital is going to use the rehabilitation apparatus 10 based on the received user confirmation information (S72).

Thereafter, when the user confirmation is terminated, the server 2 22 transmits the prescription information related to the rehabilitation exercise to the rehabilitation apparatus 10 (S73).

After step S53, the rehabilitation apparatus 10 transmits information related to the user including the prescription information to the server 1 21 in order to construct the rehabilitation platform service of the server 1 (21) (S74).

At this time, the server 1 21 determines a customized advertisement related to the user received through the step S74 among the plurality of advertisement contents received from the advertisement server 23 (S75), and transmits the determined advertisement contents to the rehab device 10 do.

Thereafter, the rehabilitation device 10 displays the received advertisement contents through the display unit 151 while performing a rehabilitation exercise for the user according to the prescription information received from the server 2 (S77).

Next, the second scheme will be described with reference to FIG.

24, it is assumed that the server 1 (21) and the advertisement server (23) form a network in advance and that the server (21) can receive contents related to the advertisement from the advertisement server (23).

24 is a flowchart illustrating a second method of providing user identification and advertisement contents in a rehabilitation exercise platform service according to the present invention.

Referring to FIG. 24, the rehabilitation apparatus 10 can receive user confirmation information and prescription information from the server 2 22 (S81).

Thereafter, when the information is input from the user (S82), the rehabilitation device confirms whether the user is correct based on the user confirmation information received in advance, and if the user is correct, transmits information on the user to the server 1 (21) S83).

At this time, the server 1 (21) determines a customized advertisement associated with the user received through the step S83 among the plurality of advertisement contents received from the advertisement server 23 (S84), and transmits the determined advertisement contents to the rehab device 10 (S85).

Then, the rehabilitation apparatus 10 displays the received advertisement contents through the display unit 151 while performing a rehabilitation exercise for the user according to the prescription information received from the server 2 (S86).

(3) Rehabilitation exercise and service delivery method

Next, a method of providing a rehabilitation exercise and a service through a user confirmation process will be described in detail.

The service for this embodiment can be divided into a first scheme and a second scheme. First, the first scheme will be described in detail with reference to FIG.

FIG. 25 is a flowchart illustrating a first method relating to rehabilitation exercise and services in the rehabilitation exercise platform service according to the present invention.

Referring to FIG. 25, first, the user confirmation step proceeds (S91).

The method according to FIG. 21 or the method according to FIG. 22 can be applied to step S91, and a description thereof will be omitted for the sake of simplification of the description.

After step S92, the rehabilitation apparatus 10 performs rehabilitation (S92), the camera 210 acquires image data (S93), and the controller 180 analyzes the motion (S94).

Thereafter, the rehabilitation apparatus 10 transmits at least one of the patient information, the analysis result information, and the image information to the server 1 (21) (S95), and the server 1 (21) (S96).

After step S96, the user confirmation step described in step S91 is performed again (S97). Thereafter, a step of supporting the prescription provided by the server 2 22 is proceeded.

Specifically, when the user is confirmed, the server 2 (22) transmits a signal to the server 1 (21) requesting information related to the identified user.

At this time, the server 1 (21) transmits the rehabilitation related information to the server 2 (22), which can help the rehabilitation and / or prescription of the patient among the information accumulated in advance.

Thereafter, the server 2 (22) can easily determine the prescription information related to the rehabilitation treatment based on the information received from the server 1 (21) (S100).

After step S100, the server 2 22 transmits the determined prescription information to the rehabilitation apparatus 10 (S101), and the rehabilitation apparatus 10 performs the rehabilitation exercise (S102).

The rehabilitation apparatus 10 transmits at least one of the acquired patient information, analysis result information, and image information to the server 1 (21) through the rehabilitation exercise (S103), and the server 21 The received information is divided and stored for each patient (S104).

In addition, the information stored in the server 1 (21) may be utilized as a rehabilitation support step for judging whether the rehabilitation treatment has been performed properly as well as the prescription.

That is, after step S104, the server 2 22 may request the server 1 21 to send a patient related information request signal, and the server 1 21 may transmit the patient related information (for example, To the server 2 (22) (S106).

Therefore, it is possible to judge whether or not the rehabilitation treatment has been properly performed using the patient-related information in the server 2 (22) (S107).

In addition, the server 1 (21) constructs a platform based on information received from a plurality of users, the rehabilitation apparatus 10, and performs a platform service for providing information in response to various needs S108).

Referring to Fig. 26, the second scheme will be described.

26 is a flowchart illustrating a second method relating to rehabilitation exercise and services in the rehabilitation exercise platform service according to the present invention.

Referring to FIG. 26, first, the user confirmation step proceeds (S91).

The method according to FIG. 21 or the method according to FIG. 22 can be applied to step S91, and a description thereof will be omitted for the sake of simplification of the description.

After step S92, the rehabilitation apparatus 10 performs rehabilitation (S92), the camera 210 acquires image data (S93), and the controller 180 analyzes the motion (S94).

Thereafter, the rehabilitation apparatus 10 transmits at least one of the patient information, the analysis result information, and the image information to the server 2 22 (S111).

After step S111, the server 1 (21) proceeds to establish user information.

Specifically, after step S111, the server 2 22 can transmit information that the patient information is received from the rehabilitation apparatus 10 to the server 1 (S112).

In response to this, the server 1 (21) can request the server 2 (22) to provide information on the patient (S113).

In response to the request of S113, the server 2 22 can provide feedback of Yes or No (S114). If the feedback of the example is sent, the server 2 22 transmits the information related to the anonymized user to the server 1 (21) ).

If no feedback is sent, the server 1 21 must collect information related to user and user rehabilitation using the rehabilitation apparatus 10 and the terminal 300 used by the user.

Specifically, the server 1 21 requests the rehabilitation apparatus 10 to confirm the user through the user terminal 300 (S115), and the rehabilitation apparatus 10 transmits an application installed in the user terminal 300 (S116). ≪ / RTI >

In step S116, the rehabilitation device 10 transmits important information related to the rehabilitation movement of the user to the terminal 300 (S117), and the terminal transmits important information related to the rehabilitation movement received through the application and information related to the user, 1 21 (S118).

Accordingly, the server 1 (21) can receive the user and rehabilitation related information from the server 2 (22) or receive the user and rehabilitation related information through the network between the rehabilitation device (10) and the terminal (300).

Thereafter, the server 1 21 stores the information received by time according to the patient and stores the information (S120).

After step S120, a step of supporting a prescription provided by the second server 22 is performed.

Specifically, the server 2 22 transmits a signal requesting information related to the identified user to the server 1 21 (S 121).

At this time, the server 1 (21) transmits to the server 2 (22) the rehabilitation related information that can help the rehabilitation and / or prescription of the patient among the information accumulated in advance (S122).

Thereafter, the server 2 (22) can easily determine the prescription information related to the rehabilitation treatment based on the information received from the server 1 (21) (S123).

After step S123, the server 2 22 transmits the determined prescription information to the rehabilitation apparatus 10 (S124), and the rehabilitation apparatus 10 performs the rehabilitation exercise (S125).

After step S125, the user information establishing step of steps S112 to S120 is repeatedly performed (S126).

In step S126, the server 1 (21) and the server 2 (22) accumulate data, and the server 2 (22) can use the patient-related information to determine whether the rehabilitation treatment has been performed properly (S127) .

In addition, the server 1 (21) constructs a platform based on information received from a plurality of users, the rehabilitation apparatus 10, and performs a platform service for providing information in response to various needs S128).

(4) How to use the built database

25 and 26, the server 1 (21) or the server 2 (22) can be utilized as a platform-to-platform service.

(1) a platform such as a hospital-specific management program, (2) a job search / job platform (caregiver, physiotherapist, etc.), (3) a device platform, and (4) a form associated with an insurance company and a health insurance corporation. And the like.

Most typically, services related to advertising can be provided.

FIG. 27 is a flowchart illustrating a service utilization method after a database is constructed in a rehabilitation exercise platform service according to the present invention.

Referring to FIG. 27, in a state where a database is established in the server 1 (21), the server 2 (22) can transmit a user related information request to the server 1 (21) (S131).

The server 1 (21) determines the rehabilitation related information in response to the received request, and can transmit the rehabilitation related information to the server 2 (22) (S132).

The server 2 22 determines the prescription information based on the information received in step S 132 and the server 1 21 receives the user information from the server 2 22 on the basis of the user information received in step S 131, It is possible to determine a customized advertisement in conjunction with the advertisement server 23 (S134).

Thereafter, when the server 2 223 sends the prescription information to the rehabilitation apparatus 10 (S135) via the step S133, the server 1 21 transmits the determined customized advertisement content to the rehabilitation apparatus 10 (S136).

Accordingly, the user views the customized advertisement through the rehabilitation device 10 and performs rehabilitation (S137).

Information obtained from a plurality of patients through the above-described method can be shared with a terminal (smart phone) of a patient, a PC control program of a hospital, a server management program, and the like, thereby providing a function as an IOT-based convergence medical platform.

First, regarding the smartphone application used by the patient, considering that the major patient is the elderly person, the intuitive and simple design is designed so that it can be easily operated by anyone, the individual exercise data can be viewed, Can be provided through the platform.

In addition, as a PC control program, a user who operates a device such as a physician or a physiotherapist in a hospital is developed to grasp the state of the device and the motion state of the patient at a glance, And a GUI environment developed so that the motion state of the patient can be confirmed in real time through the camera 121 can be provided through the platform.

In connection with the server management program, an integrated management system is developed for the exercise information through the web connection of the server 20, a management system such as operation time and AS information of the device 100 is developed, A UI environment providing customized treatment for each patient can be provided through the platform.

Further, according to the present invention, when a patient is treated in a particular hospital and then transferred to another hospital, it is ensured that the patient can proceed to the next treatment stage from the immediately preceding treatment stage based on accurate information.

In addition, when a device developer seeks to develop a device by understanding the needs and the like of the patients, it becomes possible to receive specific patient-related data from the server 20 and to develop the device based on the data.

When a marker is attached to a rehabilitation treatment apparatus based on the rehabilitation treatment apparatus, system and control method provided with the imaging apparatus according to the present invention and the imaging apparatus acquires rehabilitation therapy exercise image data of the patient through motion capture A rehabilitation apparatus, a system, and a control method for extracting and using information related to a rehabilitation exercise motion of a patient based on a change in position of a marker recognized through image processing.

In addition, the present invention facilitates the systematic preservation, management, and utilization of therapy data by measuring actual ROM, motion speed, time, frequency, etc. during a CPM exercise while the patient performs CPM exercise, Based on this, customized treatment according to the recovery rate of each patient can be made possible.

In addition, the data stored according to the present invention can be used as a big data by applying cloud computing technology according to the need in the future, so that it can be utilized as research data on treatment and recovery of joint diseases, Can also be used.

Meanwhile, the embodiments of the present invention described above can be implemented by various means. For example, embodiments of the present invention may be implemented by hardware, firmware, software, or a combination thereof.

In the case of hardware implementation, the method according to embodiments of the present invention may be implemented in one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs) , FPGAs (Field Programmable Gate Arrays), processors, controllers, microcontrollers, microprocessors, and the like.

In the case of an implementation by firmware or software, the method according to embodiments of the present invention may be implemented in the form of a module, a procedure or a function for performing the functions or operations described above. The software code can be stored in a memory unit and driven by the processor. The memory unit may be located inside or outside the processor, and may exchange data with the processor by various well-known means.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The foregoing description of the preferred embodiments of the invention disclosed herein has been presented to enable any person skilled in the art to make and use the present invention. While the present invention has been particularly shown and described with reference to preferred embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. For example, those skilled in the art can utilize each of the configurations described in the above-described embodiments in a manner of mutually combining them. Accordingly, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention. The present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein. In addition, claims that do not have an explicit citation in the claims may be combined to form an embodiment or be included in a new claim by amendment after the filing.

Claims (10)

A fixing part fixing at least a part of the user's body;
A moving part for moving at least a part of the fixed body to perform rehabilitation treatment;
A camera for capturing an action of at least one of the fixed portion and the motion portion; And
A controller for determining first information related to the rehabilitation treatment using the image data photographed by the camera; , ≪ / RTI &
Wherein at least a portion of the motion portion further comprises at least one identifier,

Wherein the at least one identifier comprises:
At least one of a singular point provided in at least a part of the moving part and a marker provided in at least a part of the moving part,

Wherein the marker includes a first marker provided on at least a part of the fixing portion and a second marker provided on at least a part of the moving portion,

Wherein,
Recognizing the first marker and the second marker in the image data and determining the first information using the positional change of the recognized first marker and the second marker,

Wherein,
Extracting first vector information from the rotation of the first marker induced by the body fixing operation of the fixing portion,
Extracting second vector information of the first marker according to the length of the motion unit,
Wherein the first information is determined by comparing the first vector information with the second vector information.
The method according to claim 1,
A communication unit for transmitting the first information to the outside; And
And a display unit for displaying the second information when the second information corresponding to the first information is received through the communication unit. delete delete delete delete The method according to claim 1,
Wherein the first marker further includes a fixed identifier indicating a degree of fixation of the fixation portion by a body fixing operation,
Wherein the control unit extracts the first vector information using the fixed identifier.
8. The method of claim 7,
Wherein,
Determining a thickness of the fixed body based on a change in the position of the fixed identifier,
Extracts the first vector information based on the degree of rotation of the fixed identifier,
And determines the degree of fixation of the body from the rotation value of the first vector information based on the second vector information. 9. The method of claim 8,
Wherein the first information includes at least one of the thickness information, the fixed degree information, the length information of the fixed portion, the motion velocity information of the motion portion, and the motion frequency information of the motion portion. The method according to claim 1,
Further comprising: a memory for storing a close loop that connects two or more of the at least one identifiers,
Wherein the control unit recognizes at least one of the fixed unit, the motion unit, and the at least one identifier in the image data using the closed loop.

Images