WO2017006618A1

WO2017006618A1 - Server, endoscopic system, transmission method, and program

Info

Publication number: WO2017006618A1
Application number: PCT/JP2016/063745
Authority: WO
Inventors: 勝義谷口; 遼太小林
Original assignee: オリンパス株式会社
Priority date: 2015-07-09
Filing date: 2016-05-09
Publication date: 2017-01-12
Also published as: JPWO2017006618A1

Abstract

Provided are a server, an endoscopic system, a transmission method and a program which allow image data groups captured by a capsule endoscope to be transmitted in a transmission order determined considering a doctor's reading workflow. The server 8 is provided with: a storage unit 82 for storing a plurality of image data groups of a plurality of cases; and a transmission control unit 834 that, when receiving a selection signal for selecting an image data group of any one case of the plurality of cases stored in the storage unit 82 from a terminal device, determines the order of transmission of images for viewing to be displayed on a display unit of the terminal device on the basis of a user's reading workflow and the input operation signal received by the terminal device and sequentially transmits the image groups to the terminal device.

Description

Server, endoscope system, transmission method and program

The present invention relates to a server, an endoscope system, and a transmission method for transmitting an image data group in a subject generated by imaging by a capsule endoscope introduced into the subject via a network to an external terminal device. And program.

Conventionally, in the field of endoscopes, examination using a capsule endoscope that is introduced into a subject and images the inside of the subject is known. A capsule endoscope is a device that incorporates an imaging function, wireless communication function, etc. in a capsule-shaped casing that is sized to be introduced into the digestive tract of a subject, and is swallowed from the mouth of the subject. After that, image data is generated by performing imaging while moving in the digestive tract by peristaltic motion or the like. The generated image data is wirelessly transmitted sequentially from the capsule endoscope to the outside of the subject.

The image data wirelessly transmitted from the capsule endoscope is received by a receiving device provided outside the subject and stored in a built-in memory or a portable memory. After the inspection is completed, the image data stored in the memory is transferred (downloaded) to an information management apparatus such as a workstation and subjected to predetermined image processing. The medical staff diagnoses the subject by observing the image thus generated.

On the other hand, in recent years, the construction of a network system for managing medical information such as image data and examination information has been promoted. By sending and receiving various types of medical information including medical images to such a network system, for example, centralized management of medical images at one facility or resides in a facility different from the facility where the examination was performed Various attempts have been made such as medical doctors diagnosing medical images.

For example, an image transfer system is known that includes a server that records a group of images taken by CT and MRI, and a terminal device that is communicably connected to the server and displays an image transmitted from the server. (See Patent Document 1). In this technique, when making a diagnosis while comparing the first image group captured by CT and the second image group captured by MRI, the terminal device displays the first image group captured by CT. Then, the server determines the image transfer order of the second image group based on the image being displayed on the terminal device, and sequentially transmits the second image group to the terminal device in the determined image transfer order.

JP 2009-230755 A

By the way, in the network system that manages the image data group photographed by the above-described conventional capsule endoscope, the server transmits the image data group corresponding to the file designated on the terminal device side to the terminal device in the photographing order. It was. For this reason, in the above-described network system of the prior art, when a specialist doctor residing in a facility different from the facility where the examination was performed diagnoses a patient using an image taken with a capsule endoscope, the optimal network for this doctor is used. However, it is not always possible to transmit an image in consideration of a correct interpretation workflow, and there is a case where a patient cannot be interpreted until all of the image data group designated by the doctor is downloaded to the terminal device.

In recent years, portable terminal devices have become widespread. However, since these terminal devices have a limited amount of communication, when all image data is downloaded in large quantities from a server or the like, the amount of communication is immediately limited. The user may have to download while paying attention to the traffic.

The present invention has been made in view of the above, and it is possible to transmit a group of image data captured by a capsule endoscope in the order of transmission in consideration of a doctor's interpretation workflow without being aware of the communication amount. An object of the present invention is to provide a server, an endoscope system, a transmission method, and a program.

In order to solve the above-described problems and achieve the object, a server according to the present invention includes a display unit capable of displaying an image and an operation input unit capable of receiving input of operation signals instructing various operations. An image data group composed of a plurality of temporally continuous image data by imaging each of a plurality of subjects, which is a server capable of bidirectional communication with a terminal device via a network. When a request signal for requesting transmission of any one of a plurality of recording units and a plurality of the image data groups recorded by the recording unit is received from the terminal device, an interpretation workflow executed by a user and the terminal device The image data group is sequentially transmitted to the terminal device in an optimal transmission order for viewing the image displayed by the display unit based on the operation signal that has received the input. A signal control unit, characterized by comprising a.

The server according to the present invention is the server according to the present invention, wherein the transmission control unit is generated according to a certain rule in the image data group according to the interpretation workflow when the operation signal is not received from the terminal device. The received image data is sequentially transmitted to the terminal device.

In the server according to the present invention as set forth in the invention described above, the predetermined rule includes a plurality of characteristic images including a predetermined time interval, a shooting interval at which image data is captured, a predetermined number interval, and the image data group. It is any one or more of predetermined intervals in the data.

In the server according to the present invention, the image data generated according to the certain rule transmitted to the terminal device corresponds to an average color bar generated for a bird's-eye view of the subject. It is the image data of the position to perform.

The server according to the present invention is the server according to the above invention, wherein the transmission control unit transmits image data at a position corresponding to the average color bar to the terminal device, and then image data at a position corresponding to the average color bar. A predetermined number of the next image data having a shooting time that is newer than the shooting time in the image data is transmitted to the terminal device, or a predetermined number of image data preceding and following the shooting time of the image data at a position corresponding to the average color bar It transmits to a terminal device, It is characterized by the above-mentioned.

In the server according to the present invention, in the above invention, the transmission control unit has a predetermined feature amount in the image data group after transmitting the image data generated according to the certain rule to the terminal device. Characteristic image data is sequentially transmitted to the terminal device.

In the server according to the present invention, the transmission control unit transmits image data including red in the image data group after transmitting the image data generated according to the certain rule to the terminal device. It transmits to the said terminal device sequentially, It is characterized by the above-mentioned.

In the server according to the present invention, in the above invention, when the transmission control unit receives a selection signal for selecting predetermined image data from the image data group as the operation signal, the selection signal The image data corresponding to the image data is transmitted, and the image data of the image data taken before and after the image data is sequentially transmitted to the terminal device at a constant ratio.

In the server according to the present invention as set forth in the invention described above, the transmission control unit may obtain image data having a shooting time that is newer than the shooting time of the image data corresponding to the selection signal, and a shooting time of the image data corresponding to the selection signal. More than the image data of the older photographing time is transmitted to the terminal device.

In the server according to the present invention as set forth in the invention described above, the transmission control unit uses the instruction signal instructing a special reproduction mode for reproducing image data satisfying a specific condition in the image data group as the operation signal. When received from a device, the image data extracted from the image data group according to the special reproduction mode is sequentially transmitted to the terminal device.

In the server according to the present invention as set forth in the invention described above, the image data extracted according to the special playback mode is characteristic image data having a predetermined feature amount in the image data group, and the transmission control The unit sequentially transmits the characteristic image data close to the imaging time of the image data at a position corresponding to the average color bar generated to observe the subject from a bird's-eye view.

In the server according to the present invention, in the above invention, the transmission control unit instructs the frame advance when the display unit displays an interpretation image corresponding to the image data transmitted from the server. When a signal is received from the terminal device as the operation signal, the interpretation image and two image data whose shooting times are before and after are transmitted, respectively, and an image with the shooting time later of the interpretation image and the two image data is transmitted. A predetermined number of image data whose photographing time is newer than the data is sequentially transmitted to the terminal device.

In the server according to the present invention as set forth in the invention described above, the transmission control unit instructs the frame return to instruct frame return when the display unit displays an interpretation image corresponding to the image data transmitted from the server. When a signal is received from the terminal device as the operation signal, the interpretation image and two image data whose shooting times are before and after are transmitted, respectively, and the image with the previous shooting time of the interpretation image and the two image data is transmitted. A predetermined number of image data whose shooting time is older than the data is sequentially transmitted to the terminal device.

In the server according to the present invention, in the above invention, the image data group is generated by a capsule endoscope that is introduced into a subject and continuously images the inside of the subject. Features.

An endoscope system according to the present invention is a capsule that is introduced into a subject, continuously captures the inside of the subject, and generates an image data group composed of a plurality of temporally continuous image data. A mold endoscope, an inspection information management device that transmits the image data group generated by the capsule endoscope to the outside via a network, a server that receives the image data group via the network, and An endoscope system comprising a terminal device capable of bidirectional communication with the server via a network, wherein the terminal device includes a display unit capable of displaying an image and operation signals for instructing various operations. An operation input unit capable of receiving an input, wherein the server records a plurality of image data groups composed of a plurality of temporally continuous image data by imaging each of the plurality of subjects. And when receiving a request signal requesting transmission of any one of the plurality of image data groups recorded by the recording unit from the terminal device, an interpretation workflow performed by the user and the terminal device input A transmission control unit that determines a transmission order for viewing images displayed by the display unit based on the received operation signal and sequentially transmits the image data group to the terminal device; It is characterized by.

In addition, a transmission method according to the present invention provides a terminal device including a display unit capable of displaying an image and an operation input unit capable of receiving input of operation signals instructing various operations via a network. A transmission method executed by a bi-directionally communicable server, which is implemented by a user when receiving a request signal requesting transmission of any one of a plurality of image data groups recorded by the recording unit from the terminal device Based on the interpretation workflow and the operation signal received by the terminal device, a transmission order for browsing the images displayed by the display unit is determined, and the image data group is sequentially transmitted to the terminal device. A transmission control step is included.

In addition, the program according to the present invention provides a terminal device including a display unit capable of displaying an image and an operation input unit capable of receiving input of operation signals for instructing various operations via a network. When a request signal requesting transmission of any one of a plurality of image data groups recorded by the recording unit is received from the terminal device to a server that can communicate with the terminal device, the interpretation workflow executed by the user and the terminal device input A transmission control step of determining a transmission order for browsing the images displayed by the display unit and transmitting the image data group sequentially to the terminal device based on the operation signal received. Features.

According to the present invention, it is possible to transmit an image data group captured by a capsule endoscope in a transmission order in consideration of a doctor's interpretation workflow.

FIG. 1 is a schematic diagram showing a schematic configuration of an endoscope system according to an embodiment of the present invention. FIG. 2 is a block diagram showing a functional configuration of the terminal device according to the embodiment of the present invention. FIG. 3 is a block diagram showing a functional configuration of the server according to the embodiment of the present invention. FIG. 4 is a flowchart showing an outline of processing executed by the server according to the embodiment of the present invention. FIG. 5 is a diagram showing an example of a case list screen displayed by the terminal device according to the embodiment of the present invention. FIG. 6 is a diagram illustrating an example of an interpretation screen displayed by the terminal device according to the embodiment of the present invention. FIG. 7 is a schematic diagram illustrating an example of the transmission order of the image data group transmitted to the terminal device by the transmission control unit of the server according to the embodiment of the present invention. FIG. 8A is a diagram schematically showing transition of an interpretation screen displayed by the terminal device according to the embodiment of the present invention. FIG. 8B is a diagram schematically showing transition of the interpretation screen displayed by the terminal device according to the embodiment of the present invention. FIG. 8C is a diagram schematically showing the transition of the interpretation screen displayed by the terminal device according to the embodiment of the present invention. FIG. 9 is a diagram schematically illustrating an example of a group of image data around the selected image transmitted by the transmission control unit of the server according to the embodiment of the present invention. FIG. 10 is a diagram schematically illustrating another example of the image data group around the selected image transmitted by the transmission control unit of the server according to the embodiment of the present invention. FIG. 11 is a diagram schematically illustrating an example of an image data group corresponding to the feature image playback mode transmitted by the transmission control unit when the feature image playback mode is selected in the terminal device according to the embodiment of the present invention. It is. FIG. 12 schematically shows another example of the image data group corresponding to the feature image playback mode transmitted by the transmission control unit when the feature image playback mode is selected in the terminal device according to the embodiment of the present invention. FIG. FIG. 13 is a diagram schematically illustrating another example of the image data group corresponding to the red mode transmitted by the transmission control unit when the red mode is selected in the terminal device according to the embodiment of the present invention. . FIG. 14 is a diagram schematically illustrating an example of the frame advance image data group transmitted by the transmission control unit of the server according to the embodiment of the present invention. FIG. 15 is a diagram schematically illustrating an example of a frame return image data group transmitted by the transmission control unit of the server according to the embodiment of the present invention. FIG. 16 is a flowchart showing an outline of display processing of the actual playback frame rate executed by the server according to another embodiment of the present invention. FIG. 17 is a flowchart showing an overview of communication speed calculation processing executed by a server according to another embodiment of the present invention. FIG. 18 is a flowchart showing an overview of a display process for displaying the total amount of data downloaded from a server executed by a terminal device according to another embodiment of the present invention. FIG. 19 is a flowchart showing an outline of a data reduction process performed by the server according to another embodiment of the present invention on the image data group transmitted from the inspection information management apparatus. FIG. 20 is a diagram schematically illustrating an example of an image recorded in the recording unit based on the determination by the feature image determination unit according to another embodiment of the present invention. FIG. 21 is a diagram schematically illustrating another example of an image recorded in the recording unit based on the determination by the feature image determination unit according to another embodiment of the present invention. FIG. 22 is a flowchart showing an outline of a data reduction process executed by a terminal device according to another embodiment of the present invention.

Hereinafter, an endoscope system according to an embodiment of the present invention will be described with reference to the drawings. In addition, this invention is not limited by the following embodiment. Moreover, in description of each drawing, the same code | symbol is attached | subjected and shown to the same part.

[Configuration of endoscope system]
FIG. 1 is a schematic diagram showing a schematic configuration of an endoscope system according to an embodiment of the present invention. An endoscope system 1 shown in FIG. 1 is introduced into a subject 2, generates image data by photographing the inside of the subject 2, and superimposes and transmits the image data on a radio signal. A receiving device 5 that receives a radio signal transmitted from the capsule endoscope 3 via a receiving antenna unit 4 attached to the subject 2, and examination information and examinations relating to examinations performed on the subject 2 An inspection information management device 6 (workstation) for managing image data as a result and performing image processing on the image data to display an image corresponding to the image data, and inspection information and image data from the outside via the network N100 And the inspection information and image data transmitted from the inspection information management device 6 via the network N100, and the terminal device 7 Comprises a server 8 to send al requested test information and image data, the. The inspection information management device 6, the terminal device 7, and the server 8 are connected via a network N100 by wireless or wired communication so that they can communicate bidirectionally.

The capsule endoscope 3 has an imaging function for imaging the inside of the subject 2 and a wireless communication function for transmitting in-vivo information including image data obtained by imaging the inside of the subject 2 to the receiving antenna unit 4. Have. The capsule endoscope 3 passes through the esophagus in the subject 2 by being swallowed into the subject 2, and moves in the body cavity of the subject 2 by peristaltic movement of the digestive tract cavity. The capsule endoscope 3 sequentially images the inside of the body cavity of the subject 2 at a minute time interval, for example, 0.5 second interval (2 fps) while moving in the body cavity of the subject 2. Are sequentially transmitted to the receiving antenna unit 4.

The receiving antenna unit 4 includes a receiving antenna 4a to a receiving antenna 4h. The receiving antennas 4a to 4h receive radio signals from the capsule endoscope 3 and transmit them to the receiving device 5. The receiving antennas 4a to 4h are configured using loop antennas or active antennas. Each of the receiving antennas 4a to 4h is attached to a predetermined position on the external surface of the subject 2, for example, a position corresponding to each organ of the subject 2 that is a passage path of the capsule endoscope 3.

The receiving device 5 records the image data in the subject 2 included in the radio signal transmitted from the capsule endoscope 3 via the receiving antenna 4a to the receiving antenna 4h, or corresponds to the image data in the subject 2. Display an image. The receiving device 5 receives position information of the capsule endoscope 3, time information indicating time, and the like via the receiving antenna 4a to the receiving antenna 4h and records them in association with image data. While the inspection by the capsule endoscope 3 is being performed, the reception device 5 is introduced from, for example, the mouth of the subject 2, moved through the digestive tract and discharged from the subject 2. It is stored in a holder (not shown) and carried by the subject 2. The receiving device 5 is detached from the subject 2 after the examination by the capsule endoscope 3 and is connected to the examination information management device 6 for transferring image data received from the capsule endoscope 3. . The receiving device 5 may transmit image data to the server 8 via the network N100 without passing through the examination information management device 6 described later after the examination by the capsule endoscope 3 is completed.

The examination information management device 6 displays an image corresponding to the image data of the subject 2 acquired via the receiving device 5 and records the image data and the examination information of the subject 2 in association with each other. The inspection information management device 6 includes a cradle 61 that reads image data and the like from the receiving device 5, and an operation input device 62 such as a keyboard and a mouse. The cradle 61 acquires related information such as image data, position information associated with the image data, time information, and identification information of the capsule endoscope 3 from the receiving device 5 when the receiving device 5 is mounted. Then, the acquired various information is transferred to the inspection information management device 6. The operation input device 62 receives an input by a user operation. While operating the operation input device 62, the user observes the body part of the subject 2, such as the esophagus, stomach, small intestine, and large intestine, while viewing the image of the subject 2 displayed by the examination information management device 6. Diagnose the lesion or the like of specimen 2. Further, the examination information management device 6 associates the image data acquired from the reception device 5 with the related information via the network N100 and transmits the image data to the server 8. The inspection information management device 6 is configured using a CPU (Central Processing Unit), a display panel such as a liquid crystal or an organic EL (Electro Luminescence), and a recording medium such as a volatile memory or a nonvolatile memory.

The terminal device 7 displays a list of image files of the image data of the plurality of subjects 2 recorded by the server 8 via the network N100, and requests the server 8 to transmit the image data of the image file selected by the user. . The terminal device 7 displays an image corresponding to the image data transmitted from the server 8 via the network N100, and transmits operation information received by the terminal device 7 to the server 8. The detailed configuration of the terminal device 7 will be described later.

The server 8 records the image data transmitted from the examination information management device 6 via the network N100 in association with the related information. Further, when there is a request for transmission of an image file from the terminal device 7 via the network N100, the server 8 transmits the image data requested from the terminal device 7. The detailed configuration of the server 8 will be described later.

[Detailed configuration of terminal device]
Next, a detailed configuration of the terminal device 7 will be described. FIG. 2 is a block diagram illustrating a functional configuration of the terminal device 7. The terminal device 7 illustrated in FIG. 2 includes a communication unit 71, a display unit 72, a touch panel 73, an operation input unit 74, a recording unit 75, and a terminal control unit 76.

The communication unit 71 transmits and receives various data radio signals including information necessary for communication with the server 8 via the network N100 according to a predetermined protocol under the control of the terminal control unit 76. Specifically, the communication unit 71 receives (downloads) an image file storing the image data of the subject 2 generated by the capsule endoscope 3 via the network N100 from the server 8, and at the terminal device 7 The received various operation information is transmitted (uploaded) to the server 8. The communication unit 71 employs Wi-Fi (Wireless Fidelity) (registered trademark) communication or Bluetooth (registered trademark) communication. The communication unit 71 may employ other communication such as communication using 4G wireless or 3G wireless, WiMAX (Worldwide Interoperability for Microwave Access) communication, in addition to Wi-Fi communication.

The display unit 72 displays an image corresponding to the image data transmitted from the server 8 and various information related to the terminal device 7. The display unit 72 is configured using a display panel such as liquid crystal or organic EL (Electro Luminescence).

The touch panel 73 is provided so as to overlap the display screen of the display unit 72, detects a contact position (coordinate information) where an external object (touch pen or finger) contacts, and receives an input of a signal corresponding to the detection result. . As a method of the touch panel 73, any of a resistive film method, a capacitance method, and an optical method can be applied. In the present embodiment, the terminal device 7 is provided with the touch panel 73. However, the present invention is not limited to this, and the touch panel 73 may be omitted.

The operation input unit 74 receives input of various operation signals of the terminal device 7. For example, the operation input unit 74 includes a power button that receives an input of a signal for turning on or off the power of the terminal device 7, a switch button that receives an input of a signal for switching the display mode of the display unit 72, and the like.

The recording unit 75 is configured using a flash memory, a RAM (Random Access Memory), a recording medium, and the like, and records various types of information related to the terminal device 7. The recording unit 75 temporarily stores a program recording unit 751 that records a program for operating the terminal device 7, an image data recording unit 752 that records image data, image data, various types of information being processed by the terminal device 7, and the like. And a temporary recording unit 753 for recording automatically.

The terminal control unit 76 controls the operation of the terminal device 7 by instructing each unit constituting the terminal device 7 and transferring data. The terminal control unit 76 is configured using a CPU (Central Processing Unit) or the like. The terminal control unit 76 includes a display control unit 761, a communication control unit 762, a recording control unit 763, and a total data amount calculation unit 764.

The display control unit 761 controls the display mode of the display unit 72. The display control unit 761 causes the display unit 72 to display an image corresponding to the image data received from the server 8 via the network N100.

The communication control unit 762 controls communication of the communication unit 71. The communication control unit 762 causes the communication unit 71 to communicate radio signals of various data including information necessary for communication with the server 8 via the network N100 according to a predetermined protocol.

The recording control unit 763 temporarily records the case image data group received from the server 8 via the network N100 in the temporary recording unit 753, and when the recording capacity of the temporary recording unit 753 exceeds a predetermined capacity, Delete temporally old image data and data sequentially. The recording control unit 763 controls the recording mode of the case image data group received from the server 8 recorded in the temporary recording unit 753. Specifically, since the recording control unit 763 has a limit on the data capacity that can be recorded by the temporary recording unit 753, when the user selects many cases, the image data group of all cases is stored in the temporary recording unit 753. Since it is difficult to record, it is determined whether or not the temporary recording unit 753 exceeds the recordable data capacity. When the temporary recording unit 753 exceeds the recordable data capacity, the image data recorded with the latest recorded time is determined. Delete sequentially. In this case, the recording control unit 763 temporarily records, in the temporary recording unit 753, image data and characteristic image data corresponding to the position of the average color bar generated for a bird's-eye observation of a subject to be described later. The image data corresponding to the position of the average color bar and the characteristic image data are deleted until a certain timing such as when the power of the terminal device 7 is turned off or the application for image interpretation is restarted. First, the image data is deleted sequentially from the image data that is the latest, for example, the image data used for frame advance. Furthermore, the recording control unit 763 performs priority and weighting for each case, for example, weighting in the order of new image data downloaded from the server 8, and if the temporary recording unit 753 exceeds the recordable data capacity, the priority and weighting are given. The image data corresponding to the position of the average color bar of the low case and the characteristic image data are deleted from the temporary recording unit 753.

The total data amount calculation unit 764 calculates the total data amount of the image data received from the server 8 via the network N100. The total data amount calculation unit 764 calculates the total data amount for each case (for each subject) in the image data group received from the server 8. Further, the total data amount calculation unit 764 calculates a total data amount obtained by summing up the total data amount for each case of the image data group received from the server 8. Furthermore, the total data amount calculation unit 764 receives the total data when the instruction signal for resetting the total data amount obtained by adding up the total data amount for each case of the image data group received from the server 8 is input from the operation input unit 74. Reset the amount.

[Detailed server configuration]
Next, a detailed configuration of the server 8 will be described. FIG. 3 is a block diagram illustrating a functional configuration of the server 8. The server 8 shown in FIG. 3 includes a communication unit 81, a recording unit 82, and a server control unit 83.

Under the control of the server control unit 83, the communication unit 81 stores various data including information necessary for communication with an external device such as the inspection information management device 6 or the terminal device 7 via the network N100. Send and receive according to the protocol.

The recording unit 82 is configured using a recording medium such as a flash memory, a RAM, and an HDD, and records various types of information regarding the server 8 and image data and various types of information received via the communication unit 81. The recording unit 82 includes a program recording unit 821 that records a program for operating the server 8 and an image data recording unit 822 that records image data generated by the capsule endoscope 3.

The server control unit 83 comprehensively controls the operation of the server 8 by giving instructions to each unit constituting the server 8, transferring data, and the like. The server control unit 83 includes an average color bar generation unit 831, a feature image determination unit 832, a determination unit 833, a transmission control unit 834, an actual reproduction frame rate calculation unit 835, and a communication speed calculation unit 836. .

The average color bar generation unit 831 converts the color information extracted along a time series from a series of image data groups generated by the capsule endoscope 3 into a band-like average color bar (image image) along the time axis. Generate. Specifically, the average color bar generation unit 831 calculates an average color for each predetermined number of image data groups generated by the capsule endoscope 3 recorded by the image data recording unit 822, and this calculation is performed. By arranging the averaged colors in a band shape along the time axis, an average color bar generated for observing the subject 2 from a bird's-eye view is generated. For example, when the image data group generated by the capsule endoscope 3 recorded by the image data recording unit 822 is 10,000 images, the average color bar generation unit 831 calculates the average of 10,000 pixels to an average of 1000 pixels (Pixel). When displaying with a color bar, an average value (average color) of ten images is calculated, and the average color bar is generated by arranging the calculated average values in a strip shape along the time axis for each pixel. Here, the observation of the subject 2 from a bird's-eye view means that the organ of the subject 2 is distinguished for each organ and the color of the whole case is confirmed, for example, the bleeding is confirmed, and the entire color is confirmed (the whole is pinkish). ), Confirmation of residues (green when there are many residues), confirmation of bile (yellowish when there are many bile), and the like. In the first embodiment, the average color bar generation unit 831 generates an average color bar of the image data group generated by the capsule endoscope 3, but for example, the reception device 5, the inspection information management device 6, and By providing the terminal device 7 with the same function as the average color bar generating unit 831, the average color bar may be generated by any of the receiving device 5, the inspection information management device 6, and the terminal device 7.

The determination unit 833 determines the content of the operation signal transmitted from the terminal device 7 via the network N100.

The transmission control unit 834 sequentially transmits the image data group to the terminal device 7 based on the determination result by the determination unit 833. Specifically, when it is determined by the determination unit 833 that the transmission control unit 834 has received a request signal requesting transmission of any one of a plurality of image data groups recorded by the recording unit 82 from the terminal device 7, Based on the interpretation workflow set in the terminal device 7 and the operation signal received by the terminal device, the transmission order for viewing the image displayed by the display unit 72 of the terminal device 7 is determined and recorded. The image data group recorded by the unit 82 is sequentially transmitted to the terminal device 7. Specifically, when the operation signal is not received from the terminal device 7, the transmission control unit 834 sequentially transmits image data generated according to a certain rule in the image data group to the terminal device 7 according to the interpretation workflow. . Here, the certain rule is a predetermined time interval, a shooting interval at which image data is captured, a predetermined number interval, a predetermined number interval in a plurality of characteristic image data included in the image data group, and a capsule type endoscope. Any one of the movement distances of the mirror 3. Note that each of the predetermined time interval, the shooting interval, the predetermined number interval, the predetermined number interval and the movement distance in the plurality of characteristic image data can be changed as appropriate, for example, the touch panel of the terminal device 7. 73 or the operation input unit 74 can be changed.

Here, the interpretation workflow set in the terminal device 7 refers to the type of reproduction mode for reproducing an image when the case is interpreted, the frame rate for reproducing the image, and user identification information (identification of the terminal device 7). Information), presence / absence information including the presence / absence of a case where interpretation has been performed, the number of times of reproduction, and the like, and position information of the slide bar in the average color bar are associated with each other. Further, the information regarding the interpretation workflow may be recorded in the recording unit 75 of the terminal device 7 or may be recorded in the recording unit 82 of the server 8. When recording in the recording unit 75 of the terminal device 7, the communication control unit 762 of the terminal device 7 transmits information related to the interpretation workflow recorded in the recording unit 75 to the server 8 when accessing the server 8. When recording in the recording unit 82 of the server 8, the transmission control unit 834 of the server 8 responds to the accessed terminal device 7 based on the identification information (for example, IP address) of the accessed terminal device 7. Information regarding the obtained interpretation workflow is determined, and an optimal transmission order is determined for the image data group of the case selected in accordance with the acquired information regarding the interpretation workflow and the operation signal received from the terminal device 7, and sequentially transmitted to the terminal device 7. To do.

The feature image determination unit 832 calculates one or more types of predetermined feature amounts for the series of image data groups generated by the capsule endoscope 3 recorded by the image data recording unit 822, and the predetermined features. Image data having a quantity is determined as characteristic image data. Specifically, the feature image determination unit 832 calculates the average color of the in-vivo image corresponding to the image data (average value of each RGB pixel value component, average value of hue value / saturation / lightness calculated from the RGB pixel value). Etc.), the amount of change from the previous image of the average color (image taken immediately before the time series), the average luminance of the in-vivo image, the amount of change of the average luminance from the previous image, one or more in the in-vivo image Color (RGB value, hue value, saturation, brightness, etc.) or luminance in a specific part (center of in-vivo image, several points at a predetermined distance from the center) or luminance, color or luminance in the specific part from the previous image The amount of change, the rate of coincidence with a specific pattern of the shape of the specific part (for example, a pattern of a predetermined lesion site), the degree of similarity with the previous image or the magnitude of the motion vector, and in-vivo images detected by known image processing Area (external, mucosal area) Is a parameter representing a non-mucosal region or organ type (stomach, small intestine, large intestine, etc.), a parameter representing a specific pattern of spatial frequency obtained by frequency analysis on in-vivo images, and the like. Image data exceeding the threshold is determined as characteristic image data.

The actual playback frame rate calculation unit 835 calculates the actual playback frame rate of the image displayed on the terminal device 7 and transmits the calculation result to the terminal device 7.

The communication speed calculation unit 836 calculates the communication speed between the terminal device 7 and the server 8 via the network N100, and transmits the calculation result to the terminal device 7.

[Server transmission processing]
Next, when a user such as a doctor uses the terminal device 7 to perform an image interpretation operation according to an image interpretation workflow for a desired case, the server 8 captures image data captured by the capsule endoscope 3. A transmission process for transmitting a group will be described. FIG. 4 is a flowchart showing an outline of processing executed by the server 8. When a user such as a doctor uses the terminal device 7 to perform an interpretation operation according to an interpretation workflow on a desired case by the user. 4 is a flowchart of a transmission process executed by the server 8.

As shown in FIG. 4, first, when there is an access from the terminal device 7 via the network N100 (step S101: Yes), the server 8 records each case recorded by the recording unit 82 on the accessed terminal device 7. The case list data of (case file in which examination ID and image data are associated) is transmitted (step S102). In this case, the display control unit 761 of the terminal device 7 causes the display unit 72 to display a case list screen corresponding to the case list data received from the server 8.

FIG. 5 is a diagram illustrating an example of a case list screen displayed by the terminal device 7. In the case list screen B1 shown in FIG. 5, a list display area W1 for displaying a list of cases that can be interpreted, a communication status image W2 for displaying the communication status of the terminal device 7, and the terminal device 7 from the server 8 image data. Communication status icon W3 (Traffic check) that accepts an input of an instruction signal for confirming the communication status (download performance) when receiving the image, and an input of an instruction signal for uploading the image file storing the image data to the server 8 An upload icon W4 (Upload) to be received, an update icon W5 (Refresh) to receive an input of an instruction signal for updating the case list screen B1, and a total data amount in which the data amount of each case downloaded from the server 8 by the terminal device 7 is accumulated. Reset that accepts input of W6 (Grand DL total) and instruction signal to reset the total data count A logout icon W7 (Reset) and a logout icon W8 (Logout) that accepts an input of an instruction signal for instructing logout.

In the list display area W1, examination ID W11 (Exam ID), patient ID W12 (Patient ID), patient (subject) name W13 (Patient Name), examination date W14 (Scheduled Date), and file size W15 (File Size), image processing status W16 (Image Processing), interpretation status W17 (Reading), survey status W18 (Report), and total download amount W19 (DL total). A user such as a doctor who interprets a case selects a predetermined case or icon by touching with a finger or a touch pen via the touch panel 73. The user operates the pointer Q1 via the touch panel 73 to select the desired case or icon by clicking on it. In this case, the communication control unit 762 transmits a selection signal indicating that a case has been selected from a plurality of cases by the user to the server 8 via the communication unit 71 and the network N100. In the case list screen B1 of FIG. 5, the patient information is displayed as the examination IDW11, the patient IDW12, and the patient name W13. However, the patient information is not limited to this and may be changed as appropriate according to the setting. For example, it may be displayed as text data, characters and symbols. *

Returning to FIG. 4, the description from step S102 onward will be continued.
In step S103, when a selection signal (request signal) for selecting any one of a plurality of cases recorded by the recording unit 82 is received from the terminal device 7 via the network N100 (step S103: Yes), the server In step 8, the process proceeds to step S104 described later. On the other hand, when the selection signal for selecting any one of a plurality of cases recorded by the recording unit 82 is not received from the terminal device 7 via the network N100 (step S103: No), the server 8 Shifts to step S128 described below.

In step S104, the transmission control unit 834 transmits the interpretation image data including the average color bar data of the case corresponding to the selection signal to the terminal device 7 via the network N100.

Subsequently, when the determination unit 833 determines that the case according to the selection signal received from the terminal device 7 has been interpreted (step S105: Yes), the transmission control unit 834 selects the selection received from the terminal device 7. The captured image data of the case corresponding to the signal is transmitted to the terminal device 7 (step S106). After step S106, the server 8 proceeds to step S107 described later. On the other hand, when the determination unit 833 determines that the case according to the selection signal received from the terminal device 7 has not been interpreted (step S105: No), the server 8 proceeds to step S107 described later.

FIG. 6 is a diagram illustrating an example of an interpretation screen displayed by the terminal device 7. As shown in FIG. 6, the image interpretation screen B2 is supplied with an image area R for displaying an image P corresponding to image data and an instruction signal for instructing a moving image mode for sequentially reproducing the image data group in time series. Movie icon A1 to be accepted, overview icon A2 to accept input of an instruction signal for instructing an overview mode for displaying a list of a predetermined number of image data groups, and a frame to accept input of an instruction signal for setting a playback frame rate of a movie A rate icon A3, a display area A4 for displaying the actual playback frame rate, and (Average speed), and a single-display mode icon A5 for receiving an instruction signal for instructing a single-display mode for displaying the image data group one by one. And multiple displays that accept input of instruction signals that direct multiple display modes to display multiple video frames simultaneously An image icon A6, a feature image reproduction mode icon A7 for receiving an input of an instruction signal for instructing a feature image reproduction mode for displaying a characteristic image extracted under a specific condition for the image data group, and an image data group The red mode icon A8 that receives input of an instruction signal for instructing the bleeding mode for extracting red image data including bleeding and red and displaying the red image, and the position of the capsule endoscope 3 when the image is taken A three-dimensional mode icon A9 that accepts an input of an instruction signal that indicates a three-dimensional mode that is schematically displayed three-dimensionally, a mode display area A10 that displays a selected reproduction mode, and a frame of image data to be reproduced And a frame instructing unit A11 that accepts an input of an instruction signal for instructing a feed or a frame return.

Further, the interpretation screen B2 includes an average color bar T1 of the selected case, a slide bar T2 for selecting an image corresponding to the average color bar T1, and a time of the slide bar T2 (a time code T3 indicating a selected position). The download bar T4 indicating the download status of the selected case, and the captured images C1 to C3 that have been selected and have already been interpreted and captured.

Furthermore, the frame rate icon A3 includes a down icon A31 for receiving an input of an instruction signal for decreasing the frame rate, and an up icon A32 for receiving an input of an instruction signal for increasing the frame rate. Furthermore, the frame instruction unit A11 includes a frame advance icon A111 that receives an input of an instruction signal for instructing frame advance of an image, and a frame return icon A112 that receives an input of an instruction signal for instructing an image frame return.

Note that the image interpretation screen B2 does not extract characteristic image data from the image data group of the characteristic image reproduction mode icon A7 and the red mode icon A8 or extract image data having a strong redness component. Auto mode (Auto Speed mode) that sequentially reproduces only a part of image data extracted under specified conditions from the normal mode icon and image data group that accepts the input of the instruction signal that instructs the normal mode that sequentially reproduces all of the data group An auto speed mode icon that receives an input of an instruction signal instructing “Adjust” may be provided. In the case of these two modes, not all the image data groups of the selected cases are displayed in the image area R of the interpretation screen B2, so that the communication amount of data downloaded from the server 8 can be suppressed.

Returning to FIG. 4, the description of step S107 and subsequent steps will be continued.
In step S 107, the transmission control unit 834 transmits to the terminal device 7 image data generated according to a certain rule from the image data group in the case image file according to the selection signal received from the terminal device 7 via the network N 100. Send sequentially. Specifically, the transmission control unit 834 transmits to the terminal device 7 image data at a position corresponding to the average color bar in the case image file corresponding to the selection signal received from the terminal device 7. Here, the image data at the position corresponding to the average color bar is any one of a predetermined time interval, a predetermined number of images, a predetermined photographing time, and an in-vivo moving distance of the capsule endoscope 3. For example, the transmission control unit 834 sets the feature image reproduction mode in the terminal device 7 and the image data group generated by the capsule endoscope 3 recorded by the image data recording unit 822 is 10,000. When the average color bar T1 of 1000 pixels is generated from 10,000 sheets, the characteristic image determination unit 832 has a characteristic among the 10 pieces of image data used to generate one pixel constituting the average color bar T1. Characteristic image data determined to be image data is transmitted to the terminal device 7. In addition, the transmission control unit 834 sets the normal mode in the terminal device 7 and the 10,000 image data groups generated by the capsule endoscope 3 recorded by the image data recording unit 822 are 10,000. When the average color bar T1 of 1000 pixels is generated, the first image data (the image with the oldest shooting time) among the 10 pieces of image data used to generate one pixel constituting the average color bar T1. Data). Of course, it is not necessary to be the first image data, and any one of the predetermined number of pieces of image data used for generating one pixel constituting the average color bar T1 may be used. In the following, when the image data group generated by the capsule endoscope 3 recorded by the image data recording unit 822 is 10,000 images, an average color bar T1 of 1000 pixels is generated from these 10,000 images. An example of image data at a position corresponding to the average color bar T1 transmitted by the transmission control unit 834 will be described.

FIG. 7 is a schematic diagram illustrating an example of the transmission order of the image data group transmitted by the transmission control unit 834 to the terminal device 7. In FIG. 7, the horizontal axis indicates time.

As shown in (a) of FIG. 7, the transmission control unit 834 receives the image data generated according to a certain rule from the image data group in the case image file according to the selection signal received from the terminal device 7. Sequentially sent to 7. For example, the transmission control unit 834 includes image data corresponding to the image P ₁ at a position corresponding to the average color bar in the image file of the case corresponding to the selection signal received from the terminal device 7, image data corresponding to the image P ₁₀₀ , Image data corresponding to the image P ₂₀₀ and image data corresponding to the image P _n (n: a natural number of 251 or more) are sequentially transmitted to the terminal device 7. In this case, as illustrated in FIG. 8A, the terminal device 7 sets the time (position) of the image data received by the display control unit 761 from the server 8 to the time corresponding to the division of the average color bar T1 (different hatching positions). The download bar T4 is updated and displayed. Thereby, the user can grasp | ascertain intuitively the present download condition of the selected case.

In FIG. 7A, the transmission control unit 834 transmits image data at a position corresponding to the average color bar T1 of the case selected by the terminal device 7, for example, one image data every 100th. However, for example, when the image data group generated by the capsule endoscope 3 recorded by the image data recording unit 822 is 50,000 images, when generating an average color bar of 1000 pixels from these 50,000 images The image data at the position corresponding to the average color bar T1 transmitted by the transmission control unit 834 may be transmitted every 50th image data.

Subsequently, the determination unit 833 determines whether or not the image data group has been transmitted to the terminal device 7 every predetermined number of sheets (step S108). When the determination unit 833 determines that the image data group has been transmitted to the terminal device 7 every predetermined number (step S108: Yes), the server 8 proceeds to step S109 described later. On the other hand, when the determination unit 833 determines that the image data group has not been transmitted to the terminal device 7 every predetermined number (step S108: No), the server 8 continues this determination.

In step S109, the determination unit 833 determines whether an operation signal for changing the playback mode or an operation signal for selecting a playback image is received from the terminal device 7 via the network N100. When the determination unit 833 determines that the operation signal for changing the reproduction mode or the operation signal for selecting the reproduction image has been received from the terminal device 7 via the network N100 (step S109: Yes), the server 8 performs step S120 described later. Migrate to On the other hand, when the determination unit 833 determines that the operation signal for changing the reproduction mode or the operation signal for selecting the reproduction image is not received from the terminal device 7 via the network N100 (step S109: No), the server In step 8, the process proceeds to step S110 described later.

In step S110, the determination unit 833 determines whether the rear image data group has been transmitted to the terminal device 7 via the network N100. When the determination unit 833 determines that the rear image data group has been transmitted to the terminal device 7 via the network N100 (step S110: Yes), the server 8 proceeds to step S113 described later. On the other hand, when the determination unit 833 determines that the rear image data group has not been transmitted to the terminal device 7 via the network N100 (step S110: No), the server 8 proceeds to step S111 described later.

In step S111, the transmission control unit 834 sequentially transmits the rear image data group in the case image file corresponding to the selection signal received from the terminal device 7 to the terminal device 7 via the communication unit 81 and the network N100. Specifically, as shown in (b) of FIG. 7, the transmission control section 834, an intermediate image between the image P ₁ and the image P _n in the image file of cases in accordance with the selection signal received from the terminal apparatus 7 Is transmitted to the terminal device 7. For example, the transmission control unit 834 sequentially transmits image data corresponding to the image P ₅₀ , image data corresponding to the image P _150, and image data corresponding to the image P ₂₅₀ to the terminal device 7. In this case, the terminal device 7 updates and displays the download bar T4 by reflecting the position of the image data received from the server 8 by the display control unit 761 on the position corresponding to the average color bar T1. (FIG. 8A → FIG. 8B → FIG. 8C). Thereby, the user can grasp | ascertain intuitively the present download condition of the selected case.

Further, in (b) of FIG. 7, the transmission control unit 834, after transmitting the image data at a position corresponding to the average color bar T1 to the terminal device 7, photographing time from the shooting time of the image P ₁ is a new next image Although image data corresponding to the P ₅₀ was sending only one, for example imaging times than the photographing time of the image P ₁ is the new next image data by a predetermined number, two or more image data specifically You may transmit to the terminal device 7. Further, in FIG. 7B, the transmission control unit 834 may transmit a predetermined number of image data before and after the photographing time of the image data at the position corresponding to the average color bar T 1 to the terminal device 7. . For example, after transmitting the images one by one to the terminal device 7, the transmission control unit 834 gradually narrows the thinning interval (photographing time interval) little by little, one more image and then another image. To the terminal device 7.

Subsequently, the determination unit 833 determines whether or not the rear image data group has been transmitted to the terminal device 7 via the network N100 (step S112). When the determination unit 833 determines that the rear image data group has been transmitted to the terminal device 7 via the network N100 (step S112: Yes), the server 8 proceeds to step S113 described later. On the other hand, when the determination unit 833 determines that the rear image data group has not been transmitted to the terminal device 7 via the network N100 (step S112: No), the server 8 returns to step S109 described above.

In step S113, the determination unit 833 determines whether a characteristic image data group in the case image file according to the selection signal received from the terminal device 7 via the network N100 has been transmitted to the terminal device 7. To do. When the determination unit 833 determines that the characteristic image data group in the case image file according to the selection signal received from the terminal device 7 via the network N100 has been transmitted to the terminal device 7 (step S113: Yes). The server 8 proceeds to Step S116 described later. On the other hand, when the determination unit 833 determines that the characteristic image data group in the case image file according to the selection signal received from the terminal device 7 via the network N100 has not been transmitted to the terminal device 7 (step (S113: No), the server 8 proceeds to Step S114 to be described later.

In step S 114, the transmission control unit 834 sequentially transmits characteristic image data groups in the case image file according to the selection signal received from the terminal device 7 via the network N 100 to the terminal device 7. Specifically, as illustrated in (c) of FIG. 7, the transmission control unit 834 applies an image P ₉₉ that is a characteristic image data group in the case image file according to the selection signal received from the terminal device 7. Corresponding image data, image data corresponding to the image P ₁₀₁ , image data corresponding to the image P ₂₄₉ , image data corresponding to the image P ₂₅₁ and image data corresponding to the image P ₃₀₀ are sequentially transmitted to the terminal device 7. In FIG. 7C, the transmission control unit 834 has a series of characteristic image data groups. However, the transmission control unit 834 is not limited to this. The image data group may be transmitted to the terminal device 7 at an interval of 1 out of 10 images.

Subsequently, the determination unit 833 determines whether the characteristic image data group in the case image file according to the selection signal received from the terminal device 7 via the network N100 has been transmitted to the terminal device 7. (Step S115). When determining unit 833 determines that the characteristic image data group in the case image file corresponding to the selection signal received from terminal device 7 via network N100 has been transmitted to terminal device 7 (step S115: Yes). The server 8 proceeds to Step S116 described later. On the other hand, when the determination unit 833 determines that the characteristic image data group in the case image file according to the selection signal received from the terminal device 7 via the network N100 has not been transmitted to the terminal device 7 (step S115: No), the server 8 returns to step S109 described above.

In step S116, the determination unit 833 determines whether the red image data group in the case image file corresponding to the selection signal received from the terminal device 7 via the network N100 has been transmitted to the terminal device 7. When the determination unit 833 determines that the red image data group in the case image file corresponding to the selection signal received from the terminal device 7 via the network N100 has been transmitted to the terminal device 7 (step S116: Yes), the server In step 8, the process proceeds to step S119 described later. On the other hand, when the determination unit 833 determines that the red image data group in the case image file according to the selection signal received from the terminal device 7 via the network N100 has not been transmitted to the terminal device 7 (step S116: No), the server 8 proceeds to Step S117 described later.

In step S117, the transmission control unit 834 sequentially transmits the red image data group in the case image file corresponding to the selection signal received from the terminal device 7 to the terminal device 7 via the network N100. Specifically, as illustrated in FIG. 7D, the transmission control unit 834 corresponds to an image P ₂₅₂ that is a red image data group in the case image file according to the selection signal received from the terminal device 7. Image data and image data corresponding to the image P ₂₅₃ are sequentially transmitted to the terminal device 7.

Subsequently, the determination unit 833 determines whether or not the red image data group in the image file of the case according to the selection signal received from the terminal device 7 via the network N100 has been transmitted to the terminal device 7 (Step S83). S118). When the determination unit 833 determines that the red image data group in the image file of the case corresponding to the selection signal received from the terminal device 7 via the network N100 has been transmitted to the terminal device 7 (step S118: Yes), the server In step 8, the process proceeds to step S119 described later. On the other hand, when the determination unit 833 determines that the red image data group in the case image file according to the selection signal received from the terminal device 7 via the network N100 has not been transmitted to the terminal device 7 (step S118: No), the server 8 proceeds to the above-described step S109.

In step S119, when the end signal instructing the end of interpretation in the image file of the case according to the selection signal is received from the terminal device 7 via the network N100 (step S119: Yes), the server 8 ends this processing. To do. On the other hand, when the end signal instructing the end of the interpretation in the image file of the case corresponding to the selection signal is not received from the terminal device 7 via the network N100 (step S119: No), the server 8 Return to step S109.

In step S120, the determination unit 833 determines whether the operation signal received from the terminal device 7 via the network N100 is a change of the selected image. When the determination unit 833 determines that the operation signal received from the terminal device 7 via the network N100 is a change of the selected image (step S120: Yes), the server 8 proceeds to step S121 described later. On the other hand, when the determination unit 833 determines that the operation signal received from the terminal device 7 via the network N100 is not a change of the selected image (step S120: No), the server 8 proceeds to step S122 described later. .

In step S121, the transmission control unit 834 transmits the image data group around the selected image selected according to the operation signal to the terminal device 7. Specifically, when the user slides the slide bar T2 of the average color bar T1 to a desired position via the touch panel 73 or the operation input unit 74, an operation signal instructing change of the selected image from the terminal device 7 is transmitted to the server. When 8 is received, the transmission control unit 834 transmits the image data group around the selected image selected according to the operation signal to the terminal device 7. After step S121, the server 8 proceeds to step S119.

FIG. 9 is a diagram schematically illustrating an example of the image data group around the selected image transmitted by the transmission control unit 834 of the server 8. In FIG. 0, the horizontal axis indicates time.

As illustrated in FIG. 9, the transmission control unit 834 transmits the image data of the image P _j when the selected image selected according to the operation signal received from the terminal device 7 is the image P _j (j: natural number). At the same time, the image data of the image data of the image P _{j and} the image data of the shooting time before and after the image data are sequentially transmitted to the terminal device 7 at a constant ratio. Specifically, the transmission control unit 834 transmits the image data of the image P _{j to} the terminal device 7 at a ratio that increases the number of image data with a new shooting time, for example, a ratio of 1: 9. For example, after transmitting the image data of the image P _j to the terminal device 7, an image P _j shooting time one image data and the image P _j from shooting time corresponding to the image P _j-1 of the new nine older than Each image data in the images P _{j + 1} to P _{j + 9} is transmitted to the terminal device 7. In this case, the transmission control unit 834 transmits the image data corresponding to the image P _j−1 after transmitting the image data corresponding to the image P _{j + 1} . Thereafter, the image data of each of the images P _{j + 2} to P _{j + 10} is sequentially transmitted to the terminal device 7. Thus, the image data group desired by the user can be transmitted, so that the image data before and after the photographing time in the image desired by the user can be quickly viewed. In FIG. 9, the transmission control unit 834, sends the image data of the image P _j, the image data of the shooting time may be around the photographing time of the image data of the image P _j 1: 9 terminal in a ratio of 7 This ratio can be changed as appropriate. Specifically, when the user changes the above-described ratio via the touch panel 73 or the operation input unit 74 of the terminal device 7, for example, when the transmission control unit 834 changes from 1: 9 to 1: 4, the transmission control unit 834 The image data of the shooting time of the image data of the selected image selected in accordance with the operation signal received from the terminal device 7 at the ratio of 4: may be transmitted to the terminal device 7.

FIG. 10 is a diagram schematically illustrating another example of the image data group around the selected image transmitted by the transmission control unit 834. In FIG. 10, the transmission order transmitted by the transmission control unit 834 is represented by numbers in parentheses.

As shown in FIG. 10, the transmission control unit 834 transmits the image data group at the position corresponding to the average color bar T1, and then selects the image data group whose shooting time is before and after in the selected image corresponding to the position of the slide bar T2. Send. Subsequently, the transmission control unit 834 transmits a characteristic image data group. Specifically, as illustrated in FIG. 10, the transmission control unit 834 displays the image P ₁ (1), the image P ₁₁ (2), the image P ₂₁ (3), and the image P at the position corresponding to the average color bar T1. After sequentially transmitting the image data of ₃₁ (4) and image P ₄₁ (5) ((a) in FIG. 10 → (b) in FIG. 10), the image P ₂₁ (3) selected by the slide bar T2 Each of the image P ₂₂ (6), the image P ₂₀ (7), the image P ₂₃ (8), the image P ₂₄ (9), and the image P ₂₅ (10) whose shooting times in FIG. (B) → FIG. 10 (c)). Subsequently, the transmission control unit 834 has a characteristic image P ₂₆ (11), image P ₂₉ (12), image P ₂₁ (3), which has a new shooting time (future image) than the image P ₂₁ (3) selected by the slide bar T2. The image data of the image P ₃₅ (13) and the image P ₃₈ (14) are sequentially transmitted. As a result, the image data group desired by the user can be transmitted, and even when the playback mode is switched from the image P ₂₁ (3) selected by the slide bar T2, a characteristic image is instantly displayed. Can be displayed. In FIG. 10, the transmission control unit 834 transmits the image with the shooting time of the image selected by the slide bar T2 around the terminal device 7 at a ratio of 1: 4. For example, the ratio is 2: 3. The image data may be transmitted sequentially. In this case, the transmission control unit 834 may transmit image data whose shooting time is around to the terminal device 7 alternately. In addition, the transmission control unit 834 receives image data of an image whose shooting image is older than the shooting time of the image selected by the slide bar T2 among the images whose shooting times of the image selected by the slide bar T2 are around. If the image data has already been transmitted, the ratio of the image data having a new photographing time from the photographing time of the image selected by the slide bar T2 may be sequentially transmitted.

Returning to FIG. 4, the description of step S122 and subsequent steps will be continued.
In step S122, the determination unit 833 determines whether the operation signal received from the terminal device 7 via the network N100 is a change in the playback mode. When the determination unit 833 determines that the operation signal received from the terminal device 7 via the network N100 is a change of the reproduction mode (step S122: Yes), the server 8 proceeds to step S123 described later. On the other hand, when the determination unit 833 determines that the operation signal received from the terminal device 7 via the network N100 is not a change of the playback mode (step S122: No), the server 8 proceeds to step S124 described later. .

In step S123, the transmission control unit 834 transmits the image data group corresponding to the reproduction mode selected according to the operation signal to the terminal device 7. Specifically, when the user selects the feature image playback mode via the touch panel 73 or the operation input unit 74, the transmission control unit 834 sequentially transmits image data groups corresponding to the feature image playback mode to the terminal device 7. When the red mode is selected, the image data group corresponding to the red mode is sequentially transmitted to the terminal device 7. After step S123, the server 8 proceeds to step S119.

FIG. 11 is a diagram schematically illustrating an example of an image data group corresponding to the feature image playback mode transmitted by the transmission control unit 834 when the feature image playback mode is selected in the terminal device 7. In FIG. 11, the horizontal axis indicates time.

As shown in FIG. 11, when the feature image playback mode is selected by the terminal device 7, the transmission control unit 834 has the characteristic image determined by the feature image determination unit 832 having a predetermined feature amount in the case image file. The image data group is sequentially transmitted to the terminal device 7. For example, as illustrated in FIG. 11, the transmission control unit 834 includes the characteristic images P ₁ , P ₁₀ , and P ₅₀ that are determined by the feature image determination unit 832 to have a predetermined feature amount in the case image file. The image data groups of the image P ₅₃ , the image P ₁₀₀ , the image P ₁₂₁ , and the image P ₂₀₀ are sequentially transmitted to the terminal device 7. Thereby, the image data group in the feature image reproduction mode desired by the user can be promptly transmitted to the terminal device 7. As a result, the user can promptly interpret the case.

FIG. 12 is a diagram schematically illustrating another example of the image data group corresponding to the feature image playback mode transmitted by the transmission control unit 834 when the feature image playback mode is selected in the terminal device 7. In FIG. 12, the transmission order transmitted by the transmission control unit 834 is represented by numbers in parentheses.

As shown in FIG. 12, the transmission control unit 834 has a feature close to an image at a position corresponding to the average color bar T1 (see FIG. 10B) when the feature image reproduction mode is selected by the terminal device 7. Priority image data is transmitted to the terminal device 7 with priority. Specifically, the transmission control unit 834 has image data corresponding to characteristic images close to the image P ₁ , the image P ₁₁ , the image P ₂₁ , the image P _31, and the image P ₄₁ at the position corresponding to the average color bar T1. For example, the image P ₃ (1), the image P ₁₂ (2), the image P ₂₂ (3), the image P ₃₁ (4), and the image P ₄₃ (5) are sequentially transmitted and then transmitted. A characteristic image close to one of the image P ₁ , the image P ₁₁ , the image P ₂₁ , the image P _31, and the image P _{41 at} the position corresponding to the average color bar T1, for example, the image P ₂₆ The image data of (6), image P ₁₅ (7), image P ₂₉ (8), image P ₃₅ (9), image P ₃₈ (10) and image P ₄₇ (11) is transmitted to the terminal device 7. ((A) in FIG. 12 → (b) in FIG. 12). Thus, by preferentially transmitting characteristic image data close to the image at the position corresponding to the average color bar T1, it is possible to quickly read the case in the characteristic image reproduction mode without delay.

FIG. 13 is a diagram schematically illustrating an example of an image data group corresponding to the red mode transmitted by the transmission control unit 834 when the red mode is selected by the terminal device 7. In FIG. 13, the horizontal axis indicates time.

As illustrated in FIG. 13, when the red mode is selected in the terminal device 7, the transmission control unit 834 sequentially transmits the red image data group in the case image file to the terminal device 7. Specifically, as shown in FIG. 13, the transmission control unit 834 performs red image data for each of the red image P ₁ , the image P ₁₀₀ , the image P ₂₀₀ , the image P ₂₅₀ , and the image P ₄₀₀ in the case image file. Are sequentially transmitted to the terminal device 7. Thereby, the image data group of the red mode desired by the user can be promptly transmitted to the terminal device 7. As a result, the user can promptly interpret the case.

Returning to FIG. 4, the description of step S124 and subsequent steps will be continued.
In step S124, when the user operates the touch panel 73 or the operation input unit 74 of the terminal device 7, the operation signal received from the terminal device 7 through the network N100 is an instruction signal instructing frame advance of the image. (Step S124: Yes), the server 8 proceeds to Step S125 described later. On the other hand, when the operation signal received from the terminal device 7 via the network N100 is not an instruction signal for instructing frame advance of an image (step S124: No), the server 8 proceeds to step S126 described later. .

In step S125, the transmission control unit 834 transmits the image data to the terminal device 7 with priority given to the frame sending side. After step S125, the server 8 proceeds to step S119.

FIG. 14 is a diagram schematically illustrating an example of a frame advance image data group transmitted by the transmission control unit 834. FIG. 14 shows an example of frame advance image data transmitted by the transmission control unit 834 when the frame advance icon A111 is operated after the feature image reproduction mode is selected on the terminal device 7. In FIG. 14, the transmission order transmitted by the transmission control unit 834 is represented by numbers in parentheses. Furthermore, in FIG. 14, in order to simplify the description, the transmission order, the ratio, and the number of transmissions transmitted by the transmission control unit 834 are merely examples, and can be changed as appropriate.

As shown in FIG. 14, the transmission control unit 834 has characteristic images P ₃ (1) and P ₁₂ (2) that are close to the image at the position corresponding to the average color bar T1 (see FIG. 10B). ), The image P ₂₂ (3), the image P ₃₁ (4), and the image P ₄₃ (5), and then the operation signal received from the terminal device 7 via the network N100 instructs the frame advance of the image. When image data is received, image data necessary for frame advance is preferentially transmitted. Specifically, when the frame advance icon A111 is operated while the display unit 72 displays the image P ₂₂ (3), the transmission control unit 834 uses the shooting time of the image P ₂₂ (3) as a reference. The image P ₂₆ (6), the image P ₁₅ (7), the image P ₂₉ (8), and the image P ₃₅ are set so that the characteristic image data whose shooting time is before and after the image data are in a certain ratio, for example, a ratio of 1: 4. The image data of (9) and image P ₃₈ (10) are transmitted to the terminal device 7 ((a) in FIG. 14 → (b) in FIG. 14).

Thereafter, when the operation signal received from the terminal device 7 via the network N100 receives an instruction signal instructing frame advance of an image, the transmission control unit 834 captures a newer image than the image P ₂₂ (3) image capture time. Since there is a high possibility that the slide bar T2 is moved toward the time (forward direction) or the frame advance icon A111 is operated continuously, the shooting time is new based on the shooting time of the image P ₂₂ (3). Increase the number of image data with a new shooting time based on the image P ₂₂ (3) at a ratio that increases the number of image data, for example, a ratio of 1: 4, and prioritizes transmission of image data necessary for frame advance. To do. Specifically, the transmission control unit 834 uses the image P ₂₂ (3) as a reference and images P ₂₃ (11), image P ₂₄ (12), and image P ₂₅ (13) of four frames (four frames) with new shooting times. ), The image data of the image P ₂₇ (14) is preferentially transmitted to the terminal device 7, and the image data of one frame (one frame) whose shooting time is old from the image P ₂₂ (3) is changed to other image data. The data is transmitted to the terminal device 7 with priority over the group ((b) in FIG. 14 → (c) in FIG. 14). In FIG. 14C, since the image data of the image P ₂₂ (3) has already been transmitted to the terminal device 7, the transmission control unit 834 displays an image older than the shooting time of the image P ₂₂ (3). image data of, for example, may be transmitted to the image data of the image P _21. Thereby, the server 8 can transmit image data required for frame advance without delay. As a result, the user can promptly interpret the case by frame-by-frame even in an interpretation workflow that frequently changes the browsing order of images.

Also, in FIG. 14, in order to simplify the description, when the frame advance icon A111 is operated, the transmission control unit 834 has a characteristic image in which the shooting time varies around the shooting time of the image P ₂₂ (3). Each of the data and the image data is transmitted to the terminal device 7 at a ratio of 1: 4. However, the ratio and the number of image data to be transmitted can be changed as appropriate. For example, the transmission control unit 834 sets the image data with the old shooting time and the new shooting time so that each piece of the image data whose shooting time is before and after the shooting time of the image P ₂₂ (3) has a ratio of 2: 5. The number of data may be adjusted and transmitted to the terminal device 7. Further, in FIG. 14, when the frame advance icon A111 is operated, the transmission control unit 834 causes the image P ₂₃ whose shooting time is adjacent to each other with the shooting time around and based on the shooting time of the image P ₂₂ (3). The image data of (11), image P ₂₄ (12), image P ₂₅ (13), image P ₂₇ (14), and image P ₂₂ (3) have been transmitted. The image data to be performed or characteristic image data may be transmitted to the terminal device 7.

Under the above-described frame advance transmission situation, the recording control unit 763 of the terminal device 7 performs each of the image P ₂₃ (11), the image P ₂₄ (12), the image P ₂₅ (13), and the image P ₂₇ (14). The image data is temporarily recorded in the temporary recording unit 753 of the terminal device 7. After that, the recording control unit 763 of the terminal device 7 again selects the frame advance again in the case file being interpreted, and when the temporary recording unit 753 exceeds the recordable data capacity, the recorded time is the longest. You may make it delete sequentially from slow image data. At this time, when the image data corresponding to the position of the average color bar T1 and the characteristic image data are temporarily recorded in the temporary recording unit 753, the recording control unit 763 of the terminal device 7 stores the average color bar T1. The image data corresponding to the position and the characteristic image data are not deleted, and the image data is deleted sequentially from the image data with the latest time. Thus, when the user switches the playback mode, the image data corresponding to the time of the average color bar T1 and the characteristic image data are recorded in the temporary recording unit 753 of the terminal device 7, so that the server 8 Cases can be read quickly without downloading from the site. Further, the display control unit 761 of the terminal device 7 can identify an image corresponding to the image data that the user has already interpreted based on the image data recorded in the temporary recording unit 753, for example, adding a mark, a character, or the like Then, it may be displayed on the display unit 72. Further, the display control unit 761 of the terminal device 7 can display information indicating that the image has been read in the vicinity of the average color bar T1 so that an image corresponding to the image data that the user has already read can be identified, for example, a bar or mark May be displayed on the display unit 72. Of course, the display control unit 761 of the terminal device 7 may display an image corresponding to the image data that has already been interpreted by the user on the display unit 72 by highlighting or highlighting the image.

Returning to FIG. 4, the description of step S126 and subsequent steps will be continued.
In step S126, when the user operates the touch panel 73 or the operation input unit 74 of the terminal device 7, the operation signal received from the terminal device 7 via the network N100 is an instruction signal instructing image frame return. (Step S126: Yes), the server 8 proceeds to Step S127 described later. On the other hand, when the operation signal received from the terminal device 7 via the network N100 is not an instruction signal for instructing the frame return of the image (step S126: No), the server 8 proceeds to step S119 described later. .

In step S127, the transmission control unit 834 transmits the image data to the terminal device 7 with priority given to the frame return side. After step S127, the server 8 proceeds to step S119.

FIG. 15 is a diagram schematically illustrating an example of a frame return image data group transmitted by the transmission control unit 834. FIG. 15 shows an example of frame return image data transmitted by the transmission control unit 834 when the frame return icon A112 is operated after the feature image playback mode is selected on the terminal device 7. In FIG. 15, the transmission order transmitted by the transmission control unit 834 is represented by numbers in parentheses. Further, in FIG. 15, in order to simplify the description, the transmission order, the ratio, and the number of transmissions transmitted by the transmission control unit 834 are merely examples, and can be changed as appropriate.

As shown in FIG. 15, the transmission control unit 834 has characteristic images P ₃ (1) and P ₁₂ (2) close to the image at the position corresponding to the average color bar T1 (see FIG. 10B). ), The image P ₂₂ (3), the image P ₃₁ (4), and the image P ₄₃ (5), and then the operation signal received from the terminal device 7 via the network N100 instructs the frame return of the image. When image data is received, image data necessary for frame advance is preferentially transmitted. Specifically, the transmission control unit 834, when the display unit 72 is displaying the image P ₂₂ (3), if the frame return icon A112 is operated, based on the shooting time of the image P ₂₂ (3) The image P ₂₆ (6), the image P ₁₅ (7), the image P ₂₉ (8), and the image P ₃₅ are set so that the characteristic image data whose shooting time is before and after the image data are in a certain ratio, for example, a ratio of 1: 4. The image data of (9) and image P ₃₈ (10) are transmitted to the terminal device 7 ((a) in FIG. 15 → (b) in FIG. 15).

Thereafter, when the operation signal received from the terminal device 7 via the network N100 receives the instruction signal instructing the frame return of the image, the transmission control unit 834 captures an image that is older than the image P ₂₂ (3). There is a high possibility of returning to the image before the shooting time of the image P ₂₂ (3) by moving the slide bar T2 toward the time (backward direction) or continuously operating the frame return icon A112. Therefore, the ratio of transmitting the image data whose shooting time is before and after the shooting time of the image P ₂₂ (3) is set to 1: 1, for example, compared with the shooting time of the image P ₂₂ (3) as compared with the case of frame advance. The number of old image data is increased, and image data necessary for frame return is preferentially transmitted. Specifically, when the frame return icon A112 is operated while the display unit 72 is displaying the image P ₂₁ (11), the transmission control unit 834 displays two frames (2) of the image P ₂₁ (11). Image) The image data of each of the previous image P ₂₀ (12) and image P ₁₉ (13) is transmitted, and image P ₂₂ (3) (already two frames after image P ₂₁ (11)) (already The image data of the transmitted image data) and the image P ₂₃ (14) are sequentially transmitted to the terminal device 7 with priority over the other image data groups ((b) in FIG. 15 → (c) in FIG. 15). Thereby, the server 8 can transmit the image data required for the frame return without delay. As a result, the user can promptly interpret the case by returning frames.

In FIG. 15, for the sake of simplification of description, when the frame return icon A112 is operated, the transmission control unit 834 has a characteristic image in which the shooting time varies around the shooting time of the image P ₂₂ (3). Each of the data and the image data is transmitted to the terminal device 7 at a ratio of 1: 1, but this ratio and the number of image data to be transmitted can be changed as appropriate. For example, the transmission control unit 834 sets the image data whose shooting time is before and after the shooting time of the image P ₂₂ (3) so that the ratio of the image data is 3: 2, and the image with the new shooting time. The number of data may be adjusted and transmitted to the terminal device 7. Further, in FIG. 15, when the frame return icon A112 is operated, the transmission control unit 834 causes the image P ₂₁ whose shooting times are around and based on the shooting time of the image P ₂₂ (3) and whose shooting times are adjacent to each other. The image data of (11), image P ₂₀ (12), image P ₁₉ (13), image P ₂₃ (14), and image P ₂₂ (3) has been transmitted. The image data to be performed or characteristic image data may be transmitted to the terminal device 7.

Returning to FIG.
A case where the selection signal is not received via the network N100 and the communication unit 81 in step S103 (step S103: No) will be described. In this case, the server 8 proceeds to step S128.

Subsequently, when an instruction signal for instructing logout is input from the terminal device 7 via the network N100 (step S128: Yes), the server 8 ends this process. In this case, the recording control unit 763 of the terminal device 7 may not delete the case image data recorded in the temporary recording unit 753 from the temporary recording unit 753. Thereby, when the user performs interpretation of the same case again using the terminal device 7, when the image data of the selected case is recorded in the temporary recording unit 753, the terminal device 7 and the server 8 The case can be read by causing the display control unit 761 to display the image data group of the case recorded in the temporary recording unit 753 on the display unit 72 without performing communication between them. As a result, it is possible to reproduce and display the image data group of the case to be interpreted without delay, and to suppress the communication cost.

Further, since the recording control unit 763 of the terminal device 7 has a limited data capacity that can be recorded by the temporary recording unit 753, when the user selects many cases, the image data group of all cases is temporarily recorded by the temporary recording unit 753. Therefore, when the temporary recording unit 753 exceeds the recordable data capacity, it may be deleted sequentially from the image data with the latest recorded time. In this case, the recording control unit 763 of the terminal device 7 supplies power to the terminal device 7 when image data corresponding to the position of the average color bar T1 and characteristic image data are temporarily recorded in the temporary recording unit 753. The image data corresponding to the position of the average color bar T1 and the characteristic image data are not deleted until a certain timing, such as when the application is turned off or the application for image interpretation is restarted. For example, the image data used for frame advance is sequentially deleted. Of course, the recording control unit 763 of the terminal device 7 prioritizes and weights for each case, for example, weights in the new order downloaded from the server 8, and if the temporary recording unit 753 exceeds the recordable data capacity, the priority or weighting is performed. The image data and the characteristic image data corresponding to the position of the average color bar T1 of the case with a low value may be deleted from the temporary recording unit 753.

In step S128, when the instruction signal for instructing logout is not input from the terminal device 7 via the network N100 (step S128: No), the server 8 returns to step S103 described above.

As described above, in the case interpretation workflow, the server 8 determines the content of the operation signal transmitted from the terminal device 7 by the determination unit 833 via the network N100, and the transmission control unit 834 displays the determination result of the determination unit 833. Based on this, the image data group in the image file of the case selected by the terminal device 7 is sequentially transmitted to the terminal device 7 in an optimal order. Thereby, the display delay of the image data group of the image file of the case selected by the user can be suppressed according to the user's interpretation workflow.

According to the embodiment of the present invention described above, when the transmission control unit 834 receives a request signal for requesting transmission of any one of a plurality of image data groups recorded by the recording unit 82 from the terminal device 7, Based on the interpretation workflow set in the terminal device 7 and the operation signal received by the terminal device 7, the image data group in the optimal transmission order for browsing the image displayed by the display unit 72 of the terminal device 7. Are sequentially transmitted to the terminal device 7, so that even if a large amount of image data is downloaded via a low-speed line with an unstable communication speed, the capsule type is used in the order of transmission in consideration of the doctor's interpretation workflow. Since the image data group captured by the endoscope can be transmitted, the image data group of the case to be interpreted can be reproduced and displayed without delay, and the communication cost can be reduced. Door can be.

In addition, according to the embodiment of the present invention, when no operation signal is received from the terminal device 7, the transmission control unit 834 is generated according to a certain rule in the image data group according to an interpretation workflow executed by the user. By sequentially transmitting the image data to the terminal device 7, image data necessary or important for interpretation of the case is preferentially transmitted when viewing the entire image data group while looking down on the entire image data group. Even when an interpretation workflow for browsing data groups discontinuously and quickly is performed, a user such as a doctor can browse without delay.

Further, according to the embodiment of the present invention, the transmission control unit 834 preferentially selects the image data at the position corresponding to the average color bar T1 among the plurality of image data compared to the other image data. Therefore, even in an interpretation workflow that frequently changes the image viewing order, a user such as a doctor can browse without delay, so that the interpretation work can be performed efficiently.

Further, according to the embodiment of the present invention, the transmission control unit 834 transmits the image data at the position corresponding to the average color bar T1 to the terminal device 7, and then the image data at the position corresponding to the average color bar T1. A predetermined number of pieces of next image data whose shooting time is newer than the shooting time are transmitted to the terminal device 7, or image data that is around the shooting time of the image data at the position corresponding to the average color bar T1 at a predetermined ratio. 7, even an interpretation workflow that frequently changes the browsing order of images can be viewed without delay by a user such as a doctor, so that the interpretation work can be performed efficiently.

Further, according to the embodiment of the present invention, after the transmission control unit 834 transmits the image data at the position corresponding to the average color bar T1 to the terminal device 7, the feature having a predetermined feature amount in the image data group. Image data is sequentially transmitted, and red image data is sequentially transmitted to the terminal device 7 after transmitting the characteristic image data. Therefore, the terminal device 7 changes the playback mode from the normal mode to the characteristic image playback mode or the red mode. Even when switched to, the image can be reproduced and displayed without delay, so that the interpretation work can be performed efficiently.

According to one embodiment of the present invention, when the transmission control unit 834 receives a selection signal for selecting predetermined image data from the image data group from the terminal device 7, the image data corresponding to the selection signal is transmitted. In addition, since the image data and the two image data whose shooting times are before and after are sequentially transmitted to the terminal device 7, even when browsing the images by frame advance, they can be reproduced and displayed without delay. .

In addition, according to the embodiment of the present invention, after the transmission control unit 834 transmits the image data corresponding to the selection signal and the image data at positions that are temporally changed, the image data corresponding to the selection signal An image interpretation workflow that frequently changes the image browsing order because image data having a new photographing time is sequentially transmitted to the terminal device 7 at a constant ratio from the image data having a photographing time later than the image data of the two image data. However, since it is possible to reproduce and display without delay, a user such as a doctor can efficiently perform the interpretation work.

Further, according to the embodiment of the present invention, when a selection signal for selecting a case image file is received from the terminal device 7, the image data groups in the case image file are sequentially selected from the image data having the oldest imaging time. Without transmission, the determination unit 833 sequentially determines the operation signal received from the terminal device 7 and the interpretation workflow performed by the user, and the transmission control unit 834 next requires the user according to the determination result of the determination unit 833. By transmitting image data that has a high possibility of being preferentially transmitted to the terminal device 7 in comparison with other image data, a user such as a doctor can efficiently perform an image interpretation operation.

In one embodiment of the present invention, the transmission control unit 834 receives the operation signal from the terminal device 7 after transmitting the image data at the position corresponding to the average color bar T1 of the case selected by the terminal device 7. If not, the next image data that is newer than the shooting time in the image data at the position corresponding to the average color bar T1 in the group of image data of the case is transmitted to the terminal device 7 at a certain ratio. Although the image data group and the red image data group have been transmitted, the order of transmitting the image data group can be changed as appropriate. For example, when there is an access from the terminal device 7, the transmission control unit 834 interprets the user in the past based on the identification information of the terminal device 7 transmitted from the terminal device 7 or the user information of the terminal device 7. Even if the order of the image data group transmitted to the terminal device 7 is changed according to the history of cases performed, the operation history of the user performed on the terminal device 7 or the interpretation workflow, or the transmission order is skipped, the data is transmitted to the terminal device 7. Good. Of course, the order of the image data group that the transmission control unit 834 transmits to the terminal device 7 can be changed as appropriate by the user operating the touch panel 73 or the operation input unit 74 of the terminal device 7. Furthermore, the order of the image data group that the transmission control unit 834 transmits to the terminal device 7 is preferentially transmitted over the image data at the position corresponding to the average color bar T1 as compared to the other image data, regardless of the reproduction mode. Or only the characteristic image data whose amount of change is larger than other characteristic image data in the characteristic image data group, or when there is captured image data, this captured image data is transmitted. In addition, it is possible to assume various variations such as transmitting the captured image data at the shooting time and the image data before and after the image data at a certain ratio or number. It can be changed as appropriate by operating the touch panel 73 or the operation input unit 74 of the device 7, It may be changed as appropriate based on the created operation history and the like.

(Other embodiments)
[Display processing of actual playback frame rate]
Next, the display process of the actual reproduction frame rate executed by the server 8 when the user performs an interpretation work according to the interpretation workflow for a desired case using the terminal device 7 will be described. FIG. 16 is a flowchart showing an overview of display processing of the actual playback frame rate executed by the server 8.

As shown in FIG. 16, first, the actual playback frame rate calculation unit 835 transmits an instruction signal requesting each of image display number information and set frame rate information for a predetermined time (for example, 1 second) to the terminal device 7 ( Step S201). In this case, the terminal device 7 transmits to the server 8 each of the image display number information and the set frame rate information regarding the display number of images displayed on the display unit 72 at a predetermined time (for example, 1 second).

Subsequently, when the image display number information and the set frame rate information are received from the terminal device 7 (step S202: Yes), the server 8 proceeds to step S203 described later. On the other hand, when the image display number information and the set frame rate information are not received from the terminal device 7 (step S202: No), the server 8 returns to step S201 described above.

In step S203, the actual playback frame rate calculation unit 835 receives the actual playback speed information related to the number of images actually displayed by the display unit 72 of the terminal device 7 received from the terminal device 7 for a predetermined time (for example, 1 second). 7 (step S203). In this case, the terminal device 7 displays, for example, 29.5 fps in the display area A4 at the actual reproduction speed of the interpretation screen B2 displayed on the display unit 72 by the display control unit 761, as shown in FIG. Thus, the user can intuitively grasp the communication state and display mode of the terminal device 7 by comparing the set frame rate (30 fps) and the frame rate (29.5 fps) of the actual playback speed.

Subsequently, when a predetermined time (for example, 1 second) has elapsed (step S204: Yes), the server 8 proceeds to step S205 described later. On the other hand, when the predetermined time has not elapsed (step S204: No), the server 8 continues this determination until the predetermined time has elapsed.

Thereafter, when an instruction signal for ending the interpretation of the case is received from the terminal device 7 (step S205: Yes), the server 8 ends this process. On the other hand, when the instruction signal for ending the interpretation of the case is not received from the terminal device 7 (step S205: No), the server 8 returns to step S201.

In this way, when the user performs a case interpretation workflow using the terminal device 7, the display control unit 761 of the terminal device 7 parallels the frame of the actual playback speed received from the server 8 and the set frame rate. The information is displayed on the interpretation screen B2 of the display unit 72. Thereby, the user can grasp | ascertain intuitively the communication state of the terminal device 7 by comparing a setting frame rate with the frame rate of real reproduction speed.

[Communication speed calculation processing]
Next, a communication speed calculation process executed by the server 8 to check the communication information of the terminal device 7 before the user downloads the desired case image data group from the server 8 to the terminal device 7 will be described. FIG. 17 is a flowchart showing an outline of a communication speed calculation process executed by the server 8.

As shown in FIG. 17, first, the communication speed calculation unit 836 transmits an instruction signal requesting setting information regarding the playback frame rate to the terminal device 7 via the network N100 (step S301).

Subsequently, when the setting information is received from the terminal device 7 (step S302: Yes), the server 8 proceeds to step S303 described later. On the other hand, when setting information is not received from the terminal device 7 (step S302: No), the server 8 returns to step S301 mentioned above.

In step S303, the communication speed calculation unit 836 transmits a certain amount of data to the terminal device 7 via the network N100. Specifically, the communication speed calculation unit 836 transmits a dummy data amount corresponding to a predetermined frame rate, for example, 30 fps, to the terminal device 7. In this case, the terminal device 7 measures the time from the time when the first data is received from the server 8 to the time when the last data is received.

Subsequently, the communication speed calculation unit 836 transmits to the terminal device 7 an instruction signal requesting data acquisition time information regarding the data acquisition time when all the data transmitted in step S303 is received via the network N100 (step S304). . In this case, when the terminal device 7 receives the instruction signal via the network N100, the time from the time when the first data is received from the server 8 to the time when the last data is received is sent to the server 8 as data acquisition time information. Send.

Thereafter, when the data acquisition time information is received from the terminal device 7 (step S305: Yes), the server 8 proceeds to step S306 described later. On the other hand, when the data acquisition time information is not received from the terminal device 7 (step S305: No), the server 8 returns to step S304.

In step S306, the communication speed calculation unit 836 calculates communication speed information at the time of interpretation based on the setting information received in step S302 and the data acquisition time information received in step S305.

Subsequently, the communication speed calculation unit 836 transmits the communication speed information calculated in step S306 to the terminal device 7 (step S307). In this case, the terminal device 7 changes the display mode (indicator display) of the communication status icon W3 based on the communication speed information received by the display control unit 761 from the server 8, and causes the display unit 72 to display the change (for example, FIG. 5). See). Thus, the user can intuitively grasp the communication status of the terminal device 7 before downloading the case image data group from the server 8. In this case, when the communication speed information received from the server 8 is smaller than a predetermined threshold, the display control unit 761 of the terminal device 7 displays a warning on the display unit 72 indicating that the predetermined communication speed is not satisfied. It may be displayed.

Thereafter, when an instruction signal for ending the interpretation of the case is received from the terminal device 7 (step S308: Yes), the server 8 ends this process. On the other hand, when the instruction signal for ending the interpretation of the case is not received from the terminal device 7 (step S308: No), the server 8 returns to step S301 described above.

In this way, when the terminal device 7 accesses the server 8, the server 8 determines that the communication speed calculation unit 836 has to download the image data group of a desired case from the server 8 to the terminal device 7. Since the communication speed of the terminal device 7 is calculated based on the setting information and the data acquisition time information and this communication speed is transmitted to the terminal device 7, the user can download the case image data group from the server 8. The communication status of the terminal device 7 can be intuitively grasped.

Further, when the communication speed calculation unit 836 receives an instruction signal for selecting the communication status icon W3 on the case list screen B1 from the terminal device 7, the communication speed calculation unit 836 may perform the communication speed calculation process described above. Thereby, the user can grasp | ascertain the communication condition of the terminal device 7 at a desired timing.

Further, the communication speed calculation unit 836 may perform the communication speed calculation process described above at a timing set by the user in the terminal device 7, for example, every minute.

Further, the communication speed calculation unit 836 may perform the communication speed calculation process described above at a predetermined timing, for example, every minute. In addition, the communication speed calculation unit 836 displays the communication line of the terminal device 7 when the screen of the image displayed on the display unit 72 of the terminal device 7 is switched (when redrawing), when the radio wave intensity of the terminal device 7 is changed. May be performed (for example, when switching from LTE to 3G or when switching from Wi-Fi to LTE), the communication speed calculation process described above may be performed. Furthermore, the communication speed calculation unit 836 may perform the communication speed calculation process described above based on the timing set by the user via the operation input unit 74 of the terminal device 7.

Further, the communication speed calculation unit 836 may perform the communication speed calculation process described above when the display unit 72 of the terminal device 7 displays the case list screen B1. In this case, the display control unit 761 of the terminal device 7 instructs that various operations are instructed when the touch panel 73 is touched or the operation input unit 74 until the communication speed calculation unit 836 finishes the communication speed calculation process described above. Even when a signal is input, the case list screen B1 is fixed (not transitioned). Furthermore, when the communication speed calculated by the communication speed calculation unit 836 is smaller than a predetermined threshold, the display control unit 761 of the terminal device 7 instructs the operation input unit 74 to perform various operations when the touch panel 73 is touched. Even after the case is input, after the case list screen B1 is fixed, a warning indicating that the communication speed is not satisfied is displayed on the display unit 72, or the case list screen B1 is switched to the interpretation screen B2. A warning may be displayed on the display unit 72. In this case, the communication control unit 762 of the terminal device 7 may reduce the size of the image data downloaded from the server 8. Thereby, although lacking in smoothness, the user can read a case for interpretation.

[Total data display processing]
Next, display processing of the total data amount downloaded from the server 8 executed by the terminal device 7 will be described. FIG. 18 is a flowchart showing an overview of display processing for displaying the total amount of data downloaded from the server 8 executed by the terminal device 7.

As shown in FIG. 18, when a user receives case list image data from the server 8 by operating the touch panel 73 or the operation input unit 74 and accessing the server 8 via the network N100 (step S401: Yes). The display control unit 761 displays the case list screen B1 (see FIG. 5) corresponding to the case list image data on the display unit 72 (step S402).

Subsequently, when the user operates the touch panel 73 or the operation input unit 74 to select a desired case from the case list screen B1, the image data group in the image file of the case selected by the user from the server 8 is selected. When received (step S403: Yes), the total data amount calculation unit 764 adds the download amount for each image file of the case received from the server 8 for each case and records it in the temporary recording unit 753 (step S404).

Thereafter, when the user operates the touch panel 73 or the operation input unit 74 to receive an instruction signal for ending the interpretation of the case from the terminal device 7 (step S405: Yes), the display control unit 761 displays the case list screen B1. The total download amount for each case is updated and displayed on the display unit 72 (step S406). Thereby, the user can grasp | ascertain intuitively the download amount for every case.

In step S401, when the case list image data is not received from the server 8 (step S401: No), the terminal device 7 continues this determination.

In step S403, when the image data group in the image file of the case selected by the user is not received from the server 8 (step S403: No), the terminal device 7 proceeds to step S407.

Subsequently, when the logout icon W8 is operated by the user operating the touch panel 73 or the operation input unit 74 (step S407: Yes), the terminal device 7 ends this process. On the other hand, when the logout icon W8 is not operated (step S407: No), the terminal device 7 returns to step S402.

In step S405, when the instruction signal for ending the interpretation of the case is not received from the terminal device 7 (step S405: No), the terminal device 7 returns to step S402.

In this way, the total data amount calculation unit 764 calculates the download amount for each case downloaded when the interpretation is performed by the user, and the display control unit 761 calculates the download amount for each case calculated by the total data amount calculation unit 764. Is displayed for each case on the case list screen B1, the user can intuitively grasp the download amount for each case. The total data amount calculation unit 764 may automatically reset the total data amount every month.

In the display process described above, the display control unit 761 displays the data amount in GB. However, for example, the data amount may be converted into a packet amount and displayed on the display unit 72. Of course, the display control unit 761 may display the packet amount on the display unit 72 at the location where the data amount is displayed in GB in the above-described embodiment. Further, the display control unit 761 may convert the above-described packet amount into a communication cost (money) and display it on the display unit 72 according to the operation of the operation input unit 74 by the user. Furthermore, when the above-described packet amount approaches the upper limit of the monthly packet amount set by the communication company or contract, the display control unit 761 displays a warning on the display unit 72 or the display unit 72 displays the packet amount. The color or icon of the image to be displayed may be changed and displayed. In this case, the communication control unit 762 may prohibit communication by the communication unit 71 when the above-described packet amount exceeds the upper limit of the monthly packet amount set by a communication company or a contract.

[Data reduction processing]
Next, when the case image data is transmitted from the server 8 to the terminal device 7, the image data group generated by the capsule endoscope 3 is enormous. Therefore, the image data group is transferred from the server 8 to the terminal device 7. If transmitted, the communication amount of the terminal device 7 becomes large. For this reason, in the following, even when the image data group is transmitted from the server 8 to the terminal device 7, the image transmitted by the server 8 from the examination information management device 6 in order to reduce the communication cost of the terminal device 7. Data reduction processing performed on the data group will be described. FIG. 19 is a flowchart showing an outline of data reduction processing performed by the server 8 on the image data group transmitted from the inspection information management apparatus 6.

As shown in FIG. 19, when the image data group is received from the inspection information management apparatus 6 via the network N100 (step S501: Yes), the server 8 proceeds to step S502 described later. On the other hand, when the image data group has not been received from the examination information management device 6 via the network N100 (step S501: No), the server 8 ends this process.

If it is determined in step S502 that the feature image determination unit 832 is red image data (step S502: Yes), the red image data is recorded in the image data recording unit 822 (step S503).

Subsequently, when the determination of all the image data received from the examination information management apparatus 6 is completed (step S504: Yes), the server 8 ends this process. On the other hand, when the determination of all the image data transmitted from the inspection information management apparatus 6 has not been completed (step S504: No), the server 8 returns to step S502 described above.

In step S502, when the feature image determination unit 832 determines that the image data is not red image data (step S502: No), the server 8 proceeds to step S505 described later.

Subsequently, when the feature image determination unit 832 determines that the image data is duplicated image data (step S505: Yes), the feature image determination unit 832 deletes it from the image data group received from the inspection information management device 6 (step S506). After step S506, the server 8 proceeds to step S504. On the other hand, when the feature image determination unit 832 determines that the image data is not duplicated image data (step S505: No), the server 8 proceeds to step S503.

FIG. 20 is a diagram schematically illustrating an example of an image recorded in the recording unit 82 based on the determination of the feature image determination unit 832. In FIG. 20, the horizontal axis indicates time.

As illustrated in FIG. 20, the feature image determination unit 832 includes the image P ₁ , the image P ₄ , the image P ₆ , the image P _9, and the other images that do not overlap the image data group received from the inspection information management device ₆ . Each image data of the image P ₇ and the image P ₁₀ is recorded in the image data recording unit 822. Thereby, the recording capacity of the recording unit 82 can be used efficiently.

As described above, the server 8 can efficiently use the recording capacity of the image data recording unit 822 by deleting the duplicate image data from the image data group received from the inspection information management device 6, and the terminal device. When the image data group of the case selected to 7 is transmitted to the terminal device 7, the total data amount of the image data group is reduced, so that the communication amount of the terminal device 7 can be suppressed.

In addition, as shown in FIG. 21, the feature image determination unit 832 performs, with respect to the image data group received from the examination information management device 6, images at positions corresponding to the average color bar T1, for example, image P ₁ and image P _4. Only the image data of the images P ₇ and P ₁₀ may be recorded in the image data recording unit 822.

[Data reduction processing by terminal device]
The terminal device 7 may transmit the image data group recorded in the image data recording unit 752 to the server 8 by wireless transmission (upload). In this case, since the total data amount of the image data group is enormous, the communication cost of the terminal device 7 becomes great. For this reason, in the following description, when the image data group is transmitted from the terminal device 7 to the server 8 by wireless communication, the image data group that the terminal device 7 transmits to the server 8 in order to reduce the communication cost of the terminal device 7. The data reduction process performed for this will be described. FIG. 22 is a flowchart illustrating an outline of the data reduction process executed by the terminal device 7.

As shown in FIG. 22, first, when a case image data group to be uploaded to the server 8 via the network N100 is selected (step S601: Yes), when the current image data is red image data (step S602). : Yes), the communication control unit 762 transmits the current image data to the server 8 (step S603).

Subsequently, when the determination is completed for all image data (step S604: Yes), the terminal device 7 ends the process. On the other hand, when the determination has not been completed for all image data (step S604: No), the terminal device 7 returns to step S602.

In step S602, when the current image data is not red image data (step S602: No), the terminal device 7 proceeds to step S605.

Subsequently, when the current image data is duplicate image data (step S605: Yes), the terminal device 7 proceeds to step S604. On the other hand, when the current image data is not a duplicate image (step S605: No), the terminal device 7 proceeds to step S603.

In step S601, when the image data group of the case to be uploaded to the server 8 via the network N100 is not selected (step S601: No), the terminal device 7 ends this process.

In this way, when the terminal device 7 deletes duplicate image data from the image data group and transmits the image data group to the server 8 by wireless communication, the total amount of data in the image data group is reduced. Can be reduced.

The present invention is not limited to the above-described embodiment, and various modifications and applications are possible within the scope of the gist of the present invention. For example, in addition to the endoscope system used in the description of the present invention, a server that distributes video to a mobile phone, a smartphone, or the like via a network, a network attached storage, a video camera, an endoscope, The present invention can also be applied to devices such as an imaging device capable of bidirectional communication with a network through an optical device such as a surveillance camera or a microscope.

In the present invention, the terminal device downloads the image data group from one server. However, the present invention can also be applied to the case of downloading the image data group from a plurality of servers.

Also, in this specification, in the description of each operation flowchart described above, the operation is described using “first”, “next”, “follow”, “after”, etc. for convenience. It does not mean that it is essential to implement.

In addition, each processing method by the terminal device and the server in the above-described embodiment, that is, the processing shown in each flowchart can be stored as a program that can be executed by a control unit such as a CPU. In addition, it can be stored and distributed in a storage medium of an external storage device such as a memory card (ROM card, RAM card, etc.), magnetic disk, optical disk (CD-ROM, DVD, etc.), semiconductor memory, or the like. Then, a control unit such as a CPU reads the program stored in the storage medium of the external storage device, and the operation described above can be executed by the operation being controlled by the read program.

Further, the present invention is not limited to the above-described embodiments and modifications as they are, and in the implementation stage, the constituent elements can be modified and embodied without departing from the spirit of the invention. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above-described embodiments. For example, some constituent elements may be deleted from all the constituent elements described in the above-described embodiments and modifications. Furthermore, you may combine suitably the component demonstrated in each Example and the modification.

Further, a term described together with a different term having a broader meaning or the same meaning at least once in the specification or the drawings can be replaced with the different term in any part of the specification or the drawings. Thus, various modifications and applications are possible without departing from the spirit of the invention.

DESCRIPTION OF SYMBOLS 1 Endoscope system 2 Subject 3 Capsule type endoscope 4 Receiving antenna unit 4a-4h Receiving antenna 5 Receiving device 6 Inspection information management device 7 Terminal device 8 Server 61 Cradle 62

Operation input device

71, 81 Communication unit 72 Display unit 73 Touch Panel 74

Operation Input Unit

75, 82 Recording Unit 76 Terminal Control Unit 83 Server Control Unit
751,821 Program recording unit 752,822 Image data recording unit 753 Temporary recording unit 761 Display control unit 762 Communication control unit 763 Recording control unit 764 Total data amount calculation unit 831 Average color bar generation unit 832 Characteristic image determination unit 833 Determination unit 834 Transmission control unit 835 Actual playback frame rate calculation unit 836 Communication speed calculation unit N100 network

Claims

A server capable of bidirectional communication via a network with a terminal device including a display unit capable of displaying an image and an operation input unit capable of receiving input of operation signals instructing various operations. ,
A recording unit that records a plurality of image data groups composed of a plurality of temporally continuous image data by imaging each of a plurality of subjects;
When a request signal requesting transmission of any one of the plurality of image data groups recorded by the recording unit is received from the terminal device, an interpretation workflow performed by a user and the operation signal received by the terminal device And a transmission control unit that sequentially determines the transmission order for browsing the images displayed by the display unit and transmits the image data group to the terminal device,
A server characterized by comprising:
The transmission control unit sequentially transmits image data generated according to a certain rule in the image data group to the terminal device according to the interpretation workflow when the operation signal is not received from the terminal device. The server according to claim 1, characterized in that:
The predetermined rule is at least one of a predetermined time interval, a shooting interval at which image data is captured, a predetermined number interval, and a predetermined number interval in a plurality of characteristic image data included in the image data group. The server according to claim 2, wherein there is a server.
The image data generated in accordance with the certain rule to be transmitted to the terminal device is image data at a position corresponding to an average color bar generated to observe the subject from a bird's-eye view. Item 3. The server according to item 2.
The transmission control unit transmits image data at a position corresponding to the average color bar to the terminal device, and then transmits the next image data having a new shooting time from the shooting time in the image data at the position corresponding to the average color bar. 5. A predetermined number of image data is transmitted to the terminal device, or a predetermined number of image data before and after the photographing time of image data at a position corresponding to the average color bar is transmitted to the terminal device. Server described in.
The transmission control unit sequentially transmits characteristic image data having a predetermined feature amount in the image data group to the terminal device after transmitting image data generated according to the certain rule to the terminal device. The server according to claim 2.
The transmission control unit sequentially transmits image data including red in the image data group to the terminal device after transmitting image data generated according to the certain rule to the terminal device. Item 3. The server according to item 2.
When the transmission control unit receives a selection signal for selecting predetermined image data from the image data group as the operation signal from the terminal device, the transmission control unit transmits the image data according to the selection signal, and the image data 2. The server according to claim 1, wherein image data of a shooting time before and after the shooting time is sequentially transmitted to the terminal device at a constant ratio.
The transmission control unit sends more image data at a shooting time newer than the shooting time of image data according to the selection signal to the terminal device than image data at a shooting time older than the shooting time of image data according to the selection signal. The server according to claim 8, wherein the server transmits the server.
When the transmission control unit receives, as the operation signal, an instruction signal instructing a special reproduction mode for reproducing image data satisfying a specific condition among the image data group, the transmission control unit 2. The server according to claim 1, wherein the image data extracted in accordance with the special reproduction mode is sequentially transmitted to the terminal device.
The image data extracted according to the special playback mode is characteristic image data having a predetermined feature amount in the image data group,
The transmission control unit sequentially transmits the characteristic image data close to the imaging time of the image data at a position corresponding to the average color bar generated in order to observe the subject from a bird's-eye view. The server according to claim 10.
The transmission control unit receives a frame advance signal that instructs frame advance when the display unit displays an interpretation image corresponding to the image data transmitted from the server as the operation signal from the terminal device. The image interpretation image and the two image data whose photographing times are before and after are respectively transmitted, and a predetermined number of image data whose photographing time is newer than the image data whose photographing time is later in the interpretation image and the two image data. The server according to claim 1, wherein the server sequentially transmits to the terminal device.
The transmission control unit receives a frame return signal instructing frame return from the terminal device when the display unit displays an interpretation image corresponding to the image data transmitted from the server as the operation signal. The image interpretation image and the two image data whose photographing times are before and after are transmitted, respectively, and a predetermined number of image data whose photographing time is older than the previous image data among the interpretation image and the two image data. The server according to claim 1, wherein the server sequentially transmits to the terminal device.
The server according to claim 1, wherein the image data group is generated by a capsule endoscope that is introduced into a subject and continuously images the inside of the subject.
A capsule endoscope that is introduced into a subject and continuously images the inside of the subject to generate a group of image data composed of a plurality of temporally continuous image data; and the capsule via a network An inspection information management device that transmits the image data group generated by the endoscope to the outside, a server that receives the image data group via the network, and bidirectional communication with the server via the network An endoscopic system comprising a terminal device,
The terminal device
A display unit capable of displaying an image;
An operation input unit capable of receiving input of operation signals instructing various operations;
With
The server
A recording unit that records a plurality of image data groups composed of a plurality of temporally continuous image data by imaging each of a plurality of subjects;
When a request signal requesting transmission of any one of the plurality of image data groups recorded by the recording unit is received from the terminal device, an interpretation workflow performed by a user and the operation signal received by the terminal device And a transmission control unit that sequentially determines the transmission order for browsing the images displayed by the display unit and transmits the image data group to the terminal device,
An endoscope system comprising:
A server capable of bidirectional communication via a network executes a terminal device including a display unit capable of displaying an image and an operation input unit capable of receiving input of operation signals instructing various operations. A transmission method,
When a request signal requesting transmission of any one of a plurality of image data groups recorded by the recording unit is received from the terminal device, the interpretation workflow performed by the user and the operation signal received by the terminal device A transmission method comprising: a transmission control step of determining a transmission order for browsing the images displayed by the display unit and sequentially transmitting the image data group to the terminal device.
A server capable of bidirectional communication via a network with a terminal device including a display unit capable of displaying an image and an operation input unit capable of receiving input of operation signals instructing various operations,
When a request signal requesting transmission of any one of a plurality of image data groups recorded by the recording unit is received from the terminal device, the interpretation workflow performed by the user and the operation signal received by the terminal device Based on this, a program for executing a transmission control step of determining a transmission order for browsing the images displayed by the display unit and sequentially transmitting the image data group to the terminal device.