WO2020166468A1 - Playback system, recording system, playback method, program for playback, recording method, and program for recording - Google Patents

Abstract

Provided are a playback system, a recording system, a playback method, a program for playback, a recording method, and a program for recording, which can reduce the time and effort required to identify an abnormality of a control target controlled by a control device or of an operation target to be operated upon by the control target. The playback system (10) is provided with a first acquisition unit, a second acquisition unit, and a display control unit. The first acquisition unit acquires control data (D1). The control data (D1) includes at least one of input data and output data of a control device (3) that executes sequence control. The second acquisition unit acquires image data (D2) obtained by photographing a control target (4) of the control device (3). The display control unit displays the control data (D1) and the image data (D2) on a display device (5) in a temporally associated display state.

Description

Reproduction system, recording system, reproduction method, reproduction program, recording method, and recording program

The present disclosure generally relates to a reproduction system, a recording system, a reproduction method, a reproduction program, a recording method, and a recording program. More specifically, the present disclosure relates to a reproduction system, a recording system, a reproduction method, a reproduction program, a recording method, and a recording program used for managing a control device that executes sequence control.

Patent Document 1 describes an input/output data management device that manages input/output data that is input/output between the control device that controls the controlled machine and the controlled machine. This input/output data management device corrugates the input/output data of the associated first control device and second control device, respectively, and displays the corrugated input/output data of the first control device and second control device on the same screen. Display means for displaying on top is provided.

However, in the technique described in Patent Document 1, it is necessary for the person or system to identify and analyze the abnormality from the waveform displayed on the display means, and the control target controlled machine (controlled machine ) It takes time to identify the abnormality.

JP 2006-92241 A

The present disclosure has been made in view of the above circumstances, and a reproduction system and a recording system that can reduce the time and effort required to identify an abnormality of a control target controlled by a control device or a work target operated by the control target. , A reproducing method, a reproducing program, a recording method, and a recording program.

A reproduction system according to one aspect of the present disclosure includes a first acquisition unit, a second acquisition unit, and a display control unit. The first acquisition unit acquires control data. The control data includes at least one of input data and output data of a control device that executes sequence control. The second acquisition unit acquires image data obtained by photographing a control target of the control device. The display control unit displays the control data and the image data on a display device in a display mode in which they are temporally associated with each other.

A recording system according to an aspect of the present disclosure includes a first acquisition unit, a second acquisition unit, and a recording control unit. The first acquisition unit acquires control data. The control data includes at least one of input data and output data of a control device that executes sequence control. The second acquisition unit acquires image data obtained by photographing a control target of the control device. The recording control unit records the control data and the image data in a recording device in a recording manner in which they are temporally associated with each other.

A reproduction method according to an aspect of the present disclosure includes a first acquisition step, a second acquisition step, and a display step. The first acquisition step is a step of acquiring control data. The control data includes at least one of input data and output data of a control device that executes sequence control. The second acquisition step is a step of acquiring image data obtained by photographing a control target of the control device. The display step is a step of displaying the control data and the image data on a display device in a display mode in which they are temporally associated with each other.

A reproduction program according to an aspect of the present disclosure is a program for causing one or more processors to execute the reproduction method.

A recording method according to an aspect of the present disclosure includes a first acquisition step, a second acquisition step, and a recording step. The first acquisition step is a step of acquiring control data. The control data includes at least one of input data and output data of a control device that executes sequence control. The second acquisition step is a step of acquiring image data obtained by photographing a control target of the control device. The recording step is a step of displaying the control data and the image data on a recording device in a recording manner in which they are temporally associated with each other.

A recording program according to an aspect of the present disclosure is a program for causing one or more processors to execute the recording method.

FIG. 1 is a schematic diagram schematically showing the configuration of the reproduction system according to the first embodiment. FIG. 2 is a block diagram showing the configuration of the reproduction system of the above. FIG. 3 is an explanatory diagram showing an example of a display screen by the reproduction system of the above. FIG. 4 is a flowchart showing the operation of the reproducing system of the above. FIG. 5 is a block diagram showing the configuration of the reproduction system according to the second embodiment.

(Embodiment 1)
(1) Outline First, an outline of the reproduction system 10 according to the present embodiment will be described with reference to FIGS. 1 and 2.

The reproduction system 10 according to the present embodiment is a system used for managing the control device 3. Management of the control device 3 includes, for example, identification of an abnormality of a control target controlled by the control device 3. Further, management of the control device 3 may include identification of an abnormality of a work target to be worked on the control target. The “control device” in the present disclosure is a device that performs sequence control. The “sequence control” in the present disclosure is control in which each step of the control is sequentially advanced according to a predetermined order or procedure, and, for example, a lamp is output according to input data from an input device such as a switch or a sensor. Alternatively, it is a method of sequentially controlling output devices such as a motor. As an example of the control device 3 dedicated to such sequence control, there is a PLC (Programmable Logic Controller). The PLC is a device used as a substitute for the relay circuit and operates according to a program described in a programming language such as a ladder language (ladder diagram).

The reproduction system 10 realizes management of the control device 3 by visualizing the control status of the control device 3 as described above. That is, for example, when an abnormality occurs in the control target of the control device 3, the user can analyze the cause of the abnormality based on the control status of the control device 3 visualized by the reproduction system 10. Is. Therefore, the user can take measures such as design change to cope with the abnormality in the control target of the control device 3.

As shown in FIG. 2, the reproduction system 10 according to the present embodiment includes a first acquisition unit 11, a second acquisition unit 12, and a display control unit 13. The first acquisition unit 11 acquires the control data D1. The control data includes at least one of input data and output data of the control device 3. The control device 3 is a device that executes sequence control as described above. The second acquisition unit 12 acquires the image data D2. The image data D2 is an image obtained by photographing the controlled object 4 of the control device 3. The display control unit 13 displays the control data D1 and the image data D2 on the display device 5 in a display mode in which they are temporally associated with each other.

As described above, the reproduction system 10 according to the present embodiment displays the control data D1 including at least one of the input data and the output data of the control device 3, and captures the controlled object 4 of the control device 3. The obtained image data D2 is displayed. That is, according to the reproduction system 10, both the control data D1 and the image data D2 are visualized as the control status of the control device 3, and management of the control device 3 is realized. Therefore, for example, when an abnormality occurs in the controlled object 4 of the control device 3, the user is based on the control situation (control data D1 and image data D2) of the control device 3 visualized by the reproduction system 10. It is possible to analyze the cause of abnormality. Here, since the control data D1 and the image data D2 are displayed on the display device 5 in a display mode in which they are temporally associated with each other, the user can confirm the control data D1 and the image data D2 separately. There is no need to perform work to compare the two. Therefore, according to the reproduction system 10, it is possible to reduce the time and effort required to identify the abnormality of the control target 4 controlled by the control device 3 or the work target operated by the control target.

(2) Details (2.1) Assumptions In the present embodiment, as an example, it is assumed that the control device 3 is used for controlling production equipment in a factory. In other words, the control target 4 of the control device 3 is a production facility. The "production equipment" referred to in the present disclosure is, for example, equipment used for manufacturing various products such as electronic devices, automobiles, clothing, foodstuffs, pharmaceuticals and crafts, and mounting, painting, printing, pressing, This equipment is used for cutting, welding and photographing. That is, in the present embodiment, the control device 3 that is the target of management of the reproduction system 10 is a device that performs sequence control of production equipment used for manufacturing various products in a factory.

The production facility that is the controlled object 4 has one or more input devices 41 and one or more output devices 42, as shown in FIG. The input device 41 is a device that outputs data (input data) to the control device 3, and is, for example, a switch that receives a human operation or a sensor that detects the occurrence of an event. The output device 42 is a device that operates by receiving data (output data) from the control device 3, and is, for example, a lamp whose lighting state changes, or a motor which generates power.

(2.2) Overall Configuration As shown in FIG. 1, the reproduction system 10 according to the present embodiment includes a recording unit 1 and a reproduction unit 2.

The recording unit 1 is configured to be able to communicate with each of the plurality of control devices 3 and the plurality of imaging devices 6. The term “communicable” in the present disclosure means that signals can be exchanged directly or indirectly via a network, a relay, or the like by an appropriate communication method such as wired communication or wireless communication. That is, the recording unit 1 is capable of receiving signals from each of the plurality of control devices 3 and the plurality of imaging devices 6. In the present embodiment, the communication method between the recording unit 1 and each control device 3 complies with a communication standard such as Ethernet (registered trademark) or RS-232C. Further, the communication method between the recording unit 1 and each imaging device 6 complies with a communication standard such as UVC (USB Video Class).

The recording unit 1 has a function as a data logger, and acquires (collects) the control data D1 from a plurality of control devices 3 and records it. In the present embodiment, the recording unit 1 acquires the control data D1 by communication from the control device 3 in real time. Further, the recording unit 1 acquires (collects) the image data D2 from the plurality of imaging devices 6 and records the image data D2. In the present embodiment, the recording unit 1 acquires the image data D2 from the imaging device 6 by communication in real time.

As described above, the control device 3 is a device that performs sequence control to sequentially advance each control step in accordance with a predetermined order or procedure. In the present embodiment, the control device 3 is configured to be able to input input data from the input device 41 and output output data to the output device 42. Thereby, the control device 3 can control the control target 4 (here, the production equipment) by outputting the output data to the output device 42 according to the input data from the input device 41.

“Control data” in the present disclosure is data including at least one of such input data and output data. In the present embodiment, as an example, the control data D1 includes both input data and output data. That is, the recording unit 1 acquires from the control device 3 both the input data input from the input device 41 to the control device 3 and the output data output from the control device 3 to the output device 42 as the control data D1. To do.

The image pickup device 6 photographs the control target 4 of the control device 3 and generates image data D2. That is, the imaging device 6 is installed so that the controlled object 4 is included within the angle of view. Here, the operation of the controlled object 4 may be represented in the image data D2. Therefore, the imaging device 6 does not need to photograph the control target 4 or the entire work target to be operated (including processing and processing) by the control target 4, and the control target 4 and the work target (hereinafter, the work target). (Sometimes referred to as “control target”) may be captured.

∙ Generally, the illuminance of a workplace where people work is set to be relatively high. However, in a workplace where the control target 4 is automatically controlled by the control device 3, the illuminance does not necessarily need to be set high, and the illuminance may be set relatively low in order to save power. .. Alternatively, the part of the controlled object 4 that is imaged by the imaging device 6 may have low illuminance because it is covered with a housing, for example. Therefore, it is preferable that the imaging device 6 includes a lighting device. The lighting device preferably emits light in synchronization with the image pickup operation of the image pickup device 6.

Alternatively, the imaging device 6 may include, for example, a night vision camera such as an infrared camera. Further, the imaging device 6 is not limited to the configuration of capturing the object itself, and may capture the temperature of the space and the object as an image, such as a thermography camera.

The “image” in the present disclosure includes a moving image (moving image) and a still image (still image). Furthermore, the “moving image” includes an image composed of a plurality of still images obtained by time-lapse shooting and the like. Here, the image data D2 is an image (that is, a moving image) that changes over time. In the present embodiment, as an example, the image data D2 is a full-color moving image. In the present embodiment, the imaging device 6 is a video camera or a web camera capable of shooting a full-color moving image. More specifically, as an example, the image data D2 is a 30 fps moving image that is composed of a plurality of time-series still images such as motion JPEG (Motion JPEG). Furthermore, the image data D2 may not be the data itself output from the image pickup device 6. For example, the image data D2 is appropriately subjected to data compression, conversion into another data format, or processing such as cutting out a part of a photographed image, focusing adjustment, brightness adjustment, or contrast adjustment as necessary. It may have been done.

In the present embodiment, the plurality of control devices 3 and the plurality of imaging devices 6 are associated with each other on a one-to-one basis. The imaging device 6 corresponding to a certain control device 3 photographs the control target 4 of this control device 3 and generates image data D2. That is, the imaging device 6 is installed toward the control target 4 of the corresponding control device 3 so as to capture at least a part of the control target 4 of the corresponding control device 3.

Then, the recording unit 1 records the control data D1 and the image data D2 acquired from the control device 3 and the image pickup device 6, which correspond to each other, in a state where the corresponding relationship is maintained. The control data D1 and the image data D2 acquired from the control device 3 and the imaging device 6 corresponding to each other are also referred to as “a group of reproduction data” below. As an example, the recording unit 1 identifies each of the plurality of control devices 3 by the address assigned to each control device 3. Similarly, the recording unit 1 identifies each of the plurality of imaging devices 6 by the address assigned to each imaging device 6. Then, the recording unit 1 stores the correspondence relationship between the control device 3 and the imaging device 6 by associating the respective addresses. Based on this correspondence, the recording unit 1 records a group of reproduction data (control data D1 and image data D2) while maintaining the correspondence.

The reproduction unit 2 has a function of displaying an arbitrary screen on the display device 5 based on the data received from the recording unit 1. The “screen” in the present disclosure is an image (including a text, a graph, an icon, etc.) displayed on the display device 5. The display device 5 is realized by an image display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. In the present embodiment, the reproduction unit 2 is connected to the display device 5 and displays a screen including the control data D1 and the image data D2 on the display device 5. Further, the reproduction unit 2 has a function of receiving a human operation and the like.

In the present embodiment, data is exchanged between the recording unit 1 and the reproducing unit 2 via the non-transitory recording medium M1 such as a memory card. That is, the recording unit 1 has a function of writing the control data D1 and the image data D2 acquired from the control device 3 and the imaging device 6 onto the non-temporary recording medium M1. The reproduction unit 2 has a function of reading data (control data D1 and image data D2) written in the non-temporary recording medium M1. As a result, data (control data D1 and image data D2) is output (transferred) from the recording unit 1 to the reproducing unit 2.

(2.3) Configuration of Playback System Next, the configuration of the playback system 10 according to the present embodiment will be described in more detail with reference to FIG. The playback system 10 includes the recording unit 1 and the playback unit 2 as described above.

The recording unit 1 includes a first acquisition unit 11, a second acquisition unit 12, a storage unit 14, an output unit 15, a clock unit 16, an extraction unit 17, a detection unit 18, and a target determination unit 19. have. In the present embodiment, as an example, the recording unit 1 mainly includes a computer system having one or more processors and one or more memories. The processor executes the program recorded in the memory, so that the first acquisition unit 11, the second acquisition unit 12, the output unit 15, the clock unit 16, the extraction unit 17, the detection unit 18, the target determination unit 19, and the like. Realize the function. The program may be recorded in a memory in advance, may be recorded in a non-transitory recording medium such as a memory card and provided, or may be provided through an electric communication line. In other words, the program is a program for causing the computer system to function as the recording unit 1.

The first acquisition unit 11 acquires the control data D1. As described above, the control data D1 is data including at least one of the input data and the output data of the control device 3 that executes the sequence control. In the present embodiment, the first acquisition unit 11 acquires the control data D1 including both the input data and the output data by communicating from the control device 3 in real time.

The second acquisition unit 12 acquires the image data D2. The image data D2 is data obtained by photographing the control target 4 of the control device 3 as described above. In the present embodiment, the second acquisition unit 12 acquires the image data D2 including a full-color moving image (moving image) in real time from the imaging device 6 by communication.

The storage unit 14 stores the control data D1 acquired by the first acquisition unit 11 and the image data D2 acquired by the second acquisition unit 12. Here, each of the control data D1 and the image data D2 is stored in the storage unit 14 with the time information added thereto. The “time information” in the present disclosure is data representing the date and time when the control data D1 or the image data D2 occurred, and is, for example, a time stamp. In the present embodiment, as an example, the time information indicating the date and time when the first acquisition unit 11 acquires the control data D1 is stored in the storage unit 14 in association with (associated with) the control data D1. In addition, the time information indicating the date and time when the second acquisition unit 12 acquired the image data D2 is stored in the storage unit 14 in association with (associated with) the image data D2. Here, in the present embodiment, as described above, since the image data D2 is a moving image composed of a plurality of still images, the time information is attached to each of the plurality of still images forming the moving image. The storage unit 14 includes a rewritable nonvolatile memory such as an EEPROM (Electrically Erasable Programmable Read-Only Memory).

Here, in the present embodiment, the length of recordable time is different between the control data D1 and the image data D2. Particularly, in the present embodiment, the recordable time of the image data D2 is set shorter than the recordable time of the control data D1. As an example, when the storage unit 14 can store a moving image of up to 24 hours as the image data D2, it can store the data of up to 1 month as the control data D1. Further, in the storage unit 14, the oldest data for which the recordable period has elapsed is sequentially deleted, so that the latest data for the recordable period remains.

Further, in the present embodiment, as described above, the recording unit 1 has a corresponding relationship regarding a group of reproduction data (control data D1 and image data D2) acquired from the corresponding control device 3 and image pickup device 6. Record while maintaining. Therefore, in the storage unit 14, for example, depending on the addresses of the control device 3 and the imaging device 6, a group of reproduction data (control data D1 and image data D2) is stored in a state in which the corresponding relationship is maintained. ..

The output unit 15 has a function of outputting the data stored in the storage unit 14. In the present embodiment, the output unit 15 writes a group of reproduction data (control data D1 and image data D2) acquired from the control device 3 and the imaging device 6 to the non-temporary recording medium M1.

The clock unit 16 measures the current time (date and time). This makes it possible to add the time information described above. The clock unit 16 measures an accurate current time by communicating with an NTP (Network Time Protocol) server or the like, for example.

The extraction unit 17 extracts the control data D1 and the image data D2 to be displayed on the display device 5, triggered by the occurrence of a predetermined event. The “predetermined event” in the present disclosure is an event that satisfies a predetermined detection condition, and includes, for example, an operation stop (including an emergency stop), an error, or a failure (including damage) of the controlled object 4 (here, the production facility). ) Etc. The extraction unit 17 uses the occurrence of such an event as a trigger to select the control data D1 and the image data D2 to be displayed on the display device 5 from the control data D1 and the image data D2 stored in the storage unit 14. To extract. For example, the extraction unit 17 extracts from the storage unit 14 the control data D1 and the image data D2 of the target period including the time when this event occurs. In this case, the target period includes a time period before and/or after the time when the event occurs.

The detection unit 18 detects the occurrence of a predetermined event based on the image data D2. That is, the occurrence of the event satisfying the predetermined detection condition is detected based on the image data D2. As an example, the detection unit 18 performs image processing on the image data D2, and determines that the detection condition is satisfied when a certain feature amount included in the result of the image processing exceeds the determination threshold value. That is, when the feature amount exceeds the determination threshold, the detection unit 18 determines that a predetermined event has occurred. The extraction unit 17 extracts the control data D1 and the image data D2, triggered by the occurrence of the event thus detected.

The target determining unit 19 determines a target for acquiring the control data D1 by the first acquiring unit 11. That is, the target determination unit 19 can set which control data D1 the first acquisition unit 11 acquires from the control device 3. In the present embodiment, the control target 4 (here, production equipment) of the control device 3 includes one or more input devices 41 and one or more output devices 42. The target determining unit 19 determines which of the one or more input devices 41 and the one or more output devices 42 is the input device 41 or the output device 42 as the target for acquiring the control data D1.

In the present embodiment, as an example, the target determination unit 19 automatically determines the target to acquire the control data D1 based on the content of the event detected by the detection unit 18, the image data D2, or the like. That is, the target determining unit 19 selects the input device 41 or the output device 42 having a correlation with the image data D2 as a target for acquiring the control data D1. The target determining unit 19 specifies the input device 41 or the output device 42 as a target for acquiring the control data D1 by, for example, the address assigned to each of the input device 41 or the output device 42.

The reproduction unit 2 has an input unit 20, a display control unit 13, and an operation reception unit 21. In the present embodiment, as an example, the reproduction unit 2 mainly includes a computer system having one or more processors and one or more memories. The processor realizes the functions of the input unit 20, the display control unit 13, the operation receiving unit 21, and the like by executing the program recorded in the memory. The program may be recorded in a memory in advance, may be recorded in a non-transitory recording medium such as a memory card and provided, or may be provided through an electric communication line. In other words, the program is a program for causing the computer system to function as the reproduction unit 2.

The input unit 20 has a function of inputting the data output from the output unit 15 of the recording unit 1. In the present embodiment, the input unit 20 reads a group of reproduction data (control data D1 and image data D2) stored in the non-temporary recording medium M1 from the non-temporary recording medium M1.

The display control unit 13 displays an arbitrary screen on the display device 5 based on the data received from the recording unit 1. In the present embodiment, the display control unit 13 temporally associates the control data D1 with the image data D2 based on the group of reproduction data (control data D1 and image data D2) read by the input unit 20. It is displayed on the display device 5 in the attached display mode. Here, the display control unit 13 displays on the display device 5 a group of reproduction data, that is, an extraction unit of the control data D1 and the image data D2 acquired from the control device 3 and the imaging device 6 corresponding to each other. It is the data of the target period extracted in 17.

Here, the display control unit 13 correlates the control data D1 and the image data D2 in time using the time information attached to each of the control data D1 and the image data D2. That is, as described above, since the control data D1 and the image data D2 are each provided with time information, the control data D1 and the image data D2 are associated in time by using this time information. It is possible. As an example, the display control unit 13 controls the control data D1 to which certain time information (first time information) is attached, and the time information (second time information) within the same or error range as this time information (first time information). The image data D2 with the time information) is displayed in a synchronized manner. The “error range” here is, for example, 1 s or less, more preferably 100 ms or less, and further preferably 10 ms or less.

Further, in the present embodiment, the display control unit 13 displays the control data D1 as a timing chart. The “timing chart” referred to in the present disclosure is a diagram showing the relationship or behavior of a plurality of signals on the time axis, and as an example, the horizontal axis is the time axis and the vertical axis is the value (value of control data D1). 4 is a diagram (see FIG. 3). The display control unit 13 realizes a display mode (corresponding in time) by synchronizing the time axis of the timing chart and the image data D2.

Further, in the present embodiment, the display control unit 13 simultaneously displays the control data D1 and the image data D2 within one screen. That is, the list display is realized by simultaneously displaying a group of reproduction data (control data D1 and image data D2) on the display device 5. A specific display mode will be described in detail in the section “(2.4) Display screen example”.

Here, the operation cycle (time required for one operation) of the controlled object 4 is, for example, several hundreds of microseconds to several seconds. The cycle in which the control data D1 is input to or output from the control device 3 is, for example, about several microseconds to several tens of microseconds. As described above, since the operation cycle of the controlled object 4 and the communication cycle of the control data D1 are very short, when reproducing the control data D1 and the image data D2, it is preferable to perform slow reproduction instead of constant speed reproduction. There are cases. In this case, it is preferable that the display control unit 13 adjust the waveform of the control data D1 or the movement of the control device 3 or the work target to a speed at which it can be visually recognized, and perform slow reproduction.

The operation receiving unit 21 has a function of receiving an operation of a person (user). The operation reception unit 21 is, for example, an input interface that receives an input signal from an operation device connected to the reproduction unit 2. The operation device is, for example, a keyboard, a pointing device, a mechanical switch, or the like. Further, the operation reception unit 21 may receive an input signal from the touch sensor included in the display device 5 as a human operation.

(2.4) Display screen example Next, the operation of the reproduction system 10 according to the present embodiment will be described with reference to FIG. FIG. 3 is an explanatory diagram schematically showing the monitoring screen Im1 displayed on the display device 5. In the example of FIG. 3, the alternate long and short dash line and the reference numeral indicating the region are shown only for the sake of description, and in reality, the alternate long and short dash line and the reference numeral are not displayed on the display device 5.

The monitoring screen Im1 shown in FIG. 3 is generated by the occurrence of a predetermined event as a trigger. That is, the monitoring screen Im1 includes the control data D1 and the image data D2 extracted by the occurrence of a predetermined event as a trigger. Here, the control data D1 and the image data D2 included in the monitoring screen Im1 are the control data D1 and the image data D2 (a group of reproduction data) acquired from the control device 3 and the imaging device 6 which correspond to each other. The monitoring screen Im1 further includes a slide bar A1, a slider A2, buttons A3, A4, A5, a time display area A6, scroll bars A7, A8, and a menu area A9.

First, as described above, the control data D1 is displayed in the monitoring screen Im1 in the form of a timing chart in which the horizontal axis is the time axis and the vertical axis is the value (value of the control data D1). In the example of FIG. 3, the control data D1 is displayed below the monitoring screen Im1. Here, since the control data D1 includes one or more input data and one or more output data, a plurality of these data (input data and output data) are displayed side by side in the vertical direction (vertical direction). .. On the left side of each chart of the control data D1, text (item name) for identifying each data is displayed.

The image data D2 is displayed on the monitoring screen Im1 as a moving image (moving image). In the example of FIG. 3, the image data D2 is displayed on the monitoring screen Im1. That is, the control data D1 and the image data D2 are arranged side by side in the vertical direction (vertical direction) on the monitoring screen Im1. In this way, the control data D1 and the image data D2 are simultaneously displayed in one screen (monitor screen Im1).

The slide bar A1 shows the reproduction status of the image data D2. That is, the entire length of the slide bar A1 corresponds to the time length of the image data D2 that is a moving image, and the slider on the slide bar A1 corresponds to the reproduction time of the image data D2. The “reproduction time” in the present disclosure means the position of the currently displayed image in the time length of the image data D2, that is, the elapsed time from the start point of the image data D2. The slider of the slide bar A1 is movable on the monitoring screen Im1 in the direction of the time axis in the timing chart of the control data D1, that is, in the lateral direction (horizontal direction). In the present embodiment, the slider of the slide bar A1 moves to the right with the passage of time.

In short, the left end of the slide bar A1 corresponds to the start point of the image data D2, and the right end of the slide bar A1 corresponds to the end point of the image data D2. Then, the slider of the slide bar A1 gradually moves from the left end portion to the right end portion of the slide bar A1 with the passage of time during reproduction of the image data D2. The slide bar A1 can also be operated by a person (user). Specifically, when the operation receiving unit 21 receives an operation by a person (user), the slider of the slide bar A1 moves according to this operation.

The slider A2 is displayed overlapping the control data D1. The slider A2 is movable on the monitoring screen Im1 in the direction of the time axis in the timing chart of the control data D1, that is, in the lateral direction (horizontal direction). In this embodiment, the slider A2 moves to the right with the lapse of time.

By the way, in the present embodiment, the control data D1 and the image data D2 are displayed on the display device 5 by the display control unit 13 in a display mode in which they are temporally associated with each other. Specifically, the display control unit 13 realizes a temporally associated display mode by synchronizing the time axis of the timing chart of the control data D1 and the image data D2. That is, in the monitoring screen Im1, the control data D1 in which the slider A2 overlaps (points) and the image data D2 currently displayed are basically data at the same time point (same time), that is, at the same timing. is there. In the present embodiment, as described above, the control data D1 to which certain time information (first time information) is attached and the time information (first time information) within the same or error range as the first time information (first time information). The image data D2 with (2 hours information) is synchronized. Therefore, the time difference between the control data D1 in which the slider A2 displayed on the monitoring screen Im1 overlaps (points) and the image data D2 is within the error range.

In particular, in the present embodiment, as described above, the image data D2 is a moving image including a plurality of still images, and the time information (second time information) is the plurality of still images forming the image data D2. Attached to each. Therefore, the image data D2 displayed on the monitor screen Im1 can be reproduced with a resolution according to the frame rate (for example, 30 fps). As a result, in the monitoring screen Im1, the image data D2 can be synchronized with the control data D1 with relatively high accuracy.

In this way, the control data D1 and the image data D2 are displayed on the display device 5 in a display mode that is temporally associated, so that the control data D1 and the image data D2 are displayed as the control status of the control device 3. Both are visualized, and management of the control device 3 is realized. Therefore, for example, when an abnormality occurs in the controlled object 4 of the control device 3, the user is based on the control situation (control data D1 and image data D2) of the control device 3 visualized by the reproduction system 10. It is possible to analyze the cause of abnormality. Furthermore, since the control data D1 and the image data D2 are displayed on the display device 5 in a display mode that is temporally associated with each other, the user can confirm the control data D1 and the image data D2 separately. There is no need to perform work to compare the two. Therefore, according to the reproduction system 10, it is possible to reduce the time and effort required to identify the abnormality of the control target 4 controlled by the control device 3 or the work target operated by the control target.

The buttons A3, A4, A5 are buttons (objects) for operations related to the reproduction of the image data D2. As an example, the button A3, the button A4, and the button A5 correspond to operations of play/pause, rewind, and fast forward, respectively. That is, by operating each of the button A3, the button A4, and the button A5, operations of reproduction/pause, rewind, and fast-forward are executed for the image data D2.

The time display area A6 is an area for displaying the reproduction time of the image data D2 and the time length of the image data D2. In the present embodiment, the reproduction time of the image data D2 and the time length of the image data D2 are displayed in text in the format of “reproduction time/time length”.

The scroll bars A7 and A8 are used for scrolling the control data D1 on the monitoring screen Im1. As an example, the scroll bar A7 and the scroll bar A8 correspond to vertical and horizontal movement operations, respectively. That is, the scroll operation of the control data D1 is executed by operating each of the scroll bar A7 and the scroll bar A8.

The menu area A9 is an area for performing various menu operations. In this embodiment, "menu", "display", "TOOL", and "help" are displayed in text in the menu area A9.

(2.5) Flowchart The basic operation of the reproduction system 10 described above, that is, the reproduction method, is represented by the flowchart shown in FIG.

That is, in the reproduction system 10, first, the first acquisition unit 11 acquires the control data D1 (S1), and the second acquisition unit 12 acquires the image data D2 (S2). After that, the reproduction system 10 detects the occurrence of a predetermined event by the detection unit 18 (S3). At this time, the detection unit 18 detects the occurrence of an event based on the image data D2. If no event has occurred (S3: No), the reproduction system 10 returns to the process S1.

When an event occurs (S3: Yes), the reproduction system 10 causes the extraction unit 17 to generate a trigger (S4). Then, the reproducing system 10 causes the extracting unit 17 to extract the control data D1 and the image data D2 of the target period including the time when this event occurs from the storage unit 14. At this time, the control data D1 and the image data D2 are extracted because the control device 3 and the imaging device corresponding to the control target 4 where the event has occurred among the plurality of control devices 3 and the imaging devices 6 are extracted. These are the control data D1 and the image data D2 acquired from the device 6. Here, the delay time between the control data D1 and the image data D2 is adjusted (S5). Then, the control data D1 and the image data D2 are output from the recording unit 1 to the reproducing unit 2.

After that, the reproduction system 10 causes the display control unit 13 to synchronously reproduce the control data D1 and the image data D2 (S6). That is, in the reproduction system 10, the display control unit 13 prepares to display the control data D1 and the image data D2 on the display device 5 in a display mode in which they are temporally associated with each other. Here, the reproduction system 10 adjusts the sampling period and the number of data of the control data D1 to match the time length of the control data D1 and the time length of the image data D2 (S7).

Then, the reproduction system 10 causes the display control unit 13 to display the control data D1 and the image data D2 on the display device 5 in a display manner in which they are temporally associated with each other (S8). As a result, the monitoring screen Im1 illustrated in FIG. 3 is displayed on the display device 5.

The flowchart of FIG. 4 is merely an example of the reproducing method, and the order of the processing may be changed as appropriate, or any processing may be omitted as appropriate.

(3) Modifications Embodiment 1 is only one of various embodiments of the present disclosure. The first embodiment can be variously modified according to the design and the like as long as the object of the present disclosure can be achieved. Each drawing described in the present disclosure is a schematic drawing, and the ratio of the size and the thickness of each constituent element in each drawing does not necessarily reflect the actual dimensional ratio. The same function as that of the reproduction system 10 according to the first embodiment may be embodied by a reproduction method, a reproduction program, a non-transitory recording medium recording the reproduction program, or the like. A reproduction method according to one aspect is a first acquisition step (corresponding to “S1” in FIG. 4), a second acquisition step (corresponding to “S2” in FIG. 4), and a display step (“S6” in FIG. 4). Corresponding to “S8”). The first acquisition step is a step of acquiring the control data D1. The control data D1 includes at least one of input data and output data of the control device 3 that executes sequence control. The second acquisition step is a step of acquiring image data D2 obtained by photographing the controlled object 4 of the control device 3. The display step is a step of displaying the control data D1 and the image data D2 on the display device 5 in a display mode in which they are temporally associated with each other. A reproduction program according to one aspect is a program for causing one or more processors to execute the above-described reproduction method.

The following is a list of modifications of the first embodiment. The modifications described below can be applied in appropriate combination.

The reproduction system 10 according to the present disclosure includes a computer system in the recording unit 1, the reproduction unit 2, and the like, for example. The computer system mainly comprises a processor as a hardware and a memory. When the processor executes the program recorded in the memory of the computer system, the function of the reproduction system 10 according to the present disclosure is realized. The program may be pre-recorded in the memory of the computer system, may be provided through an electric communication line, or may be recorded in a non-transitory recording medium such as a memory card, an optical disk, a hard disk drive, etc. that can be read by the computer system. May be provided. The processor of the computer system is composed of one or a plurality of electronic circuits including a semiconductor integrated circuit (IC) or a large scale integrated circuit (LSI). The integrated circuit such as an IC or an LSI referred to here has a different name depending on the degree of integration, and includes an integrated circuit called a system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). In addition, FPGAs (Field-Programmable Gate Arrays) that are programmed after the LSI is manufactured, or logic devices that can reconfigure the junction relationships within the LSI or the circuit sections within the LSI can also be used as processors. You can The plurality of electronic circuits may be integrated in one chip, or may be distributed and provided in the plurality of chips. The plurality of chips may be integrated in one device, or may be distributed and provided in the plurality of devices. The computer system referred to herein includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller is also composed of one or a plurality of electronic circuits including a semiconductor integrated circuit or a large scale integrated circuit.

Further, it is not an essential configuration of the playback system 10 that at least a part of the functions of the playback system 10 are integrated in one housing, and the components of the playback system 10 are distributed in a plurality of housings. It may be provided. For example, some of the functions provided in the recording unit 1 of the reproduction system 10 may be provided in a housing different from the recording unit 1. Furthermore, at least a part of the function of the reproduction system 10, for example, the function of the display control unit 13 may be realized by a cloud (cloud computing) or the like.

On the contrary, in the first embodiment, at least a part of the functions of the reproduction system 10 distributed to a plurality of devices may be integrated in one housing. For example, the functions distributed to the recording unit 1 and the reproduction unit 2 may be integrated in one housing.

Moreover, the communication system between the recording unit 1 and each control device 3 is not limited to the system described in the first embodiment, and an appropriate communication system such as wired communication or wireless communication can be adopted. Similarly, the communication system between the recording unit 1 and each imaging device 6 is not limited to the system described in the first embodiment, and an appropriate communication system such as wired communication or wireless communication can be adopted.

Further, the recording unit 1 is not limited to the configuration in which the control data D1 is acquired from the control device 3 in real time, and the control data D1 stored in the control device 3 may be periodically or irregularly transmitted from the control device 3. You may get it. Similarly, the recording unit 1 is not limited to the configuration that acquires the image data D2 in real time from the imaging device 6, but acquires the image data D2 stored in the imaging device 6 from the imaging device 6 regularly or irregularly. You may.

Further, the recording unit 1 is not limited to the configuration in which the control data D1 is acquired from the control device 3 by communication, and the transfer of the control data D1 between the recording unit 1 and the control device 3 is performed by, for example, a memory card or the like. It may be performed via a non-temporary recording medium. Similarly, the recording unit 1 is not limited to the configuration in which the image data D2 is acquired from the image pickup device 6 by communication, and the image data D2 is exchanged between the recording unit 1 and the image pickup device 6 by a non-memory card or the like. It may be performed via a temporary recording medium.

The exchange of data between the recording unit 1 and the reproduction unit 2 is not limited to the configuration performed via the non-transitory recording medium M1 such as a memory card, but may be realized by communication via a network, for example. Good. In this case, the recording unit 1 and the reproduction unit 2 are communicable.

The control device 3 that is the target of management of the reproduction system 10 is used not only in a factory but also in various environments such as a house, a building, the outdoors, a laboratory, an office, a store, and an educational facility. Furthermore, the control target 4 of the control device 3 is not limited to production equipment, and may be various devices (or equipment) such as home appliances, elevators, and traffic lights. Further, the control device 3 and the controlled object 4 may be mounted in a mobile device such as an automobile, for example. And in this case, the reproduction system 10 may be used, for example, to inspect the operation of the mobile device. Alternatively, the reproduction system 10 can also be used to inspect the operation of the control device 3 or the controlled object 4 in a process of manufacturing, inspecting, etc. the control device 3 or the controlled object 4, for example.

The imaging device 6 is not limited to a camera capable of capturing a full-color moving image, but may be, for example, a camera capable of capturing a still image (still camera), a camera capable of capturing a monochrome image, a line sensor, or the like.

Further, the predetermined event (the operation stop of the controlled object 4, the occurrence of the error or the failure is not limited to the configuration detected based on the image data D2), and for example, the control data D1 (especially the input device 41 such as the switch or the sensor 41). May be detected based on (input data from).

Further, it is not an essential configuration of the reproduction system 10 that the control data D1 and the image data D2 are simultaneously displayed on one screen (monitor screen Im1). For example, only the control data D1 may be displayed on the monitoring screen Im1. In this case, when the user selects a specific time point (timing) of the control data D1, the image data D2 at this time point is displayed. As described above, the control data D1 and the image data D2 may be displayed on the display device 5 in a display mode that is temporally associated with each other, or may be displayed on another screen.

The fact that communication with the plurality of control devices 3 and the plurality of imaging devices 6 is not an essential component of the playback system 10, and the playback system 10 includes one control device 3 and one imaging device. It may be possible to communicate only with 6.

Further, it is not essential that the plurality of control devices 3 and the plurality of image pickup devices 6 are associated with each other on a one-to-one basis. For example, one control device 3 is associated with the plurality of image pickup devices 6. It may be. In this case, the plurality of imaging devices 6 corresponding to a certain control device 3 respectively image a plurality of parts of the control target 4 of the control device 3 to generate the image data D2. Alternatively, each of the plurality of imaging devices 6 corresponding to a certain control device 3 photographs the same part of the control target 4 of the control device 3 from a plurality of directions to generate image data D2. Furthermore, one imaging device 6 may be associated with a plurality of control devices 3.

Also, it is not essential that the operation of the control target 4 based on one control data D1 of one control device 3 and one imaging device 6 are associated with each other on a one-to-one basis. For example, when the control target 4 or the work target imaged by the imaging device 6 moves, a plurality of imaging devices 6 are arranged in the moving direction of the control target 4 or the work target, and the movement of the control target 4 or the work target is imaged. You may arrange|position so that it may be in the imaging range of the apparatus 6. In this case, the reproduction unit 2 (display control unit 13) may combine the plurality of image data D2 obtained by the plurality of imaging devices 6 so as to be aligned in the moving direction and display the combined image data D2 on the display device 5. Alternatively, the reproduction unit 2 (display control unit 13) is not limited to the configuration in which the plurality of image data D2 are displayed at the same time, and the plurality of image data D2 obtained by the plurality of imaging devices 6 are sequentially displayed from the front in the moving direction. , May be displayed while being sequentially switched. Alternatively, when confirming the image data D2, for example, by selecting any of the control data D1 on the monitoring screen Im1, the reproduction unit 2 (display control unit 13) causes the image corresponding to the control data D1. The data D2 may be switched and displayed. In this case, the control data D1 and the image data D2 are provided with, for example, common addresses or the like, and these common addresses associate these data.

Further, for example, when the size of the work target is relatively small, or when the movement of the control target 4 is minute, it is necessary to increase the magnification of the lens of the image pickup device 6, and the image pickup of the image pickup device 6 is performed. The possible range (angle of view) becomes narrower. Therefore, the plurality of image pickup devices 6 may be arranged in the same direction with respect to the image pickup target so that the image pickup target to be picked up by the image pickup device 6 can be divided and imaged by the plurality of image pickup devices. In this case, the reproduction unit 2 (display control unit 13) may combine the plurality of image data D2 obtained by the plurality of imaging devices 6 and display the combined image data D2 on the display device 5. Alternatively, the reproduction unit 2 (display control unit 13) may alternately switch and display the plurality of image data D2 obtained by the plurality of imaging devices 6.

In addition, when the control target 4 or the work target imaged by the imaging device 6 moves, the imaging device 6 is moved (including pan and tilt movement) in conjunction with the movement of the control target 4 or the work target. ) May be done. In this case, it is preferable that the illumination device of the imaging device 6 illuminates the entire imaging range of the imaging device 6. Alternatively, the irradiation range of the illumination device may move in association with the movement of the imaging range of the imaging device 6. Furthermore, a plurality of illumination devices may be arranged side by side so that the imaging range of the imaging device 6 can be illuminated.

(Embodiment 2)
The recording system according to the present embodiment is a system that performs the same processing as the reproduction system according to the first embodiment in the process of recording the control data D1 and the image data D2. Hereinafter, the same components as those in the first embodiment will be denoted by the same reference numerals and the description thereof will be appropriately omitted.

The recording system 100 is connected to the recording device 7 instead of the display device 5. The recording device 7 is realized by, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), a non-transitory recording medium, or the like.

As shown in FIG. 5, the recording system 100 includes a first acquisition unit 11, a second acquisition unit 12, a storage unit 14, an output unit 15, a clock unit 16, an extraction unit 17, and a detection unit 18. The target determination unit 19 and the recording control unit 22 are included. In this embodiment, as an example, the recording system 100 mainly includes a computer system having one or more processors and one or more memories. The processor executes the program recorded in the memory to execute the first acquisition unit 11, the second acquisition unit 12, the output unit 15, the clock unit 16, the extraction unit 17, the detection unit 18, the target determination unit 19, and the recording. The functions of the control unit 22 and the like are realized. The program may be recorded in a memory in advance, may be recorded in a non-transitory recording medium such as a memory card and provided, or may be provided through an electric communication line. In other words, the program is a program for causing the computer system to function as the recording system 100.

As described above, the recording system 100 according to the present embodiment includes at least the first acquisition unit 11 and the second acquisition unit 12, similarly to the reproduction system 10 according to the first embodiment. Further, the recording system 100 includes a recording control unit 22 instead of the display control unit 13 of the reproduction system 10. The recording control unit 22 records the control data D1 and the image data D2 in the recording device 7 in a recording manner in which they are temporally associated with each other, based on a group of reproduction data (control data D1 and image data D2). To do. Here, the recording control unit 22 records in the recording device 7 a group of reproduction data, that is, an extracting unit out of the control data D1 and the image data D2 acquired from the corresponding control device 3 and imaging device 6. It is the data of the target period extracted in 17.

Here, the recording control unit 22 temporally associates the control data D1 with the image data D2 by using the time information attached to each of the control data D1 and the image data D2. That is, since the control data D1 and the image data D2 are each provided with time information, the control data D1 and the image data D2 can be temporally associated with each other by using this time information. .. As an example, the recording control unit 22 controls the control data D1 to which certain time information (first time information) is added, and the time information (second time information) within the same or error range as this time information (first time information). The image data D2 with time information) is recorded in a corresponding manner. The “error range” here is, for example, 1 s or less, more preferably 100 ms or less, and further preferably 10 ms or less.

As a result, the control data D1 and the image data D2 are recorded in the recording device 7 in a recording manner in which they are temporally associated with each other. Therefore, even when the control data D1 and the image data D2 recorded in the recording device 7 are reproduced by a general-purpose reproducing device, for example, the same display as that of the reproducing system 10 according to the first embodiment can be realized. is there. That is, according to the recording system 100 of the present embodiment, it becomes possible to display the control data D1 and the image data D2 on the display device 5 in a display mode in which they are temporally associated with each other.

The same function as that of the recording system 100 according to the second embodiment may be embodied by a recording method, a recording program, a non-transitory recording medium recording the recording program, or the like. A recording method according to one aspect includes a first acquisition step, a second acquisition step, and a recording step. The first acquisition step is a step of acquiring the control data D1. The control data D1 includes at least one of input data and output data of the control device 3 that executes sequence control. The second acquisition step is a step of acquiring image data D2 obtained by photographing the controlled object 4 of the control device 3. The recording step is a step of recording the control data D1 and the image data D2 in the recording device 7 in a recording manner in which they are temporally associated with each other. A recording program according to one aspect is a program for causing one or more processors to execute the above recording method.

The various configurations (including modified examples) described in the second embodiment can be appropriately combined with the various configurations (including modified examples) described in the first embodiment.

(Summary)
The reproduction system (10) according to the first aspect includes a first acquisition unit (11), a second acquisition unit (12), and a display control unit (13). The first acquisition unit (11) acquires control data (D1). The control data (D1) includes at least one of input data and output data of the control device (3) that executes sequence control. The second acquisition unit (12) acquires image data (D2) obtained by photographing the control target (4) of the control device (3). The display control unit (13) displays the control data (D1) and the image data (D2) on the display device (5) in a display mode in which they are temporally associated with each other.

According to this aspect, since the control data (D1) and the image data (D2) are displayed on the display device (5) in a display mode that is temporally associated with each other, the control data (D1) and the image are displayed. It is not necessary to check the data (D2) separately and compare them. Therefore, according to the reproduction system (10), it is possible to reduce the time and effort required for identifying the abnormality of the control target (4) controlled by the control device (3) or the work target operated by the control target (4). be able to.

In the reproduction system (10) according to the second aspect, in the first aspect, the display control unit (13) displays the control data (D1) as a timing chart. The display control unit (13) realizes a display mode by synchronizing the time axis of the timing chart and the image data (D2).

According to this aspect, the temporal correspondence between the control data (D1) and the image data (D2) becomes easy to understand.

In the reproduction system (10) according to the third aspect, in the first or second aspect, the display control unit (13) has time information attached to each of the control data (D1) and the image data (D2). Using, the control data (D1) and the image data (D2) are temporally associated with each other.

According to this aspect, the temporal correspondence between the control data (D1) and the image data (D2) can be realized relatively easily.

The reproduction system (10) according to the fourth aspect further includes an extraction unit (17) in any one of the first to third aspects. The extraction unit (17) extracts the control data (D1) and the image data (D2) to be displayed on the display device (5), triggered by the occurrence of a predetermined event.

According to this aspect, the control data (D1) and the image data (D2) displayed on the display device (5) are data caused by the occurrence of a predetermined event. Therefore, it is possible to analyze a predetermined event from the control data (D1) and the image data (D2) displayed on the display device (5).

The reproduction system (10) according to the fifth aspect further includes a detection unit (18) in the fourth aspect. The detection unit (18) detects the occurrence of a predetermined event based on the image data (D2).

According to this aspect, it is not necessary to separately install a sensor or the like to detect the occurrence of a predetermined event.

The reproduction system (10) according to the sixth aspect further includes a target determination unit (19) in any one of the first to fifth aspects. The target determination unit (19) determines a target for which the control data (D1) is acquired by the first acquisition unit (11).

According to this aspect, it is possible to change the target for acquiring the control data (D1) by the first acquisition unit (11).

In the reproduction system (10) according to the seventh aspect, in any one of the first to sixth aspects, the image data (D2) is an image that changes with time.

According to this aspect, for example, when an abnormality occurs in the control target (4) of the control device (3), it is possible to analyze the cause of the abnormality in a moving image.

In the reproduction system (10) according to the eighth aspect, in any one of the first to seventh aspects, the length of recordable time is different between the control data (D1) and the image data (D2).

According to this aspect, it is possible to individually set the recording time of each of the control data (D1) and the image data (D2).

In the reproduction system (10) according to the ninth aspect, in any one of the first to eighth aspects, the display control section (13) displays the control data (D1) and the image data (D2) in one screen. Display at the same time.

According to this aspect, since the control data (D1) and the image data (D2) are displayed in a list, it becomes easy to confirm the correspondence relationship between the control data (D1) and the image data (D2).

The recording system (100) according to the tenth aspect includes a first acquisition unit (11), a second acquisition unit (12), and a recording control unit (22). The first acquisition unit (11) acquires control data (D1). The control data (D1) includes at least one of input data and output data of the control device (3) that executes sequence control. The second acquisition unit (12) acquires image data (D2) obtained by photographing the control target (4) of the control device (3). The recording control unit (22) records the control data (D1) and the image data (D2) in the recording device (7) in a recording manner in which they are temporally associated with each other.

According to this aspect, since the control data (D1) and the image data (D2) are recorded in the recording device (7) in a recording mode that is temporally associated with each other, the control data (D1) and the image are recorded. It is not necessary to check the data (D2) separately and compare them. Therefore, according to the recording system (100), it is possible to reduce the time and effort required to identify the abnormality of the control target (4) controlled by the control device (3) or the work target operated by the control target (4). be able to.

The reproduction method according to the eleventh aspect has a first acquisition step, a second acquisition step, and a display step. The first acquisition step is a step of acquiring the control data (D1). The control data (D1) includes at least one of input data and output data of the control device (3) that executes sequence control. The second acquisition step is a step of acquiring image data (D2) obtained by photographing the controlled object (4) of the control device (3). The display step is a step of displaying the control data (D1) and the image data (D2) on the display device (5) in a display mode in which they are temporally associated with each other.

According to this aspect, since the control data (D1) and the image data (D2) are displayed on the display device (5) in a display mode that is temporally associated with each other, the control data (D1) and the image are displayed. It is not necessary to check the data (D2) separately and compare them. Therefore, according to the regenerating method, it is possible to reduce the time and labor required for identifying the abnormality of the control target (4) controlled by the control device (3) or the work target operated by the control target (4). ..

The reproduction program according to the twelfth aspect is a program for causing one or more processors to execute the reproduction method according to the eleventh aspect.

According to this aspect, since the control data (D1) and the image data (D2) are displayed on the display device (5) in a display mode that is temporally associated with each other, the control data (D1) and the image are displayed. It is not necessary to confirm the data (D2) separately and compare them. Therefore, according to the reproduction program, it is possible to reduce the time and effort required for identifying the abnormality of the control target (4) controlled by the control device (3) or the work target operated by the control target (4). it can.

The recording method according to the thirteenth aspect includes a first acquisition step, a second acquisition step, and a recording step. The first acquisition step is a step of acquiring the control data (D1). The control data (D1) includes at least one of input data and output data of the control device (3) that executes sequence control. The second acquisition step is a step of acquiring image data (D2) obtained by photographing the controlled object (4) of the control device (3). The recording step is a step of displaying the control data (D1) and the image data (D2) on the recording device (7) in a recording manner in which they are temporally associated with each other.

According to this aspect, since the control data (D1) and the image data (D2) are recorded in the recording device (7) in a recording mode that is temporally associated with each other, the control data (D1) and the image are recorded. It is not necessary to check the data (D2) separately and compare them. Therefore, according to the recording method, it is possible to reduce the time and effort required to identify the abnormality of the control target (4) controlled by the control device (3) or the work target operated by the control target (4). ..

The recording program according to the fourteenth aspect is a program for causing one or more processors to execute the recording method according to the thirteenth aspect.

According to this aspect, since the control data (D1) and the image data (D2) are recorded in the recording device (7) in a recording mode that is temporally associated with each other, the control data (D1) and the image are recorded. It is not necessary to check the data (D2) separately and compare them. Therefore, according to the recording program, it is possible to reduce the time and effort required for identifying the abnormality of the control target (4) controlled by the control device (3) or the work target operated by the control target (4). it can.

Not limited to the above aspect, various configurations (including modified examples) of the playback system (10) according to the first embodiment can be embodied by a playback method or a playback program.

Further, not limited to the above-described aspect, various configurations (including modified examples) of the recording system (100) according to the second embodiment can be embodied by a recording method or a recording program.

The configurations according to the second to ninth aspects are not essential for the playback system (10) and can be omitted as appropriate.

3 Control device 4 Control object 5 Display device 7 Recording device 10 Reproduction system 11 1st acquisition part 12 2nd acquisition part 13 Display control part 17 Extraction part 18 Detection part 19 Target determination part 22 Recording control part 100 Recording system D1 Control data D2 image data

Claims (14)

1. A first acquisition unit that acquires control data including at least one of input data and output data of a control device that executes sequence control;
   A second acquisition unit for acquiring image data obtained by capturing an image of a control target of the control device;
   A display control unit that displays the control data and the image data on a display device in a display mode that is temporally associated with each other;
   Playback system.
2. The display control unit,
   The control data is displayed as a timing chart,
   The display mode is realized by synchronizing the time axis of the timing chart and the image data,
   The reproduction system according to claim 1.
3. The display control unit temporally associates the control data with the image data by using time information attached to each of the control data and the image data,
   The reproduction system according to claim 1.
4. Further comprising an extraction unit for extracting the control data and the image data to be displayed on the display device, triggered by the occurrence of a predetermined event,
   The reproduction system according to any one of claims 1 to 3.
5. Further comprising a detection unit that detects the occurrence of the predetermined event based on the image data,
   The reproduction system according to claim 4.
6. The first acquisition unit further includes a target determination unit that determines a target for acquiring the control data.
   The reproduction system according to any one of claims 1 to 5.
7. The image data is an image that changes over time,
   The reproduction system according to any one of claims 1 to 6.
8. The control data and the image data have different recordable time lengths,
   The reproduction system according to any one of claims 1 to 7.
9. The display control unit simultaneously displays the control data and the image data in one screen,
   The reproduction system according to any one of claims 1 to 8.
10. A first acquisition unit that acquires control data including at least one of input data and output data of a control device that executes sequence control;
    A second acquisition unit for acquiring image data obtained by capturing an image of a control target of the control device;
    A recording control unit that records the control data and the image data in a recording device in a recording manner in which they are temporally associated with each other,
    Recording system.
11. A first acquisition step of acquiring control data including at least one of input data and output data of a control device that executes sequence control;
    A second acquisition step of acquiring image data obtained by photographing a control target of the control device;
    A display step of displaying the control data and the image data on a display device in a display mode in which they are temporally associated with each other,
    How to play.
12. A reproduction program for causing one or more processors to execute the reproduction method according to claim 11.
13. A first acquisition step of acquiring control data including at least one of input data and output data of a control device that executes sequence control;
    A second acquisition step of acquiring image data obtained by photographing a control target of the control device;
    A recording step of recording the control data and the image data in a recording device in a recording manner in which they are temporally associated with each other.
    Recording method.
14. A recording program for causing one or more processors to execute the recording method according to claim 13.

Images