JP2012053642A - Communication device, communication system, communication control method, and communication control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a communication device, a communication system, a communication control method, and a communication control program capable of easily resuming display of a material image if the material image is closed.SOLUTION: When a material image is closed because communication is disconnected between a material transmission device that is a communication device transmitting material images and an own device (S301: YES), a first icon is created (S303). When the material image is closed because the material transmission device stops transmitting material image data (S305: YES), a second icon is created (S307). When the material image is closed according to an instruction of a user who operates the own device (S309: YES), a third icon is created (S311). When the user selects any of the first to third icons, display of the material image is automatically resumed.

Description

  The present invention relates to a communication device, a communication system, a communication control method, and a communication control program capable of displaying an image of a document.

  2. Description of the Related Art Conventionally, communication apparatuses that share and display images of the same material between a plurality of communication devices installed at different locations and perform a conference or the like while referring to the materials are known. For example, in the image information transmission device for electronic conference described in Patent Document 1, image information and file names of materials necessary for presentation are transmitted from a device that is a material transmission source to a device that is a material transmission destination. . The transmission destination apparatus receives and stores image information, file names, and the like of the transmitted material. When the transmission source device user clicks an image to be presented, an identifier such as a file name is transmitted to the transmission destination device and received by the transmission destination device. The transmission destination device extracts image information corresponding to the received identifier such as a file name from the stored image information of the material, and displays it on the display device. As a result, the same image is displayed on the transmission source device and the transmission destination device.

Japanese Patent No. 3827621

  However, in the conventional communication apparatus, when the image of the document in the communication apparatus that is the transmission destination of the document is closed for some reason, the user of the communication apparatus that is the transmission destination wants to resume the display of the image of the document. Therefore, it is necessary to take a measure such as verbally requesting the transmission source user to re-send the image data, file name, etc. of the material. For this reason, there is a problem that it takes time to resume the display of the image of the material.

  An object of the present invention is to provide a communication device, a communication system, a communication control method, and a communication control program capable of easily resuming display of a document image when the document image is closed.

  The communication device according to the first aspect of the present invention transmits / receives material image data that is data of a common material image among a plurality of communication devices, and displays the material image based on the material image data on a display screen. When the document image based on the document image data transmitted from the document transmission device that is the communication device different from the own device that transmits the document image data is closed, Resumed display object creating means for creating a resume display object, which is a display object displayed on the display screen in order to accept an instruction from the user for resuming display of the document image, and created by the resume display object creating means Display restarting means for restarting the display of the document image on the display screen when the resumed display object is selected by a user. In this case, when the material is closed, a restart display object is automatically created. Then, when the user selects the resume display item, the display of the document image on the display screen is resumed. For this reason, the user can easily resume the display of the document image on the display screen only by selecting the resume display object.

  The communication device includes a cause identifying unit that identifies a cause of the document image being closed, and the display resuming unit is configured when the resuming display object created by the resuming display object creating unit is selected by a user. A predetermined process may be performed based on the cause specified by the cause specifying means, and the display of the material image on the display screen may be resumed. In this case, if the user selects the resume display item, the process is performed based on the cause specified by the cause specifying means, and the display of the document image on the display screen is automatically restarted. For this reason, it is not necessary for the user to specify the cause of the closing of the document image and to instruct an appropriate process. Therefore, user convenience is improved.

  In the communication device, the cause specifying means specifies the cause after the change when the cause once specified is changed to another cause, and the display restart means is the restart display object creating means. When the created resume display item is selected by the user, a predetermined process may be performed based on the cause after the change, and the display of the document image on the display screen may be resumed. In this case, even if the cause has changed, if the user selects the resume display item, the process is performed based on the cause identified by the cause identifying means, and the display of the document image on the display screen is automatically resumed. . For this reason, it is not necessary for the user to specify the cause of the closing of the document image and to instruct an appropriate process. Therefore, user convenience is improved.

  In the communication apparatus, the display resuming unit is configured to transmit the material transmission when the resumable display object created by the resumable display object creating unit is selected by a user and the cause identified by the cause identifying unit. When communication between the device and the device itself is disconnected, the communication between the material transmission device and the device is resumed, and the material image data transmitted from the material transmission device is used. The display of the document image on the display screen may be resumed. In this case, if the cause of the closing of the document image is that the communication between the document transmitting apparatus and the own apparatus is cut off, the communication is automatically restarted if the user selects the resume display item. Resume the display of the document image on the display screen. For this reason, user convenience is improved.

  In the communication apparatus, the display resuming unit is configured to transmit the material transmission when the resumable display object created by the resumable display object creating unit is selected by a user and the cause identified by the cause identifying unit. When the transmission of the material image data by the device is stopped, the material transmission device is requested to transmit the material image data, and the material image transmitted from the material transmission device in response to the request. The display of the material image on the display screen may be resumed based on the data. In this case, if the cause of the closing of the document image is that the transmission of the document image data has been stopped, if the user selects the resume display item, the document image is automatically transmitted to the document transmitting apparatus. A document image based on the document image data requested and transmitted in response to the request can be displayed. For this reason, user convenience is improved.

  In the communication apparatus, the display resuming unit is configured to display the cause of the display when the resuming display object created by the resuming display object creating unit is selected by a user and the cause identified by the cause identifying unit. When the display of the document image is closed in accordance with an instruction of the user who operates, by displaying the document image based on the document image data transmitted from the document transmission device on the display screen, The display of the image on the display screen may be resumed. In this case, if the cause of the closing of the document image is that the display of the document image is closed in accordance with the instruction of the user who operates the device, if the user selects the resume display object, the document transmission is automatically performed. A material image based on the material image data transmitted from the apparatus can be displayed. For this reason, user convenience is improved.

  The communication device includes: a band detection unit that detects a communication use band that is a communication band used for communication between the material transmission device and the own device; and the communication use band detected by the band detection unit. Is determined by the band determining unit to determine whether or not the communication use band detected by the band detecting unit is equal to or greater than a predetermined threshold. First parameter display object creation for creating a first parameter display object which is a display object displayed on the display screen in order to receive an instruction from the user to change a value of a predetermined parameter of the document image data And when the first parameter display object created by the first parameter display object creation means is selected by a user, An instruction to change the value of the parameter so as to reduce the data amount of data is transmitted from the material transmitting apparatus in response to an instruction by the first instructing means, and a first instructing means for transmitting to the material transmitting apparatus And a first display control means for displaying the material image based on the material image data to be displayed on the display screen. In this case, the data amount of the document image data can be reduced by the user selecting the first parameter display object when the communication use band is equal to or greater than the threshold. As a result, the communication band used for receiving the document image data can be reduced. For this reason, it is possible to prevent the display of the document image from being disturbed due to an increase in the communication use band.

  The communication device includes a load amount detection unit that detects a load amount of processing of the CPU in the own device, and whether or not the load amount of processing of the CPU detected by the load amount detection unit is equal to or greater than a predetermined threshold value. When it is determined by the load amount determination means that determines whether or not the load amount of the processing of the CPU detected by the load amount detection means is equal to or greater than a predetermined threshold, Second parameter display object creating means for creating a second parameter display object that is a display object displayed on the display screen in order to accept an instruction by the user for changing the value of a predetermined parameter of the document image data; When the second parameter display object created by the second parameter display object creation means is selected by the user, the data of the material image data A second instruction means for transmitting an instruction to change the value of the parameter to the material transmission apparatus so as to reduce the amount of data, and the material transmitted from the material transmission apparatus in response to an instruction from the second instruction means You may provide the 2nd display control means which displays the said document image based on image data on the said display screen. In this case, when the processing load of the CPU is equal to or greater than the threshold, the data amount of the document image data can be reduced by the user selecting the second parameter display object. As a result, the load on the CPU can be reduced. For this reason, disorder of the display of the document image due to a large amount of processing load on the CPU can be prevented.

  The communication device includes a file name receiving unit that receives a file name of the material image based on the material image data transmitted from the material transmitting device, and a storage unit that stores the file name received by the file name receiving unit. You may provide the memory | storage control means to memorize | store. In this case, the file name of the material image can be received and stored. Therefore, for example, the file name stored in the storage unit can be described in the display object.

  In the communication apparatus, the parameter may be at least one of a frame rate, a resolution, and a display size. In this case, the data amount can be reduced by changing at least one of the frame rate, resolution, and display size.

  The communication system according to the second aspect of the present invention transmits / receives material image data, which is data of material image common among a plurality of communication devices, and displays the material image based on the material image data on a display screen. In the communication system, the communication device closes the material image based on the material image data transmitted from the material transmission device which is the communication device different from the device transmitting the material image data. A restart display object creating means for creating a restart display object, which is a display object displayed on the display screen in order to accept an instruction from the user for resuming the display of the document image, and the restart display. When the resuming display object created by the object creating means is selected by the user, the display resuming method resumes the display of the document image on the display screen. It is equipped with a door. In this case, when the material is closed, a restart display object is automatically created. Then, when the user selects the resume display item, the display of the document image on the display screen is resumed. For this reason, the user can easily resume the display of the document image on the display screen only by selecting the resume display object.

  A communication control method according to a third aspect of the present invention transmits / receives material image data, which is data of material image common to a plurality of communication devices, and displays the material image based on the material image data on a display screen. A communication control method performed in a communication device capable of transmitting the document image data based on the document image data transmitted from the document transmission device that is the communication device different from the own device that transmits the document image data Reopen display object creation step of creating a resumption display object that is a display object displayed on the display screen in order to accept an instruction by the user about resuming display of the document image when When the resume display object created by the resume display object creation step is selected by the user, the display of the document image on the display screen is resumed. And a display resumption step to. In this case, when the material is closed, a restart display object is automatically created. Then, when the user selects the resume display item, the display of the document image on the display screen is resumed. For this reason, the user can easily resume the display of the document image on the display screen only by selecting the resume display object.

  A communication control program according to a fourth aspect of the present invention transmits / receives material image data, which is data of a common material image among a plurality of communication devices, and displays the material image based on the material image data on a display screen. A communication control program that is executed in a communication device that can be made to transmit to the CPU of the communication device from a material transmission device that is a communication device different from the device that transmits the material image data. When the document image based on the document image data is closed, a restart display object that is a display object to be displayed on the display screen is generated in order to receive an instruction from the user about resuming the display of the document image. When the user selects the resume display object creation step and the resume display object created by the resume display object creation step, Serial to execute and the resume display resumption step the display on the display screen of the document image. In this case, when the material is closed, a restart display object is automatically created. Then, when the user selects the resume display item, the display of the document image on the display screen is resumed. For this reason, the user can easily resume the display of the document image on the display screen only by selecting the resume display object.

1 is a block diagram showing a configuration of a video conference system 1. FIG. 3 is a block diagram showing an electrical configuration of a communication device 3. FIG. 3 is a conceptual diagram illustrating a storage area of an HDD 314. FIG. 3 is a conceptual diagram showing a storage area of a RAM 313. FIG. It is a figure which shows an example of the image displayed on the display. It is a flowchart which shows a 1st main process. It is a flowchart which shows an image sound process. It is a flowchart which shows an icon creation process. It is a figure which shows an example of the image displayed on the display. It is a figure which shows an example of the image displayed on the display. It is a flowchart which shows a 4th icon creation process. It is a figure which shows an example of the image displayed on the display. It is a flowchart which shows an icon execution process. It is a flowchart which shows a 4th icon execution process. It is a flowchart which shows a 2nd main process. It is a flowchart which shows the modification of a 4th icon creation process. It is a flowchart which shows the modification of a 4th icon execution process.

  Hereinafter, an embodiment of the communication devices 3, 4, 5 and the video conference system 1 according to the present invention will be described with reference to the drawings. These drawings are used for explaining the technical features that can be adopted by the present invention, and the configuration of the apparatus described, the flowcharts of various processes, and the like are not intended to be limited thereto. It is just an illustrative example.

  With reference to FIG. 1, the structure of the video conference system 1 which has the communication apparatuses 3, 4, and 5 in 1st embodiment as a component is demonstrated. The video conference system 1 includes a network 2, a communication device 3, a communication device 4, and a communication device 5. The communication devices 3, 4, 5 are connected to each other via the network 2. In the video conference system 1, a video conference is performed between the communication devices 3, 4, and 5 by transmitting and receiving image data, audio data, and the like via the network 2. In FIG. 1, three communication devices 3, 4, and 5 are connected to the network 2, but the number is not limited, and for example, 10 devices may be connected to the network 2. In the following description, when any one of the communication devices 3, 4 and 5 is not specified, it is simply referred to as “communication device”.

  The communication devices 3, 4, and 5 have the same electrical configuration, and the same program is set. A user who uses the communication device 4 is explaining using materials. The communication device 4 transmits material data to the communication devices 3 and 5. In the following description, a communication device operated by a user who is explaining using materials is referred to as a communication device 4 or a material transmission device.

  The electrical configuration of the communication devices 3, 4 and 5 will be described with reference to FIG. Since the electrical configurations of the communication devices 3, 4, and 5 are the same, the electrical configuration of the communication device 3 will be described here.

  The communication device 3 includes a notebook personal computer 31 (hereinafter referred to as PC 31) and an input / output device 34 (hereinafter referred to as IO device 34). The user can use the PC 31 and the IO device 34 to hold a video conference with the user who uses the communication devices 4 and 5. The IO device 34 can capture and encode an image, or decode and reproduce audio data of a video conference. The PC 31 is connected to the network 2 and can communicate various data with the communication devices 4 and 5.

  Details of the electrical configuration of the PC 31 will be described. The PC 31 includes a CPU 8 as a controller that controls the PC 31. Connected to the CPU 8 are a ROM 312 that stores BIOS and the like, a RAM 313 that temporarily stores various data, and a hard disk drive 314 (hereinafter referred to as HDD 314) having various storage areas. The CPU 8 can access various storage areas of the ROM 312, the RAM 313, and the HDD 314.

  The CPU 8 includes a communication interface 315 (hereinafter referred to as a communication I / F 315) for communicating with the network 2, an input unit 316 such as a touch panel installed on the front surface of a mouse, a keyboard, or a display 319, and a CD-ROM drive. 317 are connected to each other. The user can operate the input unit 316 to operate a pointer displayed on the display 319 and perform various inputs. A CD-ROM 318 inserted into the CD-ROM drive 317 stores, for example, various programs in the present embodiment. When the CD-ROM 318 is introduced, various programs and the like are set up from the CD-ROM 318 to the HDD 314 and stored in a program storage area 3141 to be described later.

  A video decoder 320 connected to the display 319 is connected to the CPU 8. In the present embodiment, the display 319 is externally attached to the PC 31. The video decoder 320 decodes the base image data and the material image data transmitted from the communication devices 4 and 5 and displays them on the display 319. The document image data is data for displaying a document image 3191 (described later). The video decoder 320 displays a pointer operated by the user of each communication device 3, 4, 5 on the display 319.

  A power control unit 322 is connected to the CPU 8. The power control unit 322 is connected to a battery 321 built in the PC 31. The power control unit 322 supplies the power supplied from the battery 321 to various circuits. The CPU 8 and other various devices are driven by power supplied from the battery 321 via the power control unit 322. Note that the power supply control unit 322 can charge the battery 321 by being connected to the AC adapter 323.

  The CPU 8 is connected to a timer 324 for measuring time. The CPU 8 can measure time using the timer 324. The CPU 8 is connected to a USB (Universal Serial Bus) interface 325 (hereinafter referred to as USB-I / F 325). The USB-I / F 325 is connected to a USB-I / F 351 of the IO device 34 to be described later via a USB cable 326. The CPU 8 can communicate with the CPU 9 of the IO device 34 via the USB-I / F 325, the USB cable 326, and the USB-I / F 351.

  Various storage areas of the HDD 314 will be described with reference to FIG. The HDD 314 is provided with at least a program storage area 3141. The program storage area 3141 stores program data necessary for the CPU 8 to execute various processes.

  Various storage areas of the RAM 313 will be described with reference to FIG. The RAM 313 is provided with at least a file name storage area 3131 and an icon type storage area 3132. The file name storage area 3131 stores file name data included in the material image data transmitted from the material transmitting device 4. The icon type storage area 3132 stores icon type data that is data corresponding to first to fourth icons 60 (described later) displayed on the display 319. For example, when the first icon 60 is displayed on the display 319, icon type data indicating that the icon 60 displayed on the display 319 is the first icon 60 is stored in the icon type storage area 3132. .

  Details of the electrical configuration of the IO device 34 will be described with reference to FIG. The IO device 34 includes a CPU 9 as a controller that controls the IO device 34. Connected to the CPU 9 are a ROM 342 that stores BIOS and the like, and a RAM 343 that temporarily stores various data. The CPU 9 can access various storage areas of the ROM 342 and the RAM 343.

  A video encoder 345 connected to the camera 344 is connected to the CPU 9. The CPU 9 uses the video encoder 345 to encode an image picked up by the camera 344 and creates base image data. The base image data is data of an image obtained by capturing the base where the communication device 3 is installed with the camera 344. The base image data is transmitted from the CPU 9 to the CPU 8 and transmitted to the communication devices 4 and 5 via the communication I / F 315 and the network 2.

  An audio encoder 346 is connected to the CPU 9. The audio encoder 346 is connected to the microphone 348 via the echo canceller 347. An audio decoder 349 is connected to the CPU 9. The audio decoder 349 is connected to the speaker 350 via the echo canceller 347. The echo canceller 347 is a circuit that prevents the occurrence of echo and howling. The microphone 348 is provided for collecting the voice of the user of the communication device 3 when performing a video conference. The voice input from the microphone 348 is encoded by the voice encoder 346. Then, the data is transmitted from the CPU 9 to the CPU 8 of the PC 31 and transmitted to the communication devices 4 and 5 via the communication I / F 315 and the network 2.

  The speaker 350 is provided for outputting the audio of the conference. Audio data transmitted from the communication devices 4 and 5 input via the network 2 and the communication I / F 315 is transmitted from the CPU 8 to the CPU 9, decoded by the audio decoder 349, and output as audio by the speaker 350. As a result, the user of the communication device 3 can listen to the audio of the video conference.

  A USB-I / F 351 is connected to the CPU 9. The USB-I / F 351 is connected to the USB-I / F 325 of the PC 31 via the USB cable 326. A power supply control unit 353 is connected to the CPU 9. The power control unit 353 is connected to the AC adapter 354. The power supply control unit 353 supplies the power of the external power supply supplied from the AC adapter 354 to various circuits. The CPU 9 and other various devices are driven by electric power supplied from the power supply control unit 353.

  With reference to FIG. 5, an example of an image displayed on the display 319 when a video conference is performed will be described. Here, an image displayed on the display 319 of the communication device 3 will be described. A base image 3192 of the communication device 4 different from the own device and a base image 3192 of the communication device 5 are displayed between the left end and the center of the display 319 in the left-right direction (the left-right direction of the paper in FIG. 5). Yes. The base images 3192 and 3193 are images taken by the camera 344 (see FIG. 2) of the communication devices 4 and 5. The base images 3192 and 3193 are displayed in the processing of S213 described later. A document image 3191 is displayed on the right side of the area where the base images 3192 and 3193 are displayed on the display 319. The material image 3191 is transmitted to the communication devices 3 and 5 from the communication device 4 which is a material transmission device. The user of the communication device 3 can hold a video conference while confirming the document image 3191 and the base images 3192 and 3193.

  In the communication devices 3, 4, and 5, the coordinate data of the pointers are mutually transmitted and received, and the pointer operated by the user of the communication devices 3, 4, and 5 is displayed on the display 319 based on the coordinate data. Is omitted. Further, an icon 60 is created on the display 319 in the process of S303 and the like (see FIG. 8) described later, and details will be described later.

  Next, an example of processing by the video conference system 1 will be described. In addition, although each process demonstrated below is a process performed in all the communication apparatuses 3, 4, and 5, in order to make description easy to understand, in each process, any of the communication apparatuses 3, 4, and 5 is described. This will be described as processing performed by the one communication device.

  First, the first main process will be described with reference to the flowchart shown in FIG. Here, the first main process by the CPU 8 of the PC 31 in the communication device 3 will be described.

  In the first main process, first, it is determined whether or not the communication apparatuses 4 and 5 different from the own apparatus are connected via the network 2 (S101). If not connected (S101: NO), it is determined whether or not a power-off instruction is input by the user via the input unit 316 (S108). If the power-off instruction has not been input (S108: NO), the process returns to S101 and is repeated. In the process of S101, when the communication apparatus 4 or 5 different from the own apparatus is connected (S101: YES), the audio / video process (see FIG. 7) is started (S102).

  Here, the image / sound processing will be described. The image / sound processing is processing for transmitting / receiving the document image data, the base image data, and the sound data and displaying them on the display 319 or outputting them from the speaker 350.

  As shown in FIG. 7, in the audio / video processing, first, it is determined whether or not the own device is a material transmitting device (S201). If it is not a material transmission device (S201: NO), the processing of S204 described later is performed. Since the communication device 3 is not a material transmission device, it is always determined that the communication device 3 is not a material transmission device.

  Further, when the CPU 8 of the communication device 4 that is the material transmission device performs the processing of S201, it is determined that the communication device 4 is the material transmission device (S201: YES), and the communication device 3 and 5 that transmits the material image data different from the own device. It is determined whether or not to transmit to (S202). The material image data is transmitted at a predetermined frame rate (for example, 15 fps). Therefore, in the process of S202, it is determined that the document image data is transmitted every time corresponding to the predetermined frame rate (S202: YES), and the document image data is created from the document image 3191 displayed on the display 319. Then, it is transmitted to the communication devices 3 and 5 different from the own device (S203). Note that the material image data created in the process of S203 includes data indicating the file name of the material image 3191. For example, it is assumed that the file name in this embodiment is “ABC”. When the document image data is not transmitted (S202: NO), the process of S204 is performed.

  Hereinafter, the processing by the CPU 8 of the communication device 3 will be described. In the process of S204, it is determined whether or not the base image data is transmitted to the communication apparatuses 4 and 5 different from the own apparatus (S204). The base image data is transmitted at a predetermined frame rate (for example, 15 fps). For this reason, in the process of S204, it is determined that the base image data is transmitted every time corresponding to a predetermined frame rate (S204: YES), and the base image data is created from the image captured by the camera 344. It is transmitted to communication devices 4 and 5 different from the own device (S205). The transmitted base image data is received in S212 (described later) of the communication devices 4 and 5, and is displayed on the display 319 of the communication devices 4 and 5 in S213 (described later). Next, the process of S206 is performed. Even when the base image data is not transmitted (S204: NO), the process of S206 is performed.

  In the process of S206, it is determined whether or not the audio data is transmitted to the communication apparatuses 4 and 5 different from the own apparatus (S206). The audio data is transmitted every predetermined time (for example, every second). In S206, it is determined that audio data is transmitted every predetermined time (S206: YES), audio data is created from the audio input from the microphone 348, and transmitted to the communication devices 4 and 5 different from the own device. (S207). Next, the process of S208 is performed. In the process of S206, the process of S208 is also performed when audio data is not transmitted (S206: NO).

  In the process of S208, it is determined whether or not the material image 3191 is displayed on the display 319. For example, if the user of the communication device 3 is set to display the document image 3191 on the display 319, such as when software for displaying the document image 3191 is started, the document image 3191 is displayed. Determination is made (S208: YES). Further, for example, if the user of the communication apparatus 3 has set the display of the document image 3191 so that the document image 3191 is not displayed, such as when the software for displaying the document image 3191 is closed, the document image 3191 must be displayed. Determination is made (S208: NO).

  When the document image 3191 is displayed on the display 319 (S208: YES), it is determined whether or not the document image data transmitted in the process of S203 of the document transmission device 4 is received (S209). If the document image data has not been received (S209: NO), the process of S212 described later is performed. When the document image data is received (S209: YES), the received document image data is decoded and displayed on the display 319 (S210). Thereby, for example, as shown in FIG. 5, a document image 3191 is displayed on the display 319. Next, the file name of the material image 3191 included in the material image data is stored in the file name storage area 3131 (S211).

  Next, it is determined whether or not the base image data transmitted in the process of S205 of the communication apparatuses 4 and 5 different from the own apparatus has been received (S212). In the process of S208, even when it is determined not to display the document image data on the display 319 (S208: NO), the process of S212 is performed. When the base image data is not received (S212: NO), the process of S214 described later is performed. When the base image data is received (S212: YES), the received base image data is decoded and displayed on the display 319 (S213). Thereby, for example, as shown in FIG. 5, base images 3192 and 3193 are displayed on the display 319.

  Next, it is determined whether or not the audio data transmitted in the process of S207 of the communication apparatuses 4 and 5 different from the own apparatus has been received (S214). If no audio data has been received (S214: NO), the process returns to S201 and the process is repeated. When audio data is received (S214: YES), the received audio data is decoded and output from the speaker 350 (S215). Next, the process returns to S201 and is repeated.

  Returning to the description of FIG. When the image / sound process is started in the process of S102, an icon creation process is then performed (S103). Here, the icon creation process will be described with reference to FIG. The icon creation process is a process of creating the first to third icons 60 or executing a fourth icon creation process to be described later when the document image 3191 is closed. The first to third icons are icons displayed on the display 319 in order to accept an instruction from the user about resuming the material image 3191. In the following description, the first to fourth icons 60 are created, and are all referred to as the first icon 60, the second icon 60, the third icon 60, and the fourth icon 60 using the same reference numerals. . Further, when any one of the first to fourth icons 60 is not specified, it is referred to as an icon 60. The first to fourth icons 60 are assumed to have the same appearance.

  In the icon creation process shown in FIG. 8, it is determined whether or not the communication between the communication device 4 as the material transmission device and the communication device 3 as the own device has been disconnected (S301). When the communication is disconnected, the document image 3191 is not displayed on the display 319 because the document image data cannot be received. That is, in the process of S301, it is determined whether or not the cause of closing the document image 3191 is that the communication has been cut off. Note that the cause of communication disconnection is, for example, that many applications other than those for video conferencing have been started up, resulting in an increase in the load on the CPU 8, or the result of sharing a large number of document images with each communication device. For example, when the bandwidth is greatly exceeded.

  When the document image 3191 is closed due to disconnection (S301: YES), the icon type data stored in the icon type storage area 3132 is referred to, and the icons 60 other than the first icon 60 are displayed. It is determined whether (that is, the second to fourth icons 60) have already been created (S302). If not created (S302: NO), the first icon 60 is created and displayed on the display 319 (S303). At this time, the file name of the document image 3191 stored in the file name storage area 3131 is referred to, and the file name is described and displayed on the first icon 60 (S304, S307, S308, S311, S312, which will be described later). The same applies to the case where the icon 60 is created or updated in S403 (see FIG. 11) and S404). In the process of S <b> 303, icon type data indicating that the icon 60 displayed on the display 319 is the first icon 60 is stored in the icon type storage area 3132.

  In the process of S302, if an icon 60 other than the first icon 60 has already been created (S302: YES), icon type data indicating that the icon 60 displayed on the display 319 is the first icon 60. Is updated and stored in the icon type storage area 3132, so that the icon 60 already created is updated as the first icon 60 (S304). When the process of S303 or S304 is performed, the icon creation process is terminated, and the process of S104 (see FIG. 6, described later) is performed.

  When the process of S303 or S304 is performed, for example, the screen shown in FIG. 9 is displayed on the display 319. In FIG. 9, since the communication between the material transmission device 4 and the communication device 3 is disconnected, the material image data cannot be received, and the material image 3191 displayed in FIG. 5 is not displayed. Further, since the base image data transmitted from the communication device 4 cannot be received, the base image 3192 of the communication device 4 is not displayed. In the process of S303 or S304, the first icon 60 is created and displayed on the upper left of the display 319. The first icon 60 displays the file name “ABC” stored in the file name storage area 3131 in the process of S211 (see FIG. 7).

  If it is determined that the communication is not disconnected in the process of S301 (S301: NO), the process of S305 is performed. In addition, after it is determined as “YES” in the process of S301 and the first icon 60 is created (S303 and S304), it is determined as “NO” every time the process of S301 is repeated, and the processes of S303 and S304 are performed. Is not repeated continuously (the same applies to the case where the second to fourth icons 60 are created when performing the processing of S305, S309, and S401 described later).

  In the process of S305, it is determined whether or not the material transmitting device 4 has stopped transmitting the material image data (S305). When the material transmission device 4 stops transmitting the material image data, the material image 3191 is not displayed on the display 319. That is, in the process of S305, it is determined whether or not the cause of the closing of the material image 3191 is that the material transmitting device 4 has stopped transmitting the material image data.

  When the document image 3191 is closed because the document transmission device 4 stops transmitting the document image data (S305: YES), the icon type data stored in the icon type storage area 3132 is referred to. It is determined whether an icon 60 other than the second icon 60 (that is, the first, third, and fourth icons 60) has already been created (S306). If not created (S306: NO), the second icon 60 is created and displayed on the display 319 (S307). In the processing of S307, icon type data indicating that the icon 60 displayed on the display 319 is the second icon 60 is stored in the icon type storage area 3132.

  In the process of S306, when an icon 60 other than the second icon 60 has already been created (S306: YES), icon type data indicating that the icon 60 displayed on the display 319 is the second icon 60. Is updated and stored in the icon type storage area 3132, so that the icon 60 already created is updated as the second icon 60 (S308). When the process of S307 or S308 is performed, the icon creation process is terminated, and the process of S104 (see FIG. 6, described later) is performed.

  When the processing of S307 or S308 is performed, for example, the screen illustrated in FIG. 10 is displayed on the display 319. In FIG. 10, since the transmission of the document image data is stopped, the document image 3191 displayed in FIG. 5 is not displayed. Unlike FIG. 9, since the base image data is received, the base image 3192 of the communication device 4 is displayed. In the process of S307 or S308, the second icon 60 is created and displayed on the upper left part of the display 319.

  If the material transmission device 4 has not stopped transmission of the material image data (S305: NO), it is determined whether or not the material image 3191 is closed according to an instruction of the user who operates the communication device 3 that is the device itself. (S309). The user operates the input unit 316 to input an instruction for closing the document image 3191 to the communication device 3. When the document image 3191 is closed according to the user's instruction (S309: YES), the icon type data stored in the icon type storage area 3132 is referred to, and the icons 60 other than the third icon 60 have already been created. It is determined whether or not (S310). If not created (S310: NO), the third icon 60 is created and displayed on the display 319 (S311). In the process of S 311, icon type data indicating that the icon 60 displayed on the display 319 is the third icon 60 is stored in the icon type storage area 3132.

  In the process of S310, when an icon 60 other than the third icon 60 has been created (S310: YES), icon type data indicating that the icon 60 displayed on the display 319 is the third icon 60 is displayed. The icon 60 that has been created is updated as the third icon 60 by being updated and stored in the icon type storage area 3132 (S312). When the process of S311 or S312 is performed, the icon creation process is terminated, and the process of S104 (see FIG. 6, described later) is performed.

  When the processing of S311 or S312 is performed, for example, a screen similar to FIG. 10 is displayed on the display 319. In FIG. 10, since the document image 3191 is closed, the document image 3191 displayed in FIG. 5 is not displayed. Unlike FIG. 9, since the base image data is received, the base image 3192 of the communication device 4 is displayed. Further, in the processing of S311 and S312, a third icon 60 is created and displayed on the upper left portion of the display 319.

  If it is determined in the process of S309 that the document image 3191 is not closed (S309: NO), a fourth icon creation process is performed (S313). Here, the fourth icon creation process will be described with reference to FIG. The fourth icon creation process is a process for creating the fourth icon 60 when the communication use band, which is the communication band used for communication, is equal to or greater than the threshold value. The fourth icon is an icon displayed on the display 319 in order to receive an instruction from the user about changing the frame rate value of the document image data transmitted from the document transmission device 4.

  As shown in FIG. 11, in the fourth icon creation process, first, the communication usage band is measured, and it is determined whether or not the measured communication usage band is equal to or greater than a predetermined threshold (S401). The predetermined threshold is, for example, 90% with respect to a communicable band that is a communication band that can be used in communication between bases. In this case, for example, when the communicable bandwidth is 640 kbps, the threshold is 576 kbps. The predetermined threshold may be arbitrarily set by the user. The predetermined threshold is a value that increases the possibility that the image of the material image 3191 displayed on the display 319 is distorted and displayed when the communication use band is equal to or higher than the predetermined threshold. Is set to Various known measurement methods can be used as a method for measuring the communication bandwidth. Various methods known in the art can be used as a method for acquiring a communicable band. For example, measurement may be performed during execution of the first main process or the like, or may be set in advance and stored in the HDD 314.

  If the communication bandwidth is equal to or greater than the predetermined threshold (S401: YES), the icon type data stored in the icon type storage area 3132 is referred to, and the icons 60 other than the fourth icon 60 (that is, the first icon It is determined whether (.about.third icon) has already been created (S402). If not created (S402: NO), the fourth icon 60 is created and displayed on the display 319 (S403). That is, the fourth icon 60 is created when the possibility that the image of the document image 3191 is disturbed and displayed increases. In the process of S 403, icon type data indicating that the icon 60 displayed on the display 319 is the fourth icon 60 is stored in the icon type storage area 3132.

  In the process of S402, if an icon 60 other than the fourth icon 60 has already been created (S402: YES), icon type data indicating that the icon 60 displayed on the display 319 is the fourth icon 60. Is updated and stored in the icon type storage area 3132, so that the icon 60 already created is updated as the fourth icon 60 (S404).

  When the processing of S403 or S404 is performed, for example, the screen shown in FIG. In FIG. 12, a fourth icon 60 is displayed on the upper left portion of the display 319. Although the communication use band is equal to or greater than the predetermined threshold value, the document image 3191 is displayed because the communication is not blocked. However, there is a high possibility that the image of the document image 3191 is displayed distorted.

  When the process of S403 or S404 is performed, or when it is determined in the process of S401 that the communication use band is not equal to or greater than the threshold (S401: NO), the fourth icon creation process is terminated, and FIG. The icon creation process shown is finished, and the process of S104 (see FIG. 6, described later) is performed.

  As shown in FIG. 6, in the process of S104, the icon 60 (that is, the first to fourth icons 60) created in the icon creation process and the fourth icon creation process (see FIGS. 8 and 11) is performed by the user. It is determined whether or not it has been selected (S104). Note that the user selects the icon 60 by clicking the icon 60 displayed on the display 319 via the input unit 316. When the icon 60 is not selected (S104: NO), the process of S106 described later is performed. When the icon 60 is selected (S104: YES), icon execution processing is performed (S105).

  The icon execution process will be described with reference to FIG. The icon execution process performs a process for resuming the display of the document image 3191 when the first to third icons 60 are selected by the user, and the fourth is performed when the fourth icon 60 is selected by the user. This is a process for executing an icon execution process.

  As illustrated in FIG. 13, in the icon execution process, it is determined whether or not the icon type data stored in the icon type storage area 3132 is data indicating that the icon is the first icon 60. It is determined whether or not the first icon 60 has been selected in the process (S501). When the first icon 60 is selected (S501: YES), a communication request signal that is a signal for requesting the material transmission device 4 to resume communication is transmitted to the material transmission device 4 in order to resume communication. Transmit (S502). The transmitted communication request signal is received in the process of S706 (see FIG. 15, described later) of the material transmitting apparatus 4, and the communication is resumed by the process of S707 (see FIG. 15, described later). That is, communication can be resumed by performing the process of S502.

  When communication is resumed, the document image data transmitted in the process of S203 of the document transmission apparatus 4 (see FIG. 7) is received in the process of S209 of the communication apparatus 3 (see FIG. 7). Then, a document image 3191 is displayed on the display 319 (S210, see FIG. 7). That is, the display of the document image 3191 on the display 319 is resumed. Next, the icon 60 is deleted from the display 319 (S509). Thereby, for example, the display on the display 319 changes from the state shown in FIG. 9 to the state shown in FIG. That is, when the first icon 60 is selected, the display of the document image 3191 on the display 319 is resumed. As described above, when the first icon 60 is selected by the user, the CPU 8 of the communication device 3 transmits a communication request signal to the material transmission device 4 to resume communication (S502), and the display 319 of the material image 3191 is displayed. The display is resumed (S210). In the process of S509, the icon type data stored in the icon type storage area 3132 is also deleted.

  If it is determined in the process of S501 that the first icon 60 is not selected (S501: NO), the icon type data stored in the icon type storage area 3132 indicates that the second icon 60 is stored. By determining whether or not the data is data, it is determined whether or not the second icon 60 is selected in the processing of S104 (S503). When the second icon 60 is selected (S503: YES), a material transmission request signal that is a signal for requesting transmission of the material image data to the material transmitting device 4 is transmitted (S504). The material transmission request signal transmitted in the process of S504 is received in the process of S704 (see FIG. 15, described later) of the material transmitting apparatus 4, and the transmission of the material image 3191 is performed in the process of S705 (see FIG. 15, described later). Resumed.

  When transmission of the document image 3191 is resumed, document image data is transmitted in the process of S203 of the document transmission apparatus 4 (see FIG. 7) and received in the process of S209 of the communication apparatus 3 (see FIG. 7). Then, a document image 3191 is displayed on the display 319 (S210, see FIG. 7). That is, the display of the document image 3191 on the display 319 is resumed. Next, the icon 60 is deleted from the display 319 (S509). Thereby, for example, the display on the display 319 changes from the state shown in FIG. 10 to the state shown in FIG. That is, when the second icon 60 is selected, the display of the document image 3191 on the display 319 is resumed. In this way, when the second icon 60 is selected by the user, the CPU 8 of the communication device 3 transmits a material transmission request signal to the material transmission device 4 (S504), and from the material transmission device 4 in response to the request. Based on the transmitted material image data, the display of the material image 3191 on the display 319 is resumed (S210).

  If it is determined in the processing of S503 that the second icon 60 has not been selected (S503: NO), the icon type data stored in the icon type storage area 3132 indicates that it is the third icon 60. By determining whether or not the data is data, it is determined whether or not the third icon 60 is selected in the processing of S104 (S505). When the third icon 60 is selected (S505: YES), the display of the material image 3191 on the display 319 is resumed (S506).

  In the process of S506, in order to restart the display of the document image 3191 on the display 319, for example, software for displaying the document image 3191 is started. That is, the document image 3191 is set to be displayed on the display 319. Accordingly, it is determined that the document image 3191 is displayed on the display 319 in the process of S208 (see FIG. 7) (S208: YES). Then, the material image data transmitted in the process of S203 of the material transmitting device 4 is received (S209: YES), and the display of the material image 3191 on the display 319 is resumed (S210, S506). Next, the icon 60 is deleted from the display 319 (S509). Thereby, for example, the display on the display 319 changes from the state shown in FIG. 10 to the state shown in FIG. That is, when the third icon 60 is selected, the display of the document image 3191 on the display 319 is resumed. As described above, when the third icon 60 is selected by the user, the CPU 8 of the communication device 3 resumes the display of the material image 3191 on the display 319 based on the material image data transmitted from the material transmitting device 4. .

  If it is determined in step S505 that the third icon 60 has not been selected (S505: NO), the icon type data stored in the icon type storage area 3132 indicates that the fourth icon 60 is stored. By determining whether or not the data is data, it is determined whether or not the fourth icon 60 is selected in the processing of S104 (S507). When the fourth icon 60 is selected (S507: YES), a fourth icon execution process is performed (S508).

  The fourth icon execution process will be described with reference to FIG. In the fourth icon execution process, an instruction to change the frame rate of the document image data transmitted from the material transmission device 4 is transmitted to the material transmission device 4 so that the communication use band becomes smaller than a predetermined threshold. It is.

  In the fourth icon execution process shown in FIG. 14, it is determined whether or not the frame rate of the document image data transmitted in the process of S203 of the document transmission apparatus 4 is the minimum setting (S601). In the present embodiment, it is assumed that the frame rate can be set in stages. Assume that the frame rates that can be set are, for example, 15 fps, 10 fps, 5 fps, and 1 fps. The initial setting state is assumed to be 15 fps. The minimum setting in the process of S601 is 1 fps.

  When the frame rate is not the minimum setting (S601: NO), a frame rate change instruction signal, which is an instruction to change the value of the frame rate, is sent to the material transmitting device 4 so that the data amount of the material image data is not reduced. It transmits to (S602). In this embodiment, it is assumed that the frame rate change instruction signal is a signal instructing to lower the frame rate of the document image data by one step.

  The frame rate change instruction signal transmitted in the process of S602 is received in the process of S708 of the material transmitting apparatus 4 (see FIG. 15), and in the process of S709, the frame rate of the document image data is lowered by one step. As a result, the frame rate of the material image data transmitted in the process of S203 of the material transmitting device 4 is lowered from 15 fps to 10 fps, for example, and the data amount is decreased. Then, the document image data with the frame rate lowered is received by the communication device 3 (S209: YES), and the document image 3191 is displayed (S210).

  When the process of S602 is performed, similarly to the process of S401 (see FIG. 11), the communication use band is measured, and it is determined whether or not the measured communication use band is equal to or greater than a predetermined threshold (S603). . That is, it is determined whether the communication use band after the frame rate transmitted from the material transmission device 4 is lowered is equal to or greater than a predetermined threshold. If the communication bandwidth is equal to or greater than the predetermined threshold (S603: YES), the process returns to S601 and the process is repeated. That is, the frame rate change instruction signal is transmitted until the communication use band becomes smaller than the threshold (S602), and the frame rate of the material image data transmitted from the material transmitting device 4 is decreased (S709, see FIG. 15). As a result, the amount of data is reduced and the communication bandwidth is smaller than the threshold value. That is, the image of the document image 3191 can be prevented from being displayed on the display 319 in a disordered manner.

  If the communication use band is not equal to or greater than the threshold (S603: NO), the fourth icon execution process is terminated. Note that the fourth icon execution process is also ended when it is determined that the frame rate is the minimum in the process of S601 (S601: YES). When the fourth icon execution process ends, the icon 60 is deleted from the display 319 as shown in FIG. 13 (S509).

  In the process of S509, when the first to fourth icons 60 are deleted from the display 319, the icon execution process ends. Note that, in the process of S507, also when it is determined that the fourth icon is not selected (S507: NO), the icon execution process is ended. When the icon execution process ends, as shown in FIG. 6, it is determined whether or not an instruction to end the video conference is input by the user via the input unit 316 (S106). If no termination instruction has been input (S106: NO), the process returns to S103 and the process is repeated. If an end instruction is input (S106: YES), the image / sound processing (see FIG. 7) is ended (S107). Next, it is determined whether or not a power-off instruction has been input by the user via the input unit 316 (S108). If a power-off instruction is input (S108: YES), the first main process is terminated.

  The second main process will be described with reference to the flowchart shown in FIG. The second main process is a process performed by the CPU 8 of the PC 31 in the communication device 4 that is a material transmission device.

  As shown in FIG. 15, in the second main process, first, it is determined whether or not the communication apparatuses 3 and 5 different from the own apparatus are connected via the network 2 (S701). If not connected (S701: NO), it is determined whether or not a power-off instruction is input by the user via the input unit 316 (S712). If no power-off instruction has been input (S712: NO), the process returns to S701 and the process is repeated. In the process of S701, if the communication apparatus 3 or 5 different from the own apparatus is connected (S701: YES), the image / sound process (see FIG. 7) is started (S702). Thereby, the base image data and the voice data are transmitted and received between the communication devices 3 and 5 and the communication device 4 different from the own device. Further, the material image data is transmitted to the communication devices 3 and 5 different from the own device (S203, see FIG. 7).

  Next, whether or not the transmission of the document image data by the process of S203 is stopped by determining whether or not the document image 3191 transmitted to the communication devices 3 and 5 different from the own device is closed according to the user's instruction. Is determined (S703). When the transmission of the document image data is stopped (S703: YES), whether or not the document transmission request signal transmitted in the process of S504 (see FIG. 13) of the communication devices 3 and 5 different from the own device is received. Is determined (S704). When the material transmission request signal has not been received, the process of S706 described later is performed. When the material transmission request signal is received (S704: YES), the material image 3191 is opened again, and transmission of the material image data is resumed (S705). As a result, transmission of the document image data from the material transmission device 4 to the communication devices 3 and 5 (S203, see FIG. 7) is resumed (S705).

  Next, it is determined whether or not a communication request signal transmitted in the process of S502 (see FIG. 13) of the communication apparatuses 3 and 5 different from the own apparatus has been received (S706). Note that, in the process of S703, even when it is determined that the transmission of the document image data is not stopped (S703: NO), the process of S706 is performed. When the communication request signal is received (S706: YES), communication with the communication devices 3 and 5 that have transmitted the communication request signal is resumed (S707). That is, the communication once disconnected is resumed. As a result, the document image data transmitted in the process of S203 (see FIG. 7) can be received by the communication devices 3 and 5 in which communication has been resumed (S209, see FIG. 7).

  Next, it is determined whether or not a frame rate change instruction signal transmitted in the process of S602 (see FIG. 14) of the communication apparatuses 3 and 5 different from the own apparatus has been received (S708). Even when it is determined in step S706 that a communication request signal has not been received (S706: NO), step S708 is performed. When the frame rate change instruction signal is received (S708: YES), the frame rate is lowered based on the frame rate change instruction signal (S709). For example, in the process of S203, if the document image data is transmitted at 15 fps, the document image data is transmitted at 10 fps, which is lowered by one step.

  Next, it is determined whether an instruction to end the video conference is input by the user via the input unit 316 (S710). Even when it is determined in the process of S708 that the frame rate change instruction signal has not been received (S708: NO), the process of S710 is executed. If no termination instruction has been input (S710: NO), the process returns to S703 and the process is repeated. When the end instruction is input (S710: YES), the image / sound processing (see FIG. 7) is ended (S711), and then the power off instruction is input by the user via the input unit 316. It is determined whether or not (S712). If a power-off instruction is input (S712: YES), the second main process is terminated.

  As described above, the processing in this embodiment is performed. When the document image 3191 is closed, the first to third icons 60 are automatically created in the processing of S303, S307, and S311 of FIG. When the first to third icons 60 are selected by the user, the processing of S502, S504, and S506 in FIG. 13 is performed, and the display of the document image 3191 on the display 319 is automatically resumed. For this reason, the user can easily restart the display of the document image 3191 on the display 319 only by selecting the first to third icons 60.

  Further, in the processes of S301, S305, and S309 in FIG. 8, the cause of the closing of the document image 3191 is specified, and the first to third icons 60 are created according to the cause (S303, S303 in FIG. 8). (See S307 and S311). Then, based on the types of the first to third icons 60, the processing of S502, S504, and S506 in FIG. 13 is performed, and the display of the document image 3191 on the display 319 is resumed. In other words, based on the cause of the closing of the document image 3191, the processing of S502, S504, and S506 in FIG. 13 is performed, and the display of the document image 3191 on the display 319 is resumed. For this reason, it is not necessary for the user to specify the cause of the closing of the document image 3191 and to instruct an appropriate process. Therefore, convenience for the user is improved.

  In addition, the icon 60 is updated in the processes of S304, S308, and S312 of FIG. When the processes of S304, S308, and S312 are performed, the icon 60 is once created for another cause, and the cause has changed. For example, after the third image 60 is created (S311) by closing the material image 3191 in the communication device 3 that is the device itself (S309: YES), communication between the communication device 3 and the material transmission device 4 is performed. Is disconnected (S301: YES), it is determined that an icon 60 other than the first icon 60 has been created (S302: YES), and the icon 60 displayed on the display 319 is updated to the first icon 60. (S304). When the first icon 60 is selected by the user (S104 in FIG. 6: YES, S501 in FIG. 13), a communication request signal is transmitted (S502) and received by the material transmitting device 4 (in FIG. 15). (S706: YES), the communication is resumed and the transmission of the document image data is resumed (S707). Thereby, in the communication apparatus 3, the display of the document image 3191 on the display 319 is resumed (S209 in FIG. 7: YES, S210).

  Thus, even if the cause changes, if the user selects the icon 60, the processing of S502, S504, and S506 in FIG. 13 is performed based on the cause after the change, and the display of the document image 3191 is performed. Display on 319 is resumed. For this reason, the user does not need to specify the cause of the closing of the document image 3191 and instruct an appropriate process. Therefore, user convenience is improved.

  Further, when the process of S502 in FIG. 13 is performed, the communication between the communication device 3 as the own device and the material transmission device 4 is disconnected (S301: YES in FIG. 8), and the first icon 60 is created. This is a case where the first icon 60 is selected by the user (S303 or S304 in FIG. 8) (S104: YES in FIG. 6, S501: YES in FIG. 13). In other words, if the cause of closing the document image 3191 is that the communication between the document transmission device 4 and the communication device 3 that is the device itself is disconnected, the user selects the first icon 60, The process of S502 is performed, communication is automatically resumed, and display of the document image 3191 on the display 319 is resumed. For this reason, the user must specify that the cause of closing the document image 3191 is that the communication has been cut off, and perform an instruction or the like to restart the communication and restart the display of the document image 3191. There is no. Further, it is not necessary to verbally request the user of the material transmission device 4 to resume communication. For this reason, user convenience is improved.

  Further, when the process of S504 in FIG. 13 is performed, the material transmission apparatus 4 stops transmitting the material image data (S305 in FIG. 8: YES), and the second icon 60 is created (S307 or S308). ), When the second icon 60 is selected by the user (S104 in FIG. 6: YES, S503 in FIG. 13: YES). That is, if the cause of closing the document image 3191 is that the transmission of the document image data is stopped, if the user selects the second icon 60, the process of S504 is automatically performed, and the document transmission is performed. Transmission of the document image data from the apparatus 4 is resumed (S705 in FIG. 15). Then, the display of the document image 3191 on the display 319 is resumed. For this reason, the user specifies that the cause of closing the document image 3191 is that the document transmission apparatus 4 has stopped transmitting the document image data, and requests the document transmission apparatus 4 to transmit the document image data. Thus, there is no need to give an instruction to resume the display of the document image 3191. Further, there is no need to verbally request the user of the material transmitting device 4 to retransmit the material image data. For this reason, user convenience is improved.

  Further, when the process of S506 in FIG. 13 is performed, the display of the document image 3191 on the display 319 is closed according to the instruction of the user who operates the device (S309: YES in FIG. 8), and the third icon is created. (S311 or S312 in FIG. 8) and the third icon 60 is selected by the user (S104: YES in FIG. 6, 505: YES in FIG. 13). In other words, when the cause of closing the document image 3191 is that the display of the document image 3191 is closed in accordance with an instruction of the user who operates the device, if the user selects the third icon 60, the document is automatically updated. The display of the image 3191 can be resumed (S506). For this reason, user convenience is improved.

  Further, when the process of S602 in FIG. 14 is performed, it is determined that the communication use band between the own device and the material transmission device 4 is equal to or greater than the threshold (S401: YES in FIG. 11), and the fourth icon 60 is displayed. Is created (S403 or S404 in FIG. 11), and the fourth icon 60 is selected by the user (S104 in FIG. 6: YES, S507 in FIG. 13: YES). That is, when the communication bandwidth is equal to or greater than the threshold, the user can reduce the data amount of the material image data by selecting the fourth icon. As a result, the communication band used for receiving the document image data can be reduced. Therefore, it is possible to prevent the display of the document image 3191 from being disturbed due to an increase in the communication use band.

  In addition, in the process of S209 in FIG. 7, data indicating the file name included in the document image data is received, and the file name can be stored in the file name storage area 3131 in the process of S211. For this reason, referring to the stored file name, the file name can be written in the first to fourth icons 60.

  In the above embodiment, the communication devices 3, 4, 5 and the PC 31 correspond to the “communication device” of the present invention. The display 319 corresponds to the “display screen” of the present invention, and the first to third icons 60 correspond to the “resume display object” of the present invention. The CPU 8 that performs the processes of S303, S304, S307, S308, S311, and S312 in FIG. 8 corresponds to the “resumed display object creation means” of the present invention, and performs the processes of S502, S504, and S506 in FIG. The CPU 8 that performs the process of resuming the display of the document image 3191 in S210 in FIG. 7 corresponds to the “display resuming unit” of the present invention. The CPU 8 that performs the processes of S301, S305, and S309 in FIG. 8 corresponds to the “cause identifying unit” of the present invention.

  In the process of S401 of FIG. 11, the CPU 8 that performs the process of detecting the communication use band corresponds to the “band detection unit” of the present invention. In the process of S401 of FIG. 11, is the communication use band equal to or greater than a predetermined threshold? The CPU 8 that determines whether or not corresponds to the “band determination unit” of the present invention. The frame rate corresponds to the “parameter” of the present invention, and the fourth icon 60 corresponds to the “first parameter display object” of the present invention. The CPU 8 that performs the processing of S403 and S404 in FIG. 11 corresponds to the “first parameter display object creation means” of the present invention, and the CPU 8 that performs the processing of S602 in FIG. 14 corresponds to the “first instruction means” of the present invention. . The CPU 8 that performs the process of S210 in FIG. 7 corresponds to the “first display control means” of the present invention.

  In the processing of S209 in FIG. 7, the CPU 8 that receives the data indicating the file name included in the document image data corresponds to the “file name receiving means” of the present invention, and the file name storage area 3131 is the “storage means” of the present invention. It corresponds to. The CPU 8 that performs the processing of S211 in FIG. 7 corresponds to the “storage control unit” of the present invention, and the video conference system 1 corresponds to the “communication system” of the present invention. The processing of S303, S304, S307, S308, S311, and S312 in FIG. 8 corresponds to the “icon creation step” of the present invention, and the processing of S502, S504, and S506 in FIG. The process of restarting the display of 3191 corresponds to the “display restart step” of the present invention.

  In addition, this invention is not limited to said embodiment, A various change is possible. For example, in the processing of S601 and S602 of FIG. 14, the frame rate change instruction signal is transmitted so as to reduce the data amount by reducing the frame rate, but the present invention is not limited to this. For example, the instruction signal may be transmitted to the material transmitting device 4 so as to reduce the data amount by reducing the resolution and display size of the material image data instead of the frame rate. Even in this case, the data amount of the material image data transmitted from the material transmitting device 4 can be reduced, and the display disorder of the material image 3191 can be prevented. Further, the frame rate, resolution, display size, and the like of the base image data may be reduced so as to reduce the data amount of the base image data instead of reducing the data amount of the material image data. Even in this case, the data amount of the base image data transmitted from the material transmitting device 4 can be reduced, and display disorder of the base image 3192, 3193 and the material image 3191 can be prevented.

  In the process of S602 in FIG. 14, the frame rate change instruction signal is transmitted so as to lower the frame rate by one step. However, the present invention is not limited to this. For example, the frame rate change instruction signal may be transmitted so as to change the frame rate to an arbitrary numerical value.

  Moreover, although the 1st-4th icon 60 is not divided and described on the external appearance, it is not limited to this. For example, the shape and color of each of the first to fourth icons 60 may be changed so that they can be displayed on the display 319 so as to be distinguishable from other icons.

  Further, although the icon 60 is updated in the processing of S304, S308, S312 of FIG. 8 and S404 of FIG. 11, the present invention is not limited to this. For example, instead of updating the icon 60, a new icon 60 may be displayed on the display 319 in addition to the icon 60 that has already been created. That is, the icon 60 may be created for each cause of the material image 3191 being closed.

  In the processes of S303, S304, S307, S308, S311, S312, S403, and S404, the first to fourth icons 60 are created and updated. However, the present invention is not limited to this. For example, instead of the icon 60, a menu button displayed on the display 319 may be created and updated by pressing the right mouse button. Further, buttons that can be selected by the input unit 316 may be created and updated on the screen of the video conference application displayed on the display 319. Also, a shortcut menu or the like may be created and updated in the menu item of the video conference application. Thus, instead of the first to fourth icons, various display objects for receiving instructions from the user may be created and updated.

  Further, in the fourth icon creation process shown in FIG. 11 and the fourth icon execution process shown in FIG. 14, the process is performed based on the frame rate so as to prevent the display of the document image 3191 from being disturbed. It is not limited to. For example, display disorder of the document image 3191 may be prevented based on the load amount of the CPU 8. Hereinafter, a specific description will be given with reference to FIGS. 16 and 17.

  16 is a modification of the fourth icon creation process shown in FIG. 11, and FIG. 17 is a modification of the fourth icon execution process shown in FIG. In FIG. 16 and FIG. 17, processes similar to those in FIG. 11 and FIG. 14 are denoted by the same reference numerals, and detailed description thereof is omitted.

  As shown in FIG. 16, in the modified example of the fourth icon creation process, first, the process load of the CPU 8 is measured, and it is determined whether or not the measured process load is equal to or greater than a predetermined threshold. (S801). The predetermined threshold is 95%, for example. The maximum load amount that can be processed by the CPU 8 is 100%. As for the predetermined threshold, if the load amount is equal to or greater than the predetermined threshold, processing of the document image data is delayed, and the possibility that the image of the document image 3191 displayed on the display 319 is displayed distorted is increased. Is set to a value. As a method for measuring the load amount of the CPU 8, various known measurement methods can be used.

  If the load amount is equal to or greater than the predetermined threshold (S801: YES), the process of S402 is performed. If no icon 60 other than the fourth icon 60 is created (S402: NO), the fourth icon 60 is created and displayed on the display 319 (S403). If it is created (S402: YES), the icon 60 that has already been created is updated as the fourth icon (S404). That is, the fourth icon 60 is created when the possibility that the image of the document image 3191 is disturbed and displayed increases. When the process of S403 or S404 is performed, or when it is determined in the process of S801 that the load amount of the CPU 8 is not equal to or greater than the predetermined threshold (S801: NO), the fourth icon creation process is terminated, The icon creation process shown in FIG. 8 is terminated, and the process of S104 (see FIG. 6) is performed.

  Next, FIG. 17 will be described. As shown in FIG. 17, in the modified example of the fourth icon execution process, it is determined whether or not the frame rate of the document image data transmitted in the process of S203 of the document transmission apparatus 4 is the minimum setting ( S601). When the frame rate is not the minimum setting (S601: NO), a frame rate change instruction signal is transmitted (S602). When the frame rate change instruction signal is transmitted, it is determined whether or not the load amount of the CPU 8 is equal to or greater than a predetermined threshold (S901).

  If the load amount is equal to or greater than the predetermined threshold (S901: YES), the process returns to S601 and the process is repeated. That is, the frame rate change instruction signal is transmitted until the load amount becomes smaller than the predetermined threshold (S602), and the frame rate of the material image data transmitted from the material transmitting device 4 is decreased (S709, see FIG. 15). As a result, the data amount is reduced, and the load amount of the CPU 8 becomes smaller than the threshold value. In other words, the image of the document image 3191 can be prevented from being displayed on the display 319 because it is disturbed.

  If the load amount of the CPU 8 is not equal to or greater than the predetermined threshold (S901: NO), the fourth icon execution process is terminated. Note that the fourth icon execution process is also ended when it is determined that the frame rate is the minimum in the process of S601 (S601: YES).

  As described above, the process in the modified example is performed. In the modification, when the process of S602 in FIG. 17 is performed, it is determined that the load amount of the CPU 8 is equal to or greater than the threshold (S801: YES in FIG. 16), and the fourth icon 60 is created (S403 in FIG. 16). Or it is a case where the 4th icon 60 is selected by the user (S104: YES of FIG. 6, S507: YES of FIG. 13). That is, when the load amount of the CPU 8 is equal to or greater than the threshold value, the data amount of the document image data can be reduced by the user selecting the fourth icon. As a result, it is possible to reduce the load of the CPU 8 necessary for processing the document image data. Therefore, it is possible to prevent the display image 3191 from being disturbed due to a large load on the CPU 8.

  In the above modification, the CPU 8 that performs the process of detecting the load amount of the CPU 8 in the process of S801 in FIG. 16 corresponds to the “load amount detection means” of the present invention. In the process of S801 in FIG. The CPU 8 that determines whether or not it is equal to or greater than the threshold corresponds to the “load amount determination means” of the present invention. The fourth icon 60 created by the processing of S403 and S404 in FIG. 16 corresponds to the “second parameter display object” of the present invention. The CPU 8 that performs the processing of S403 and S404 in FIG. 16 corresponds to the “second parameter display object creation means” of the present invention, and the CPU 8 that performs the processing of S602 in FIG. 17 corresponds to the “second instruction means” of the present invention. . The CPU 8 that performs the process of S210 in FIG. 7 corresponds to the “second display control means” of the present invention.

DESCRIPTION OF SYMBOLS 1 Video conference system 2 Network 3, 4, 5 Communication apparatus 31 Personal computer 34 Input / output device 60 1st-4th icon 316 Input part 319 Display 3131 File name storage area 3132 Icon kind storage area 3141 Program storage area 3191 Document image

Claims (13)

A communication device capable of transmitting / receiving material image data, which is data of a common material image among a plurality of communication devices, and displaying the material image based on the material image data on a display screen,
About resuming display of the document image when the document image based on the document image data transmitted from the document transmission device which is the communication device different from the own device that transmits the document image data is closed Resuming display object creating means for creating a resuming instruction object which is a display object displayed on the display screen in order to accept an instruction by the user;
A communication apparatus comprising: a display restarting unit that restarts the display of the document image on the display screen when the restart display object created by the restart display object creating unit is selected by a user. . A cause identifying means for identifying the cause of the closing of the document image;
The display resuming unit performs a predetermined process based on the cause identified by the cause identifying unit when the resumed display item created by the resume displayed item creating unit is selected by a user. The communication apparatus according to claim 1, wherein display of an image on the display screen is resumed. The cause identifying means identifies the cause after the change when the cause once identified is changed to another cause,
The display resuming unit performs a predetermined process based on the cause after the change when the resuming display object created by the resuming display object creating unit is selected by a user, and the display screen of the document image The communication apparatus according to claim 2, wherein display on the network is resumed.   The display resuming unit is configured such that when the resuming display object created by the resuming display object creating unit is selected by a user, and the cause identified by the cause identifying unit is the material transmitting apparatus and the own apparatus. When the communication between the document transmitting apparatus and the own apparatus is disconnected, the display of the document image based on the document image data transmitted from the document transmitting apparatus is resumed. 4. The communication apparatus according to claim 2, wherein display on the screen is resumed.   The display resuming unit is configured such that when the resuming display object created by the resuming display object creating unit is selected by a user, the cause specified by the cause specifying unit is the material image by the material transmitting device. When the transmission of data is stopped, the material transmission device is requested to transmit the material image data, and based on the material image data transmitted from the material transmission device in response to the request, The communication apparatus according to claim 2, wherein the display of the document image on the display screen is resumed.   The display resuming means, when the resumable display object created by the resumable display object creating means is selected by a user, and the cause identified by the cause identifying means is an instruction from the user who operates the device When the display of the document image is closed according to the display of the document image, the document image based on the document image data transmitted from the document transmission device is displayed on the display screen. The communication apparatus according to claim 2, wherein display on the network is resumed. Band detecting means for detecting a communication use band that is a communication band used for communication between the material transmitting apparatus and the own apparatus;
Band judging means for judging whether or not the communication use band detected by the band detecting means is a predetermined threshold value or more;
A user about changing a value of a predetermined parameter of the document image data when the band determination unit determines that the communication use band detected by the band detection unit is equal to or greater than a predetermined threshold. A first parameter display object creating means for creating a first parameter display object which is a display object displayed on the display screen in order to receive an instruction by:
When the first parameter display object created by the first parameter display object creation means is selected by a user, an instruction to change the value of the parameter so that the data amount of the material image data is reduced, First instruction means for transmitting to the material transmitting device;
The first display control means for displaying the material image based on the material image data transmitted from the material transmitting device in response to an instruction from the first instruction means on the display screen. Item 7. The communication device according to any one of Items 1 to 6. Load amount detection means for detecting the load amount of processing of the CPU in its own device;
Load amount determination means for determining whether or not the load amount of the processing of the CPU detected by the load amount detection means is equal to or greater than a predetermined threshold;
When the load amount determination unit determines that the load amount of the processing of the CPU detected by the load amount detection unit is equal to or greater than a predetermined threshold, the value of the predetermined parameter of the material image data is set. Second parameter display object creating means for creating a second parameter display object, which is a display object displayed on the display screen in order to accept an instruction by the user about changing,
When the second parameter display object created by the second parameter display object creation means is selected by a user, an instruction to change the parameter value so that the data amount of the material image data is reduced, Second instruction means for transmitting to the material transmitting device;
And a second display control unit configured to display the material image based on the material image data transmitted from the material transmission device in response to an instruction from the second instruction unit on the display screen. Item 8. The communication device according to any one of Items 1 to 7. File name receiving means for receiving a file name of the material image based on the material image data transmitted from the material transmitting device;
9. The communication apparatus according to claim 1, further comprising storage control means for storing the file name received by the file name receiving means in a storage means.   The communication apparatus according to claim 7, wherein the parameter is at least one of a frame rate, a resolution, and a display size. A communication system capable of transmitting / receiving document image data that is data of a document image common between a plurality of communication devices and displaying the document image based on the document image data on a display screen,
The communication device
About resuming display of the document image when the document image based on the document image data transmitted from the document transmission device which is the communication device different from the own device that transmits the document image data is closed Resuming display object creating means for creating a resuming display object that is a display object displayed on the display screen in order to receive an instruction by the user;
And a display restarting means for restarting the display of the document image on the display screen when the restart display object created by the restart display object creating means is selected by a user. . A communication control method performed in a communication device capable of transmitting / receiving material image data, which is data of a common material image among a plurality of communication devices, and displaying the material image based on the material image data on a display screen. There,
About resuming display of the document image when the document image based on the document image data transmitted from the document transmission device which is the communication device different from the own device that transmits the document image data is closed A resume display object creation step of creating a resume display object that is a display object displayed on the display screen in order to receive an instruction from the user;
A communication resumption step comprising: a display resuming step of resuming display of the material image on the display screen when the resumable display object created in the resuming display object creation step is selected by a user. Method. A communication control program executed in a communication device capable of transmitting / receiving material image data, which is data of material image common among a plurality of communication devices, and displaying the material image based on the material image data on a display screen Because
In the CPU of the communication device,
About resuming display of the document image when the document image based on the document image data transmitted from the document transmission device which is the communication device different from the own device that transmits the document image data is closed A resume display object creation step of creating a resume display object that is a display object displayed on the display screen in order to receive an instruction from the user;
And a display resuming step of resuming display of the document image on the display screen when the resumable display object created in the resuming display object creation step is selected by a user. program.

Images