JP5636747B2 - Communication terminal, communication system, communication method, and computer program - Google Patents

Description

  The present invention relates to a communication terminal that performs communication via a network, and more particularly, to a communication terminal, a communication system, a communication method, and a computer program having a voice communication function and a photographing function for photographing the surroundings.

  Communication terminals having a voice communication function and a photographing function are generally known. For example, as such a communication terminal, a mobile phone with a camera or the like is widely used. As such a general communication terminal, there is one that can share a captured image during voice communication. Here, sharing of a captured image during voice communication means that a captured image captured by one communication terminal during voice communication is transmitted to the other communication terminal to continue voice communication while being displayed on both communication terminals. That means.

  For example, such a communication terminal shares a captured image during voice communication using an electronic mail function. Specifically, such a communication terminal uses a shooting function activated by a user during voice communication to capture a surrounding image and save a captured image. Then, such a communication terminal further uses the electronic mail function activated by the user to transmit the stored photographed image to the communication terminal of the communication destination as an attached file of the electronic mail. Subsequently, such a communication terminal further displays a captured image during voice communication using an image display function activated by the user. On the other hand, when the communication terminal of the communication destination receives an e-mail attached with a captured image during voice communication, the received communication image is displayed using an image display function activated by the user.

  In addition, as another communication terminal that shares a captured image during voice communication in this way, a device that transmits and receives a surrounding captured image as presence information indicating whether or not there is a call partner around the communication terminal of the communication destination. Yes (see, for example, Patent Document 1).

  The communication terminal described in Patent Document 1 registers in advance with a server and logs in to the server. And this communication terminal acquires the information regarding the communication terminal of the user who is logging in to the server among the user lists set in advance from the server. Furthermore, this communication terminal transmits and receives a captured image as presence information to and from the communication terminal of the user who is logged in to the server, using the acquired information.

  In addition, as other such communication terminals, a display switching key for switching display of the operation screen and the captured image, an image input switching key for switching display of the captured image and the external input image, and the displayed image are transmitted or stored in a storage medium A cellular phone having a transmission storage switching key for switching between storing and notifying is known (for example, see Patent Document 2).

  When the display switch key and the image input switch key are pressed during voice communication and display of a captured image is selected, the mobile phone described in Patent Document 2 displays the captured image being captured by the capturing device on the display device. indicate. Then, when the transmission storage switch key is further pressed and transmission of the photographed image is selected, the cellular phone transmits the displayed photographed image to the communication destination cellular phone.

  Another example of such a communication terminal is a portable communication device that has a plurality of cameras and transmits / receives captured images captured by the plurality of cameras to / from a communication terminal that is a voice communication destination (for example, Patent Documents). 3).

  When one or more of a plurality of cameras are selected during voice communication, the mobile communication device described in Patent Document 3 captures a captured image being captured by the selected camera, and the terminal and the communication. It is displayed on one or more windows in the display screen of the previous communication terminal.

JP 2004-214934 A Japanese Patent No. 3397163 Patent No. 4203246

  However, in a communication terminal that shares a captured image using an electronic mail function during voice communication, the operation by the user is complicated.

  For example, in such a communication terminal, although an operation for designating a communication destination communication terminal has already been performed at the start of voice communication, the communication destination communication terminal is used as a transmission destination of an e-mail attached with a captured image. The operation for specifying the e-mail address is required again. Moreover, in such a communication terminal, in order to display the transmitted / received captured image, an operation for starting an image display function is required during voice communication. Furthermore, in such a communication terminal, there may be a case where an operation for selecting a captured image to be displayed by the image display function is required.

  In the communication terminal described in Patent Document 1, a login operation is first required in order to share a captured image during voice communication. Furthermore, in this communication terminal, an operation for designating the other party who is logged in as the other party to transmit / receive the captured image is required. As described above, even in the communication terminal described in Patent Document 1, an operation for sharing a captured image during voice communication is complicated.

  In addition, the communication terminal described in Patent Document 2 enables sharing of a captured image during voice communication with a simple button operation. For this purpose, the shooting function and the image display function are simultaneously activated. Therefore, the communication terminal described in Patent Document 2 has a problem of consuming a large amount of resources such as a memory when sharing a captured image during voice communication.

  In addition, the communication terminal described in Patent Document 3 enables sharing of captured images by a plurality of cameras during voice communication with a simple operation of selecting a camera. The function is activated at the same time. Therefore, the communication terminal described in Patent Document 3 also has a problem of consuming a large amount of resources such as a memory when sharing a captured image during voice communication.

  The present invention has been made to solve the above-described problems, and reduces the complexity of operation without increasing the resource consumption of communication terminals when sharing captured images between communication terminals performing voice communication. It is an object of the present invention to provide a communication system that can do the above.

  The communication system of the present invention is a communication system including a communication terminal on the transmission side and a communication terminal on the reception side that communicate via a network, and the communication terminal on the transmission side is connected to the communication terminal on the reception side and a voice. A voice communication unit that performs communication, a shooting unit that acquires a shot image by shooting the periphery of the communication terminal on the transmission side, an image storage unit that stores the shot image, and a shooting stored in the image storage unit An image display unit that displays an image, an image transmission unit that transmits the captured image to the communication terminal on the reception side, and display request information that requests to display the captured image on the communication terminal on the reception side, When the captured image is acquired by the imaging unit during the voice communication, the display request transmitting unit that transmits to the communication terminal on the reception side, and after the imaging by the imaging unit is terminated, the acquired captured image is An image display unit, and a captured image display control unit that causes the image transmission unit and the display request transmission unit to transmit the captured image and the display request information. A voice communication unit that performs voice communication with a communication terminal on the transmission side, an image reception unit that receives the captured image from the communication terminal on the transmission side, and a display request reception that receives the display request information from the communication terminal on the transmission side An image storage unit that stores the captured image received by the image receiving unit, an image display unit that displays the captured image stored in the image storage unit, and the display request receiving unit during the voice communication. A reception image display control unit configured to display a captured image indicated by the display request information on the image display unit when the display request information is received.

  The communication terminal of the present invention is a communication terminal that communicates with another communication terminal via a network, and captures a voice communication unit that performs voice communication with the other communication terminal and a surrounding area of the terminal itself. An image storage unit that acquires a captured image, an image storage unit that stores the captured image, an image display unit that displays the captured image stored in the image storage unit, and the captured image to the other communication terminal. An image transmitting unit for transmitting, a display request transmitting unit for transmitting display request information for requesting the captured image to be displayed on the other communication terminal, and a capturing request by the capturing unit during the voice communication. When the photographed image is acquired, after the photographing by the photographing unit is terminated, the obtained photographed image is displayed on the image display unit, and the photographed image is displayed on the image transmission unit and the display request transmission unit. Comprising a captured image display control unit for transmitting a finely the display request information.

  The communication terminal of the present invention is a communication terminal that communicates with another communication terminal via a network, and a voice communication unit that performs voice communication with the other communication terminal, and a periphery of the other communication terminal. An image reception unit that receives a captured image from the other communication terminal, a display request reception unit that receives display request information for requesting display of the captured image from the other communication terminal, and the image reception unit. The display request information is received by the image storage unit that stores the received captured image, the image display unit that displays the captured image stored in the image storage unit, and the display request receiving unit during the voice communication. And a received image display control unit that causes the image display unit to display a captured image indicated by the display request information.

  Further, the communication method of the present invention is a communication system including a transmission-side communication terminal and a reception-side communication terminal that perform communication via a network, wherein the transmission-side communication terminal and the reception-side communication terminal perform voice communication. The transmitting communication terminal acquires a captured image by capturing the surroundings of the transmitting communication terminal using the capturing unit, stores the captured image in an image storage unit, and Shooting is terminated, the captured image stored in the image storage unit is displayed on the image display unit, and the captured image and display request information for requesting display of the captured image are transmitted to the communication terminal on the receiving side, The receiving communication terminal receives the captured image and the display request information, stores the received captured image in an image storage unit, and causes the image display unit to display the captured image indicated by the display request information.

  Further, the computer program of the present invention includes a communication terminal that communicates with another communication terminal via a network, a voice communication start step for starting voice communication with the other communication terminal, and the other communication terminal. During the voice communication, a shooting step for causing the shooting unit to take a picture of the surroundings of the terminal and acquiring a shot image, a shooting end step for ending shooting by the shooting unit, and a shooting for displaying the shot image on the image display unit An image display step, a captured image, and a captured image display request transmission step of transmitting display request information requesting display of the captured image to the other communication terminal are executed.

  Further, the computer program of the present invention provides a communication terminal that communicates with another communication terminal via a network, a photographed image obtained by photographing the periphery of the other communication terminal, and a display requesting display of the photographed image. A captured image display request receiving step of receiving request information from the other communication terminal, and an image display step of displaying a captured image indicated by the display request information on an image display unit are executed.

  ADVANTAGE OF THE INVENTION According to this invention, when sharing a picked-up image between the communication terminals which perform audio | voice communication, the communication system which reduces the complexity of operation, without increasing the resource consumption of a communication terminal can be provided.

It is a block diagram which shows the structure of the communication system as the 1st Embodiment of this invention. It is a hardware block diagram of the communication terminal in the 1st Embodiment of this invention. It is a functional block diagram of the communication system as a 1st embodiment of the present invention. It is a flowchart explaining operation | movement of the communication system as the 1st Embodiment of this invention. It is a functional block diagram of the communication system as the 2nd Embodiment of this invention. It is a figure which shows an example of the display request information in the 2nd Embodiment of this invention. It is a flowchart explaining operation | movement of the communication system as the 2nd Embodiment of this invention.

  Embodiments of the present invention will be described below with reference to the drawings.

(First embodiment)
First, FIG. 1 shows a configuration of a communication system 1 as a first embodiment of the present invention.

  In FIG. 1, a communication system 1 includes a communication terminal 10a on the transmission side and a communication terminal 10b on the reception side (hereinafter also collectively referred to as communication terminal 10). The communication terminals 10a and 10b are connected to each other via a network 9 constituted by the Internet, a LAN (Local Area Network), a public line network, a wireless communication network, or a combination thereof.

  Although FIG. 1 shows one communication terminal 10a and one communication terminal 10b, the number of communication terminals on the transmission side and the number of communication terminals on the reception side in the present invention are not limited.

  Next, the hardware configuration of the communication terminal 10 is shown in FIG. The communication terminal 10 includes a CPU (Central Processing Unit) 1001, a RAM (Random Access Memory) 1002, a ROM (Read Only Memory) 1003, a storage device 1004 such as a flash memory, a microphone 1005, a speaker 1006, and a voice. The encoding / decoding circuit 1007, the camera 1008, the image processing circuit 1009, a display device 1010 such as a liquid crystal display, an input device 1011 such as operation buttons and a keyboard, and a communication module 1012 are configured. Note that the communication terminal 10b may not include the camera 1008 and the image processing circuit 1009.

  The CPU 1001 controls each unit of the communication terminal 10 by reading the program stored in the ROM 1003 and the storage device 1004 into the RAM 1002 and executing it.

  The voice codec circuit 1007 encodes a voice signal input from the microphone 1005 and outputs voice data. The voice codec circuit 1007 decodes the voice data and outputs it to the speaker 1006.

  The image processing circuit 1009 encodes a signal input from the camera 1008 and outputs image data. The image processing circuit 1009 may further include a circuit that compresses image data.

  The communication module 1012 communicates with the outside via the network 9. For example, when the communication terminal 10 is connected to a wireless communication network, the communication module 1012 may include an antenna that transmits and receives radio waves, a circuit that modulates and demodulates signals transmitted and received by the antenna, and the like.

  Next, the functional block configuration of the communication terminal 10 is shown in FIG. In FIG. 3, the communication terminal 10a includes a voice communication unit 101a, an imaging unit 102, an image display unit 103a, an image storage unit 104a, an image transmission unit 105, a display request transmission unit 106, and a captured image display control unit 107. The communication terminal 10b includes a voice communication unit 101b, an image display unit 103b, an image storage unit 104b, an image reception unit 108, a display request reception unit 109, and a received image display control unit 110.

  Here, the voice communication units 101a and 101b (hereinafter collectively referred to as the voice communication unit 101) are configured by a CPU 1001, a microphone 1005, a speaker 1006, a voice codec circuit 1007, and a communication module 1012. The photographing unit 102 includes a CPU 1001, a camera 1008, and an image processing circuit 1009. In addition, the image display units 103a and 103b (hereinafter collectively referred to as the image display unit 103) are configured by the CPU 1001 and the display device 1010. The image storage unit 104 includes a storage device 1004. The captured image display control unit 107 and the received image display control unit 110 are configured by the CPU 1001. The image transmission unit 105, the display request transmission unit 106, the image reception unit 108, and the display request reception unit 109 are configured by the CPU 1001 and the communication module 1012.

  The communication terminal 10 may be configured to function as both a communication terminal on the transmission side and a communication terminal on the reception side by including all the functional blocks included in the communication terminals 10a and 10b.

  Next, each functional block will be described.

  The voice communication unit 101 performs voice communication with the voice communication unit 101 of another communication terminal 10. Specifically, the voice communication unit 101 performs a calling process to another communication terminal 10, an incoming call process from another communication terminal 10, a voice signal transmission / reception process, a voice signal codec decoding process, and the like. . As a result, the voice communication unit 101 provides a user of the communication terminal 10 with a call function with another communication terminal 10.

  For example, the voice communication unit 101 may perform voice communication using a SIP session by establishing a session between the communication terminals 10 using SIP (Session Initiation Protocol).

  The voice communication unit 101 may establish a session for voice communication with another communication terminal 10 via an exchange (not shown) connected to the network 9. For example, when the voice communication unit 101 uses SIP, a SIP session with another communication terminal 10 may be established via a SIP proxy server connected to the network 9.

  The imaging unit 102 captures the periphery of the communication terminal 10a and acquires a captured image. Here, acquisition of a captured image means that image data is generated by copying an imaged object. The image data is referred to herein as a captured image. Furthermore, the imaging unit 102 may perform a compression process on the captured image. Then, the photographing unit 102 assigns identification information such as a file name to the photographed image and stores it in the image storage unit 104 described later.

  When the capturing unit 102 finishes acquiring and storing the captured image, the capturing unit 102 notifies the captured image display control unit 107 (described later) of the identification information given to the captured image and the storage position in the image storage unit 104.

  Note that the image capturing unit 102 is activated when the CPU 1001 executes an image capturing application stored in the storage device 1004. In addition, the imaging unit 102 may display an imaging target on the display device 1010 from when it is activated until a captured image is acquired.

  The image storage unit 104 stores a captured image acquired by the imaging unit 102 or a captured image received by an image receiving unit 108 described later.

  The image display unit 103 displays the captured image stored in the image storage unit 104.

  The image display unit 103 is activated when the CPU 1001 executes an image display application stored in the storage device 1004.

  The image transmission unit 105 transmits the captured image acquired by the imaging unit 102 to the communication terminal 10 b via the network 9. For example, the image transmission unit 105 may transmit a captured image using an e-mail function realized by executing an e-mail client application stored in the storage device 1004 by the CPU 1001.

  The display request transmission unit 106 transmits display request information representing information for requesting the communication terminal 10b to display the captured image acquired by the imaging unit 102, to the communication terminal 10b. In addition, the display request transmission unit 106 includes the identification information of the captured image to be requested in the display request information.

  For example, the display request transmission unit 106 may transmit the display request information using the above-described electronic mail function. In this case, the display request transmission unit 106 may include display request information that represents the identification information of the captured image in a tag format in the header or body of the email to which the image transmission unit 105 attaches the captured image. .

  When a photographed image is acquired by the photographing unit 102 during voice communication by the voice communication unit 101, the photographed image display control unit 107 activates the image display unit 103a after the photographing unit 102 finishes photographing the surroundings. Then, the captured image display control unit 107 controls the image display unit 103a to display the captured image. That is, the photographed image display control unit 107 ends the photographing application that configures the photographing unit 102, starts the image display application that configures the image display unit 103a, and causes the image display application to display the photographed image.

  At this time, the captured image display control unit 107 may display the captured image on the image display unit 103a by notifying the image display unit 103a of the identification information and the storage position of the captured image notified from the imaging unit 102. .

  In addition, when a captured image is acquired by the imaging unit 102 during voice communication by the audio communication unit 101, the captured image display control unit 107 sends the acquired captured image and its acquired image to the image transmission unit 105 and the display request transmission unit 106. Send display request information.

  At this time, the captured image display control unit 107 acquires destination information for identifying the communication terminal 10b as a transmission destination for transmitting the captured image to the image transmission unit 105. For example, when the image transmission unit 105 transmits a captured image using the email function, the captured image display control unit 107 acquires the email address of the communication terminal 10b as destination information. Then, the captured image display control unit 107 causes the image transmission unit 105 to transmit a captured image to the acquired e-mail address.

  Note that the captured image display control unit 107 may acquire the destination information of the communication terminal 10b by using the connection by the voice communication unit 101. For example, when the voice communication unit 101 has established a SIP session, the captured image display control unit 107 may inquire the destination information to the communication terminal 10b using a SIP MESSAGE request. In addition, when the voice communication unit 101 performs voice communication with the communication terminal 10b via an exchange such as a SIP proxy server, the captured image display control unit 107 inquires of the exchange about information regarding the communication terminal 10b, thereby communicating with the communication terminal. The destination information of 10b may be acquired.

  The image receiving unit 108 receives a captured image transmitted from the communication terminal 10a. Further, the image receiving unit 108 stores the received captured image in the image storage unit 104b. For example, when the image transmission unit 105 transmits a captured image attached to an email, the image reception unit 108 may receive the captured image using the email function.

  The display request receiving unit 109 receives display request information transmitted from the communication terminal 10a. For example, the display request receiving unit 109 may receive the display request information using the e-mail function when the display request transmitting unit 106 transmits the display request information using the e-mail function.

  The received image display control unit 110 activates the image display unit 103b when the display request information is received by the display request receiving unit 109 during the voice communication by the voice communication unit 101b. Then, the received image display control unit 110 displays the captured image indicated by the display request information on the image display unit 103b. That is, when display request information is received during voice communication, the received image display control unit 110 activates an image display application constituting the image display unit 103b and notifies the image display application of a captured image indicated by the display request information. To display. Specifically, the received image display control unit 110 notifies the image display unit 103b of identification information included in the display request information received by the display request receiving unit 109. Then, the received image display control unit 110 causes the image display unit 103b to display the captured image indicated by the identification information by acquiring it from the image storage unit 104b.

  The operation of the communication system 1 configured as described above will be described with reference to FIG. In FIG. 4, the left flow shows the operation of the communication terminal 10a on the transmission side, and the right flow shows the operation of the communication terminal 10b on the reception side. In addition, broken arrows connecting the left and right flows indicate the flow of data to be transmitted and received.

  First, the voice communication unit 101a of the communication terminal 10a performs a calling process for the communication terminal 10b (step S1).

  For example, the voice communication unit 101a starts a calling process by transmitting a SIP INVITE request to the above-described SIP proxy server. The SIP proxy server that has received the INVITE request refers to the To field in the INVITE request and transfers the INVITE request to the communication terminal 10b. Note that the voice communication unit 101a may perform call processing without going through an exchange such as a SIP proxy server.

  Next, the voice communication unit 101b of the communication terminal 10b transmits a response signal to the communication terminal 10a (step S2).

  For example, when receiving the INVITE request from the communication terminal 10a, the voice communication unit 101b notifies the user of the communication terminal 10b that there is an incoming call from the communication terminal 10a. And the voice communication part 101b will transmit 200OK as a response signal with respect to the communication terminal 10a, if the information showing responding to an incoming call is acquired via the input device 1011. FIG.

  Next, when the voice communication unit 101a of the communication terminal 10a transmits the reception of the response signal to the communication terminal 10b, the communication terminals 10a and 10b start voice communication (step S3).

  Next, the imaging unit 102 of the communication terminal 10a captures the surroundings to acquire a captured image, adds identification information to the acquired captured image, and stores the identification information in the image storage unit 104 (step S4).

  At this time, the imaging unit 102 may store the captured image in the image storage unit 104 after compressing the captured image. The identification information given to the photographed image may be represented by a file name in the file system such as “share.jpg”, for example.

  Next, the imaging unit 102 notifies the captured image display control unit 107 that acquisition and storage of the captured image have been completed. Then, the photographed image display control unit 107 ends the surrounding photographing by the photographing unit 102 (step S5).

  At the time of notification in step S5 or at the end of shooting, the shooting unit 102 notifies the shot image display control unit 107 of the acquired identification information of the shot image and the storage position in the image storage unit 104a. The identification information and the storage location may be represented by a file path and a file name such as “/home/user/share.jpg”, for example.

  Next, after the photographing is finished, the photographed image display control unit 107 activates the image display unit 103a (step S6).

  Next, the captured image display control unit 107 displays the captured image acquired in step S4 on the image display unit 103a (step S7).

  Specifically, when starting up the image display unit 103a, the captured image display control unit 107 notifies the image display unit 103a of the identification information and information indicating the storage position notified from the imaging unit 102 in step S5. Then, the image display unit 103a displays the target captured image by searching the image storage unit 104a.

  Next, the captured image display control unit 107 controls the image transmission unit 105 and the display request transmission unit 106 to transmit the captured image acquired in step S4 and its display request information to the communication terminal 10b (step S4). S8).

  For example, the image transmission unit 105 and the display request transmission unit 106 include display request information including identification information of the captured image in the header or body of the email attached with the captured image using the electronic mail function as described above. May be transmitted. Specifically, for example, the image transmission unit 105 reads a captured image from the image storage unit 104a. Furthermore, the image transmission unit 105 attaches the read captured image to an e-mail. At this time, the display request transmission unit 106 inserts display request information including identification information of the captured image into the header or body of the e-mail. After the insertion, the image transmission unit 105 transmits an e-mail including display request information including identification information of the captured image.

  In step S8, the captured image display control unit 107 may cause the image transmission unit 105 and the display request transmission unit 106 to sequentially transmit the captured image and the display request information without transmitting them simultaneously. Further, either the transmission of the captured image by the image transmission unit 105 or the transmission of the display request information by the display request transmission unit 106 may be executed first.

  Next, the image receiving unit 108 and the display request receiving unit 109 of the communication terminal 10b receive the captured image and display request information transmitted from the communication terminal 10a (step S9). Then, the image receiving unit 108 stores the received captured image in the image storage unit 104b.

  Next, the received image display control unit 110 activates the image display unit 103b (step S10).

  Next, the received image display control unit 110 notifies the image display unit 103b of identification information included in the display request information received in step S9, thereby causing the image display unit 103b to display a captured image (step S11).

  Above, description of the operation | movement which shares a picked-up image in voice communication between the communication terminals 10a and 10b in the communication system 1 is complete | finished.

  Next, effects of the first exemplary embodiment of the present invention will be described.

  The communication system according to the first exemplary embodiment of the present invention reduces the complexity of operation without increasing the resource consumption of the communication terminal when sharing a captured image between communication terminals performing voice communication. Can do.

  The reason is that when the captured image display control unit acquires a captured image during voice communication, the image display unit is started after ending the imaging unit. Is not started at the same time.

  A further reason is that not only the captured image is transmitted from the communication terminal that has acquired the captured image, but also display request information for requesting display of the captured image is transmitted. Furthermore, another communication terminal that has received the display request information activates the image display unit and displays a captured image indicated by the display request information. As a result, if an operation for photographing the surroundings during voice communication is performed in the communication terminal on the transmission side, the communication terminal on the transmission side and the reception side can display the captured image without requiring further operation. is there.

(Second Embodiment)
Next, a second embodiment of the present invention will be described in detail with reference to the drawings. First, FIG. 5 shows a functional block configuration of a communication system 2 as a second embodiment of the present invention. In FIG. 5, the same components as those in the first embodiment of the present invention are denoted by the same reference numerals, and detailed description thereof is omitted.

  In FIG. 5, the communication system 2 includes a communication terminal 20a on the transmission side and a communication terminal 20b on the reception side. Communication terminals 20 a and 20 b (hereinafter collectively referred to as communication terminal 20) are communicably connected via a network 9. Further, the communication terminal 20 includes the hardware configuration shown in FIG. 2, similarly to the communication terminal 10 in the first embodiment of the present invention.

  In contrast to the communication terminal 10a according to the first embodiment of the present invention, the communication terminal 20a replaces the image transmission unit 105, the display request transmission unit 106, and the captured image display control unit 107 with an image transmission unit 205, a display The difference is that a request transmission unit 206 and a captured image display control unit 207 are provided.

  Upon receiving transmission request information described later from the communication terminal 20b, the image transmission unit 205 transmits the captured image indicated by the transmission request information to the communication terminal 20b via the network 9.

  For example, the image transmission unit 205 may transmit a captured image using a web server function realized by the CPU 1001 executing a web server application stored in the storage device 1004. In this case, the image transmission unit 205 may transmit a captured image using HTTP (HyperText Transfer Protocol) by receiving a URL (Uniform Resource Locator) that identifies the captured image as transmission request information.

  The display request transmission unit 206 generates captured image specifying information for specifying the captured image stored in the image storage unit 104a from the outside of the communication terminal 20a. For example, the captured image specifying information may be a URL of the captured image.

  Then, the display request transmitting unit 206 transmits display request information including the captured image specifying information to the communication terminal 20b via the network 9. At this time, the display request transmission unit 206 may transmit the display request information using a session established by the voice communication unit 101.

  Here, an example of the display request information including the captured image specifying information is shown in FIG.

  FIG. 6 is an example of display request information using a SIP MESSAGE request when a SIP session is established by the voice communication unit 101. In FIG. 6, the MESSAGE request as display request information includes URL “http://area1.com/share.jpg” as captured image specifying information.

  When the photographed image is acquired by the photographing unit 102 during the voice communication by the voice communication unit 101a, the photographed image display control unit 207 performs the photographing similarly to the photographed image display control unit 107 in the first embodiment of the present invention. The captured image is displayed by controlling the unit 102 and the image display unit 103a.

  Further, when a photographed image is acquired by the photographing unit 102 during voice communication by the voice communication unit 101a, the photographed image display control unit 207 transmits a display request including the photographed image specifying information in the acquired display request information of the photographed image. Transmitted by the unit 206. Then, the captured image display control unit 207 causes the image transmission unit 205 to receive the transmission request information including the captured image specifying information, thereby transmitting the captured image.

  The communication terminal 20b replaces the image reception unit 108, the display request reception unit 109, and the reception image display control unit 110 with respect to the communication terminal 10b according to the first embodiment of the present invention, The difference is that a request receiving unit 209 and a received image display control unit 210 are provided.

  The display request receiving unit 209 receives display request information including captured image specifying information from the communication terminal 20 a via the network 9. For example, when a voice communication session by the voice communication unit 101b is established by SIP, the display request receiving unit 209 receives a SIP MESSAGE request in the session during voice communication, thereby including a display request including shooting specific information. Information may be acquired.

  The image receiving unit 208 transmits transmission request information for requesting the communication terminal 20 a to transmit the captured image indicated by the captured image specifying information to the communication terminal 20 a via the network 9.

  When the display request receiving unit 209 receives the display request information during the voice communication by the voice communication unit 101b, the received image display control unit 210 indicates to the image receiving unit 208 the captured image specifying information included in the display request information. The captured image is received by transmitting the transmission request information.

  For example, when the captured image specifying information is the URL of the captured image, the image receiving unit 208 may transmit the transmission request information of the captured image to the communication terminal 20a using an HTTP GET message.

  The operation of the communication system 2 configured as described above will be described in detail with reference to FIG. In FIG. 7, steps that operate in the same manner as in the first embodiment of the present invention are denoted by the same reference numerals, and detailed description thereof is omitted.

  First, the communication system 2 operates in the same manner as the communication system 1 according to the first embodiment of the present invention from step S1 to step S7, so that a captured image captured by the communication terminal 20a during voice communication is transmitted to the communication terminal. 20a is displayed.

  Next, the captured image display control unit 207 of the communication terminal 20a causes the display request transmission unit 206 to transmit display request information including the captured image specifying information to the communication terminal 20b (step S21).

  At this time, the display request transmission unit 206 may transmit the display request information including the captured image specifying information using the connection established by the voice communication unit 101a.

  For example, the display request transmission unit 206 may transmit the SIP MESSAGE request illustrated in FIG. 6 to the communication terminal 20b as display request information.

  Next, the display request receiving unit 209 of the communication terminal 20b receives display request information. Then, the received image display control unit 210 causes the image receiving unit 208 to transmit the captured image transmission request information indicated by the captured image specifying information included in the display request information to the communication terminal 20a (step S22).

  For example, the image receiving unit 208 may transmit an HTTP GET request requesting the URL “http://area1.com/share.jpg” as the captured image specifying information to the communication terminal 20a as transmission request information.

  Next, the image transmission unit 205 of the communication terminal 20a receives the transmission request information. Then, the image transmission unit 205 transmits the captured image indicated by the captured image specifying information included in the received transmission request information to the communication terminal 20b (step S23).

  For example, when the transmission request information is received as an HTTP GET request, the image transmission unit 205 may transmit a captured image as an HTTP response.

  Next, the image receiving unit 208 of the communication terminal 20b receives the captured image transmitted from the communication terminal 20b (step S24). Then, the image receiving unit 208 stores the captured image received in the image storage unit 104b.

  Next, the received image display control unit 210 of the communication terminal 20b activates the image display unit 103b (step S25).

  Next, the received image display control unit 210 causes the image display unit 103b to display the captured image received in step S24 (step S26).

  Above, description of the operation | movement which shares a picked-up image in voice communication between the communication terminals 20a and 20b in the communication system 2 is complete | finished.

  Next, the effect of the second exemplary embodiment of the present invention will be described.

  The communication system as the second embodiment of the present invention can improve the efficiency of processing of a communication terminal that shares a captured image during voice communication while reducing resource consumption and complexity of operation.

  The reason is that the communication terminal on the transmission side includes the captured image specifying information for specifying the captured image from the outside in the display request information and transmits it to the communication terminal on the reception side. This is because the photographed image is received by using the photographed image specifying information included in the request information. This is because processing for inquiring destination information of the receiving communication terminal as the transmission destination of the captured image from the transmitting communication terminal to the receiving communication terminal becomes unnecessary.

  In each of the embodiments of the present invention described above, the operation of the communication terminal on the transmission side and the reception side described with reference to each flowchart is the storage device (storage medium) of each communication terminal as the computer program of the present invention. The computer program may be read out and executed by the CPU of each communication terminal. In such a case, the present invention is constituted by the code of the computer program or a storage medium.

  Moreover, each embodiment mentioned above can be implemented in combination as appropriate.

  The present invention is not limited to the above-described embodiments, and can be implemented in various modes.

Moreover, although a part or all of said embodiment can be described also as the following additional remarks, it is not restricted to the following.
(Appendix 1)
A communication system including a communication terminal on a transmission side and a communication terminal on a reception side that perform communication via a network,
The transmitting communication terminal is
A voice communication unit that performs voice communication with the receiving communication terminal;
A photographing unit that obtains a photographed image by photographing the periphery of the communication terminal on the transmission side;
An image storage unit for storing the captured image;
An image display unit for displaying a captured image stored in the image storage unit;
An image transmission unit that transmits the captured image to the communication terminal on the receiving side;
Display request information for requesting display of the captured image on the receiving communication terminal, a display request transmitting unit for transmitting to the receiving communication terminal,
When the photographed image is acquired by the photographing unit during the voice communication, after the photographing by the photographing unit is finished, the obtained photographed image is displayed on the image display unit, and the image transmitting unit and the A captured image display control unit that causes the display request transmission unit to transmit the captured image and the display request information;
Have
The receiving communication terminal is:
A voice communication unit that performs voice communication with the transmission-side communication terminal;
An image receiving unit for receiving the captured image from the communication terminal on the transmission side;
A display request receiver that receives the display request information from the communication terminal on the transmission side;
An image storage unit for storing a captured image received by the image receiving unit;
An image display unit for displaying a captured image stored in the image storage unit;
When the display request information is received by the display request receiving unit during the voice communication, a received image display control unit that displays a captured image indicated by the display request information on the image display unit;
A communication system.
(Appendix 2)
In the communication terminal on the transmission side,
The display request transmitting unit includes, in the display request information, captured image specifying information for specifying a captured image stored in the image storage unit of the transmitting communication terminal from the outside of the transmitting communication terminal. Send it to the receiving communication terminal,
The image transmitting unit, when receiving transmission request information requesting transmission of a captured image specified by the captured image specifying information from the communication terminal on the receiving side, transmits the captured image to the communication terminal on the receiving side,
The captured image display control unit causes the display request transmission unit to transmit the display request information during the voice communication, and then causes the image transmission unit to receive the transmission request information to transmit the captured image,
In the communication terminal on the receiving side,
The display request receiving unit receives the display request information including the captured image specifying information from the communication terminal on the transmission side,
The image receiving unit transmits transmission request information of a captured image specified by the captured image specifying information to the communication terminal on the transmission side,
When the display request receiving unit receives the display request information during the voice communication, the received image display control unit causes the image receiving unit to transmit the transmission request information to receive the captured image. The communication system according to appendix 1, characterized by:
(Appendix 3)
A communication terminal that communicates with other communication terminals via a network,
A voice communication unit that performs voice communication with the other communication terminal;
A photographing unit that obtains a photographed image by photographing the surroundings of the terminal;
An image storage unit for storing the captured image;
An image display unit for displaying a captured image stored in the image storage unit;
An image transmission unit for transmitting the captured image to the other communication terminal;
A display request transmitting unit that transmits display request information for requesting the other communication terminal to display the captured image, to the other communication terminal;
When the photographed image is acquired by the photographing unit during the voice communication, after the photographing by the photographing unit is finished, the obtained photographed image is displayed on the image display unit, and the image transmitting unit and the A captured image display control unit that causes the display request transmission unit to transmit the captured image and the display request information;
Communication terminal equipped with.
(Appendix 4)
The display request transmission unit includes, in the display request information, captured image specifying information for specifying a captured image stored in the image storage unit from the outside of the terminal, and transmits it to the other communication terminal,
The image transmitting unit, when receiving transmission request information requesting transmission of a captured image specified by the captured image specifying information from the other communication terminal, transmits the captured image to the other communication terminal;
The captured image display control unit causes the display request transmission unit to transmit the display request information during the voice communication, and then causes the image transmission unit to receive the transmission request information to transmit the captured image. The communication terminal according to Appendix 3, characterized by:
(Appendix 5)
A communication terminal that communicates with other communication terminals via a network,
A voice communication unit that performs voice communication with the other communication terminal;
An image receiving unit that receives from the other communication terminal a captured image obtained by photographing the surroundings of the other communication terminal;
A display request receiving unit that receives display request information for requesting display of the captured image from the other communication terminal;
An image storage unit for storing a captured image received by the image receiving unit;
An image display unit for displaying a captured image stored in the image storage unit;
When the display request information is received by the display request receiving unit during the voice communication, a received image display control unit that displays a captured image indicated by the display request information on the image display unit;
Communication terminal equipped with.
(Appendix 6)
The display request receiving unit transmits the display request information including captured image specifying information for specifying the captured image stored in the other communication terminal from the outside of the other communication terminal. Received from
The image receiving unit transmits transmission request information for requesting transmission of a captured image specified by the captured image specifying information to the communication terminal on the transmission side,
When the display request receiving unit receives the display request information during the voice communication, the received image display control unit causes the image receiving unit to transmit the transmission request information to receive the captured image. The communication terminal according to appendix 5, characterized by:
(Appendix 7)
In a communication system including a communication terminal on a transmission side and a communication terminal on a reception side that perform communication via a network,
The transmitting communication terminal and the receiving communication terminal start voice communication,
The transmitting communication terminal is
A photographed image is acquired by photographing the surroundings of the communication terminal on the transmission side using a photographing unit,
Storing the captured image in an image storage unit;
End the shooting by the shooting unit,
The captured image stored in the image storage unit is displayed on the image display unit,
Transmitting the captured image and display request information requesting display of the captured image to the communication terminal on the receiving side;
The receiving communication terminal is
Receiving the captured image and the display request information;
The received captured image is stored in the image storage unit,
A communication method for displaying a captured image indicated by the display request information on an image display unit.
(Appendix 8)
The transmitting communication terminal is
The captured image specifying information for specifying the captured image stored in the image storage unit from the outside of the transmitting communication terminal is included in the display request information and transmitted to the receiving communication terminal,
When the receiving communication terminal receives the display request information, the receiving communication terminal sends transmission request information for requesting transmission of a captured image specified by the captured image specifying information included in the received display request information. To
The communication method according to appendix 7, wherein the transmission-side communication terminal transmits the captured image to the reception-side communication terminal when receiving the transmission request information.
(Appendix 9)
To communication terminals that communicate with other communication terminals via the network,
A voice communication start step for starting voice communication with the other communication terminal;
During voice communication with the other communication terminal, a photographing step of causing the photographing unit to photograph the surroundings of the terminal and acquiring a photographed image;
A photographing end step for ending photographing by the photographing unit;
A captured image display step of displaying the captured image on an image display unit;
A computer program that executes the captured image display request transmission step of transmitting the captured image and display request information for requesting display of the captured image to the other communication terminal.
(Appendix 10)
To communication terminals that communicate with other communication terminals via the network,
A captured image display request reception step of receiving a captured image obtained by capturing the periphery of the other communication terminal and display request information for requesting display of the captured image from the other communication terminal;
An image display step of causing the image display unit to display a captured image indicated by the display request information.
(Appendix 11)
In the captured image display request transmission step, after the captured image specifying information for specifying the captured image from the outside of the terminal is included in the display request information and transmitted to the other communication terminal, the captured image specifying information is used. The computer program according to appendix 9, wherein the captured image is transmitted to the other communication terminal by receiving transmission request information for requesting transmission of the specified captured image from the other communication terminal. .
(Appendix 12)
In the captured image display request receiving step, the display request information including captured image specifying information for specifying the captured image stored in the other communication terminal from the outside of the other communication terminal is transmitted to the transmission side. After receiving from the communication terminal, the captured image is received by transmitting transmission request information requesting transmission of the captured image specified by the captured image specifying information to the communication terminal on the transmitting side. The computer program according to attachment 10.

  The present invention can provide a communication system that reduces the complexity of operation without increasing the resource consumption of a communication terminal when a captured image is shared between communication terminals that perform voice communication. It is suitable as a communication system including a telephone, a remote conference support system, and the like.

DESCRIPTION OF SYMBOLS 1, 2 Communication system 9 Network 10, 20 Communication terminal 101 Voice communication part 102 Image | photographing part 103 Image display part 104 Image memory | storage part 105,205 Image transmission part 106,206 Display request transmission part 107,207 Photographed image display control part 108, 208 Image receiver 109, 209 Display request receiver 110, 210 Received image display controller

Claims (7)

A communication system including a communication terminal on a transmission side and a communication terminal on a reception side that perform communication via a network,
The transmitting communication terminal is
A voice communication unit that performs voice communication with the receiving communication terminal;
A photographing unit that obtains a photographed image by photographing the periphery of the communication terminal on the transmission side;
An image storage unit for storing the captured image;
An image display unit for displaying a captured image stored in the image storage unit;
An image transmission unit that transmits the captured image to the communication terminal on the receiving side;
Display request information for requesting display of the captured image on the receiving communication terminal, a display request transmitting unit for transmitting to the receiving communication terminal,
When the photographed image is acquired by the photographing unit during the voice communication, after the photographing by the photographing unit is finished, the obtained photographed image is displayed on the image display unit, and the image transmitting unit and the A captured image display control unit that causes the display request transmission unit to transmit the captured image and the display request information;
Have
The receiving communication terminal is:
A voice communication unit that performs voice communication with the transmission-side communication terminal;
An image receiving unit for receiving the captured image from the communication terminal on the transmission side;
A display request receiver that receives the display request information from the communication terminal on the transmission side;
An image storage unit for storing a captured image received by the image receiving unit;
An image display unit for displaying a captured image stored in the image storage unit;
When the display request information is received by the display request receiving unit during the voice communication, a received image display control unit that displays a captured image indicated by the display request information on the image display unit;
A communication system. In the communication terminal on the transmission side,
The display request transmitting unit includes, in the display request information, captured image specifying information for specifying a captured image stored in the image storage unit of the transmitting communication terminal from the outside of the transmitting communication terminal. Send it to the receiving communication terminal,
The image transmitting unit, when receiving transmission request information requesting transmission of a captured image specified by the captured image specifying information from the communication terminal on the receiving side, transmits the captured image to the communication terminal on the receiving side,
The captured image display control unit causes the display request transmission unit to transmit the display request information during the voice communication, and then causes the image transmission unit to receive the transmission request information to transmit the captured image,
In the communication terminal on the receiving side,
The display request receiving unit receives the display request information including the captured image specifying information from the communication terminal on the transmission side,
The image receiving unit transmits transmission request information of a captured image specified by the captured image specifying information to the communication terminal on the transmission side,
When the display request receiving unit receives the display request information during the voice communication, the received image display control unit causes the image receiving unit to transmit the transmission request information to receive the captured image. The communication system according to claim 1. A communication terminal that communicates with other communication terminals via a network,
A voice communication unit that performs voice communication with the other communication terminal;
A photographing unit that obtains a photographed image by photographing the surroundings of the terminal;
An image storage unit for storing the captured image;
An image display unit for displaying a captured image stored in the image storage unit;
An image transmission unit for transmitting the captured image to the other communication terminal;
A display request transmitting unit that transmits display request information for requesting the other communication terminal to display the captured image, to the other communication terminal;
When the photographed image is acquired by the photographing unit during the voice communication, after the photographing by the photographing unit is finished, the obtained photographed image is displayed on the image display unit, and the image transmitting unit and the A captured image display control unit that causes the display request transmission unit to transmit the captured image and the display request information;
Communication terminal equipped with. The display request transmission unit includes, in the display request information, captured image specifying information for specifying a captured image stored in the image storage unit from the outside of the terminal, and transmits it to the other communication terminal,
The image transmitting unit, when receiving transmission request information requesting transmission of a captured image specified by the captured image specifying information from the other communication terminal, transmits the captured image to the other communication terminal;
The captured image display control unit causes the display request transmission unit to transmit the display request information during the voice communication, and then causes the image transmission unit to receive the transmission request information to transmit the captured image. The communication terminal according to claim 3. In a communication system including a communication terminal on a transmission side and a communication terminal on a reception side that perform communication via a network,
The transmitting communication terminal and the receiving communication terminal start voice communication,
The transmitting communication terminal is
A photographed image is acquired by photographing the surroundings of the communication terminal on the transmission side using a photographing unit,
Storing the captured image in an image storage unit;
End the shooting by the shooting unit,
The captured image stored in the image storage unit is displayed on the image display unit,
Transmitting the captured image and display request information requesting display of the captured image to the communication terminal on the receiving side;
The receiving communication terminal is
Receiving the captured image and the display request information;
The received captured image is stored in the image storage unit,
A communication method for displaying a captured image indicated by the display request information on an image display unit. The transmitting communication terminal is
The captured image specifying information for specifying the captured image stored in the image storage unit from the outside of the transmitting communication terminal is included in the display request information and transmitted to the receiving communication terminal,
When the receiving communication terminal receives the display request information, the receiving communication terminal sends transmission request information for requesting transmission of a captured image specified by the captured image specifying information included in the received display request information. To
The communication method according to claim 5 , wherein the transmission-side communication terminal transmits the captured image to the reception-side communication terminal when receiving the transmission request information. To communication terminals that communicate with other communication terminals via the network,
A voice communication start step for starting voice communication with the other communication terminal;
During voice communication with the other communication terminal, a photographing step of causing the photographing unit to photograph the surroundings of the terminal and acquiring a photographed image;
A photographing end step for ending photographing by the photographing unit;
A captured image display step of displaying the captured image on an image display unit;
A computer program that executes the captured image display request transmission step of transmitting the captured image and display request information for requesting display of the captured image to the other communication terminal.

Images