JP2005303360A - Mobile phone terminal and image composite method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile phone terminal whereby a caller and a called party can store an image in the same timing respectively during a videophone call and the caller and the called party can select a segmented image and easily set photographing configuration while making communication with each other during the videophone call and to provide an image composite method thereof. <P>SOLUTION: A control section 101 performs selection processing of a segmented image and a paste position of the segmented image, the segmented image being selected by a user for operating an operation section 103 while viewing a composite image of a caller side image and a called party side image displayed on a display section 106 during the videophone call. Thereafter the user depresses a particular button of the operation section 103 to determine and enter an image to be stored. When receiving the storage image determination entry, the control section 101 allows an image processing section 109 to supply data of a composite image to which the image displayed on the display section 106 is pasted to a memory 104, which stores the received data. Further, the control section 101 transmits the composite image data stored in the memory 104 to an opposite terminal during the videophone call. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a mobile phone terminal and an image synthesizing method thereof, and more particularly to a mobile phone terminal with a videophone function capable of transmitting and receiving images and sounds and an image synthesizing method thereof.

  2. Description of the Related Art Conventionally, a mobile phone terminal with a video phone function is known in which a telephone call can be made outdoors or on a moving car while looking at the other party's face by combining the functions of a video phone device and a mobile phone device ( For example, see Patent Document 1). In this cellular phone terminal with a videophone function, the video signal on the transmission side obtained by photographing with the camera means and the audio signal on the transmission side obtained by the voice capturing means are simultaneously transmitted and received. The display device displays the received video signal on the display side and outputs the received audio signal on the receiving side using the sound generation device. The display device can be recognized by viewing the display device on the display screen. By providing eyepiece display means and arranging the sound generating means in the vicinity of the ear, it is possible to reliably hear the received sound together with the received video without being disturbed by external noise or the like. . In addition, in this mobile phone with a videophone function, it is possible to synthesize the video obtained by the user and the received video and display them on the screen.

  On the other hand, a videophone device that can obtain a composite image in which an image of a calling party (receiving side) and an image of a user (sending side) are arranged has also been proposed (see, for example, Patent Document 2). In the videophone device described in Patent Document 2, the image of the user and the image data of the other party of the call received via the telephone line are reduced in accordance with an arbitrary background image, and the reduced image data and the background image are reduced. The data is synthesized in time series and displayed on the screen display unit or printed by the printing unit.

JP-A-10-155141 JP 2000-023123 A

  However, in the conventional mobile phone terminal described in Patent Document 1, when the contents of a call including an image are stored during a videophone call, only one of the contents of the receiver side and the contents of the transmitter side can be stored. Therefore, in order to save both the images on the transmitting side and the receiving side as one image, it is necessary to obtain the image data on the transmitting side and the receiving side separately and then combine them as one image data. Furthermore, the transmission of the composite image to the other party must be performed after the call ends using mail or the like, which is troublesome.

  In addition, in the conventional mobile phone terminal described in Patent Document 1 and the videophone device described in Patent Document 2, generation and display of a composite image of the image of the other party (receiving side) and the image of the user (sending side) Is possible only with the user's videophone device, and during the videophone call, the transmitting side and the receiving side cannot save the composite image of both at the same timing. Furthermore, in the conventional mobile phone terminal described in Patent Document 1 and the videophone device described in Patent Document 2, the cut-out image cannot be selected on the transmission side or the reception side, and the user can arbitrarily select the cut-out range and the pasting position of the image. There is a problem that cannot be selected.

  The present invention has been made in view of the above points, and it is an object of the present invention to provide a mobile phone terminal capable of storing images at the same timing during a videophone call, and a method for synthesizing the same. And

  Another object of the present invention is to provide a mobile phone terminal capable of selecting a cut-out image on the transmission side and the reception side and easily setting a shooting configuration while communicating with the other party during a videophone call, and its image composition It is to provide a method.

  To achieve the above object, according to a first aspect of the present invention, in a mobile phone terminal with a videophone function capable of transmitting and receiving image data and audio data, the first image data relating to the image of the user on the transmitting side is acquired. First image data acquisition means and second image data acquisition means for receiving image data of the user of the partner terminal transmitted from the partner terminal of the receiving side and acquiring second image data relating to the user of the partner terminal The first and second image data are synthesized by the first synthesized image generating means for synthesizing the first and second image data during a call with the counterpart terminal and generating one synthesized image data, and the first synthesized image generating means. The first composite image displayed on the display unit that displays the first composite image based on the composite image data and the first composite image displayed on the display unit is displayed on the first image or the second image data based on the first image data. A second image obtained by cutting one arbitrarily selected image out of the second image in an arbitrary size and obtaining the data of the second composite image obtained by pasting the extracted image at an arbitrary position with respect to the other image. And a display / storage unit for displaying the second composite image on the display unit and storing the data of the second composite image in the storage unit during a call with the partner terminal. It is what.

  In the present invention, during a call with a partner terminal, one of the images of the user of the partner terminal and the image of the user of the terminal is arbitrarily selected and cut out to the other size. Data of a composite image pasted at an arbitrary position on the image can be saved.

  In order to achieve the above object, the second invention is the first invention according to the first invention, wherein the data of the second composite image saved in the storage unit by the display / save means is transmitted during a call with the partner terminal. It is characterized in that a composite image data transmitting means for transmitting to the partner terminal in place of a call signal to the partner terminal is further added. In this invention, since the composite image data stored in the first invention is transmitted to the partner terminal during a call of the partner terminal, the partner terminal can store the composite image data.

  In order to achieve the above object, the third invention stores, in the storage unit, composite image data corresponding to the data of the second composite image transmitted from the counterpart terminal during a call with the counterpart terminal. It further has a storing means. In the present invention, the composite image data transmitted from the partner terminal and received during a call with the partner terminal can be stored in the storage unit.

  In order to achieve the above object, the fourth invention is characterized in that the first and second image data are still image data or moving image data.

  In order to achieve the above object, according to a fifth aspect of the present invention, there is provided an image synthesizing method for a mobile phone terminal with a videophone function capable of transmitting and receiving image data and audio data. A first step of acquiring image data, and a second step of receiving image data of the user of the partner terminal transmitted from the partner terminal on the receiving side and acquiring second image data relating to the user of the partner terminal A first step of synthesizing the first and second image data during a call with the counterpart terminal to generate one synthesized image data, and a first step based on the synthesized image data displayed on the display unit. Of the first image data based on the first image data or the second image data based on the second image data. A fourth step of obtaining data of a second composite image obtained by pasting the selected image at an arbitrary position with respect to the other image, and displaying the second composite image on the display unit during a call with the other terminal. And a fifth step of storing the data of the second composite image in the storage unit.

  In the present invention, during a call with a partner terminal, one of the images of the user of the partner terminal and the image of the user of the terminal is arbitrarily selected and cut out to the other size. Data of a composite image pasted at an arbitrary position on the image can be saved.

  In order to achieve the above object, according to a sixth aspect of the present invention, the data of the second composite image stored in the storage unit in the fifth step is used as a call signal to the partner terminal during a call with the partner terminal. The method further includes a sixth step of transmitting to the counterpart terminal. In the present invention, since the composite image data stored in the fifth invention is transmitted to the partner terminal during a call of the partner terminal, the partner terminal can store the composite image data.

  According to the present invention, during a call with the partner terminal, one of the images of the user of the partner terminal and the image of the user of the terminal is arbitrarily selected and cut out. Since the composite image data pasted at an arbitrary position with respect to the other image is stored, a videophone call can be made while viewing the composite image having a desired composition.

  In addition, according to the present invention, since the stored composite image data is transmitted to the partner terminal during a call of the partner terminal, the partner terminal is made to store the composite image data, so that the videophone call (call In the middle), the same composite image can be stored simultaneously on both the transmitting side and the receiving side, whereby the transmitting side and the receiving side can store images at the same timing.

  Furthermore, according to the present invention, the cut-out image can be selected as the transmission side and the reception side, and the cut-out range and the pasting position can be arbitrarily selected by the user. Can be easily set.

  Next, the best mode for carrying out the present invention will be described. FIG. 1 shows a block diagram of an embodiment of a cellular phone terminal according to the present invention. In the figure, a control unit 101 has a central processing unit (CPU) 102, and performs various controls for operating the cellular phone terminal in an integrated manner triggered by a user operation input from the operation unit 103. . The operation unit 103 is an input device having various keys for inputting various data such as characters, symbols, and numbers, and keys for determining and selecting. The memory 104 stores various programs, ID information, phone book data, image data, and the like necessary for operating the mobile phone terminal, and performs reading and writing under the control of the control unit 101. The camera 105 captures an image of an arbitrary subject, generates image data, and supplies the image data to the control unit 101.

  The display unit 106 displays various images and characters under the control of the control unit 101. Radio section 107 performs processing such as demodulation on the received signal (received voice signal and e-mail data) from the nearest base station (not shown) and the other terminal received via antenna 108 and supplies it to control section 101. In addition, a predetermined process such as modulation is performed on the transmission voice signal and the e-mail data to the partner terminal supplied from the control unit 101 to generate a transmission signal of a predetermined frequency band to set the antenna 108. Via wireless transmission to the nearest base station (not shown).

  The image processing unit 109 includes a plurality of image processing buffers 110 and 111, and image data received by the wireless unit 107 and image data captured by the camera 105 are supplied via the control unit 101 and input thereof. Processing for display, processing to a storage format, image composition processing, and the like are performed on the image data. The receiver 112 performs electro-acoustic conversion on a received voice signal, an incoming voice signal, or the like of a counterpart terminal supplied via the control unit 101 to generate a voice. The microphone 113 performs an acoustic-electric conversion on the transmitted voice to obtain a transmitted voice signal and supplies it to the control unit 101.

  Next, the videophone operation of this embodiment will be described. Now, assuming that a call path is established with a partner terminal via a base station and a public network (not shown) and a videophone for transmitting and receiving image data and audio signals is performed with the partner terminal, the microphone 113 The transmitted voice signal obtained by picking up the sound is supplied to the control unit 101, and is converted from analog to digital to be transmitted voice data.

  Further, the image data on the transmission side obtained by being photographed by the camera 105 is supplied to the image processing unit 109 via the control unit 101, where display processing, information compression, and encoding are performed. Then, it is supplied to and displayed on the display unit 106 under the control of the control unit 101, and is wirelessly transmitted to the partner terminal via the wireless unit 107 and the antenna 108 together with the transmitted voice data.

  On the other hand, the synthesized data composed of the received voice data from the counterpart terminal and the receiver side image data of the user of the counterpart terminal received by the radio unit 107 via the antenna 108 is supplied to the control unit 101 and separated, and further received voice The data is converted into an analog voice signal, supplied to the receiver 112, and pronounced as a received voice. The receiver image data separated by the control unit 101 is supplied to the image processing unit 109, where display processing is performed, and then supplied to the display unit 106 via the control unit 101. Displayed under the control of. Therefore, during a videophone call, both images on the receiver side and on the transmitter side are displayed on the display unit 106 at the same time.

  Next, the image registration / save processing operation of the present embodiment will be described with reference to the flowchart of FIG. 2 and the image examples of FIGS. Now, during the above videophone operation, as shown in FIG. 3, the receiving side image based on the image data transmitted from the partner terminal (that is, the receiving side) to the display unit 106 of the transmitting side mobile phone terminal. Assume that 201 and a transmission side image 202 based on image data obtained by photographing with the camera 105 of the own terminal (that is, the transmission side) are displayed at the same time.

  First, when the user operates the operation unit 103 in FIG. 1 and selects an image storage process (step S1 in FIG. 2), a determination process is performed to determine whether or not the clipped image is to be transmitted (self terminal). (Step S2 in FIG. 2). When it is specified that the clipped image is set as the transmission side, the control unit 101 performs image cutout range selection processing on the transmission side image data stored in the buffer 110 (step S3 in FIG. 2). .

  In this case, as shown in FIG. 4, the user performs an operation of displaying the transmission side image 202 ′ so as to be easily cut out while viewing the display unit 106 and displaying the reception side image 201 ′ in a small size. A range selected as a cut-out image is, for example, an area surrounded by a circle 203 indicated by a dotted line. The transmitting-side image in the arbitrarily selected area 203 is read from the corresponding memory area of the buffer 110 and becomes a cut-out image.

  Next, the control unit 101 executes an image pasting position selection process (step S5 in FIG. 2). In this image pasting position selection process, the user pastes an image pasted by arbitrarily arranging the cut-out image 205 so as to line up with the receiver image 204, for example, while checking the image on the display unit 106, as shown in FIG. A processed composite image 206 is obtained. When the composition by the image pasting process is determined, the user presses a specific button (key) on the operation unit 103 to input a stored image determination (step S6 in FIG. 2).

  When the storage image determination input is received, the control unit 101 causes the image processing unit 109 to process the composite image 206 currently displayed on the display unit 106 as composite image data. Subsequently, based on the registration process input of the operation unit 103, the control unit 101 supplies the composite image data processed by the image processing unit 109 to the memory 104 and stores it (step S7 in FIG. 2).

  If it is determined in the selection process in step S2 of FIG. 2 that the reception side image cutout process has been selected, a cutout image range selection process is performed on the reception side image (step S4 in FIG. 2). An image cutout range for the receiver image data stored in the buffer 111 is selected. When the receiving side image cutout range selection process in step S4 is completed, the processes in steps S5 to S7 described above are sequentially executed.

  In the above embodiment, the image cutout range is designated by a circle as indicated by 203 in FIG. 4, but the shape of this image cutout range can be arbitrarily selected by the user. Various settings such as a rectangle and a frame are possible, and the size can be arbitrarily set. In addition to the synthesis of the cut-out image, as shown by 207 in FIG. 6, it is possible to set image synthesis by equally dividing the reception side image 201 and the transmission side image 202.

  Next, another embodiment of the present invention will be described. This embodiment is shown in the block diagram of FIG. 1 as in the above embodiment, but is characterized in that the composite image data can be stored as moving image data. This embodiment will be described with reference to the flowchart of FIG. When saving the moving image data of both the transmitting side and the receiving side as one moving image data during a videophone call, the user operates the operation unit 103 in FIG. 1 to select the moving image saving process (see FIG. 7). Step S11), a storage screen setting process similar to steps S2 to S4 in FIG. 2 is performed (step S12 in FIG. 7).

  Next, the control unit 101 performs processing for selecting a stored voice that is sounded together with the stored moving image (step S13 in FIG. 7). When the saved voice is the voice on the receiving side, both voices are saved for the voice data from the wireless unit 107, and when the voice is sent from the microphone 113 when the voice is sent from the microphone 113. In this case, the audio data of the wireless unit 107 and the microphone 113 is converted into audio data that can be stored under the control of the control unit 101, and the converted audio data is output to the image processing unit 109. The

  Subsequently, when the control unit 101 detects a moving image storage start input from the operation unit 103, the reception side moving image data received and output by the wireless unit 107, the transmission side moving image data output from the camera 105, and storage The audio data to be processed is compressed and encoded in the moving image storage format in the image processing unit 109 until the moving image storage end is input from the operation unit 103 (steps S14 and S15 in FIG. 7). Subsequently, based on the stored image registration input from the operation unit 103, the control unit 101 performs storage processing for storing the moving image data processed in the storage format by the image processing unit 109 in the memory 104 under the control of the control unit 101. This is performed (step S16 in FIG. 7).

  Next, still another embodiment of the present invention will be described. In this embodiment, one synthesized still image or synthesized video obtained by synthesizing the images (still images) or videos of the transmitting side and the receiving side saved in each of the above embodiments is being used for a videophone call. It is characterized in that it is replaced with image data.

  Therefore, the configuration of the present embodiment is the same as that in FIG. 1, but the processing by the control unit 101 is different from the above embodiment. The processing by the control unit 101 will be described with reference to the flowchart of FIG. In the figure, the same processing steps as those in FIG. In this embodiment, the composite image data stored in the memory 104 in step S21 in FIG. 8 is replaced with image data and audio data during a videophone call under the control of the control unit 101, and the wireless unit 107 and the antenna 108 are replaced. To the receiver side (step S22 in FIG. 8).

  As a result, if the receiving side mobile phone terminal of the other party is also configured as shown in the block diagram of FIG. 1, the receiving side mobile phone terminal performs image registration processing on the receiving side as necessary, and receives it in its memory. The synthesized image (still image or moving image) data and audio data are stored. In this case, both the transmitting side and the receiving side can simultaneously store the synthesized image data and the voice data obtained at the same timing during the call, and can share the same synthesized image and the voice. In addition, since synthetic image data and audio data are transmitted and received during a call, it is possible to save the trouble of separately transmitting them after the call ends, and it is possible to share a captured image or moving image with the other party immediately.

  The present invention is not limited to the above embodiment. For example, audio data does not necessarily have to be registered and stored or transmitted together with the synthesized image data.

It is a block diagram of one embodiment of a mobile phone terminal according to the present invention. It is a flowchart for image operation | movement preservation | save process operation | movement of one embodiment of this invention. It is a figure which shows an example of the image display during a videophone. It is a figure which shows an example of selection of a cutting-out image range. It is a figure which shows an example of the paste position selection of a cut-out image. It is a figure which shows an example of a division | segmentation synthetic | combination image. It is a flowchart for image operation preservation | save processing operation | movement description of other embodiment of this invention. It is a flowchart for operation | movement explanation of further another embodiment of this invention.

Explanation of symbols

101 control unit 102 central processing unit (CPU)
DESCRIPTION OF SYMBOLS 103 Operation part 104 Memory 105 Camera 106 Display part 107 Radio | wireless part 109 Image processing part 110, 111 Buffer 112 Receiver 113 Microphone 201, 201'204 Reception side image 202, 202 'Transmission side image 203 Cutout range 205 Cutout image

Claims (7)

In a mobile phone terminal with a videophone function capable of transmitting and receiving image data and audio data,
First image data acquisition means for acquiring first image data relating to the image of the user on the transmission side;
Second image data acquisition means for receiving image data of a user of the counterpart terminal and acquiring second image data relating to the user of the counterpart terminal transmitted from the counterpart terminal on the receiving side;
First synthesized image generating means for synthesizing the first and second image data during a call with the counterpart terminal to generate one synthesized image data;
A display unit for displaying a first composite image based on the composite image data generated by the first composite image generation unit;
Of the first composite image displayed on the display unit, one arbitrarily selected image is arbitrarily selected from the first image based on the first image data or the second image based on the second image data. A second composite image generating means for obtaining data of a second composite image obtained by cutting out the cut-out image with a size of and pasting the cut-out image at an arbitrary position relative to the other image
A display / storing unit for displaying the second composite image on the display unit and storing the data of the second composite image in a storage unit during a call with the counterpart terminal. Mobile phone terminal.   The composite image that is transmitted to the partner terminal by replacing the data of the second composite image saved in the storage unit by the display / save unit with a call signal to the partner terminal during a call with the partner terminal. 2. The mobile phone terminal according to claim 1, further comprising data transmission means.   2. The storage device according to claim 1, further comprising: a storage unit that stores, in a storage unit, composite image data corresponding to the data of the second composite image transmitted from the counterpart terminal during a call with the counterpart terminal. Or the mobile telephone terminal of 2.   4. The mobile phone terminal according to claim 1, wherein the first and second image data are still image data or moving image data. In an image composition method for a mobile phone terminal with a videophone function capable of transmitting and receiving image data and audio data,
A first step of obtaining first image data relating to an image of a user on the transmission side;
A second step of receiving image data of the user of the counterpart terminal transmitted from the counterpart terminal on the receiver side and acquiring second image data relating to the user of the counterpart terminal;
A third step of synthesizing the first and second image data during a call with the counterpart terminal to generate one composite image data;
One arbitrarily selected from the first image based on the first image data or the second image based on the second image data among the first composite images based on the composite image data displayed on the display unit. A fourth step of obtaining data of a second composite image obtained by cutting out the image of any size in an arbitrary size and pasting the cut-out image at an arbitrary position with respect to the other image;
A second step of displaying the second composite image on the display unit during a call with the counterpart terminal and storing data of the second composite image in a storage unit. Image composition method.   The second composite image data stored in the storage unit in the fifth step is transmitted to the counterpart terminal while being exchanged with a call signal to the counterpart terminal during a call with the counterpart terminal. The image synthesizing method according to claim 5, further comprising: 7. The image composition method according to claim 5, wherein the first and second image data are still image data or moving image data.

Images