JP2018196017A - Communication terminal and communication system - Google Patents

Abstract

To provide a communication terminal enabling communication depending on a user's state.SOLUTION: A communication unit 101 transmits/receives a message; and a timer unit 102 performs count processing for indicating a state a user can handle. For example, the timer unit 102 starts the count processing at the time of the communication unit 101 performing message transmission, or starts the count processing at the time of a control unit 107 performing face authentication processing on the user. When a message is received by the communication unit 101 according to control by the control unit 107, a speaker 104 performs real-time processing on the message received by the communication unit 101 depending on a count time by the timer unit 102.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a communication terminal and a communication system for transmitting and receiving messages.

  2. Description of the Related Art Conventionally, communication systems that transmit and receive text messages and voice messages according to the circumstances of the time are known. For example, Patent Document 1 describes a communication media automatic conversion system that allows a communication media used for incoming calls to be selected independently of a communication media selected by a user on the calling side. There is a description that an appropriate communication medium (such as voice or text) is selected based on presence information on the called side with reference to the table, and the SIP server performs media conversion processing accordingly.

JP 2008-85838 A

  In the communication system described in Patent Document 1, presence information needs to be registered in advance. Further, the user does not necessarily act according to the presence information, and it is difficult to select a message form according to the user's state.

  Then, an object of this invention is to provide the communication terminal and communication system which enable communication according to a user's state.

  In order to solve the above-described problem, a communication terminal according to the present invention includes a communication unit that transmits and receives a message, a communication unit that transmits and receives a message, and a timer unit that performs time measurement processing to indicate a state that the user can handle And, when a message is transmitted to the communication terminal, a control unit that performs control for performing real-time processing on the transmitted message according to a time measured by the timer unit, and outputs the real-time processed message An output unit.

  According to the present invention, it is possible to perform real-time processing based on a timer time for indicating a state that the user can handle, and appropriate processing according to the situation can be performed. Therefore, a comfortable communication for the user can be realized.

  ADVANTAGE OF THE INVENTION According to this invention, a comfortable communication for a user is realizable.

It is a block diagram which shows the function structure of the communication terminal 100 of this embodiment. 4 is a flowchart showing processing when a text message is received from a mobile terminal which is a counterpart terminal in communication terminal 100. FIG. 5 is a flowchart showing processing of the communication terminal 100 when an incoming call request for a voice call is received from the mobile terminal. It is a flowchart which shows the process of the communication terminal 100 when a reply is received outside predetermined time after transmission of a text message. It is a flowchart which shows the process of the communication terminal 100 when a message is transmitted from a portable terminal after face authentication. It is a flowchart which shows the process of the communication terminal 100 when performing face authentication after receiving a message. It is a flowchart which shows the process of the communication terminal 100 when processing the incoming signal for an audio | voice request | requirement. 2 is a hardware configuration diagram of a communication terminal 100. FIG.

  Embodiments of the present invention will be described with reference to the accompanying drawings. Where possible, the same parts are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 1 is a block diagram illustrating a functional configuration of the communication terminal 100 according to the present embodiment. The communication terminal 100 includes a communication unit 101, a timer unit 102, a microphone 103, a speaker 104 (output unit), a camera 105, a display 106, and a control unit 107 (control unit, authentication unit).

  The communication unit 101 is a part that communicates with a counterpart terminal wirelessly or by wire. The communication unit 101 performs communication using a text message (or including a voice file attached) by voice communication and chat communication via e-mail (such as text mail or voice mail) or SNS.

  The timer unit 102 is a part that performs time measurement processing according to a predetermined condition. The timer unit 102 is for measuring a timer time indicating a state that the user can handle.

  The microphone 103 is a part that collects the voice of the user of the communication terminal 100.

  The speaker 104 is a part that outputs sound based on the message communicated by the communication unit 101.

  The camera 105 is a part that photographs the user of the communication terminal 100 and other subjects. The camera 105 is a part that performs shooting processing for authentication, for example, shooting for user face authentication.

  The display 106 is a part that displays information indicating the state of the communication terminal 100. For example, information indicating that the communication terminal 100 is activated is displayed.

  The control unit 107 is a part that controls the communication unit 101 to the display 106. The control unit 107 performs face authentication processing based on the user image taken by the camera 105. In addition to face authentication, biometric authentication using a fingerprint or an iris may be used. In addition, the control unit 107 performs processing for mutually converting the text message and the voice communicated by the communication unit 101 according to a predetermined condition.

  The communication terminal 100 is a terminal based on a concept that does not include a manual input unit such as a keyboard and a touch panel. The terminal is activated by face authentication processing by the camera 105. Then, after the face authentication process, the user can input a transmission destination and a message by inputting voice through the microphone 103. In addition, if there is a received message after face authentication, it is converted to voice as necessary and output.

  Hereinafter, the operation of the communication terminal 100 will be described. FIG. 2 is a flowchart showing processing when a text message is received from a portable terminal which is a transmission destination in the communication terminal 100 of the present embodiment.

  In the communication terminal 100, the camera 105 captures the user, and the control unit 107 performs face authentication processing based on the captured user image data (S101). This is performed based on user face data registered in advance.

  The communication terminal 100 is activated by inputting a predetermined voice, and then can perform face authentication processing, transmission destination and message reception. In the present embodiment, the microphone 103 collects sound generated by the user, and the control unit 107 performs analysis processing on the collected sound. Then, the control unit 107 determines the destination according to the analysis process, and converts the voice received after the destination determination into a text message. Note that the communication terminal 100 stores a transmission destination (phone number or mail address) and a name in advance in association with each other, and can determine a corresponding transmission destination by inputting the name by voice.

  The communication unit 101 transmits the converted text message to the mobile terminal (S103). Along with the transmission of the text message, the timer unit 102 starts a timing process (S104).

  When the mobile terminal receives the text message, the text message is transmitted according to the operation of the user of the mobile terminal (S105).

  In the communication terminal 100, when the communication unit 101 receives a text message from the mobile terminal, the communication unit 101 determines the timer time counted by the timer unit 102 (S106). Here, the control unit 107 determines that the timer time is equal to or shorter than a predetermined time.

  Then, the control unit 107 converts the received text data into speech, and the control unit 107 outputs speech from the speaker 104 as a text data reading process (S107). Thereafter, the microphone 103 receives the voice from the user, the control unit 107 converts the voice into a text message (S108), and the communication unit 101 transmits the text message to the mobile terminal (S109).

  According to the above-described processing, if the text message is received within a predetermined time after the text message is transmitted, it can be determined that the user of the communication terminal 100 is in the vicinity of the communication terminal 100. Therefore, the communication terminal 100 can transmit a message to the user of the communication terminal 100 in real time by converting the received text message into a voice.

  If the timer time is within the predetermined time in S106, the communication terminal 100 automatically establishes a communication path for streaming delivery or videophone to the mobile terminal after the text reading process in S107. May be. The same applies to the embodiments described below.

  If this process is followed, there is a high possibility that both users of the communication terminal 100 and the portable terminal are compatible, and real-time communication can be performed.

  Further, in the processing S105, the description is made in which the mobile terminal returns a text message. However, the present invention is not limited to this, and the case where a text message is received from a mobile terminal different from the transmission destination in the processing S103 is also applied. The same applies to the embodiments described below.

  In the above process, the timer unit 102 has started the timing process in response to the message transmission. However, the present invention is not limited to this. For example, the timer unit 102 may perform the first time measurement process (first timer time) in response to the message transmission, and may perform the second time measurement process (second timer time) after performing face authentication. . When the first timer time based on the first time measurement process and the second timer time based on the second time measurement process are both within the predetermined time, the control unit 107 responds by the user This is a possible state, and control for performing real-time processing may be performed.

  In the present embodiment (including the embodiments described below), the communication terminal 100 is described as converting a text message into a voice or converting a voice into a text message as real-time processing. It is not limited. The conversion process between the text message and the voice may be performed in a node arranged on the network such as a server.

  When the mobile terminal transmits a text message to the communication terminal 100, the server (not shown) temporarily stores the text message. When the server transmits a notification indicating that the message has been received to the communication terminal 100, the communication terminal 100, in accordance with the control of the control unit 107, determines the time when the notification is received after transmitting the text message transmission. If it is within the time, as a real-time process, the server is requested to convert the text message into speech, and processing for acquiring the speech is performed. If the message from the mobile terminal is a voice, no conversion request is required.

  Next, processing when a text message is transmitted from the communication terminal 100 and an incoming call request for a voice call is received from the mobile terminal will be described. FIG. 3 is a flowchart showing processing of the communication terminal 100 when an incoming call request for a voice call is received from the mobile terminal.

  Similar to the processing of S101 to S104 in FIG. 2, the communication terminal 100 performs face authentication processing, receives a voice message, converts it into a text message, and transmits the text message to a destination mobile terminal (S201 to S201). S203). Along with the transmission, the timer unit 102 starts timing processing (S204).

  When the mobile terminal receives the text message, an incoming signal for a voice call is transmitted according to the operation of the user of the mobile terminal (S205).

  In the communication terminal 100, when the communication unit 101 receives the incoming signal, the control unit 107 determines the timer time of the timer unit 102 (S206). Here, the control unit 107 determines that the timer time is equal to or shorter than a predetermined time.

  Then, the communication unit 101 performs an incoming call process (S207) and establishes a communication path with the mobile terminal (S208). Then, a call can be made between the communication terminal 100 and the portable terminal.

  In step S208, a bi-directional communication path for videophone is established, but a communication path for transmitting only video and audio from the mobile terminal may be established. This is in consideration of the privacy of the user of the communication terminal 100. That is, the case where the privacy of the user of the communication terminal 100 is infringed when the communication path for the videophone call is automatically connected due to the convenience of the mobile phone user is taken into consideration.

  In the process in FIG. 3 as well, in the same way as the process in FIG. 2, a real-time voice call is made possible based on the timer time.

  Next, the processing when the timer time is equal to or longer than the predetermined time in S106 in FIG. 2 and S206 in FIG. 3 will be described. FIG. 4 is a flowchart illustrating processing of the communication terminal 100 when a reply is received outside a predetermined time after the text message is transmitted.

  Processes S301 to S305 in FIG. 4 are the same processes as S101 to S105 in FIG. That is, the communication terminal 100 performs user face authentication processing, and then transmits a text message to the mobile terminal. Along with the transmission, the timer unit 102 starts timing processing. Thereafter, the communication terminal 100 receives a text message from the mobile terminal.

  When the communication terminal 100 receives a text message from the portable terminal, the control unit 107 determines the timer time of the timer unit 102 (S306). Here, it is determined that the timer time is equal to or longer than a predetermined time.

  When determining that the timer time is equal to or longer than the predetermined time, the control unit 107 temporarily stores the received text message in the memory 108 (S307). When a predetermined time elapses after the text message is transmitted, the user of the communication terminal 100 can determine that the user is not in the vicinity thereof, and thus real-time processing is not performed.

  Thereafter, the control unit 107 performs face authentication processing for the user of the communication terminal 100 (S308), takes out a text message from the memory 108, and converts it into speech. Then, the speaker 104 outputs the converted sound (S309).

  In step S306, even if the timer time from the text message transmission time is determined to be equal to or longer than the predetermined time, if the time after the face authentication processing is within the predetermined time, real-time processing may be performed. . This is because in a situation where face authentication is performed regularly or constantly, it is highly likely that the user stays in the vicinity of the communication terminal 100 even if a certain time or more has passed since the message transmission by the communication terminal 100.

  Further, although the text message is received in the process S305, it may be a reception notification from the server. In that case, in the process S308, the communication terminal 100 acquires voice to the server at the timing when face authentication is performed. If the message from the mobile terminal is a text message, a request is made to convert the text message to speech, and the communication terminal 100 acquires the converted speech from the server.

  According to the above-described processing, whether or not to perform real-time processing can be switched depending on the state of the user, for example, whether or not the user is in the vicinity of the communication terminal 100.

  In the present embodiment, it is assumed that one communication terminal 100 is used for one user. However, when a plurality of users use one communication terminal 100, text message destinations and face authentication are performed. It is necessary to maintain consistency. Therefore, when a plurality of users use the text message reading process (voice output process) in the above-described process S309, the text message transmission destination (user) in the process S305 and the face authentication in the process S308 are specified. Preferably, it is performed only when the user matches.

  2 and 4, when a text message is transmitted from the portable terminal (105 in FIG. 2, S305 in FIG. 4), the process of reading out or storing the text message is performed according to the timer time. However, in either case, it may be temporarily stored in the memory 108 and it may be determined whether or not to read out immediately according to the timer time.

  The processes in FIGS. 2 to 4 described above indicate processes according to whether or not a reply was received within a predetermined time after transmitting a message from the communication terminal 100. Next, a process when a message is transmitted from the mobile terminal without transmitting a message from the communication terminal 100 will be described. FIG. 5 is a flowchart showing processing of communication terminal 100 after performing face authentication at that time.

  The control unit 107 performs face authentication processing based on user image data captured by the camera 105 (S401). The timer unit 102 starts a timing process in accordance with the face authentication process (S402).

  Thereafter, in the communication terminal 100, the communication unit 101 receives a text message from the mobile terminal (S403), and stores the text message in the memory 108 (S404). After storing the text message, the control unit 107 determines whether or not the timer time counted by the timer unit 102 has exceeded a predetermined time (S405). Here, it is determined that the timer time is within a predetermined time.

  When the control unit 107 determines that the timer time is within the predetermined time, the control unit 107 extracts the text message from the memory, converts it into a voice, and outputs the voice from the speaker 104 as a text message reading process ( S406).

  According to the above processing, processing corresponding to the user's condition can be performed by performing real-time processing until a predetermined time after the face authentication processing.

  Similarly to the above, the conversion process to voice may be performed in the server. That is, instead of sending the text message in step S403, a reception notification from the server is sent. If the reception notification is within a predetermined time after the face authentication, the communication terminal 100 performs a voice conversion request and a voice acquisition process on the server.

  When the timer time is within the predetermined time in S405, the communication terminal 100 automatically establishes a communication path for streaming delivery or videophone to the mobile terminal after the text reading process in S406. May be.

  Next, processing of the communication terminal 100 that has received the text message before the face authentication processing will be described. FIG. 6 is a flowchart of the communication terminal 100.

  In the communication terminal 100, the communication unit 101 receives a text message from the portable terminal (S501), and the control unit 107 stores the received text message in the memory 108 (S502). Until this time, the user is not yet in the vicinity of the communication terminal 100, and thus face authentication processing has not been performed.

  Thereafter, in the communication terminal 100, the control unit 107 performs user face authentication processing using the camera 105 (S503), and the timer unit 102 starts timing (S504).

  On the other hand, the control unit 107 extracts the text message stored in the memory 108, converts it into voice, and outputs the voice from the speaker 104 (S505).

  Thereafter, when the timer unit 102 elapses for a predetermined time, the face authentication state becomes invalid (S506, S507).

  According to the above processing, when receiving a text message in a state before the face authentication processing, the communication terminal 100 stores the text message in the memory 108 without performing real-time processing. Then, a text message reading process is performed in accordance with the face authentication process. Therefore, real-time processing can be performed according to the user's state.

  As described above, instead of transmitting the text message in step S501, the server may transmit a reception notification of the message transmitted from the mobile terminal to the communication terminal 100. The communication terminal 100 stores the reception notification, and performs a request for conversion to speech and acquisition processing of the speech to the server after face authentication.

  Next, processing of the communication terminal 100 when processing an incoming signal for voice request will be described. FIG. 7 is a flowchart showing the processing in the communication terminal 100.

  The control unit 107 performs face authentication processing based on user image data captured by the camera 105 (S601). The timer unit 102 starts a time measurement process in accordance with the face authentication process (S602).

  Thereafter, in the communication terminal 100, the communication unit 101 receives an incoming signal for a videophone call from the mobile terminal (S603).

  The control unit 107 determines whether the timer time of the timer unit 102 has elapsed a predetermined time (S604). Here, it is determined that the timer time is equal to or shorter than a predetermined time.

  When the control unit 107 determines that the timer time is equal to or shorter than the predetermined time, the communication unit 101 performs an incoming call process on the incoming signal (S605), and a communication path is established (S606).

  According to the above process, the communication terminal 100 can determine that the user is in the vicinity of the communication terminal 100 within a predetermined time after the face authentication process, and therefore performs an incoming call process and a communication path establishment process. Conversely, when determining that the predetermined time has elapsed, the user can determine that the user is within the vicinity of the communication terminal 100. In that case, incoming call processing is not performed. In addition, you may make it respond automatically by an answering machine function.

  Next, operational effects of the communication terminal 100 of the present embodiment will be described.

  In the communication terminal 100 according to the present embodiment, the communication unit 101 transmits and receives messages, and the timer unit 102 performs time measurement processing to indicate a state that the user can handle. For example, the timer unit 102 starts the timing process when the communication unit 101 transmits a message, or when the face authentication process is performed by the control unit 107 for the user.

  Then, when a message is received by the communication unit 101 according to control by the control unit 107, the speaker 104 performs real-time processing on the message received by the communication unit 101 according to the time measured by the timer unit 102.

  If this process is followed, real-time processing can be performed based on the state that the user can handle, and appropriate processing according to the situation can be performed. Therefore, communication suitable for the user can be realized.

  In this communication terminal 100, when a text message is transmitted to the communication terminal 100, the control unit 107 converts the text message into voice when performing real-time processing according to the time measured by the timer unit 102. Process to do. For example, when a text message is received by the own device, the own device performs conversion processing. Alternatively, when the server receives a text message, the server requests the server for conversion processing and acquires the voice. Then, the speaker 104 outputs the converted sound after processing for sound conversion by the control unit 107.

  If this process is followed, a text message can be converted into a sound suitable for real-time processing and output, and a comfortable communication for the user can be realized.

  Further, in this communication terminal 100, the control unit 107 performs a process for converting a text message into a voice after performing a predetermined process when not performing real-time processing according to the time measured by the timer unit 102. I do. The speaker 104 outputs the converted sound after processing for conversion to sound.

  According to this processing, when real-time processing is not performed, processing for converting a text message into speech is performed when predetermined processing is performed. For example, after performing the face authentication process, a conversion process is performed in the own apparatus or the server, thereby enabling voice communication when the user is ready for handling.

  In the communication terminal 100, when a voice message is received by the communication unit 101, the speaker 104 outputs a voice message as real-time processing according to the time measured by the timer unit 102.

  There is no need to convert voice messages such as voicemail. Therefore, in the case of a voice message, appropriate communication is possible by outputting the message as it is without performing a conversion process.

  In communication terminal 100, when communication unit 101 receives an incoming call request for a voice call (videophone or voice call), when performing real-time processing according to the time measured by timer unit 102, voice communication The communication path for voice call is established with respect to the portable terminal that is the transmission source device of the incoming call request.

  If this process is followed, the communication path for the voice call can be automatically established, so that quick and comfortable communication can be provided to the user.

  Further, in the communication terminal 100 of the present embodiment, the timer unit 102 starts the first time measurement process along with the message transmission by the communication unit 101 to indicate a state that the user can handle, and performs the authentication process for the user. When this is done, the second timing process is started.

  Then, when a message is transmitted to communication terminal 100, control unit 107 determines the message received by communication unit 101 for real-time processing according to the first time measured by timer unit 102 and the second time measured. The processing is performed, and the speaker 104 outputs sound corresponding to the processing.

  For example, when both the first timekeeping process and the second timekeeping process are within a predetermined time, the user can be determined to be in the vicinity of the communication terminal 100 and capable of handling.

  On the other hand, if either one of the first timing process and the second timing process is not within the predetermined time, the user can determine that the user is not in the vicinity of the communication terminal 100. The predetermined time for the first time measurement process and the second time measurement process may be the same time, or either one may be lengthened. It is preferable to set a preferable time according to the situation of each user.

  Therefore, it is possible to provide a more comfortable communication to the user by determining whether or not the user can respond based on both the first time measurement process and the second time measurement process.

  The block diagram used in the description of the above embodiment shows functional unit blocks. These functional blocks (components) are realized by any combination of hardware and / or software. Further, the means for realizing each functional block is not particularly limited. That is, each functional block may be realized by one device physically and / or logically coupled, and two or more devices physically and / or logically separated may be directly and / or indirectly. (For example, wired and / or wireless) and may be realized by these plural devices.

  For example, the communication terminal 100 according to an embodiment of the present invention may function as a computer that performs processing of the communication terminal 100 according to the present embodiment. FIG. 8 is a diagram illustrating an example of a hardware configuration of the communication terminal 100 according to the present embodiment. The communication terminal 100 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an output device 1006, a bus 1007, and the like.

  In the following description, the term “apparatus” can be read as a circuit, a device, a unit, or the like. The hardware configuration of the communication terminal 100 may be configured to include one or a plurality of the devices illustrated in the figure, or may be configured not to include some devices.

  Each function in the communication terminal 100 is obtained by reading predetermined software (program) on hardware such as the processor 1001 and the memory 1002, so that the processor 1001 performs an operation and performs communication by the communication device 1004, memory 1002 and storage 1003. This is realized by controlling the reading and / or writing of data.

  For example, the processor 1001 controls the entire computer by operating an operating system. The processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic device, a register, and the like. For example, the control unit 107 and the like may be realized by the processor 1001.

  Further, the processor 1001 reads a program (program code), software module, and data from the storage 1003 and / or the communication device 1004 to the memory 1002, and executes various processes according to these. As the program, a program that causes a computer to execute at least a part of the operations described in the above embodiments is used. For example, the control unit 107 of the communication terminal 100 may be realized by a control program stored in the memory 1002 and operated by the processor 1001, and may be realized similarly for other functional blocks. Although the above-described various processes have been described as being executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. Note that the program may be transmitted from a network via a telecommunication line.

  The memory 1002 is a computer-readable recording medium and includes, for example, at least one of ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), RAM (Random Access Memory), and the like. May be. The memory 1002 may be called a register, a cache, a main memory (main storage device), or the like. The memory 1002 can store a program (program code), a software module, and the like that can be executed to implement the wireless communication method according to the embodiment of the present invention.

  The storage 1003 is a computer-readable recording medium such as an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (for example, a compact disk, a digital versatile disk, a Blu-ray (Registered trademark) disk, smart card, flash memory (for example, card, stick, key drive), floppy (registered trademark) disk, magnetic strip, and the like. The storage 1003 may be referred to as an auxiliary storage device. The storage medium described above may be, for example, a database, server, or other suitable medium including the memory 1002 and / or the storage 1003.

  The communication device 1004 is hardware (transmission / reception device) for performing communication between computers via a wired and / or wireless network, and is also referred to as a network device, a network controller, a network card, a communication module, or the like. For example, the communication unit 101 described above may be realized by the communication device 1004.

  The output device 1006 is an output device (for example, a display, a speaker, an LED lamp, etc.) that performs output to the outside. Each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. The bus 1007 may be configured with a single bus or may be configured with different buses between apparatuses.

  The communication terminal 100 includes hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), and a field programmable gate array (FPGA). A part or all of each functional block may be realized by the hardware. For example, the processor 1001 may be implemented by at least one of these hardware.

  Although the present embodiment has been described in detail above, it will be apparent to those skilled in the art that the present embodiment is not limited to the embodiment described in this specification. The present embodiment can be implemented as a modification and change without departing from the spirit and scope of the present invention defined by the description of the scope of claims. Therefore, the description of the present specification is for illustrative purposes and does not have any limiting meaning to the present embodiment.

  The notification of information is not limited to the aspect / embodiment described in the present specification, and may be performed by other methods. For example, notification of information includes physical layer signaling (for example, DCI (Downlink Control Information), UCI (Uplink Control Information)), upper layer signaling (for example, RRC (Radio Resource Control) signaling, MAC (Medium Access Control) signaling), It may be implemented by broadcast information (MIB (Master Information Block), SIB (System Information Block))), other signals, or a combination thereof. Further, the RRC signaling may be referred to as an RRC message, and may be, for example, an RRC connection setup message, an RRC connection reconfiguration message, or the like.

  Each aspect / embodiment described herein includes LTE (Long Term Evolution), LTE-A (LTE-Advanced), SUPER 3G, IMT-Advanced, 4G, 5G, FRA (Future Radio Access), W-CDMA. (Registered trademark), GSM (registered trademark), CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi), IEEE 802.16 (WiMAX), IEEE 802.20, UWB (Ultra-WideBand), The present invention may be applied to a Bluetooth (registered trademark), a system using another appropriate system, and / or a next generation system extended based on the system.

  As long as there is no contradiction, the order of the processing procedures, sequences, flowcharts, and the like of each aspect / embodiment described in this specification may be changed. For example, the methods described herein present the elements of the various steps in an exemplary order and are not limited to the specific order presented.

  Input / output information and the like may be stored in a specific location (for example, a memory) or may be managed by a management table. Input / output information and the like can be overwritten, updated, or additionally written. The output information or the like may be deleted. The input information or the like may be transmitted to another device.

  The determination may be performed by a value represented by 1 bit (0 or 1), may be performed by a true / false value (Boolean: true or false), or may be performed by comparing numerical values (for example, a predetermined value) Comparison with the value).

  Each aspect / embodiment described in this specification may be used independently, may be used in combination, or may be switched according to execution. In addition, notification of predetermined information (for example, notification of being “X”) is not limited to explicitly performed, but is performed implicitly (for example, notification of the predetermined information is not performed). Also good.

  Software, whether it is called software, firmware, middleware, microcode, hardware description language, or other names, instructions, instruction sets, codes, code segments, program codes, programs, subprograms, software modules , Applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc. should be interpreted broadly.

  Also, software, instructions, etc. may be transmitted / received via a transmission medium. For example, software may use websites, servers, or other devices using wired technology such as coaxial cable, fiber optic cable, twisted pair and digital subscriber line (DSL) and / or wireless technology such as infrared, wireless and microwave. When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission media.

  Information, signals, etc. described herein may be represented using any of a variety of different technologies. For example, data, commands, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description are voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these May be represented by a combination of

  Note that the terms described in this specification and / or terms necessary for understanding this specification may be replaced with terms having the same or similar meaning.

  In addition, information, parameters, and the like described in this specification may be represented by absolute values, may be represented by relative values from a predetermined value, or may be represented by other corresponding information. . For example, the radio resource may be indicated by an index.

  As used herein, the terms “determining” and “determining” may encompass a wide variety of actions. “Judgment”, “decision” can be, for example, calculating, computing, processing, deriving, investigating, looking up (eg, table, database or another (Searching in the data structure), and confirming (ascertaining) what has been confirmed may be considered as “determining” or “determining”. In addition, “determination” and “determination” include receiving (for example, receiving information), transmitting (for example, transmitting information), input (input), output (output), and access. (accessing) (e.g., accessing data in a memory) may be considered as "determined" or "determined". In addition, “determination” and “decision” means that “resolving”, “selecting”, “choosing”, “establishing”, and “comparing” are regarded as “determining” and “deciding”. May be included. In other words, “determination” and “determination” may include considering some operation as “determination” and “determination”.

  As used herein, the phrase “based on” does not mean “based only on,” unless expressly specified otherwise. In other words, the phrase “based on” means both “based only on” and “based at least on.”

  Where the designation "first", "second", etc. is used herein, any reference to that element does not generally limit the amount or order of those elements. These designations can be used herein as a convenient way to distinguish between two or more elements. Thus, a reference to the first and second elements does not mean that only two elements can be employed there, or that in some way the first element must precede the second element.

  These terms are similar to the term “comprising” as long as “include”, “including” and variations thereof are used herein or in the claims. It is intended to be comprehensive. Furthermore, the term “or” as used herein or in the claims is not intended to be an exclusive OR.

  In this specification, a plurality of devices are also included unless there is only one device that is clearly present in context or technically.

  Throughout this disclosure, the plural is included unless the context clearly indicates one.

DESCRIPTION OF SYMBOLS 100 ... Communication terminal, 101 ... Communication part, 102 ... Timer part, 103 ... Microphone, 104 ... Speaker, 105 ... Camera, 106 ... Display, 107 ... Control part, 108 ... Memory.

Claims (8)

In a communication terminal that sends and receives messages,
A communication unit for sending and receiving messages;
A timer unit that performs a timing process to indicate a state that the user can handle;
When a message is transmitted to the communication terminal, a control unit that performs control for processing the transmitted message in real time according to a time measured by the timer unit;
An output unit for outputting the real-time processed message;
A communication terminal comprising: The timer unit starts a time measurement process along with message transmission by the communication unit,
The communication terminal according to claim 1. An authentication unit that performs authentication processing for the user is further provided,
The timer unit starts timing processing when performing authentication processing for the user,
The communication terminal according to claim 1. The controller is
When a text message is sent to the communication terminal, according to the time measured by the timer unit, in the case of real-time processing, perform processing for converting the text message to speech,
The output unit outputs the converted voice;
The communication terminal as described in any one of Claim 1 to 3. A memory unit for storing the text message;
When the control unit does not perform real-time processing according to the time measured by the timer unit, the text message is temporarily stored in the memory, and after user authentication is performed, a process for converting the text message into speech And
The output unit outputs the converted voice;
The communication terminal according to claim 4. When the communication unit receives an incoming request for a voice call and performs real-time processing according to the time measured by the timer unit, the communication unit sends a voice to the source device of the incoming request for the voice call. Establish a communication path for calls
The communication terminal according to any one of claims 1 to 5. A communication unit for sending and receiving messages;
In order to indicate a state that can be handled by the user, a timer unit that starts the first timing process in response to the message transmission by the communication unit, and starts the second timing process when the authentication process for the user is performed,
When a message is transmitted to the communication terminal, the transmitted message is processed in real time according to the first time by the first timekeeping process by the timer unit and the second time by the second timekeeping process. A control unit for performing control for
An output unit for outputting the real-time processed message;
A communication terminal comprising: In a communication system for sending and receiving messages,
A communication unit for sending and receiving messages;
A timer unit that performs a timing process to indicate a state that the user can handle;
When the message is received, a control unit that performs real-time processing on the received message according to the time measured by the timer unit;
An output unit for outputting the real-time processed message;
A communication system comprising:

Images