JP6213297B2 - Image forming system, image forming apparatus, remote control device, and program - Google Patents

Description

  The present invention relates to an image forming system including an image forming apparatus such as an MFP (Multi-Functional Peripheral), and a related technology.

  There is a technique for operating an image forming apparatus with an external terminal (remote operation apparatus).

  For example, in Patent Document 1, the operation screen data itself (bitmap image data or the like) is transmitted as it is from the image forming apparatus to the external terminal, and the operation screen is displayed on the display unit of the external terminal. A technique for receiving operation input in an operation screen by transmitting / receiving operation position information (pressed position information, etc.) is shown. This is a remote operation technology by so-called remote connection.

Japanese Patent Laid-Open No. 05-122424

  By the way, in the remote operation technology related to the image forming apparatus as described above, a keyboard screen having a software keyboard is used when inputting characters. Specifically, keyboard screen data itself (bitmap image data or the like) is transmitted from the image forming apparatus to the external terminal, and the keyboard screen is displayed on the display unit of the external terminal. Then, operation position information (pressed position information and the like) in the keyboard screen is transmitted from the external terminal to the image forming apparatus, and character input in the operation screen is accepted.

  When inputting characters, it is conceivable that character conversion is performed on the input kana character string. For example, when a hiragana character string is input on the keyboard screen displayed on the display unit of the external terminal and the conversion button is pressed, character conversion for the character string (for example, conversion from kana characters to kanji characters) forms an image. Performed in the apparatus. Then, a screen showing conversion candidates is displayed on the display unit of the external terminal, and the user can select a desired conversion candidate as a conversion result.

  Here, in many cases, the character conversion function of the image forming apparatus is not sufficient, and there is no kanji conversion candidate for the input kana character string in the image forming apparatus, and character conversion (kanji conversion) may not be performed. . For example, even if the user desires to convert the input kana character string “Tomiyasu” into the kanji character string “Tomiyasu”, the kanji conversion candidate corresponding to the character string “Tomiyasu” is an image. There is a case in which character conversion (kanji conversion) is not performed because it does not exist in the forming apparatus. As described above, when the image forming apparatus does not have an excellent character conversion function, it is often impossible to perform comfortable character conversion (and thus character input).

  In consideration of such circumstances, when inputting characters on an external terminal during remote operation of the image forming apparatus, an input method editor (IME) (hereinafter simply referred to as IME) installed in the external terminal is used. It is conceivable to use (also referred to as). The IME has an excellent character conversion function and can perform advanced character conversion.

  However, some external terminals do not necessarily have sufficient hardware performance. In such an external terminal, when a highly functional IME is activated and character input accompanied by kana-kanji conversion is performed, the operability in the character input may be deteriorated. For example, a problem that the time required for the conversion process from the kana character string to the kanji becomes long may occur due to the activation of the IME. Therefore, it is not preferable that the IME is always activated on the external terminal when inputting characters on such an external terminal.

  Accordingly, an object of the present invention is to provide a technique capable of suppressing deterioration in operability of character input in a remote operation device that remotely operates an image forming apparatus.

  In order to solve the above-mentioned problem, the invention of claim 1 is an image forming system, comprising: an image forming apparatus; and a remote operation apparatus for remotely operating the image forming apparatus, wherein the remote operation apparatus is the remote control apparatus. In a state where the IME installed in the operating device is not activated, operating means for accepting input of a character string from the operator, and information related to the input character string input by the operator are transmitted to the image forming apparatus. A communication means, wherein the image forming apparatus receives information related to the input character string from the remote control device, and the input character string specified based on the information related to the input character string. Determining means for determining whether or not there is a kanji conversion candidate in kana-kanji conversion by the image forming apparatus; and determining that there is no kanji conversion candidate. In this case, a transmission means for transmitting an activation command to activate the IME installed in the remote operation device to the remote operation device, and the communication means of the remote operation device includes the An activation command is received from the image forming apparatus, and the remote control device further includes display control means for activating the IME when the activation command is received from the image forming apparatus.

  According to a second aspect of the present invention, in the image forming system according to the first aspect of the invention, the operation means of the remote control device accepts an activation instruction operation that is an operation of instructing activation of the IME from the operator, When the activation instruction operation is accepted, the communication unit of the remote operation device transmits acceptance information indicating that the activation instruction operation is accepted to the image forming apparatus, and the transmission unit of the image forming apparatus includes: Even when it is determined that there is a conversion candidate for the Chinese character, the activation command is transmitted to the remote operation device when the reception information is received from the remote operation device.

  According to a third aspect of the present invention, in the image forming system according to the second aspect of the invention, the operation means of the remote operation device is a button in a display screen displayed on the operation means, and instructs activation of the IME. A pressing operation of a button for performing is received from the operator as the activation instruction operation, and the communication unit of the remote control device transmits the reception information to the image forming apparatus when the pressing operation is received. Features.

  According to a fourth aspect of the present invention, in the image forming system according to the second aspect of the invention, the operation means of the remote control device uses the flick operation on the display screen displayed on the operation means as the start instruction operation. When the flick operation is accepted, the communication unit of the remote operation device transmits the acceptance information to the image forming apparatus.

  According to a fifth aspect of the present invention, in the image forming system according to any one of the first to fourth aspects, the communication unit of the remote control device transmits coordinate information of the input character string to the image forming device. The transmission unit of the image forming apparatus transmits text information corresponding to the input character string specified based on the coordinate information to the remote operation device, and the display control unit of the remote operation device includes the display control unit, When text information is received from the image forming apparatus, a conversion candidate by the IME for the input character string specified based on the text information is displayed in the character input screen of the IME when the IME is activated. It is characterized by that.

  According to a sixth aspect of the present invention, in the image forming system according to any one of the second to fourth aspects, the transmitting unit of the image forming apparatus determines that the conversion candidate for the kanji character exists. However, when the reception information is received from the remote operation device, the kanji conversion candidate information is also transmitted to the remote operation device, and the display control means of the remote operation device is configured to perform the image formation. The kanji conversion candidate in the kana-kanji conversion by the device is specified based on the information of the kanji conversion candidate, and the kanji conversion candidate is converted from the conversion candidate by the IME to the input character string with the activation of the IME. The conversion candidates excluding “” are displayed in the IME character input screen.

  According to a seventh aspect of the present invention, in the image forming system according to any one of the first to sixth aspects, the transmission unit of the image forming apparatus activates the IME prior to transmitting the activation command. An image of a selection screen, which is a screen for selecting whether to permit or not, is transmitted to the remote operation device, and the display control unit of the remote operation device receives the image of the selection screen from the image forming device, and The selection screen is displayed on the operation means of the remote operation device, and the operation means of the remote operation device accepts an operation for permitting activation of the IME from the operator on the selection screen, and When the permission operation is accepted, the communication unit transmits activation permission information for permitting activation of the IME to the image forming apparatus, and the transmission unit of the image forming apparatus , When the start permission information is received from the remote control device, and transmits the start command to the remote controller.

  According to an eighth aspect of the present invention, there is provided an image forming apparatus that is remotely operated by a remote control device, wherein information relating to an input character string input by an operator in the operation means of the remote control device is received from the remote control device. Determining means for determining whether or not there exists a kanji conversion candidate in kana-kanji conversion by the image forming apparatus for the input character string specified based on the information related to the input character string; A transmission means for transmitting, to the remote operation device, an activation command to activate the IME installed in the remote operation device when it is determined that there is no kanji conversion candidate. Features.

  According to a ninth aspect of the present invention, there is provided a computer incorporated in an image forming apparatus that is remotely operated by a remote operation device. A) Information regarding an input character string input by an operator in an operation means of the remote operation device is stored in the remote operation. A step of receiving from the apparatus; and b) determining whether or not there is a kanji conversion candidate in the kana-kanji conversion by the image forming apparatus for the input character string specified based on the information related to the input character string. C) a step of transmitting, to the remote control device, a start command indicating that the IME installed in the remote control device should be started when it is determined that there is no conversion candidate for the kanji And a program for executing the above.

  According to a tenth aspect of the present invention, there is provided a remote operation device for remotely operating an image forming apparatus, and an operation for accepting an input of a character string from an operator when an IME installed in the remote operation device is not activated. And an instruction to start the IME installed in the remote operation device, the information on the input character string input by the operator and the input character string is transmitted to the image forming apparatus. Communication means for receiving an activation command from the image forming apparatus based on a determination that kanji conversion candidates for the input character string specified based on information on the character string do not exist in kana / kanji conversion by the image forming apparatus; And a display control unit that activates the IME when an activation command is received from the image forming apparatus.

  According to an eleventh aspect of the present invention, there is provided a computer incorporated in a remote operation device for remotely operating an image forming apparatus. A) a character string from an operator in a state where an IME installed in the remote operation device is not activated. B) a step of transmitting information related to the input character string input by the operator to the image forming apparatus, and c) that the IME installed in the remote operation apparatus should be activated. The image formation command is a start command based on a determination that kanji conversion candidates for the input character string specified based on the information related to the input character string do not exist in kana-kanji conversion by the image forming apparatus. A step of receiving from the apparatus; and d) a step of starting the IME when the start command is received from the image forming apparatus. Characterized in that it is a program for executing the flop, the.

  According to the first to eleventh aspects of the present invention, when the image forming apparatus determines that there is no kanji conversion candidate for the input input character string, the IME installed in the remote control device An activation command is transmitted to the remote control device. When the IME activation command is received from the image forming apparatus, the remote control apparatus activates the IME. Therefore, when performing character input in a remote operation device that remotely operates the image forming apparatus, it is possible to prevent the IME from being always activated and to suppress the opportunity to activate the IME. For this reason, it is possible to suppress deterioration in the operability of character input in a remote operation device that remotely operates the image forming apparatus.

1 is a diagram illustrating an image forming system. 2 is a diagram illustrating functional blocks of an MFP (image forming apparatus). FIG. It is a functional block diagram which shows schematic structure of an external terminal (remote control device). 3 is a flowchart showing the operation of the MFP. It is a flowchart which shows operation | movement of an external terminal. It is a flowchart which shows an input character reception process. It is a flowchart which shows a character input process. 6 is a timing chart illustrating an operation example in the image forming system. It is a figure which shows a character input screen. It is a figure which shows a character input screen. It is a figure which shows a character input screen. It is a figure which shows a selection screen. It is a figure which shows the character input screen of IME. It is a figure which shows a character input screen. It is a figure which shows a conversion candidate list screen. 10 is a flowchart showing an operation of the MFP according to the second embodiment. It is a flowchart which shows operation | movement of the external terminal which concerns on 2nd Embodiment. 12 is a timing chart illustrating an operation example in the image forming system according to the second embodiment. It is a figure which shows the conversion candidate list screen which concerns on 2nd Embodiment. It is a figure which shows the selection screen which concerns on 2nd Embodiment. It is a figure which shows the character input screen of IME which concerns on 2nd Embodiment. It is a figure which shows the mode of the flick operation with respect to the conversion candidate list screen which concerns on the modification of 2nd Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<1. First Embodiment>
<1-1. Outline of configuration>
FIG. 1 is a diagram showing an image forming system 1 according to the present invention. As shown in FIG. 1, the image forming system 1 includes an image forming apparatus 10 and an external terminal 50.

  The image forming apparatus 10 and the external terminal 50 are connected to each other via a network (communication network) 108. The network 108 is configured by a LAN (Local Area Network), the Internet, and the like. Further, the connection mode to the network 108 may be wired connection or wireless connection. For example, the image forming apparatus 10 is wired to the network 108, and the external terminal 50 is wirelessly connected to the network 108.

  In the image forming system 1, various operations on the image forming apparatus 10 can be performed using the external terminal 50. That is, the external terminal 50 can remotely operate the image forming apparatus 10. The image forming system 1 is also expressed as a remote operation system that performs remote operation of the image forming apparatus 10.

<1-2. Configuration of image forming apparatus>
FIG. 2 is a diagram illustrating functional blocks of the image forming apparatus 10. Here, an MFP (Multi-Functional Peripheral) is exemplified as the image forming apparatus 10.

  The MFP 10 is a device (also referred to as a multi-function device) having a scan function, a copy function, a facsimile function, a box storage function, and the like. Specifically, as shown in the functional block diagram of FIG. 2, the MFP 10 includes an image reading unit 2, a print output unit 3, a communication unit 4, a storage unit 5, an operation unit 6, a controller 9, and the like. Various functions are realized by operating each part of the above in a complex manner.

  The image reading unit 2 is a processing unit that optically reads (that is, scans) a document placed at a predetermined position of the MFP 10 and generates image data of the document (also referred to as a document image or a scanned image). is there. The image reading unit 2 is also referred to as a scanning unit.

  The print output unit 3 is an output unit that prints out an image on various media such as paper based on data related to a print target.

  The communication unit 4 is a processing unit capable of performing facsimile communication via a public line or the like. Further, the communication unit 4 can perform network communication via the network 108. In this network communication, for example, various protocols such as TCP / IP (Transmission Control Protocol / Internet Protocol) are used. By using the network communication, the MFP 10 can exchange various data with a desired partner (for example, the external terminal 50). The communication unit 4 includes a transmission unit 4a that transmits various data and a reception unit 4b that receives various data.

  The storage unit 5 includes a storage device such as a hard disk drive (HDD). The storage unit 5 stores image data of each operation screen. In addition, when the operation input by the operator is a character input (pressing a character area), the storage unit 5 also stores data related to the input character.

  The operation unit 6 includes an operation input unit 6a that receives an operation input to the MFP 10 and a display unit 6b that displays and outputs various types of information.

  The MFP 10 is provided with a substantially plate-like operation panel unit 6c (see FIG. 1). Further, the operation panel unit 6c has a touch panel 25 (see FIG. 1) on the front side thereof. The touch panel 25 functions as a part of the operation input unit 6a and also functions as a part of the display unit 6b. The touch panel 25 is configured by embedding a piezoelectric sensor or the like in a liquid crystal display panel, and can display various kinds of information and accept an operation input from an operator.

  For example, on the touch panel 25, menu images (including button images and the like) are displayed. The operator can set various operation contents of the MFP 10 by pressing a button (button represented by a button image) virtually arranged in the touch panel 25.

  As described later, on the touch panel 75 (see FIG. 1) of the external terminal 50, a screen similar to the operation screen displayed on the touch panel 25 of the MFP 10 is displayed. By using the operation screen (display screen) displayed on the touch panel 75 of the external terminal 50, an operation similar to the operation using the operation screen displayed on the touch panel 25 of the MFP 10 is realized.

  The controller 9 is a control device that is built in the MFP 10 and controls the MFP 10 in an integrated manner. The controller 9 is configured as a computer system including a CPU and various semiconductor memories (RAM and ROM). The controller 9 implements various processing units by executing a predetermined software program (hereinafter also simply referred to as a program) P1 stored in a ROM (for example, EEPROM) in the CPU. The program (specifically, a program module group) P1 may be installed in the MFP 10 via a portable recording medium such as a USB memory or the network 108.

  Specifically, as illustrated in FIG. 2, the controller 9 performs various types of operations including a communication control unit 11, an input control unit 12, a display control unit 13, a determination unit 14, and an image generation unit 15 by executing the program P <b> 1. A processing unit is realized.

  The communication control unit 11 is a processing unit that controls communication operations with other devices (such as the external terminal 50) in cooperation with the communication unit 4 and the like. For example, the communication control unit 11 displays an image for display on an operation screen (also referred to as a remote operation screen) 200 (201, 202,...) (See FIG. 9, FIG. ) And the like are transmitted to the external terminal 50. In addition, the communication control unit 11 transmits operation input information (input character string information, etc.) that is information related to an operation input (character input, etc.) from the operator to the operation screen (201, etc.) displayed on the external terminal 50. Receive from 50. Furthermore, when a certain condition is satisfied, the communication control unit 11 transmits an IME activation command (activation command indicating that the IME installed in the external terminal 50 should be activated) to the external terminal 50. .

  The input control unit 12 is a control unit that controls an operation input operation to the operation input unit 6a (the touch panel 25 or the like). For example, the input control unit 12 controls an operation for receiving an operation input on the operation screen displayed on the touch panel 25.

  The display control unit 13 is a processing unit that controls a display operation in the display unit 6b (the touch panel 25 or the like). The display control unit 13 controls an operation for displaying various types of information on the touch panel 25.

  The determination unit 14 performs kanji conversion candidates in kana-kanji conversion by the MFP 10 for an input character string (input character string input by the operator) specified based on the received information on the input character string (such as coordinate information). The operation of determining whether or not exists is controlled.

  The image generation unit 15 is a processing unit that generates an operation screen or the like on the touch panel 25 of the MFP 10.

<1-3. Configuration of external terminal>
Next, the configuration of the external terminal (also referred to as a remote control device) 50 will be described.

  The external terminal 50 is a portable information input / output terminal device capable of network communication with other devices. Here, a tablet type terminal is illustrated as the external terminal 50. However, the present invention is not limited to this, and the external terminal 50 may be a smartphone or a personal computer. The external terminal 50 may be a portable device or a stationary device.

  FIG. 3 is a functional block diagram showing a schematic configuration of the external terminal 50.

  As shown in the functional block diagram of FIG. 3, the external terminal 50 includes a communication unit 54, a storage unit 55, an operation unit 56, a controller 59, and the like. Realize the function.

  The communication unit 54 can perform network communication via the network 108. In this network communication, for example, various protocols such as TCP / IP (Transmission Control Protocol / Internet Protocol) are used. By using the network communication, the external terminal 50 can exchange various data with a desired partner (MFP 10 or the like). The communication unit 54 includes a transmission unit 54a that transmits various data and a reception unit 54b that receives various data. For example, the receiving unit 54 b receives a display image (specifically, image data thereof) of the operation screen (remote operation screen) from the MFP 10, and the transmission unit 54 a responds to the operation screen displayed on the touch panel 75. Operation input information (touch coordinate information and the like) is transmitted to the MFP 10. In addition, the transmission unit 54 a transmits operation input information (input character string information or the like) that is information related to an operation input (character input or the like) from the operator to the operation screen to the MFP 10. In addition, the receiving unit 54b receives from the MFP 10 a display image (specifically, image data thereof) of a new operation screen (next operation screen) corresponding to the operation input. Further, the receiving unit 54b also receives an IME activation command from the MFP 10.

  The storage unit 55 includes a storage device such as a nonvolatile semiconductor memory. The storage unit 55 temporarily stores various image data transmitted from the MFP 10. For example, image data of a display image on the operation screen is temporarily stored.

  The operation unit 56 includes an operation input unit 56a that receives an operation input to the external terminal 50, and a display unit 56b that displays and outputs various types of information. The operation input unit 56a also accepts input of a character string from the operator. In the external terminal 50, a touch panel 75 (see FIG. 1) configured by embedding various sensors or the like in a liquid crystal display panel is provided. Specifically, as shown in FIG. 1, a touch panel 75 is provided on almost the entire surface excluding the peripheral edge portion (frame portion) on the front side of the substantially plate-like external terminal 50. The touch panel 75 functions as a part of the operation input unit 56a and also functions as a part of the display unit 56b.

  On touch panel 75, an operation screen similar to the operation screen of touch panel 25 is displayed as a remote operation screen (screen for remotely operating MFP 10). The touch panel 75 receives a touch gesture operation (also referred to as a touch operation) on the remote operation screen or the like.

  The controller 59 is a control device that is built in the external terminal 50 and controls the external terminal 50 in an integrated manner. The controller 59 is configured as a computer system including a CPU and various semiconductor memories (RAM and ROM). The controller 59 implements various processing units by executing predetermined software programs (hereinafter also simply referred to as programs) stored in a storage unit (semiconductor memory or the like) in the CPU. The program (specifically, a program module group) may be installed in the external terminal 50 via a portable recording medium such as a USB memory or the network 108.

  Specifically, an input method editor (IME) is installed in the external terminal 50 in advance. IME is software that performs processing for receiving character input by an operator, and is also expressed as character input assistance software. The IME also performs a conversion process on the character string (for example, a conversion process from a kana character string to a kanji character).

  The external terminal 50 is also installed with a remote operation program P2. The program P2 is an application software program for remotely operating the MFP 10 and implements various functions related to remote operation.

  Specifically, the controller 59 realizes various processing units including a communication control unit 61, an input control unit 62, a display control unit 63, and a coordinate conversion unit 65 by executing the program P2 and the like.

  The communication control unit 61 is a processing unit that controls a communication operation with the MFP 10 or the like in cooperation with the communication unit 54 or the like. For example, the communication control unit 61 transmits operation input information (information regarding an operation input from the operator to the operation screen displayed on the touch panel 75) to the MFP 10. In addition, the communication control unit 61 receives a display image of the operation screen 200 (201, 202, etc.) on the external terminal 50. Further, the communication control unit 61 also receives an IME activation command from the MFP 10.

  The input control unit 62 is a control unit that controls an operation input operation to the operation input unit 56a (the touch panel 75 or the like). For example, the input control unit 62 controls an operation of accepting a touch operation input on the operation screen 200 or the like. The input control unit 62 also controls an operation of accepting a touch operation input on the IME operation screen 250 (251, 252, etc.).

  The display control unit 63 is a processing unit that controls a display operation in the display unit 56b (touch panel 75 or the like). The display control unit 63 causes the touch panel 75 to display an operation screen 200 (201, 202, etc.) for remotely operating the MFP 10.

  The display control unit 63 has an IME control unit 64. The IME control unit 64 controls the operation of the IME installed in the external terminal 50. Specifically, the IME control unit 64 controls the operation of starting the IME and displaying it on the operation screen 200 or the like based on the IME start command from the MFP 10.

  The coordinate conversion unit 65 is a processing unit that converts the coordinate value of the operation input position on the touch panel 75 from the coordinate system value on the touch panel 75 of the external terminal 50 to the coordinate system value on the touch panel 25 of the MFP 10. The converted coordinate value is transmitted to the MFP 10 by the communication control unit 61 or the like as position information (operation position information) indicating the operation position of the operation input.

<1-4. Operation screen>
In the image forming system 1, an operation screen (not shown) is displayed on the touch panel 25 of the MFP 10, and image data of the operation screen is transmitted from the MFP 10 to the external terminal 50, and the operation is performed on the touch panel 75 of the external terminal 50. An operation screen (remote operation screen) 200 similar to the screen is displayed. The operation screen displayed on the touch panel 75 is the same screen as the operation screen displayed on the touch panel 25 in appearance.

  The operation screen of the external terminal 50 is basically displayed based on image data (also referred to as simulated image data) of a simulated image that simulates the operation screen on the touch panel 25 of the MFP 10. The simulated image data is configured as a bitmap image, for example.

  Here, it is assumed that an administrator name input screen 201 (FIG. 9) on the setting screen of the administrator of the MFP 10 is displayed as the operation screen 200.

  FIG. 9 is a diagram showing an administrator name input screen (character input screen) 201 in the administrator setting of the MFP 10. The character input screen 201 includes character buttons (Hiragana keys), a conversion button 301, an OK button 302, an input character display field 321 and the like. The user (operator) can input various character information by pressing each character button and various operation buttons.

<1-5. Operation>
In the image forming system 1 according to the first embodiment, kanji conversion candidates for an input character string (a kana character string input by the user on the character input screen 201 displayed on the external terminal 50) in kana-kanji conversion by the MFP 10 are displayed. It is determined whether or not it exists. When it is determined that there is no conversion candidate for the kanji, an activation command (IME activation command) indicating that the IME installed in the external terminal 50 should be activated is transmitted to the external terminal 50. When the external terminal 50 receives the IME activation command from the MFP 10, the external terminal 50 activates the IME.

  The operation of the image forming system 1 will be described with reference to FIGS.

  FIG. 4 is a flowchart showing the operation of the MFP 10, and FIG. 5 is a flowchart showing the operation of the external terminal 50. 6 is a diagram showing the subroutine processing in FIG. 4, and FIG. 7 is a diagram showing the subroutine processing in FIG. FIG. 8 is a timing chart showing an operation example in the image forming system 1.

  First, a character input process (step S70 (FIG. 7)) in the external terminal 50 and an input character reception process (step S30 (FIG. 6)) in the MFP 10 are executed. With reference to FIGS. 6 and 7, a description will be given of a situation in which a character is input by the user and a character input screen on which the input character is reflected is displayed on the external terminal 50.

  In step S71 (FIG. 7), when the external terminal 50 receives the screen data (image data of the character input screen 201) from the MFP 10, the touch screen 75 of the external terminal 50 displays the character input screen 201 (see FIG. 9) on the operation screen. 200 is displayed.

  When a user presses a certain button in the character input screen 201 (for example, a character “to” button), the operation input unit 56a accepts an operation input from the user (step S72), and is information related to the operation input. The external terminal 50 (transmission unit 54a) transmits the operation input information to the MFP 10 (step S73). For example, the operation input information is transmitted from the external terminal 50 to the MFP 10 as coordinate information of a pressed position (operation position). In addition, the IME has not yet been activated in the external terminal 50 at the time of user operation input on the character input screen 201. That is, an operation input (for example, input of a character string) from the user is accepted by the operation input unit 56a using the operation screen 200 in a state where the IME is not activated.

  When the MFP 10 receives the operation input information as coordinate information from the external terminal 50 (step S31 (FIG. 6)), the MFP 10 specifies an input operation corresponding to the operation input information based on the received coordinate information (coordinate value). . Then, the MFP 10 determines whether or not the specified input operation is a pressing operation of a character area (character button) (step S32). If it is determined that the input operation is a character region pressing operation, the process proceeds to step S33. If it is determined that the input operation is not a character region pressing operation, the process proceeds to step S33. Proceed to S35.

  Here, first, it is determined in step S32 that the input operation corresponding to the operation input information is a press operation of a character region (for example, a character “to” button), and the process proceeds to step S33. To do. In step S <b> 33, the MFP 10 specifies an input character (for example, a character “to”) based on the operation input information (also referred to as input character string information) and stores it in the storage unit 5. Then, the image generation unit 15 generates an image of the next (new) character input screen 202 (FIG. 10) reflecting the input character (character “to”), and the MFP 10 (transmission unit 4a) The image on the input screen 202 is transmitted to the external terminal 50 (step S34).

  When the external terminal 50 determines in step S74 (FIG. 7) that the next (new) character input screen image has been received, the process returns to step S71 again. Then, the display control unit 63 displays the received new character input screen 202 (FIG. 10) as the operation screen 200. As shown in FIG. 10, on the character input screen 202, the input character “TO” is reflected and displayed in the input character display field 321.

  Thereafter, on the character input screen 202, for example, when the user presses the button for the character “mi”, the same processing as described above is executed, and the next (new) character input reflecting the input character “mi” is performed. A screen (not shown) is displayed on the external terminal 50 as the operation screen 200. On the new character input screen (not shown), the input character string “TOMI” is displayed in the input character display field 321.

  FIG. 11 is a diagram showing the character input screen 203 when characters “TO”, “MI”, “YA”, and “SU” are sequentially input successively. In the input character display field 321 of the character input screen 203, an input character string “Tomiyasu” is displayed. In order to indicate that the input character string “Tomiyasu” is an undetermined character string, the display control unit 63 reverses the background color of the input character string “Tomiyasu” and displays it.

  Then, on the character input screen 203, the operation input unit 56a accepts the next operation input from the user. For example, when the user presses the conversion button 301 to perform character conversion (kanji conversion) on the unconfirmed character string “Tomiyasu”, the operation input unit 56a accepts a pressing operation (operation input) of the conversion button 301 (step S72). ), The transmitter 54a transmits coordinate information (coordinate values) to the MFP 10 (step S73) (see also FIG. 8).

  When the MFP 10 receives the coordinate information (coordinate value) (step S31 (FIG. 6)), the MFP 10 specifies an input operation corresponding to the operation input information based on the received coordinate information (coordinate value). If it is determined in step S32 that the input operation is not a character region pressing operation, the process proceeds to step S35. Furthermore, when it is determined in step S35 that the input operation is a pressing operation of the conversion button 301, the subroutine processing ends, and the processing proceeds to step S11 (FIG. 4). If it is determined in step S35 that the input operation is not a pressing operation of the conversion button 301, the process proceeds to step S36, and processing corresponding to the input operation of other buttons is executed.

  In step S11 (FIG. 4), whether or not there is a kanji conversion candidate in kana-kanji conversion by the MFP 10 for the input character string (kana character string) specified based on the input character string information (coordinate information); Is determined by the determination unit 14. Here, assuming that it is determined that there is no kanji conversion candidate for the input character string “Tomiyasu”, an image of a selection screen 211 (described later) regarding IME activation is generated by the image generation unit 15 and the external terminal 50 (step S15) (see also FIG. 8). As will be described later, when there is a conversion candidate for the kanji, an image of the conversion candidate list screen is generated and transmitted to the external terminal 50 (step S12).

  When receiving the image of the selection screen 211, the external terminal 50 determines in step S74 (FIG. 7) that it is not the reception of the next (new) character input screen image. Thereby, the subroutine processing ends, and the processing proceeds to step S51 (FIG. 5).

  In step S51, the external terminal 50 determines whether the received image is an image of a selection screen related to IME activation or an image of a conversion candidate list screen. Here, it is determined that the received image is an image of the selection screen 211, and the process proceeds to step S55.

  As shown in FIG. 12, when the image of the selection screen 211 is received from the MFP 10, the display control unit 63 displays the selection screen 211 based on the image superimposed on the character input screen 203 (step S55). (See also FIG. 8). This selection screen 211 is a screen for selecting whether or not IME activation is permitted, and is transmitted from the MFP 10 to the external terminal 50 prior to the IME activation command (described later). Also, in the selection screen 211, a button 311 (“Yes” button) that permits IME activation and a button 312 (“No” button) that does not allow IME activation are displayed.

  In the selection screen 211, when the operation input unit 56a accepts a pressing operation of the button 311 (“Yes” button) by the user (step S56), IME activation permission information (information indicating that IME activation is permitted) is displayed. The external terminal 50 transmits to the MFP 10 (step S57). On the other hand, when the operation input unit 56a accepts a pressing operation of the button 312 ("No" button) by the user on the selection screen 211 (step S56), the IME activation non-permission information (information indicating that the activation of the IME is not permitted). ) Transmits to the MFP 10 (step S62). Here, assuming that the user permits IME activation, IME activation permission information is transmitted from the external terminal 50 to the MFP 10.

  When the MFP 10 receives the activation permission information (step S <b> 16 (FIG. 4)), the MFP 10 transmits an IME activation command (activation command to activate the IME installed in the external terminal 50) to the external terminal 50. (Step S17) (see also FIG. 8). The IME activation command is transmitted from the MFP 10 to the external terminal 50 when it is determined in step S11 that there is no kanji conversion candidate. That is, the IME activation instruction is also expressed as an activation instruction based on a determination that kanji conversion candidates for the input character string do not exist in the kana / kanji conversion by the MFP 10. In response to the transmission of the IME activation command, the MFP 10 stores the text information (external terminal 50) of the input character string (here, the character string “Tomiya”) stored in the storage unit 5 in step S33 (FIG. 6). The text information corresponding to the input character string specified based on the coordinate information received from is also transmitted to the external terminal 50.

  When the external terminal 50 receives the IME activation command (step S58 (FIG. 5)), the external terminal 50 activates the IME and displays an IME operation screen (character input screen) 251 (see also FIG. 8). ). As shown in FIG. 13, the IME character input screen 251 is displayed so as to be superimposed on the character input screen 203 (see also FIG. 11). When the IME is activated, the display control unit 63 sets the conversion candidate by the IME for the input character string (here, the character string “Tomiyasu”) specified based on the text information of the input character string. The information is displayed in the conversion candidate display field 261 in the input screen 251. Specifically, as shown in FIG. 13, the conversion candidate display field 261 in the IME character input screen 251 displays an IME conversion candidate (“Fuan”, “Huan”, “ Futai ", ...) is displayed as IME starts. As described above, when the IME is activated, the IME conversion candidates for the input character string (character string “Tomiyasu”) stored in the MFP 10 are displayed in the conversion candidate display field 261. Therefore, the user does not need to input the character string “Tomiyasu” again on the IME character input screen, and can efficiently input characters in the IME.

  After that, the user selects a desired character string (for example, the character string “Fanan”) from the conversion candidates displayed in the conversion candidate display field 261 in the IME character input screen 251, and a button 351 (“Close” button) When the button is pressed, the operation input unit 56a accepts the selection of the character string (step S60 (FIG. 5)), and the external terminal 50 receives information on the selected character string of the IME (for example, a character code related to the character string “Toan”) Is transmitted to the MFP 10 (step S61) (see also FIG. 8). Note that when information on the selected character string of the IME is transmitted to the MFP 10, the IME ends.

  When the MFP 10 receives information on the selected character string of the IME (for example, the character string “Toyasu”) (step S18 (FIG. 4)), the MFP 10 determines the selected character string of the IME as a conversion result (step S19). Then, the MFP 10 generates an image of the character input screen 204 (FIG. 14) reflecting the conversion result and transmits it to the external terminal 50 (step S21).

  The external terminal 50 displays the received character input screen 204 (FIG. 14) as the operation screen 200 (step S63) (see also FIG. 8). As shown in FIG. 14, in the input character display field 321 of the character input screen 204, a confirmed character string “Fuan” converted from kana characters to kanji is displayed.

  As described above, in the first embodiment, when the MFP 10 determines that there is no kanji conversion candidate for the input character string, the IME activation command is transmitted from the MFP 10 to the external terminal 50, and the external terminal 50 displays the IME. to start.

  Here, if the activation of the IME is not permitted in step S56 (FIG. 5) and the IME activation non-permission information is transmitted from the external terminal 50 to the MFP 10 (step S62), the following processing is performed. Is called.

  Specifically, when the MFP 10 receives the IME activation non-permission information (step S16 (FIG. 4)), the MFP 10 determines an unconverted input character string as a conversion result (step S20), and the process proceeds to step S21. move on. For example, in FIG. 12, when a “No” button (button 312) is pressed by the user (step S56 (FIG. 5)), the external terminal 50 transmits IME activation non-permission information to the MFP 10 (step S62). . When the MFP 10 receives the activation non-permission information, the MFP 10 determines a non-converted character string “Tomiyasu” for the input character string “Tomiyasu” as a conversion result (step S20 (FIG. 4)). Then, an image of a character input screen (not shown) reflecting the conversion result (non-converted character string “Tomiyasu”) is generated and transmitted to the external terminal 50 (step S21). A screen (not shown) is displayed as the operation screen 200 (step S63 (FIG. 5)).

  If it is determined in step S11 (FIG. 4) that there is a kanji conversion candidate for the input character string and the process proceeds to step S12, the following process is performed.

  In step S <b> 12 (FIG. 4), the MFP 10 generates an image of the conversion candidate list screen and transmits it to the external terminal 50. When the external terminal 50 receives the image of the conversion candidate list screen (step S51 (FIG. 5)), the process proceeds to step S52, and the display control unit 63 displays the conversion candidate list screen as the operation screen 200. On this conversion candidate list screen, a list of conversion candidates including at least conversion candidates for the kanji is displayed.

  For example, if there is a kanji conversion candidate for the input character string “Nishimura” input by the user in the kana-kanji conversion of the MFP 10, the MFP 10 generates an image of the conversion candidate list screen 205 (FIG. 15) to generate an external image. It transmits to the terminal 50 (step S12 (FIG. 4)). Then, the external terminal 50 displays the conversion candidate list screen 205 (FIG. 15) based on the image as the operation screen 200 (step S52 (FIG. 5)). Here, as shown in FIG. 15, on the conversion candidate list screen 205, kanji conversion candidates (character string “Nishimura”) and hiragana conversion candidates (that is, non-converted character string “Nishimura”) are displayed. The

  Thereafter, when the user selects a desired character string (for example, the character string “Nishimura”) on the conversion candidate list screen 205 and presses the OK button 303, it is determined that the user selects the character string (step S53). ), The external terminal 50 transmits the selected character string information to the MFP 10 (step S54). When the MFP 10 receives information on the selected character string (for example, the character string “Nishimura”) (step S13 (FIG. 4)), the MFP 10 determines the selected character string as a conversion result (step S14). Then, the MFP 10 generates an image of a character input screen (not shown) reflecting the conversion result and transmits it to the external terminal 50 (step S21), and the external terminal 50 receives the character input screen (not shown) received from the MFP 10. (Shown) is displayed as the operation screen 200 (step S63).

  If the user's desired conversion candidate does not exist on the conversion candidate list screen 205 (FIG. 15), it is determined that the user does not select a character string when the user presses the “Cancel” button (button 304). Then (step S53 (FIG. 5)), the process returns to the character input process (step S70) again. Specifically, the character input screen 203 (FIG. 11) is displayed as the operation screen 200.

  As described above, in the operation according to the first embodiment, when the MFP 10 determines that there is no kanji conversion candidate for the input character string (step S11 (FIG. 4)), the IME activation command is sent to the external terminal 50. (Step S17). When the IME activation command is received from the MFP 10 (step S58 (FIG. 5)), the external terminal 50 activates the IME (step S59). Therefore, it is possible to avoid the activation of the IME at all times and to suppress (optimize) the activation opportunity of the IME when inputting characters on the external terminal 50 that remotely operates the MFP 10. Therefore, it is possible to suppress deterioration in the operability of character input in the external terminal 50 that remotely operates the MFP 10.

<2. Second Embodiment>
In the first embodiment, an example in which the IME activation command is transmitted to the external terminal 50 when the MFP 10 determines that there is no kanji conversion candidate for the input character string. In other words, when the MFP 10 determines that there is a conversion candidate for the kanji, the IME activation command is not transmitted to the external terminal 50.

  In contrast, in the second embodiment, even when the MFP 10 determines that there is a kanji conversion candidate for the input character string, an IME activation instruction operation (described later) is received from the user. An example in which the IME activation command is transmitted to the external terminal 50 is illustrated.

  The second embodiment is a modification of the first embodiment. Below, it demonstrates centering on difference with 1st Embodiment.

  FIG. 16 is a flowchart showing the operation of the MFP 10 according to the second embodiment, and FIG. 17 is a flowchart showing the operation of the external terminal 50 according to the second embodiment. FIG. 18 is a timing chart showing an operation example in the image forming system 1 according to the second embodiment.

  As shown in FIG. 16, the operation of the MFP 10 according to the second embodiment is the same as the operation of the MFP 10 according to the first embodiment in that step S22 is added between step S12 and step S13 in FIG. It is different.

  Moreover, as shown in FIG. 17, step S64 is added between step S52 and step S53 of FIG. 5, and step S65 is also added. In this respect, the operation of the external terminal 50 according to the second embodiment is different from the operation of the external terminal 50 according to the first embodiment.

  Here, it is assumed that it is determined in step S11 (FIG. 16) that kanji conversion candidates for the input character string (kana character string) exist in kana-kanji conversion of MFP 10. For example, if the MFP 10 determines that there is a kanji conversion candidate for the input character string “Nishimura”, an image of the conversion candidate list screen 206 (FIG. 19) is generated and transmitted to the external terminal 50 ( Step S12) (see also FIG. 18).

  When receiving the image of the conversion candidate list screen 206, the external terminal 50 displays the conversion candidate list screen 206 (FIG. 19) based on the image as the operation screen 200 (step S52) (see also FIG. 18). As shown in FIG. 19, in this conversion candidate list screen 206, conversion candidates for input character strings (kanji conversion candidates (character string “Nishimura”)) and hiragana conversion candidates (ie, non-converted character strings “Nishimura”). In addition to “)), an IME activation button 331 (button for instructing activation of IME) is also displayed. For example, when there is no conversion candidate desired by the user on the conversion candidate list screen 206, the user presses the IME activation button 331.

  In the conversion candidate list screen 206, when the operation input unit 56a accepts a pressing operation by the user of the IME activation button 331 as an IME activation instruction operation (an operation for instructing activation of the IME) (step S64), the activation instruction operation The external terminal 50 transmits the reception information indicating that is received to the MFP 10 (step S65) (see also FIG. 18). Then, the process proceeds to step S150 (steps S55 to S62). The processes in steps S55 to S62 in FIG. 17 have the same contents as the processes in steps S55 to S62 in FIG. If the IME activation button 331 is not pressed and a character string is selected from the conversion candidates, the process proceeds to step S53.

  In MFP 10, when the reception information is received from external terminal 50 (step S22 (FIG. 16)), the process proceeds to step S100 (steps S15 to S20). Each process in steps S15 to S20 in FIG. 16 has the same contents as each process in steps S15 to S20 in FIG.

  For example, steps S15 to S21 in FIG. 16 and steps S55 to S63 in FIG. 17 are executed as follows.

  The MFP 10 generates an image of the selection screen 212 (FIG. 20) and transmits it to the external terminal 50 (step S15), and the external terminal 50 (specifically, the display control unit 63) receives the received selection screen 212 (FIG. 20). 20) is displayed superimposed on the conversion candidate list screen 206 (FIG. 19) (step S55) (see also FIG. 18).

  After that, when the operation input unit 56a accepts an IME activation permission operation (pressing operation of the button 311 (“Yes” button) in the selection screen 212) from the user (step S56), the external terminal 50 permits the IME activation. Information is transmitted to the MFP 10 (step S57). When the MFP 10 receives the activation permission information (step S16), the MFP 10 transmits an IME activation command to the external terminal 50 (step S17) (see also FIG. 18). Note that the MFP 10 also transmits information on kanji conversion candidates to the external terminal 50 along with the transmission of the IME activation command. Specifically, even when it is determined that there is a kanji conversion candidate (here “Nishimura”) for the input character string (here “Nishimura”) in the kana / kanji conversion of the MFP 10, the reception information Is received from the MFP 10, the MFP 10 also transmits information on conversion candidates for the kanji to the external terminal 50.

  When the external terminal 50 receives the IME activation command (step S58), the external terminal 50 activates the IME and displays the IME character input screen (step S59). FIG. 21 is a diagram illustrating a state in which the IME character input screen 252 is displayed superimposed on the conversion candidate list screen 206. Here, the display control unit 63 specifies a kanji conversion candidate by kana-kanji conversion of the MFP 10 based on the kanji conversion candidate information, and the IME conversion candidate by the IME with respect to the input character string when the IME is activated. Conversion candidates excluding Kanji conversion candidates are displayed in a conversion candidate list in the IME character input screen. Specifically, as shown in FIG. 21, the conversion candidate display field 262 in the IME character input screen 252 excludes the conversion candidate “Nishimura” from the IME conversion candidate for the input character string “Nishimura”. Conversion candidates are displayed. As shown in FIG. 21, a conversion candidate (character string “Nishimura”) further excluding the hiragana conversion candidate “Nishimura” displayed on the conversion candidate list screen 206 from the IME conversion candidates for the input character string “Nishimura”. , "Saijo", "Nishimura", ...) may be displayed.

  As described above, the kanji conversion candidate (character string “Nishimura”) in the kana-kanji conversion of the MFP 10 is not displayed in the conversion candidate display field 262 of the IME, and therefore the conversion candidate and conversion of the kanji displayed on the conversion candidate list screen 206 are displayed. The conversion candidates displayed in the candidate display field 262 are not displayed redundantly. In other words, conversion candidates that are not the user's desired conversion candidates are not displayed in the conversion candidate display field 262, and only conversion candidates that are likely to be user's desired conversion candidates are displayed in the conversion candidate display field 262 ( (Selectively) can be displayed.

  Thereafter, when the user selects a desired character string (for example, the character string “Saijo”) from the conversion candidates displayed in the conversion candidate display field 262 (step S60), the external terminal 50 accepts the selection operation, and the IME The selected character string information (for example, the character code of the character string “Saijo”) is transmitted to the MFP 10 (step S61).

  When the MFP 10 receives the information on the selected character string of the IME (step S18), the MFP 10 determines the selected character string of the IME (for example, the character string “Saijo”) as a conversion result (step S19). Then, the MFP 10 generates an image of a character input screen (not shown) reflecting the conversion result and transmits it to the external terminal 50 (step S21), and the external terminal 50 receives the character input screen (from the MFP 10). (Not shown) is displayed as the operation screen 200 (step S63).

  As described above, in the second embodiment, even if the MFP 10 determines that there is a kanji conversion candidate for the input character string, the IME activation instruction operation from the user is accepted, and the acceptance information is When received from the external terminal 50, the MFP 10 transmits an IME activation command to the external terminal 50.

  In the second embodiment, the mode in which the pressing operation of the IME activation button 331 (see FIG. 19) by the user is accepted as the IME activation instruction operation is illustrated, but the present invention is not limited to this. For example, a flick operation on the conversion candidate list screen may be accepted as an IME activation instruction operation.

  FIG. 22 is a diagram illustrating a flick operation on the conversion candidate list screen 207. When the operation input unit 56a accepts a flick operation on the conversion candidate list screen 207 as the activation instruction operation from the user, the external terminal 50 transmits to the MFP 10 reception information indicating that the activation instruction operation of IME has been accepted. Then, the display control unit 63 superimposes and displays the IME character input screen 252 on the conversion candidate list screen 206 (see FIG. 21). According to this, the user can intuitively perform an IME activation instruction operation. Note that, here, the direction of the flick operation is a direction from the lower side to the upper side (that is, upward) of the conversion candidate list screen 207 in FIG. 22, but is not limited thereto, and any direction is possible. It may be.

  In the second embodiment, information on conversion candidates for kanji has been illustrated as being transmitted from the MFP 10 to the external terminal 50 in accordance with the transmission of the IME activation command. However, the present invention is not limited to this. For example, information on kanji conversion candidates may be transmitted from the MFP 10 to the external terminal 50 along with the transmission of the conversion candidate list screen image.

<3. Modified example>
Although the embodiment of the present invention has been described above, the present invention is not limited to the above-described content.

  For example, in each of the above-described embodiments, the IME activation instruction is transmitted from the MFP 10 to the external terminal 50 when the selection screen (211 and 212) accepting the IME activation permission operation is accepted. Not.

  Specifically, in response to the determination that there is no kanji conversion candidate for the input character string (step S11 (FIGS. 4 and 16)), an IME activation command is immediately transmitted to the external terminal 50 (step S17). You may do it. In other words, if it is determined in step S11 that there is no kanji conversion candidate for the input character string in the MFP 10, an image of the selection screen is not generated (the process of step S15 is not executed), and an IME activation command is immediately issued. May be transmitted from the MFP 10 to the external terminal 50.

  Furthermore, in the second embodiment, an IME activation command may be immediately transmitted to the external terminal 50 in response to reception of reception information of an IME activation instruction operation (step S22 (FIG. 16)). In other words, when the reception information of the IME start instruction operation from the user is received in step S22, the image of the selection screen is not generated (the process of step S15 is not executed), and the IME start command is immediately sent from the MFP 10. It may be transmitted to the external terminal 50.

  In each of the above embodiments, “input hiragana” by pressing the hiragana key is exemplified as the character string input method. However, the present invention is not limited to this. For example, the character string input method may be “katakana input” by pressing a katakana key, or “romaji input” by pressing a romaji key. That is, it is only necessary to determine whether or not there is a kanji conversion candidate in the kana-kanji conversion of the MFP 10 for a character string input by various input methods.

1 image forming system 10 MFP (image forming apparatus)
50 External terminal (remote control device)
75 Touch panel 201-207 (external terminal) Operation screen 211, 212 Selection screen 251, 252 IME character input screen

Claims (11)

An image forming system,
An image forming apparatus;
A remote operation device for remotely operating the image forming apparatus;
With
The remote control device is:
An operation means for receiving an input of a character string from an operator in a state where the IME installed in the remote operation device is not activated;
Communication means for transmitting information on the input character string input by the operator to the image forming apparatus;
Have
The image forming apparatus includes:
Receiving means for receiving information on the input character string from the remote control device;
Determining means for determining whether or not there is a kanji conversion candidate in kana-kanji conversion by the image forming apparatus for the input character string specified based on the information related to the input character string;
When it is determined that there is no conversion candidate for the kanji, a transmission unit that transmits an activation command to activate the IME installed in the remote operation device to the remote operation device;
Have
The communication means of the remote control device receives the activation command from the image forming device,
The remote control device is:
Display control means for activating the IME when the activation command is received from the image forming apparatus;
And an image forming system. The image forming system according to claim 1,
The operation means of the remote control device receives a start instruction operation that is an operation to instruct start of the IME from the operator,
When the activation instruction operation is accepted, the communication unit of the remote operation device transmits acceptance information indicating that the activation instruction operation is accepted to the image forming apparatus,
Even if it is determined that there is a candidate for conversion of the kanji character, the transmission unit of the image forming apparatus receives the activation command when the reception information is received from the remote control device. An image forming system which transmits to an apparatus. The image forming system according to claim 2.
The operation means of the remote operation device accepts, from the operator as a start instruction operation, a pressing operation of a button in the display screen displayed on the operation means for instructing start of the IME,
The image forming system, wherein the communication unit of the remote control device transmits the reception information to the image forming device when the pressing operation is received. The image forming system according to claim 2.
The operation means of the remote operation device accepts a flick operation on the display screen displayed on the operation means as the start instruction operation from the operator,
When the flick operation is accepted, the communication unit of the remote operation device transmits the acceptance information to the image forming apparatus. The image forming system according to any one of claims 1 to 4,
The communication means of the remote control device transmits coordinate information of the input character string to the image forming device;
The transmitting unit of the image forming apparatus transmits text information corresponding to the input character string specified based on the coordinate information to the remote operation device;
When the text information is received from the image forming apparatus, the display control unit of the remote control device converts the input character string specified based on the text information by the IME when the IME is activated. A candidate is displayed in the character input screen of said IME, The image forming system characterized by the above-mentioned. The image forming system according to any one of claims 2 to 4,
Even if it is determined that the conversion candidate for the Chinese character exists, the transmission unit of the image forming apparatus may receive information on the conversion candidate for the Chinese character when the reception information is received from the remote control device. To the remote control device,
The display control means of the remote control device identifies the kanji conversion candidate in the kana-kanji conversion by the image forming device based on the information of the kanji conversion candidate, and the input is performed when the IME is activated. A conversion candidate obtained by removing the kanji conversion candidate from the conversion candidates by the IME for a character string is displayed in a character input screen of the IME. The image forming system according to any one of claims 1 to 6,
The transmission unit of the image forming apparatus transmits an image of a selection screen, which is a screen for selecting whether to start the IME, to the remote control device prior to transmission of the activation command,
When the image of the selection screen is received from the image forming apparatus, the display control unit of the remote operation device displays the selection screen based on the image on the operation unit of the remote operation device,
The operation means of the remote operation device accepts an operation for permitting activation of the IME from the operator on the selection screen,
When the permission operation is accepted, the communication unit of the remote operation device transmits activation permission information for permitting activation of the IME to the image forming apparatus,
When the activation permission information is received from the remote operation device, the transmission unit of the image forming device transmits the activation command to the remote operation device. An image forming apparatus remotely operated by a remote operation device,
Receiving means for receiving, from the remote operation device, information relating to an input character string input by an operator in the operation unit of the remote operation device;
Determining means for determining whether or not there is a kanji conversion candidate in kana-kanji conversion by the image forming apparatus for the input character string specified based on the information related to the input character string;
When it is determined that there is no conversion candidate for the kanji, a transmission means for transmitting an activation instruction to activate the IME installed in the remote operation device to the remote operation device;
An image forming apparatus comprising: In the computer built in the image forming apparatus remotely operated by the remote operation device,
a) receiving from the remote control device information related to an input character string input by an operator in the operating means of the remote control device;
b) determining whether or not there exists a kanji conversion candidate in kana-kanji conversion by the image forming apparatus for the input character string specified based on the information related to the input character string;
c) when it is determined that there is no conversion candidate for the kanji, a start command to start the IME installed in the remote control device is transmitted to the remote control device;
A program for running A remote operation device for remotely operating an image forming apparatus,
An operation means for receiving an input of a character string from an operator in a state where the IME installed in the remote operation device is not activated;
Information relating to the input character string input by the operator is transmitted to the image forming apparatus, and is a start command indicating that the IME installed in the remote operation device is to be started, and relates to the input character string Communication means for receiving an activation command from the image forming apparatus based on a determination that kanji conversion candidates for the input character string specified based on information do not exist in kana-kanji conversion by the image forming apparatus;
Display control means for activating the IME when the activation command is received from the image forming apparatus;
A remote control device comprising: In the computer built in the remote control device that remotely controls the image forming device,
a) receiving an input of a character string from an operator in a state where the IME installed in the remote operation device is not activated;
b) transmitting information related to the input character string input by the operator to the image forming apparatus;
c) an activation command for activating the IME installed in the remote control device, and kanji conversion candidates for the input character string specified based on the information related to the input character string are the image forming apparatus Receiving an activation command from the image forming apparatus based on the determination that it does not exist in kana-kanji conversion by:
d) activating the IME when the activation command is received from the image forming apparatus;
A program for running