JP4957292B2 - Image forming system - Google Patents

Description

The present invention relates to an image forming system, in particular, it relates to an image forming system including an image forming apparatus which is remotely operated by the mobile information terminal.

  In recent years, functions of multifunction peripherals (MFPs) have become complicated, and contents of operation screens for setting operations and items to be set have been diversified. When the display screen is small, the keys may be small and it may be difficult to distinguish the menu, and there is a problem that the operation is difficult. Further, since the MFP is used by a plurality of users, there may be a user who has few opportunities to operate the MFP, and there is a problem that it is difficult for the user to learn a complicated operation procedure.

  On the other hand, in recent years, portable information terminals have become highly functional and diversified to meet the needs of individuals, and since they are carried by individuals, they are used more frequently than MFPs and can learn even complicated operating procedures. Is done. Further, there are many functions similar to the functions of the MFP, such as transmission / reception of various data and browser operations. Further, in many cases, the portable information terminal customizes the color information, language information, voice function, and the like of the display screen so that the portable user can easily use it.

  Japanese Patent Application Laid-Open No. 2006-60535 discloses an imaging unit, a main display unit having a display screen on the opposite side of the lens mounting surface of the imaging unit, which can display an image captured by the imaging unit, and the main display unit. Is a mobile phone device comprising sub-display means having a display screen on the lens mounting surface side capable of independently displaying another image, communication means, and key input means for inputting communication-related information. A magnifying glass mode setting means for setting an operation mode to a magnifying glass mode for enlarging a captured image taken by the imaging means to a magnification equal to or greater than that and displaying the image on the display screen of the main display means; Control means for controlling the display screen of the sub display means to display a higher brightness when the mode is set than when the magnifying glass mode is not set. Mobile telephone device is described to symptoms.

However, in the conventional mobile phone device, the operation screen of the MFP can be enlarged and displayed, but the setting cannot be facilitated.
JP 2006-60535 A

  The present invention has been made to solve the above-described problems, and one object of the present invention is to provide an image forming system that facilitates the setting operation of the image forming apparatus.

According to an aspect of the present invention, an image forming system is an image forming system including an image forming apparatus and a portable information terminal that can communicate with the image forming apparatus, and the portable information terminal images a subject. Imaging means, storage means for storing an image obtained by capturing an operation screen of the image forming apparatus, notification means for notifying that the image forming apparatus has captured the image according to the imaging of the operation screen, and an image corresponding to the notification Registration number receiving means for receiving a registration number from the forming apparatus, storage means for storing the registration number and the image in association with each other, display means for displaying an image read from the storage means, and the registration number as an image forming apparatus and a transmitting unit capable of transmitting to the image forming apparatus, display means for displaying an operation screen, steering in response to receiving the notification from the portable information terminal, are displayed at the time of receiving the notification It is set on the screen, with the settings for the image processing of the image forming apparatus, associating the registration number given to a setting value storing means for storing, a mobile communication terminal is displayed on the display means The registration number associated with the image is transmitted to the image forming apparatus in response to the designated image, and the image forming apparatus stores the registration number in the set value storage unit according to the registration number received from the mobile communication terminal. The read set value is read out, and the read set value is set.

  According to this aspect, when the operation screen of the image forming apparatus is imaged by the portable information terminal and the screen is specified later, the setting value set at the time of image capturing is set in the image forming apparatus. Therefore, it is possible to provide an image forming system that facilitates the operation of the image forming apparatus.

Preferably , there are a plurality of image forming apparatuses, and device identification information is assigned to each of the image forming apparatuses, and the mobile communication terminal receives and receives the apparatus identification information together with the registration number from the image forming apparatus in response to the notification. A registration number is associated with the device identification information and the image and stored in the storage unit, and the registration number associated with the image and the image displayed on the display unit and the destination image forming device are designated and The apparatus identification information is transmitted to the designated image forming apparatus. When the apparatus identification information received from the portable communication terminal relates to another image forming apparatus, the designated image forming apparatus A setting value related to the registration number stored in the setting value storage unit of the forming apparatus is acquired, and the acquired setting value is set.
Preferably, the mobile communication terminal is capable of inputting a setting value corresponding to the image displayed on the display unit, transmits the input setting value to the image forming apparatus that has transmitted the registration number, and the image forming apparatus receives the setting value received. To change the set value.

Preferably, the mobile communication terminal can input a setting value on an operation screen corresponding to the image displayed on the display unit, and transmits the input setting value to the image forming apparatus that transmitted the registration number. The set value is changed according to the received set value.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

<First Embodiment>
FIG. 1 is a diagram showing an overall outline of an image forming system according to one embodiment of the present invention. Referring to FIG. 1, an image forming system 1 includes MFPs (Multi Function Peripherals) 100, 101, 102 and personal computers (hereinafter referred to as “PCs”) 105 as image forming apparatuses each connected to a network 2. A portable information terminal 200 and a radio station 300 are included.

  The PC 105 is a general computer, and a printer driver program for controlling the MFPs 100, 101, 102 is installed. If the types of MFPs 100, 101, and 102 are different, three types of printer driver programs for controlling MFPs 100, 101, and 102 are installed in PC 105, respectively.

  Each of MFPs 100, 101, and 102 includes a scanner device for reading a document, an image forming device for forming an image on a recording medium such as paper based on image data, and a facsimile device. It has a transmission / reception function. In the present embodiment, MFPs 100, 101, and 102 will be described as an example, but instead of MFPs 100, 101, and 102, any apparatus having a function of forming an image may be used, for example, a printer, a facsimile machine, or the like. There may be. Further, since the MFPs 100, 101, and 102 have the same function, the MFP 100 will be described as an example in the following description unless otherwise specified.

  The mobile information terminal 200 is a general mobile phone, and can communicate with a mobile phone base station by wirelessly connecting to the mobile phone network. In addition, the portable information terminal 200 has a wireless LAN function.

  The network 2 is a local area network (LAN), and the connection form may be wired or wireless. Further, the network 2 is not limited to a LAN, and may be a network using a public switched telephone network (Public Switched Telephone Networks). Furthermore, the network 2 is connected to a wide area network (WAN) such as the Internet.

  The wireless station 300 is a relay device of the network 2 and communicates with the portable information terminal 200 having a wireless LAN communication function to connect the portable information terminal 200 to the network 2. Each of MFPs 100, 101, and 102 can send and receive data to and from PC 105 via network 2. Each of MFPs 100, 101, and 102 can transmit and receive data to and from portable information terminal 200 via network 2 and wireless station 300.

  FIG. 2 is a perspective view showing the appearance of the MFP. FIG. 3 is a block diagram showing an outline of the hardware configuration of the MFP. 2 and 3, MFP 100 includes a main circuit 110, a document reading unit 130 for reading a document, an automatic document transport device 120 for transporting a document to document reading unit 130, and a document reading unit. An image forming unit 140 for forming an image on a sheet or the like based on image data output by reading a document by the document 130, a sheet feeding unit 150 for supplying the image forming unit 140 with a sheet, and an operation as a user interface Panel 160.

  The main circuit 110 includes a CPU 111, a communication interface (I / F) unit 112, a ROM 113, a RAM 114, an EEPROM (Electronically Erasable and Programmable ROM) 115, a hard disk drive (HDD) 116 as a mass storage device, A facsimile unit 117 and a card interface (I / F) 118 to which a flash memory 118A is attached are included. CPU 111 is connected to automatic document feeder 120, document reading unit 130, image forming unit 140, sheet feeding unit 150, and operation panel 160, and controls the entire MFP 100.

  The ROM 113 stores a program executed by the CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes a program. The RAM 114 temporarily stores read data (image data) continuously sent from the document reading unit 130.

  Operation panel 160 is provided on the upper surface of MFP 100 and includes a display unit 160A and an operation unit 160B. The display unit 160A is a display device such as a liquid crystal display (LCD) or an organic ELD (Electro-Luminescence Display), and displays an instruction menu for the user, information about acquired image data, and the like. The operation unit 160B includes a plurality of keys, and accepts input of various instructions, data such as characters and numbers by user operations corresponding to the keys. Operation unit 160B further includes a touch panel provided on display unit 160A.

  Communication I / F unit 112 is an interface for connecting MFP 100 to network 2. The CPU 111 communicates with the MFPs 101 and 102, the PC 105, or the portable information terminal 200 via the communication I / F unit 112, and transmits and receives data. The communication I / F unit 112 can communicate with a computer connected to the Internet via the network 2.

  The facsimile unit 117 is connected to a public switched telephone network (PSTN) and transmits facsimile data to the PSTN or receives facsimile data from the PSTN. The facsimile unit 117 stores the received facsimile data in the HDD 116 or outputs it to the image forming unit 140. The image forming unit 140 prints the facsimile data received by the facsimile unit 117 on a sheet. Further, the facsimile unit 117 converts the data stored in the HDD 116 into facsimile data, and transmits the facsimile data to a facsimile apparatus connected to the PSTN.

  The card I / F 118 is mounted with a flash memory 118A. The CPU 111 can access the flash memory 118A via the card I / F 118. The CPU 111 loads the program recorded in the flash memory 118A attached to the card I / F 118 to the RAM 114 and executes it. Note that the program executed by the CPU 111 is not limited to the program recorded in the flash memory 118A, and the program stored in the HDD 116 may be loaded into the RAM 114 and executed. In this case, another computer connected to the network 2 may rewrite the program stored in the HDD 116 of the MFP 100 or may add a new program and write it. Further, MFP 100 may download a program from another computer connected to network 2 and store the program in HDD 116. The program here includes not only a program directly executable by the CPU 111 but also a source program, a compressed program, an encrypted program, and the like.

  In image forming system 1 in the present embodiment, data is transmitted and received between MFPs 100, 101, 102 and portable information terminal 200. As a protocol for transmitting and receiving data, any protocol can be used as long as the transmission source can be specified in the receiving apparatus. As a protocol for transmitting and receiving data, for example, HTTP (Hyper Text Transfer Protocol), FTP (File Transfer Protocol), SMPT (Simple Mail Transfer Protocol), POP (Post Office Protocol), and the like are used.

  FIG. 4 is a functional block diagram showing an outline of the hardware configuration of the portable information terminal. Referring to FIG. 4, portable information terminal 200 is connected to CPU 201 for controlling overall portable information terminal 200, camera 202, flash memory 203 for storing data in a nonvolatile manner, and call unit 205. A wireless communication unit 204, a display unit 206 that displays information, an operation unit 207 that accepts an input of a user operation, and a wireless LAN I / F 208 are included.

  The wireless communication unit 204 performs wireless communication with a mobile phone base station connected to a telephone communication network. The wireless communication unit 204 connects the portable information terminal 200 to a telephone communication network and enables a call using the call unit 205. The radio communication unit 204 decodes a voice signal obtained by demodulating the radio signal received from the mobile phone base station and outputs the decoded signal to the call unit 205. Further, the wireless communication unit 204 encodes the voice input from the call unit 205 and transmits it to the mobile phone base station. The call unit 205 includes a microphone and a speaker, outputs the voice input from the wireless communication unit 204 from the speaker, and outputs the voice input from the microphone to the wireless communication unit 204. Further, the wireless communication unit 204 is controlled by the CPU 201, connects the portable information terminal 200 to an e-mail server, and transmits / receives e-mails.

  The camera 202 includes a lens and a photoelectric conversion element such as a CMOS (Complementary Metal Oxide Semiconductor) sensor, and focuses light collected by the lens on a CMOS sensor. The CMOS sensor photoelectrically converts the received light to convert image data. It outputs to CPU201.

  The display unit 206 is a display device such as a liquid crystal display device (LCD) or an organic ELD, and displays an instruction menu for a user, information about acquired image data, and the like. The operation unit 207 includes a plurality of keys, and accepts input of various instructions, data such as characters and numbers by user operations corresponding to the keys.

  The wireless LAN I / F 208 is an interface for communicating with the wireless station 300 and connecting the portable information terminal 200 to the network 2. By registering IP (Internet Protocol) addresses of MFPs 100, 101, and 102 in advance in portable information terminal 200, portable information terminal 200 can communicate with MFPs 100, 101, and 102 and can transmit and receive data. It becomes.

  FIG. 5 is a functional block diagram showing an overview of the functions of the CPU 111 provided in the MFP according to the first embodiment. Referring to FIG. 5, CPU 111 receives a request reception unit 11 that receives a screen transmission request from portable information terminal 200, screen display control unit 13 for controlling display unit 160 </ b> A, and a remote stored in HDD 116. A remote operation screen reading unit 15 that reads an operation screen for operation, a screen transmission unit 17 that transmits an operation screen for remote operation to the portable information terminal 200, and an instruction reception unit 19 that receives an instruction from the portable information terminal 200; The process execution part 21 for performing a process is included.

  The request receiving unit 11 receives the operation screen transmission request transmitted from the portable information terminal 200 after establishing the connection with the portable information terminal 200. The request receiving unit 11 receives an authentication information such as a user ID and a password from the portable information terminal 200 when establishing a connection with the portable information terminal 200, and is operated on the condition that the authentication is successful. The transmission request may be received. Thereby, users who use MFP 100 can be limited. Upon receiving the operation screen transmission request, the request receiving unit 11 outputs a reading instruction to the remote operation screen reading unit 15.

  The screen display control unit 13 displays one of a plurality of operation screens stored in advance in the EEPROM 115 on the display unit 160A. The plurality of operation screens are associated with each other, and have a transition button for transitioning from one operation screen to another operation screen. When the instruction of the transition button is detected by the operation unit 160B, the screen display control unit 13 reads the operation screen associated with the transition button from the EEPROM 115 and displays it on the display unit 160A.

  When a read instruction is input from the request receiving unit 11, the remote operation screen reading unit 15 corresponds to the operation screen displayed on the display unit 160A by the screen display control unit 13 and is stored in the EEPROM 115 in advance. Is read out and output to the screen transmission unit 17. The EEPROM 115 stores a plurality of remote operation screens respectively corresponding to a plurality of operation screens. When the remote operation screen is input, the screen transmission unit 17 transmits an operation screen for remote operation to the portable information terminal 200 that has transmitted the request received by the request reception unit 11. Further, the screen transmission unit 17 identifies the identification information of the portable information terminal 200 and the operation screen for remote operation in order to notify the instruction receiving unit 19 that the operation screen for remote operation has been transmitted to the portable information terminal 200. To the instruction receiving unit 19. The identification information of the portable information terminal 200 is position information on the network 2 assigned to the portable information terminal 200, for example. The location information on the network 2 is, for example, an IP (Internet Protocol) address or a MAC (Media Access Control) address.

  When receiving the identification information of the portable information terminal 200 and the screen identification information of the remote operation screen from the screen transmission unit 17, the instruction receiving unit 19 waits until an instruction is received from the portable information terminal 200. When an instruction is received from the portable information terminal 200, the received instruction is output to the process execution unit 21. The process execution unit 21 executes the process according to the instruction received by the instruction reception unit 19. The processing executed by the processing execution unit 21 includes image formation processing by the image forming unit 140, data transmission processing for transmitting data from the communication I / F 112, processing for facsimile transmission from the facsimile unit 117, and browsing of data stored in the HDD 116. , Including all the processes that can be executed by the MFP 100, such as a process of copying and a process of reading a document by the document reading unit 130. When in the sleep mode where power consumption is low and an image cannot be formed, the process execution unit 21 maintains the sleep mode until an instruction for executing the image formation process is input. For example, when data transmission processing other than image formation processing, facsimile transmission processing, data browsing / copying processing, and document reading processing are instructed, the sleep mode is maintained. For this reason, when the portable information terminal 200 is remotely operated, the sleep mode is maintained as much as possible, so that power consumption can be reduced.

FIG. 6 is a functional block diagram showing an overview of the functions of the CPU provided in the portable information terminal according to the first embodiment. Referring to FIG. 6, CPU 201 of portable information terminal 200 has a request unit 51 that requests transmission of a remote operation screen from one of MFPs 100, 101, and 102 and a screen reception unit that receives a remote operation screen from MFP 100. 53, converts the set value reading unit 55 for reading pre-stored display mode setting in the flash memory 203 (hereinafter referred to as "display format setting values"), according to the display mode setting value screen for remote control Screen converting unit 57, voice synthesizing unit 60 that synthesizes characters included in the converted screen and outputs the voice, screen display unit 59 for displaying the converted screen on display unit 206, and instruction reception for receiving instructions Unit 61 and an instruction transmission unit 63 for transmitting the accepted instruction.

  Request unit 51 transmits an operation screen transmission request to one of MFPs 100, 101, and 102. When the user carrying portable information terminal 200 selects one of MFPs 100, 101, and 102, the MFP that transmits the operation screen transmission request is determined. For example, if the user selects MFP 100 to operate MFP 100, portable information terminal 200 transmits an operation screen transmission request to MFP 100. Here, a case where MFP 100 is selected will be described as an example. When establishing a connection with any of MFPs 100, 101, 102, request unit 51 allows the user to input authentication information such as a user ID and a password, and transmits the information to MFP 100. The operation screen transmission request may be transmitted on condition that the authentication succeeds. When the request unit 51 transmits the operation screen transmission request, the request unit 51 outputs a reception instruction to the screen reception unit 53. The reception instruction includes device identification information for identifying the MFP that has transmitted the operation screen transmission request, here, MFP 100.

  When receiving a reception instruction, screen receiving unit 53 enters a standby state until receiving an operation screen from MFP 100. When receiving the operation screen, screen receiving unit 53 outputs a reading instruction to setting value reading unit 55 and screen conversion unit 57. The received operation screen is output.

Set value reading unit 55 outputs the pre-stored display mode setting value in the flash memory 203 reads the display mode setting value on the screen conversion unit 57. The display form setting value is a value that determines the display mode of the screen, and is, for example, a value that determines the character color, the screen size, and the language.

The screen conversion unit 57 converts the operation screen input from the screen reception unit 53 according to the display mode setting value, and outputs the converted screen to the screen display unit 59. Specifically, the display mode setting value if you set the text color, and converts the color of the character defined by the display mode setting value the color contained in the screen. If the screen size is determined by the display form setting value , the operation screen is enlarged or reduced to a size determined by the display form setting value . Further, if a language is set in the display form setting value , the character included in the operation screen is recognized, and the character is translated into a language determined by the display form setting value . The screen conversion unit 57 outputs the operation screen converted according to the display form setting value to the screen display unit 59 and the voice synthesis unit 60.

The screen display unit 59 displays the input screen on the display unit 206. Since the screen to be displayed is a screen obtained by converting the operation screen received from MFP 100 according to the display mode setting value, the screen is displayed in a display mode desired by the user. Since the operation screen is displayed in the color, size, or language of characters desired and set in advance by the user, it is easy to input display form setting values .

  The voice synthesizer 60 synthesizes voice (text data) included in the input screen and outputs the voice from the speaker included in the call unit 205. For this reason, since the characters included in the screen are output by voice, the user can recognize the operation screen without looking at the display unit 206.

  The instruction receiving unit 61 receives an instruction that the user inputs to the operation unit 207 according to the screen displayed on the display unit 206. In addition, the instruction receiving unit 61 has a voice recognition function. When the user utters an instruction toward the microphone included in the calling unit 205, the voice is recognized and the instruction is accepted. The instruction receiving unit 61 outputs the received instruction to the instruction transmitting unit 63. Instruction transmitting unit 63 transmits the input instruction to MFP 100 that has transmitted the operation screen.

Figure 7 is a flowchart showing an exemplary flow of remote operation accepting process in the first embodiment. The remote operation reception process is a process executed by the CPU when the CPU of the MFP executes a remote operation reception program. Referring to FIG. 7, it is determined whether an operation screen transmission request is received from portable information terminal 200 (step S01). The process waits until an operation screen transmission request is received from portable information terminal 200 (NO in step S01). When an operation screen transmission request is received, the process proceeds to step S02. That is, the remote operation acceptance process is a process executed on condition that a transmission request for an operation screen is received. When the transmission request is received, the position information on the network 2 of the portable information terminal 200 is received together with the transmission request. The location information on the network 2 is, for example, an IP address or a MAC address.

  In step S02, an operation screen is acquired. Information for specifying the operation screen displayed on the display unit 160A at that time, for example, a screen number is acquired. Then, a remote operation screen corresponding to the acquired screen number is read from the EEPROM 115 (step S03). Then, the read remote operation screen is transmitted to the portable information terminal 200 that has transmitted the transmission request. In step S01, since the position information on the network 2 of the portable information terminal 200 received together with the transmission request is received, an operation screen for remote operation is transmitted to the portable information terminal 200 using this position information.

  In step S05, the process waits until an instruction is received from portable information terminal 200 (NO in step S05). When the instruction is received, the process proceeds to step S06. In step S06, it is determined whether the received support is a screen transition instruction for transitioning the screen. If it is a screen transition instruction, the process proceeds to step S08; otherwise, the process proceeds to step S07. In step S08, the operation screen displayed on display unit 160A is switched to the operation screen specified by the transition instruction, and the process proceeds to step S02.

  In step S07, the process is executed in accordance with the received instruction. For example, copy processing, print processing, data transmission, facsimile transmission, etc. are executed. When the received instruction is other than the copy process and the print process, if MFP 100 is in the sleep mode, the sleep mode is maintained. When an instruction to execute processing that does not use the image forming unit 140 is received, it is not necessary to drive the image forming unit 140. Therefore, the image forming unit 140 in the sleep mode is not driven and power consumption is reduced. This is to reduce.

  FIG. 8 is a flowchart illustrating an example of the flow of remote operation processing according to the first embodiment. The remote operation process is a process executed by the CPU 201 when the CPU 201 of the portable information terminal 200 executes a remote operation program. Referring to FIG. 8, it is determined whether an instruction to connect to any of MFPs 100, 101, or 102 has been received. It is determined whether an instruction to select one of MFPs 100, 101, and 102 and an instruction to connect are accepted by operation unit 207. The process waits until a connection instruction is accepted (NO in step S11). If a connection instruction is accepted, the process proceeds to step S12. That is, the remote operation process is a process executed on condition that a connection instruction is received. Here, a case where an instruction to select MFP 100 and an instruction to connect are input will be described as an example.

In step S12, the display form setting value stored in the flash memory 203 is read. Then, an operation screen transmission request is transmitted to MFP 100 (step S13). In the next step S14, the process waits until an operation screen is received (NO in step S14). When the operation screen is received, the process proceeds to step S15.

In step S15, the operation screen received in step S14 is converted in accordance with the display mode setting value read in step S12. Specifically, if the color of the character is defined in the display mode setting value is converted to the color of the character defined by the display mode setting value the color contained in the operation screen. If the screen size is limited by the display form setting value , the operation screen is enlarged or reduced to the size determined by the display form setting value . Further, if the language is defined in the display form setting value , the character included in the operation screen is recognized, and the character is translated into the language defined by the display form setting value . Then, the converted operation screen is displayed on the display unit 206. In addition to displaying on the display unit 206 or separately from this, the characters included in the converted operation screen may be recognized, and the synthesized voice of the recognized characters may be output from the speaker. .

  Next, the process waits until an instruction is input to the operation unit 207 according to the operation screen (NO in step S17). When the instruction is input, the process proceeds to step S18. Instead of or in addition to receiving the instruction with the operation unit 207, the instruction may be received by voice and the instruction may be received by recognizing the voice.

  In step S18, it is determined whether or not the input instruction is an instruction to end the remote operation. If it is an end instruction to end the remote operation, the process ends. If not, the process proceeds to step S19. In step S18, the input instruction is transmitted to MFP 100.

<Modification>
In the embodiment described above, the operation screen is converted according to the display form setting value in portable information terminal 200, but the operation screen may be converted in MFP 100 according to the display form setting value .

  FIG. 9 is a functional block diagram illustrating an overview of the functions of the CPU provided in the MFP according to the modification. Referring to FIG. 9, CPU 111A provided in MFP 100 in the modification differs from the functional block diagram shown in FIG. 5 in that request receiving unit 11A is changed and screen conversion unit 23 is added. . Since other configurations have been described above, description thereof will not be repeated here.

Referring to FIG. 9, request receiving unit 11 </ b> A receives the operation screen transmission request and the display form setting value transmitted from portable information terminal 200 after establishing connection with portable information terminal 200. Upon receiving the operation screen transmission request and the display mode setting value , the request receiving unit 11A outputs a reading instruction to the remote operation screen reading unit 15 and outputs the display mode setting value to the screen conversion unit 23.

  When a read instruction is input from the request receiving unit 11, the remote operation screen reading unit 15 corresponds to the operation screen displayed on the display unit 160A by the screen display control unit 13 and is stored in the EEPROM 115 in advance. The screen is read out and output to the screen conversion unit 23.

The screen conversion unit 23 converts the remote operation screen input from the remote operation screen reading unit 15 according to the display form setting value input from the request reception unit 11A, and converts the converted screen to the screen transmission unit 17. Output. Specifically, if the character color is set in the display form setting value , the color included in the screen is converted to the character color set in the display form setting value . If the screen size is limited by the display form setting value , the operation screen is enlarged or reduced to the size determined by the display form setting value . If further language is defined in the display mode setting value, the characters in the operation screen and character recognition, translating the language defined by the display mode setting value that character.

  FIG. 10 is a functional block diagram showing an overview of the functions of the CPU provided in the portable information terminal in the modified example. Referring to FIG. 10, the difference from the functional block diagram shown in FIG. 6 is that request unit 51A and screen reception unit 53A are changed, and screen conversion unit 57 is deleted. Since other configurations have been described above, description thereof will not be repeated here.

The request unit 51 </ b> A receives the display form set value from the set value reading unit 55. Further, request unit 51A transmits an operation screen transmission request and a display form setting value to one of MFPs 100, 101, and 102. When the user carrying portable information terminal 200 selects one of MFPs 100, 101, and 102, the MFP that transmits the operation screen transmission request is determined. Here, a case where MFP 100 is selected will be described as an example. When establishing a connection with any of MFPs 100, 101, 102, request unit 51 A causes the user to input authentication information such as a user ID and a password, and transmits the information to MFP 100. The operation screen transmission request may be transmitted on condition that the authentication succeeds. The request unit 51A outputs a reception instruction to the screen reception unit 53 when transmitting the operation screen transmission request and the display form setting value . The reception instruction includes device identification information for identifying the MFP that has transmitted the operation screen transmission request, here, MFP 100.

  When receiving a reception instruction, screen receiving unit 53A enters a standby state until it receives an operation screen from MFP 100. When receiving the operation screen, screen receiving unit 53A outputs the operation screen to screen display unit 59 and voice synthesis unit 60.

  FIG. 11 is a flowchart illustrating an example of the flow of remote operation acceptance processing in the modification. Referring to FIG. 11, the difference from the remote operation acceptance process shown in FIG. 7 is that step S02A is added between steps S02 and S03, and step S03A is different between steps S03 and S04. It has been added. Since other processes are the same, the description will not be repeated here.

In step S02A, a standby state is set until a display form setting value is received from portable information terminal 200 that has transmitted the operation screen transmission request in step S01. When the display form set value is received, the process proceeds to step S03. In step S03, an operation screen for remote operation corresponding to the screen number of the operation screen acquired in step S02 is read from EEPROM 115. Then, the read operation screen for remote operation is converted in accordance with the display form setting value received in step S02A. In the next step S04, the converted screen is transmitted to portable information terminal 200 that has transmitted the transmission request.

FIG. 12 is a flowchart illustrating an example of the flow of remote operation processing in the modification. Referring to FIG. 12, the difference from the remote operation reception process shown in FIG. 8 is that step S13A is changed and step S15 is deleted. Since other processes are the same, the description will not be repeated here. In step S13A, an operation screen transmission request and a display form setting value are transmitted to MFP 100.

As described above, in image forming system 1 according to the present embodiment, the operation screen for setting MFP 100 is converted and displayed on portable information terminal 200 according to the display form setting value desired by the user, and portable information is displayed. A designation for causing MFP 100 to execute processing in terminal 200 is accepted. Therefore, the user can set MFP 100 on a desired operation screen without changing the operation screen of the image forming apparatus used by a plurality of users.

  Further, when an instruction received by MFP 100 by remote operation is not related to the function of forming an image, image forming unit 140 is not driven without canceling the sleep mode, so that power consumption can be reduced.

  In addition, since an instruction can be input by voice, the operation can be simplified.

Further, in the image forming system 1 in the modification, the MFP 100, 101, 102 converts the operation screen according to the display form setting value set in the portable information terminal 200, so that it is not necessary to convert in the portable information terminal 200. . For this reason, it is not necessary to install a special program in the portable information terminal 200.

<Second Embodiment>
The image forming system 1 in the second embodiment has the same system configuration as the image forming system 1 in the first embodiment. Here, differences from the image forming system 1 according to the first embodiment will be mainly described. Since all the functions of the MFPs 100, 101, and 102 are the same, the MFP 100 will be described as an example here.

FIG. 13 is a functional block diagram showing an overview of the functions of the CPU 111B provided in the MFP 100 according to the second embodiment. Referring to FIG. 13, CPU 111 </ b> B receives imaging notification receiving unit 31 that receives an imaging notification from portable information terminal 200, and setting values (hereinafter simply referred to as “setting values”) relating to processing of the image forming apparatus that has been set . A setting value storage unit 33 for storing data, a screen display control unit 13 for controlling the display unit 160A, an instruction receiving unit 19A for receiving instructions from the portable information terminal, and a setting value reading for reading the setting values from the EEPROM 115 A unit 35, a set value changing unit 37 for changing the set value, and a process executing unit 21 for executing the process are included.

  The imaging notification receiving unit 31 receives an imaging notification transmitted from the portable information terminal 200 after establishing a connection with the portable information terminal 200. The imaging notification is a signal transmitted to the MFP 100 when the portable information terminal 200 described later captures an operation screen displayed on the display unit 160A of the MFP 100 with the camera 202. The imaging notification receiving unit 31 receives the identification information of the portable information terminal 200 when establishing a connection with the portable information terminal 200. The identification information of the portable information terminal 200 is position information on the network 2 assigned to the portable information terminal 200, for example. The location information on the network 2 is, for example, an IP (Internet Protocol) address or a MAC (Media Access Control) address. In addition, the imaging notification receiving unit 31 receives authentication information such as a user ID and a password from the portable information terminal 200 when establishing a connection with the portable information terminal 200, and the authentication is successful. An imaging notification may be received. Thereby, users who use MFP 100 can be limited. When the imaging notification receiving unit 31 receives the imaging notification, the imaging notification receiving unit 31 outputs a storage instruction to the setting value storage unit 33.

  When the storage instruction is input from the imaging notification receiving unit 31, the setting value storage unit 33 acquires the setting value set on the setting screen displayed on the display unit 160A from the screen display control unit 13, and the setting is performed. A registration number is assigned to the value and stored in the EEPROM 115, and the registration number is transmitted to the portable information terminal 200 that has transmitted the imaging notification.

  The screen display control unit 13 displays one of a plurality of operation screens stored in advance in the EEPROM 115 on the display unit 160A. The plurality of operation screens are associated with each other, and have a transition button for transitioning from one operation screen to another operation screen. When the instruction of the transition button is detected by the operation unit 160B, the screen display control unit 13 reads the operation screen associated with the transition button from the EEPROM 115 and displays it on the display unit 160A.

  The instruction receiving unit 19A waits until an instruction is received from the portable information terminal 200. When the instruction is received from the portable information terminal 200, the registration number included in the received instruction is output to the set value reading unit 55, and the received instruction is received. The included set value is output to the set value changing unit 37. In addition, if the registration number included in the received instruction includes the device identification information of another device, for example, the MFP 101, the instruction receiving unit 19 outputs the set of the device identification information and the registration number to the set value reading unit 35. To do. The instruction receiving unit 19 </ b> A does not output the setting value to the setting value changing unit 37 when the instruction received from the portable information terminal 200 does not include the setting value.

  The set value reading unit 35 reads the set value to which the input registration number is attached from the EEPROM 115 and outputs the read set value to the set value changing unit 37. Also, when a set of device identification information and a registration number is input, the set value reading unit 35 transmits a set value with the registration number assigned to another MFP specified in the device identification information, here, the MFP 101. The setting value requested and received from the MFP 101 is output to the setting value changing unit 37.

  The set value changing unit 37 changes the set value input from the set value reading unit 35 to the set value input from the instruction receiving unit 19A, and outputs the changed set value to the process executing unit 21. Note that if the instruction received from the portable information terminal 200 does not include a set value, the setting value is not input from the instruction receiving unit 19A, and therefore the setting value changing unit 37 is set by the setting value reading unit 35. Is output to the process execution unit 21.

  The process execution unit 21 executes a process according to the set value input from the set value change unit 37. The processing executed by the processing execution unit 21 includes image formation processing by the image forming unit 140, data transmission processing for transmitting data from the communication I / F 112, processing for facsimile transmission from the facsimile unit 117, and browsing of data stored in the HDD 116. , Including all the processes that can be executed by the MFP 100, such as a process of copying and a process of reading a document by the document reading unit 130. When in the sleep mode where power consumption is low and an image cannot be formed, the process execution unit 21 maintains the sleep mode until an instruction for executing the image formation process is input. For example, when data transmission processing other than image formation processing, facsimile transmission processing, data browsing / copying processing, and document reading processing are instructed, the sleep mode is maintained. For this reason, when the portable information terminal 200 is remotely operated, the sleep mode is maintained as much as possible, so that power consumption can be reduced.

  FIG. 14 is a functional block diagram showing an overview of the functions of the CPU provided in the portable information terminal according to the second embodiment. Referring to FIG. 14, CPU 201 </ b> B of portable information terminal 200 captures an image that is captured by camera 202 and receives an image to be output, and imaging for notifying any of MFPs 100, 101, and 102. A notification unit 75, a storage unit 73 that receives a registration number from the MFP that has notified that the image has been captured, stores the registration number and the captured image in association with each other, and an instruction reception unit 77 that receives an instruction input by the user to the operation unit 207. An image display unit 79 that displays an image on the display unit 206, a setting value reception unit 81 that receives a setting value input by the user to the operation unit 207, and the received instruction is transmitted to one of the MFPs 100, 101, and 102. And an instruction transmission unit 83.

  The image receiving unit 71 receives an image captured and output by the camera 202. The subject of the camera is preferably an operation screen displayed on one of display units 160A of MFPs 100, 101, and 102. The image reception unit 71 outputs the received image to the storage unit 73 and outputs a notification instruction for notifying the imaging notification unit 75 that the image has been captured.

  The imaging notification unit 75 notifies any of the MFPs 100, 101, 102 that the imaging has been performed. The notification target is an MFP in which the user has captured the operation screen. Accordingly, when the user selects one of the MFPs 100, 101, and 102, the selection is accepted, and the selected MFP is notified that the image has been captured. Here, a case of notifying MFP 100 will be described as an example. Receiving the notification, MFP 100 assigns and stores a registration number to the value set at that time, and transmits the registration number to portable information terminal 200. Therefore, storage unit 73 receives the registration number.

  Upon receipt of the registration number, the storage unit 73 associates the registration number with the image input from the image receiving unit 71 and stores it in the flash memory 203. Therefore, the operation screen displayed on display portion 160A of MFP 100, the image obtained by capturing the operation screen, and the set value at that time are one registration number, and each of MFP 100 and portable information terminal 200 is used. , Associated. The storage unit 73 stores the device identification information of the MFP that has transmitted the registration number, here, the MFP 100 together with the registration number.

The instruction receiving unit 77 receives an instruction input by the user to the operation unit 207. When receiving an instruction to display an image stored in the flash memory 203, the instruction receiving unit 77 outputs an instruction to display the image to the image display unit 79. The image display unit 79 reads an image from the flash memory 203 according to the input display instruction and displays the image on the display unit 206.

When the instruction receiving unit 77 receives an instruction to set when the operation screen displayed on the display unit 206 is displayed on any of the MFPs 100, 101, 102, the instruction receiving unit 77 outputs a transmission instruction to the instruction transmitting unit 83. To do. When the user selects one of MFPs 100, 101, and 102, the selection is accepted, and a transmission instruction including device identification information of the selected MFP is output. The transmission instruction includes a registration number associated with the image displayed on the display unit 206 by the image display unit 79. The transmission instruction further includes device identification information when the registration number is associated with the device identification information.

Further, when a setting value different from the setting when the operation screen displayed on the display unit 206 is displayed is input to the operation unit 207, the setting value reception unit 81 receives the setting value. The set value receiving unit 81 outputs the received set value to the instruction transmitting unit 83. The set value receiving unit 81 does not output the set value to the instruction transmitting unit 83 when the set value is not received. The instruction transmission unit 83 transmits the registration number included in the transmission instruction input from the instruction reception unit 77 to the MFP specified by the device identification information included in the transmission instruction.

Figure 15 is a flowchart showing an exemplary flow of remote operation accepting process in the second embodiment. The remote operation acceptance process is a process executed by CPU 111 of MFP 100 in the second embodiment. Referring to FIG. 15, it is determined whether a remote operation request has been received from portable information terminal 200 (step S21). The process waits until a remote operation request is received from portable information terminal 200 (NO in step S21). When the remote operation request is received, the process proceeds to step S22. That is, the remote operation acceptance process is a process executed on condition that a remote operation request is received. When the remote operation request is received, the location information on the network 2 of the portable information terminal 200 is received together with the request. The location information on the network is, for example, an IP address or a MAC address.

  In step S22, it is determined whether an imaging notification is received from portable information terminal 200. If an imaging notification is received, the process proceeds to step S23; otherwise, the process proceeds to step S28. In step S23, the operation screen displayed at that time on display unit 160A is acquired. Which of the plurality of operation screens is displayed is determined, and the screen number of the operation screen is acquired. In the next step S24, the setting value set on the operation screen is acquired. Then, a registration number is assigned to the set value (step S25), and the set value is stored in the EEPROM 115 together with the registration number (step S26). The screen number may be stored in addition to the set value. The registration number can be arbitrarily determined, but is a unique number in MFP 100 in order to specify the setting value. For example, a number combining a date and a serial number can be used.

  In the next step S27, the registration number is transmitted to the portable information terminal 200. In portable information terminal 200, if an image obtained by capturing an operation screen displayed on display unit 160A of MFP 100 is associated with a registration number, in portable information terminal 200, the image of the operation screen is associated with the registration number. As a result, the image obtained by capturing the operation screen is associated with the set value by the registration number.

  In step S28, it is determined whether device information and a registration number have been received. If they are received, the process proceeds to step S29; otherwise, the process proceeds to step S31. In step S29, it is determined whether or not the device specified by the device information is its own device. If so, the process proceeds to step S30; otherwise, the process proceeds to step S31. In step S31, the setting value stored in EEPROM 115 together with the registration number received in step S28 is read, and the process proceeds to step S32. On the other hand, in step S31, a registration number is transmitted to the MFP identified by the device information among the MFPs 101 and 102, and a setting value related to the registration number is acquired.

  In step S32, it is determined whether or not a setting value is received from portable information terminal 200. If the set value is received, the process proceeds to step S33. If not, step S33 is skipped and the process proceeds to step S34. On the other hand, in step S33, the setting value read from EEPROM 115 in step S30 or the setting value acquired from either MFP 101 or 102 in step S31 is replaced with the setting value received in step S32.

  In step S34, if step S33 is not executed, the process is executed according to the setting value read from the EEPROM 115 in step S30 or the setting value acquired from one of the MFPs 101 and 102 in step S31, and step S33 is executed. In step S33, the process is executed according to the set value replaced with the received set value.

  FIG. 16 is a flowchart illustrating an example of the flow of remote operation processing according to the second embodiment. Referring to FIG. 16, it is determined whether a connection instruction has been accepted. The remote operation process is a process executed by the CPU 201 when the CPU 201 of the portable information terminal 200 executes a remote operation program. Referring to FIG. 16, it is determined whether an instruction to connect to any of MFPs 100, 101, or 102 has been received. It is determined whether an instruction to select one of MFPs 100, 101, and 102 and an instruction to connect are accepted by operation unit 207. The process waits until a connection instruction is accepted (NO in step S41). If a connection instruction is accepted, the process proceeds to step S42. That is, the remote operation process is a process executed on condition that a connection instruction is received. Here, a case where an instruction to select MFP 100 and an instruction to connect are input will be described as an example.

  In step S42, a request for remote operation is transmitted to MFP 100. In the next step S14, it is determined whether an imaging instruction has been accepted. It is detected whether or not an imaging button provided in the operation unit 207 is pressed. If the imaging button is pressed, the process proceeds to step S44; otherwise, the process proceeds to step S47.

  In step S44, MFP 100 is notified that the image has been captured. Then, the process waits until a registration number is received from MFP 100 (step S45). When the registration number is received, the process proceeds to step S46. In step S46, the image acquired in step S43 is stored in the flash memory 203 in association with the registration number received in step S45, and the process proceeds to step S47. When the user of portable information terminal 200 captures the operation screen displayed on display unit 160 </ b> A of MFP 100 with camera 202, the image of the operation screen and the registration number received from MFP 100 are stored in flash memory 203.

  In step S47, it is determined whether or not an instruction to read an image stored in the flash memory 203 has been received. If a read instruction is accepted, the instructed image is read and displayed on the display unit 206, and then the process proceeds to step S48. As a result, an image obtained by capturing the operation screen is displayed on the display unit 206. On the other hand, if an image read instruction is not accepted, the process proceeds to step S53. In step S48, it is determined whether a set value has been accepted. If the set value is accepted, the process proceeds to step S49; otherwise, step S49 is skipped and the process proceeds to step S50. The setting value is a setting value that can be set on the operation screen in MFP 100, 101, 102 when an image obtained by capturing the operation screen is displayed on display unit 206. In step S49, the set value is accepted and the process proceeds to step S50.

  In step S50, it is determined whether an execution instruction has been accepted. If an execution instruction is accepted, the process proceeds to step S51; otherwise, the process returns to step S48. The execution instruction includes an instruction for designating one of MFPs 100, 101, and 102. When an instruction to select one of MFPs 100, 101, and 102 is accepted by operation unit 207, device information for specifying the accepted MFP and the registration number associated with the image displayed in step S47 are given to MFP 100. Send. The registration number associated with the image is a registration number stored in the flash memory 203 together with the image.

  In step S52, the setting value set in step S49 is transmitted to MFP 100. If the set value is not set in step S49, a signal indicating that there is no set value to be changed instead of the set value is transmitted to MFP 100.

  And it is judged whether the cutting | disconnection instruction | indication was received (step S53). If a cutting instruction is accepted, the process proceeds to step S54; otherwise, the process returns to step S43. In step S54, a disconnection request is transmitted to MFP 100, and the process ends.

  As described above, in the image forming system according to the second embodiment, when camera 202 captures an operation screen displayed on display unit 160A of MFP 100 on portable information terminal 200, it is set in MFP 100 at that time. The setting value and the registration number are stored, and the image of the operation screen imaged in the portable information terminal 200 and the registration number are stored. Thereafter, when the user displays any of the stored images and inputs an execution instruction on portable information terminal 200, the registration number stored in association with the image on MFP 100 is transmitted to MFP 100. When MFP 100 receives the registration number, it executes processing according to the setting value stored in association with the registration number. For this reason, once the setting value is input to the MFP 100 and the operation screen is captured by the portable information terminal 200, the same setting as the previously set value can be obtained simply by reading the captured image and inputting an execution instruction. The value can cause MFP 100 to execute processing. Therefore, setting of MFP 100 is facilitated.

  Furthermore, if a setting value is input at the stage where the operation screen image is displayed on portable information terminal 200, the setting value previously set in MFP 100 can be changed. For this reason, since a setting value can be changed, a flexible setting can be performed.

  In the above-described embodiment, the image forming system 1 has been described. However, the remote operation method for executing the processes shown in FIGS. 7, 8, 11, 12, 15, and 16, and FIG. 7, a remote operation reception program for causing MFPs 100, 101, and 102 to execute the processes shown in FIGS. 11 and 15, or for causing portable information terminal 200 to execute the processes shown in FIGS. It goes without saying that the invention can be specified as a remote control program.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1 is a diagram showing an overall outline of an image forming system in one embodiment of the present invention. 1 is a perspective view showing an appearance of an MFP. 2 is a block diagram illustrating an outline of a hardware configuration of an MFP. FIG. It is a functional block diagram which shows the outline | summary of the hardware constitutions of a portable information terminal. 3 is a functional block diagram illustrating an outline of functions of a CPU 111 provided in the MFP according to the first embodiment. FIG. It is a functional block diagram which shows the outline | summary of the function of CPU with which the portable information terminal in 1st Embodiment is provided. Is a flowchart showing an exemplary flow of remote operation accepting process in the first embodiment. It is a flowchart which shows an example of the flow of the remote operation processing in 1st Embodiment. FIG. 10 is a functional block diagram illustrating an overview of functions of a CPU provided in an MFP according to a modification. It is a functional block diagram which shows the outline | summary of the function of CPU with which the portable information terminal in a modification is provided. It is a flowchart which shows an example in the flow of the remote operation reception process in a modification. It is a flowchart which shows an example in the flow of the remote operation process in a modification. FIG. 10 is a functional block diagram illustrating an overview of functions of a CPU 111B provided in the MFP 100 according to the second embodiment. It is a functional block diagram which shows the outline | summary of the function of CPU with which the portable information terminal in 2nd Embodiment is provided. Is a flowchart showing an exemplary flow of remote operation accepting process in the second embodiment. It is a flowchart which shows an example of the flow of the remote operation process in 2nd Embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Image forming system, 2 networks, 11 Wireless station, 11, 11A request | requirement receiving part, 13 Screen display control part, 15 Remote operation screen reading part, 17 Screen transmission part, 19, 19A Instruction receiving part, 21 Process execution part, 23 screen conversion unit, 31 imaging notification receiving unit, 33 setting value storage unit, 35 setting value reading unit, 37 setting value changing unit, 51, 51A requesting unit, 53, 53A screen receiving unit, 55 setting value reading unit, 57 screen Conversion unit, 59 screen display unit, 60 speech synthesis unit, 61 instruction reception unit, 63 instruction transmission unit, 71 image reception unit, 73 storage unit, 75 imaging notification unit, 77 instruction reception unit, 79 image display unit, 81 set value Reception unit, 83 instruction transmission unit, 110 main circuit, 111 CPU, 112 communication I / F unit, 113 ROM, 114 RAM, 115 EEPROM, 11 6 HDD, 117 facsimile unit, 118 card I / F, 118A flash memory, 120 automatic document feeder, 130 document reading unit, 140 image forming unit, 150 sheet feeding unit, 160 operation panel, 160A display unit, 160B operation unit, 200 mobile information terminal, 201 CPU, 202 camera, 203 flash memory, 204 wireless communication unit, 205 call unit, 206 display unit, 207 operation unit, 300 wireless station.

Claims (3)

An image forming system comprising an image forming apparatus and a portable communication terminal capable of communicating with the image forming apparatus,
The mobile communication terminal includes imaging means for imaging a subject;
Storage means for storing an image obtained by imaging the operation screen of the image forming apparatus;
Notification means for notifying that the image forming apparatus has imaged in response to imaging of the operation screen;
Registration number receiving means for receiving a registration number from the image forming apparatus in response to the notification;
Storage means for storing the registration number and the image in association with each other;
Display means capable of displaying the image read from the storage means;
Transmission means capable of transmitting the registration number to the image forming apparatus,
The image forming apparatus includes display means for displaying an operation screen;
In response to receiving a notification from the mobile communication terminal, a setting value related to image processing of the image forming apparatus set on the operation screen displayed when the notification is received, and a setting value assigned thereto Setting value storage means for associating and storing a registration number,
The mobile communication terminal transmits the registration number associated with the image to the image forming apparatus in response to the image displayed on the display unit being designated,
The image forming apparatus reads the setting value stored in the setting value storage unit according to the registration number received from the mobile communication terminal, and sets the read setting value. There are a plurality of the image forming apparatuses,
Device identification information is given to each of the image forming devices,
The mobile communication terminal receives device identification information together with a registration number from the image forming device in response to the notification, stores the received registration number in the storage unit in association with the device identification information and the image,
In response to the designation of the image displayed on the display unit and the destination image forming apparatus, the registration number and the apparatus identification information associated with the image are transmitted to the designated image forming apparatus. And
The designated image forming apparatus is stored in the setting value storage unit of the other image forming apparatus when the apparatus identification information received from the portable communication terminal relates to the other image forming apparatus. Obtaining a setting value associated with the registration number and setting the obtained setting value;
The image forming system according to claim 1. The mobile communication terminal is capable of inputting a setting value on an operation screen corresponding to the image displayed on the display means, and transmits the input setting value to the image forming apparatus that has transmitted the registration number;
The image forming system according to claim 1, wherein the image forming apparatus changes a set value according to the received set value.

Images