JP2016051225A - Portable terminal equipment, image processing method in the same equipment, and image processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide portable terminal equipment for, even when an input operation part such as a software key is temporarily displayed in the case of storing an image displayed by display means, preventing the size of an image file from varying due to the presence/absence of display of an input operation part, and for preventing the number of pages of the image file from being made different during printing and storage.SOLUTION: The portable terminal equipment includes: display means 15 capable of displaying the image of a Web page generated in a first view 100; image generation means 11 for generating the same image as the image of the Web page generated in the first view in a second view 200 different from the first view; and capture means 11 for capturing the image generated in the second view 200 by the image generation means.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a mobile terminal device such as a smartphone or a tablet terminal, an image processing method and an image processing program implemented in the device.

  In the portable terminal device as described above, when an image on a web page displayed on the display unit is stored as an image file, an input operation such as a software keyboard used by the user to input a file name, a storage destination, etc. Some have a function of temporarily displaying a part. In some cases, when printing an image, there is a direct print function for transmitting a file to be printed to a printing apparatus in a file format.

  A portable terminal device having these functions has the following drawbacks depending on the model of the portable terminal device with respect to storage and printing of images displayed on the display unit.

  In Patent Document 1, even if the environment is different for each user or there is a problem that depends on the application used at the time of document creation, printing according to the image confirmed on the web can be performed, and character font replacement A system for resolving printing differences that prevents problems such as printing, garbled characters, and printing across two pages is disclosed.

  Specifically, in the center system, the image data creation server checks the text of the document data from the user terminal received by the WWW server via the Internet, and then converts the document data into general-purpose image data having a page concept. After conversion, the document storage server stores the converted image data. The WWW server reads the stored image data and posts it on the Web. When the user confirms and approves using the browser, The image data is printed out on a printer.

Japanese Patent Laid-Open No. 2001-228982

  That is, in a portable terminal device using a certain basic OS, the display state of the input operation unit such as a software keyboard that is temporarily displayed when an image is stored cannot be detected. The size of the will fluctuate.

  More specifically, as shown in FIG. 6, when a web page image is displayed on the display unit 15 of the mobile terminal device 1, the vertical width A1 of the web page image size is displayed on the mobile terminal device 1. If the area is smaller than the vertical width B1, a margin area C1 is generated. When printing the image displayed on this screen, the display image is captured and printed, but the margin area C1 is also captured and printed in the same size.

  On the other hand, when saving the image displayed on the screen, as shown in FIG. 7, when the input operation unit 20 such as a software keyboard is displayed, the vertical width A1 of the image size of the web page does not change, but the portable terminal It can be considered that the vertical width of the blank area C2 is automatically adjusted to become smaller as the vertical width B2 of the image display area of the apparatus 1 becomes smaller. For this reason, the capture of the display image for storage is also executed in a state where the vertical width of the margin area C2 is small, and a page is allocated to the stored image.

  For this reason, the number of pages of the image file may be different between the direct printing in which the input operation unit 20 is not displayed and the saving in which the input operation unit 20 is displayed, and when the image file once saved is printed again. There is a problem that the number of pages is different from the previous printing and the print settings are changed.

  Such a problem cannot be solved even by referring to the technique described in Patent Document 1 described above.

  The present invention has been made in view of such a technical background, and even when an input operation unit such as a software key is temporarily displayed when an image displayed on the display unit is saved, The size of the image file does not fluctuate depending on whether or not the input operation unit is displayed, and the mobile terminal device that prevents the number of pages of the image file from being different between printing and saving, and image processing in the device It is an object to provide a method and an image processing program.

The above problem is solved by the following means.
(1) Display means capable of displaying an image of the web page generated in the first view, and a second view different from the first view, the same as the image of the web page generated in the first view A portable terminal device comprising: an image generation unit that generates an image of the image; and a capture unit that captures an image generated in the second view by the image generation unit.
(2) The mobile terminal device according to item 1, wherein the second view has a vertical width smaller than that of the first view.
(3) The mobile terminal device according to (1) or (2), wherein the second view is formed on a back surface of the first view.
(4) A size acquisition unit that acquires the size of the vertical width of the image of the web page generated in the first view, and the second view has the vertical width acquired by the size acquisition unit. 4. The mobile terminal device according to any one of the preceding items 1 to 3, which is set to be smaller than a vertical width of the image.
(5) The mobile terminal device according to any one of (1) to (4), wherein the vertical width of the second view is set to a minimum vertical width allowed by the device itself.
(6) The generation of the image of the web page in the second view by the image generation unit is started when a print execution button for printing the image captured by the capture unit is pressed. The portable terminal device in any one of 1-5.
(7) The generation of the image of the web page in the second view by the image generation unit is started when a save execution button for saving the image captured by the capture unit is pressed. The portable terminal device in any one of 1-5.
(8) A display step of displaying on the display means an image of the web page generated in the first view, and an image of the web page generated in the first view in a second view different from the first view. An image processing method in a portable terminal device, comprising: an image generation step for generating the same image as the first step; and a capture step for capturing an image generated in the second view by the image generation step.
(9) A display step of displaying on the display means an image of the web page generated in the first view, and an image of the web page generated in the first view in a second view different from the first view. An image processing program for causing a computer of a mobile terminal device to execute an image generation step for generating the same image as the first and a capture step for capturing an image generated in the second view by the image generation step.

  According to the invention described in (1), the web page generated in the first view is displayed in a second view different from the first view in which the image of the web page displayed on the display unit is generated. Since the same image as the image is generated and the image generated in the second view is captured, an input operation unit such as a software key is temporarily displayed when the image displayed on the display unit is saved. Even in such a case, the captured second view image is not affected, and the size of the image file does not vary depending on whether or not the input operation unit is displayed. In other words, since the image file is generated and saved without being affected by whether or not the input operation unit is displayed, the captured second view image is used for both printing and saving, so that the input operation unit The problem that the size of the image file fluctuates depending on the presence or absence of display can be solved, and the problem that the number of pages of the image file differs between printing and saving can be solved.

  According to the invention described in (2) above, since the second view is set to have a smaller vertical width than the first view, the second view is an image of a web page having a small size that generates a blank area. Even if it exists, a useless blank area can be reduced.

  According to the invention described in item (3) above, since the second view is formed on the back surface of the first view, there is no adverse effect on the first view with respect to user operations and the like.

  According to the invention described in (4) above, the vertical size of the image of the web page generated in the first view is acquired, and the vertical length of the image of the web page acquired by the second view is acquired in the second view. Since the width is set to be smaller than the width, it is possible to reliably prevent generation of useless blank areas.

  According to the invention described in item (5) above, since the vertical width of the second view is set to the minimum vertical width allowed by the own apparatus, it is possible to prevent generation of useless blank areas.

  According to the invention described in the above item (6), when the print execution button is pressed, generation of the image of the web page in the second view is started, so that the second view is displayed only when necessary. An image of a web page can be generated and efficient processing can be performed.

  According to the invention described in the preceding item (7), when the save execution button is pressed, the generation of the web page image in the second view is started, so that the second view is displayed only when necessary. An image of a web page can be generated and efficient processing can be performed.

  According to the invention described in item (8) above, the image generated in the second view is captured, and the captured image is saved, so that it is not affected by whether or not the input operation unit is displayed. An image file is generated and saved. Therefore, by using the captured second view image for both printing and saving, it is possible to eliminate the inconvenience that the size of the image file fluctuates depending on whether or not the input operation unit is displayed. Can solve the problem that the number of pages of the image file differs.

  According to the invention described in (9), the web page generated in the first view is displayed in a second view different from the first view in which the image of the web page displayed on the display unit is generated. A process of generating the same image as the image and capturing the image generated in the second view can be executed by the computer of the mobile terminal device.

It is a block diagram of the communication system provided with the portable terminal device which concerns on one Embodiment of this invention. It is a block diagram which shows the function structure of a portable terminal device. It is explanatory drawing about the image generation in the case of displaying the image when displaying the image of a web page. 3 is a flowchart for explaining an operation at the time of image printing of the mobile terminal device shown in FIG. 2. 3 is a flowchart for explaining an operation at the time of image storage of the mobile terminal device shown in FIG. 2. It is a figure which shows the screen displayed on a display means when printing the image displayed on the display means of a portable terminal device. It is a figure which shows the screen displayed on a display means when preserve | saving the image displayed on the display means of a portable terminal device.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a configuration diagram of a communication system including a mobile terminal device according to an embodiment of the present invention.

  This system includes a mobile terminal device 1 composed of a smartphone, a tablet terminal, etc., one or a plurality of image processing devices 2, a web server 3, a personal computer 4 and the like, which are connected via a wired or wireless network 5. Are connected to each other.

  In this embodiment, an MFP (Multi Function Peripherals), which is a multifunction digital image forming apparatus that combines a plurality of functions such as a copy function, a printer function, a facsimile function, and a scan function, is used as the image processing apparatus 2. .

  FIG. 2 is a block diagram showing a functional configuration of the mobile terminal device 1.

  The mobile terminal device 1 includes a CPU 11, a ROM 12, a RAM 13, a storage unit 14, a display unit 15, a touch panel 16, a communication interface (communication IF) 17, a camera 18, and the like.

  The CPU 11 comprehensively controls the entire portable terminal device 1 based on an OS (Operating System) installed, various data processing applications, an application for operating the image processing device 2, and the like. Specific control contents will be described later.

  The ROM 12 is a memory that stores an operation program of the CPU 11, and the RAM 13 is a memory that provides a work area when the CPU 11 executes the operation program.

  The storage unit 14 is a memory that stores the OS, applications, and image files for images displayed on the display unit 15.

  The display unit 15 displays various images such as web page images or camera-captured images, operation screens for users, messages, and the like, and is used for user operations. The display unit 15 includes a display device such as a liquid crystal display. Yes. In addition, the touch panel 16 is provided on the screen of the display unit 15 and detects a touch operation of the user and specifies a touched coordinate or the like.

  The communication interface 17 is used for making a call through a telephone line or transmitting / receiving data to / from the image processing apparatus 2 or the web server 3 by wireless communication through an access point. The camera 18 photographs various subjects.

  The mobile terminal device 1 according to this embodiment performs image generation for capture separately from image generation for displaying an image of a web page on the display unit 15.

  FIG. 3 is an explanatory diagram of image generation when a web page image is displayed and captured.

  An image to be displayed on the display unit 15 is generated in the display view 100 which is an image generation region having the same size as the display screen 15a of the display unit 15 as in the conventional case. On the other hand, the capture image is generated in the capture view 200 which is an image generation area different from the display view 100.

  It is desirable that the capture view 200 is generated on the back surface of the display view 100 because it does not affect the user's operation performed on the display screen.

  Further, the vertical width A3 of the capture view 200 is set to be smaller than the vertical width A4 of the display view 100 in order to eliminate as much as possible a blank area that occurs when the vertical width of the image of the web page is small. desirable. More preferably, acquiring the actual vertical width of the image of the web page generated in the display view 100, and setting the vertical width A3 of the capture view 200 smaller than the vertical width of the image, the margin area is set. Recommended because it can disappear reliably. Alternatively, the minimum vertical width allowed by the mobile terminal device 1 may be set.

  The image of the web page generated in the display view 100 is displayed on the display unit 15. When the user wants to print the image displayed on the display unit 15, the print setting screen is displayed on the display unit 15, print setting is performed, and the print execution button is pressed. Then, the same image as the web page image generated in the display view 100 is downloaded from the web page and generated in the capture view 200. Then, the captured image is captured in the capture view 200, and the captured image is transmitted to the image processing apparatus 2 together with print settings, and printing is executed.

  On the other hand, when the user wants to save the image displayed on the display unit 15, a save setting screen is displayed on the display unit 15 and a file name is input. At this time, an input operation unit such as a software keyboard is displayed on the display screen. When the user performs the necessary storage settings and presses the save execution button, the same image as the web page image generated in the display view 100 is downloaded from the web page and generated in the capture view 200. Then, the captured image is captured in the capture view 200, and the captured image is stored in a specified storage location according to the storage setting.

  For example, in AndroidOS, it is possible to capture (capture) an image with the capturePicture () method of the WebView class, such as "WebView wview ;, Picture picture = wview.capturePicture ();" Is longer than the vertical width A3 of the capture view 200, the image is captured in the vertical size of the image.

  In this way, the captured web page image is generated in the capture view 200, which is different from the display view 100, such as a software keyboard displayed on the display unit 15 when the image is saved. It is not affected by the display of the input operation unit. Accordingly, even when the vertical width of the image of the web page is shorter than the vertical width A3 of the capture view 200 and a blank area is generated, the blank area is displayed on the input operation unit when the image is saved. The size of the image file is not changed under the influence of the above, and can be saved at the same size as when printing. As a result, the number of pages of the image file is different between printing and saving, and when the once saved image file is printed again, the number of pages is different from the previous printing, and the print settings change. The problem can be solved.

  Moreover, the vertical width A3 of the capture view 200 is set to be smaller than the vertical width A4 of the display view 100, and preferably set to be smaller than the vertical width of the image of the web page generated in the display view 100. Thus, it is possible to reliably suppress the generation of useless blank areas and capture the web page image as it is.

  FIG. 4 is a flowchart for explaining the operation at the time of image printing of the mobile terminal device 1 shown in FIG. This operation is executed by the CPU 11 of the mobile terminal device 1 based on an application stored in the storage unit 14 or the like.

  The display unit 15 displays an image downloaded from a predetermined web page. When the user prints the displayed image, when the user presses a print button or the like, the CPU 11 creates a print range selection dialog for selecting a print range and displays it on the display unit 15 in step S11. Each time the user advances print settings, the next dialog is created and displayed in step S12. When all the dialogs are set and the user presses the print instruction button, in step S21, an asynchronous event occurs when the button is pressed, and the CPU 11 proceeds to the next stage. Do. That is, first, in step S31, the CPU 11 creates the capture view 200, and in step S32, starts reloading from the web page of the same image as the web page image displayed in the display view 100, and captures it. The image of the web page read into the view 200 for generation is generated.

  Then, in step S41, an asynchronous event is generated by reading a web page, and the process proceeds to the next stage. In this stage, when the reading of the web page is completed in step S51, a PDF file creation start message is transmitted in step S52.

  Then, in step S61, an asynchronous event is generated by this message, and the process proceeds to the next stage. In this stage, after capturing the image formed in the capture view 200 in step S71, PNG files for the number of pages are created in step S72. Next, in step S73, the PNG file is converted into a PDF file, and then in step S74, the print function application or the cooperation application with the external device is started, and the captured image is transmitted to the image processing apparatus 2 or the like. Return to the stage.

  FIG. 5 is a flowchart for explaining the operation of the portable terminal device 1 shown in FIG. This operation is executed by the CPU 11 of the mobile terminal device 1 based on an application stored in the storage unit 14 or the like.

  The display unit 15 displays an image downloaded from a predetermined web page. When the user saves the displayed image, when the user presses the save button or the like, the CPU 11 creates a save destination selection dialog for selecting the save destination and displays it on the display unit 15 in step S111. When the user designates a save destination and sets a file name using the input operation unit displayed on the display unit 15 and then presses the save instruction button, in step S121, an asynchronous event is triggered by the button press. Occur and proceed to the next stage.

  The CPU 11 performs web page reload processing. That is, first in step S131, the CPU 11 creates the capture view 200, and then in step S132, starts reloading from the web page of the same image as the web page image displayed in the display view 100, and captures it. An image of the web page read into the commercial view 200 is generated.

  Then, in step S141, an asynchronous event is generated by reading a web page, and the process proceeds to the next stage. In this stage, when the reading of the web page is completed in step S151, a task of asynchronous processing for storage is activated in step S152.

  Then, a task execution event occurs in step S161, and the process proceeds to the next stage. In this stage, after capturing the image formed in the capture view 200 in step S171, PNG files for the number of pages are created in step S172. Next, in step S173, the PNG file is converted into a PDF file, and in step S174, the image is uploaded to a predetermined storage location such as an external storage. Next, in step S175, the storage completion is displayed on the screen to notify the user, and then the process returns to the original stage.

  In the example of FIGS. 4 and 5, when the print execution button or the save execution button is pressed, generation of a web page image on the capture view 200 is started. Web page images can be generated and efficient processing can be performed.

  It is determined whether a blank area exists in the web page image displayed in the display view 100. If the blank area does not exist, the web page image is captured from the display view 100, and the blank area exists. Only when it is, it is good also as a structure which produces | generates and captures the image of a web page in the view 200 for capture.

1 Mobile terminal device 11 CPU
14 storage unit 15 display unit 15a display screen 17 communication interface 100 view for display 200 view for capture

Claims (9)

Display means capable of displaying an image of the generated web page in the first view;
Image generating means for generating, in a second view different from the first view, an image identical to the image of the web page generated in the first view;
Capture means for capturing an image generated in the second view by the image generation means;
A portable terminal device comprising:   The mobile terminal apparatus according to claim 1, wherein the second view is set to have a vertical width smaller than that of the first view.   The mobile terminal device according to claim 1, wherein the second view is formed on a back surface of the first view.   Size acquisition means for acquiring the vertical size of the image of the web page generated in the first view, and the second view of the image of the web page whose vertical width is acquired by the size acquisition means. The mobile terminal device according to claim 1, wherein the mobile terminal device is set to be smaller than a vertical width.   The portable terminal device according to any one of claims 1 to 4, wherein a vertical width of the second view is set to a minimum vertical width allowed by the own device.   The generation of the image of the web page in the second view by the image generation unit is started when a print execution button for printing the image captured by the capture unit is pressed. The mobile terminal device according to claim 5.   The generation of the image of the web page in the second view by the image generation unit is started when a save execution button for saving the image captured by the capture unit is pressed. The mobile terminal device according to claim 5. A display step of displaying on the display means an image of the web page generated in the first view;
An image generation step of generating, in a second view different from the first view, an image identical to the image of the web page generated in the first view;
A capture step for capturing the image generated in the second view by the image generation step;
An image processing method in a mobile terminal device, comprising: A display step of displaying on the display means an image of the web page generated in the first view;
An image generation step of generating, in a second view different from the first view, an image identical to the image of the web page generated in the first view;
A capture step for capturing the image generated in the second view by the image generation step;
Is an image processing program for causing a computer of a mobile terminal device to execute the program.

Images