JP6068137B2 - Image display apparatus, image display method, and image display program - Google Patents

Description

  The present application belongs to a technical field of an image display device, an image display method, and an image display program. More specifically, the present invention belongs to the technical field of an image display device and an image display method for displaying an object superimposed on an image, and a program for the image display device.

  In recent years, in a portable terminal device represented by a so-called smartphone, it is widely used to operate the terminal device using a touch panel installed on a surface of a display unit such as a liquid crystal panel because of its convenience. It has been broken. As an example of such a prior art, there exists a technique currently disclosed by the following patent document 1, for example.

  In the technique described in Patent Document 1, when the map displayed on the display unit is enlarged or reduced, the approach of a human hand is detected with respect to the display unit displaying the map data. The map corresponding to the acquired map data at the scale when the map data at a scale different from the displayed map data is acquired and it is detected that the hand touches the touch panel arranged on the surface of the display unit. Is supposed to be displayed.

JP 2011-118007 A

  However, in the technique disclosed in Patent Document 1, a map corresponding to the acquired map data at a reduced scale is displayed by replacing the original map, and as a result, the enlarged or reduced map is displayed from the previous scale. The user cannot easily recognize whether the image is enlarged or reduced from the state after being enlarged or reduced. Therefore, in this case, there is a problem that it is inconvenient that the user may have to repeat a plurality of operations such as enlargement → reduction → enlargement until a map of a desired scale is displayed. .

  In addition, the technique disclosed in Patent Document 1 only displays a map corresponding to the scaled map data after the change, and does not consider displaying more detailed information or the like.

  Therefore, the present application has been made in view of the above-described problems, and an example of the problem is an image display device and an image display method capable of displaying more detailed information simply and intuitively, and the image. The object is to provide a program for a display device.

In order to solve the above problems, the invention according to claim 1 includes a display control means for displaying by overlapping the object in the image, move operation, and the object moving the position of said object on said image and an operation unit for accepting an enlargement operation to expand, said display control means, when enlarging the object from a predetermined size by the enlargement operation, corresponding to the position of the object, more detailed information than the image Is displayed in the enlarged object, and the detailed image is not displayed when the object is displayed at the predetermined size .

In order to solve the above problems, the invention according to claim 5, and a display control step of displaying by superimposing objects in the image, the movement operation for moving the position of the object on the image, and the object look including a operation receiving step for receiving an enlargement operation to expand, in the display control step, when enlarging the object from a predetermined size by the enlargement operation, corresponding to the position of the object than the image A detailed image including detailed information is displayed in the enlarged object, and the detailed image is not displayed when the object is displayed at the predetermined size .

In order to solve the above problems, the invention according to claim 6, display control means for a computer included in an image display device for displaying an image and an operation unit, display by superimposing a object in the image, The enlargement operation of the computer that functions as a movement operation for moving the position of the object on the image and an operation reception unit that receives an enlargement operation for enlarging the object by the operation unit , and also functions as the display control unit. When enlarging the object from a predetermined size by an operation, a detailed image corresponding to the position of the object and including more detailed information than the image is displayed in the enlarged object, and the object is enlarged at the predetermined size. When displaying, the function is performed so that the detailed image is not displayed .

1 is a block diagram illustrating a schematic configuration of an image display device according to an embodiment. It is a block diagram etc. which show schematic structure of the image display system containing the smart phone which concerns on an Example, (a) is the said block diagram, (b) is the content of the map data memorize | stored in the smart phone which concerns on an Example. It is a figure illustrated. It is a flowchart which shows the image display process which concerns on an Example. It is a figure (1) which shows the example of an image display concerning an example, (a) is a figure showing the 1st example, and (b) is a figure showing the 2nd example. It is a figure (2) which shows the example of an image display concerning an example, (a) is a figure showing the 3rd example, and (b) is a figure showing the 4th example. It is a figure (3) which shows the example of image display concerning an example, (a) is a figure showing the 5th example, and (b) is a figure showing the 6th example. It is a figure (4) which shows the image display example which concerns on an Example, (a) is a figure which shows a 7th example, (b) is a figure which shows an 8th example.

  Next, the form for implementing this application is demonstrated using FIG.

  As shown in FIG. 1, the image display device S according to the embodiment is an image display device S that displays an image, and includes an operation unit 1, a display unit 2, a determination unit 3, and a display control unit 4. It is prepared for. At this time, the operation means 1 is constituted by, for example, a touch panel or a predetermined operation button. Moreover, the display means 2 consists of a display etc., for example.

  In this configuration, the display means 2 displays the object superimposed on the image.

  On the other hand, the operation means 1 moves the displayed object while superimposing it on the image by the user's operation.

  Then, the determination unit 3 determines whether or not the object moved by the operation is at a predetermined position on the displayed image.

  Thereby, the display control means 4 enlarges and displays the object determined to be at the predetermined position, and displays detailed information more detailed than the image at the predetermined position by using the enlarged and displayed object.

  As described above, according to the operation of the image display device S according to the embodiment, an object that is determined to have been moved by a user's operation to a predetermined position on the image is displayed in an enlarged manner, and more than the image at the predetermined position. Since detailed information is displayed using the enlarged object, more detailed information can be displayed easily and intuitively.

  Next, specific examples corresponding to the above-described embodiment will be described with reference to FIGS. In addition, the Example demonstrated below is an Example at the time of applying embodiment with respect to control of the screen display in the said smart phone contained in the image display system containing what is called a smart phone.

  FIG. 2 is a block diagram illustrating a schematic configuration of the image display system according to the embodiment, and FIG. 3 is a flowchart illustrating image display processing according to the embodiment. 4 to 7 are diagrams illustrating examples of image display according to the embodiment. At this time, in FIG. 2, the same member numbers as those of the constituent members in the image display device S are used for the constituent members of the examples corresponding to the constituent members in the image display device S according to the embodiment shown in FIG. 1. ing.

  As shown to Fig.2 (a), the image display system GS which concerns on an Example connects server SV, several smart phone T1, smart phone T2, ..., smart phone Tn, server SV, and each terminal device T. And a communication line NW for exchanging information. In the following description, when the smartphone T1, the smartphone T2,..., The smartphone Tn are described in common, they are simply referred to as “smartphone T”.

  At this time, the server SV includes an interface 10, a processing unit 11 including a CPU, a RAM (Random Access Memory), a ROM (Read Only Memory), and the like, and a storage unit 12 including an HDD (Hard Disc Drive) or a nonvolatile memory. And is constituted by. At this time, the storage unit 12 stores the facility data D distributed to each smartphone T according to the embodiment via the communication line NW in a nonvolatile manner. As the facility data D, as illustrated in FIG. 2 (a), a facility floor made up of floor image data that is associated with a facility name and is a simplified plan view of each floor of the facility having the facility name. Data, facility location data indicating the location of the facility on the map by, for example, latitude / longitude or, for example, coordinates on a predetermined coordinate axis, and the location of a resting facility installed on each floor of the facility, for example, on a predetermined coordinate axis Rest facility position data indicated by coordinates are accumulated. The rest facility in this case corresponds to, for example, a resting room excluding a resting chair or a toilet. These facility data D are distributed to the smartphone T according to the request information from each smartphone T.

  On the other hand, each smartphone T has an interface 6, an operation unit 1 including a touch panel and operation buttons as an example of the operation unit 1 according to the embodiment, and a display as an example of the display unit 2 according to the embodiment. 2, a CPU 3 as an example of the determination unit 3 and an example of the display control unit 4 according to the embodiment, and a map storage unit 5. At this time, the touch panel constituting the operation unit 1 is disposed on the surface of the display 2. Further, as indicated by a broken line in FIG. 2A, the operation unit 1, the display 2, and the CPU 3 constitute an example corresponding to the image display device S according to the embodiment.

  In the configuration shown in FIG. 2A, the interface 10 of the server SV executes information input / output control processing and the like with each smartphone T via the communication line NW under the control of the processing unit 11.

  Next, the processing unit 11 extracts, from the facility data D in the storage unit 12, floor image data, break facility position data, and the like corresponding to the facility requested by the request information from each smartphone T. Thereafter, the processing unit 11 transmits the extracted data to the smartphone T that has transmitted the request information via the interface 10 and the communication line NW.

  On the other hand, the interface 6 of each smartphone T executes information input / output control processing and the like with the server SV via the communication line NW under the control of the CPU 3. The touch panel constituting the operation unit 1 outputs position information indicating the touched position to the CPU 3 when the user of the smartphone T touches with a finger or the like. Thereby, CPU3 uses the map data mentioned later as map display part 5 as image display processing concerning an example, and a map and facilities corresponding to operation (including the drag operation using the above-mentioned touch panel) in operation part 1 A figure or the like is displayed on the display 2. The image display processing according to this embodiment will be described in detail later with reference to FIGS.

  Here, the data structure of the map data stored in the map storage unit 5 will be described with reference to FIG.

  As illustrated in FIG. 2B, the map data according to the embodiment includes road data, background data, name data such as place names, etc. for each predetermined scale (so-called mesh) for each predetermined scale. It is composed of In addition, the floor image data of the facility according to the embodiment stored in the map storage unit 5 is, for example, the server SV using the facility name data indicating the facility or the facility position data indicating the position of the facility as a link (linkage). It is the data extracted and acquired from within the map data D. At this time, when a plurality of floors (floors) exist in one facility, floor image data as a plurality of facility floor data for each floor is stored in the map storage unit 5 as so-called records. . The facility floor data includes break facility position data indicating the break facility and image data indicating the break facility.

  Next, the image display processing according to the embodiment executed in each smartphone T with the CPU 3 as the center will be specifically described with reference to FIGS. 3 to 7.

  As shown in a corresponding flowchart in FIG. 3, when the image display process according to the embodiment is started, the CPU 3 of the smartphone T according to the embodiment first performs an operation indicating the loupe mode according to the embodiment in the operation unit 1, for example. It is monitored whether it was made by the user (step S1). Here, the “loupe mode” according to the embodiment is a mode in which the detailed information of the facility on the map currently displayed on the display 2 is superimposed and displayed on the map. In addition, the “operation indicating the loupe mode” in the monitoring in step S1 is for operating the map MP on the display 2 and the enlargement or reduction of the map MP with the finger F as illustrated in FIG. When a map MP having a scale set in advance using the enlargement / reduction key MG is displayed, the magnifying / reducing key MG is displayed, and a transition to the loupe mode is made by designating the scale. It is preferable to recognize that a power operation has been performed. When the operation indicating the loupe mode is not performed in the monitoring of step S1 (step S1; NO), the CPU 3 executes a predetermined process corresponding to the operation performed at that time (step S15), and relates to the embodiment. The image display process ends.

  On the other hand, when the operation indicating the loupe mode is performed in the monitoring in step S1 (step S1; YES), the CPU 3 next switches the display on the display 2 to the display in the loupe mode (step S2). Specifically, as illustrated in FIG. 4A, as the processing in step S <b> 2, when the map MP is displayed on the display 2, a loupe mark LM indicating that the mode has been shifted to the loupe mode is displayed. 2 and a position mark M indicating the facility where the detailed information (for example, the facility floor data) exists among the facilities displayed in the map MP. In FIG. 4 to FIG. 7, the position mark M is exemplified by “*”. For the facility where the position mark M is displayed, if the facility floor data or the like is already stored in the map storage unit 5, a floor map or the like to be described later is displayed using the facility floor data. On the other hand, when the facility floor data or the like is not stored in the map storage unit 5, the CPU 3 transmits the request information indicating that the facility floor data or the like is requested to the server SV at a predetermined timing. As a result, when the facility floor data or the like is transmitted from the server SV in response to the request information, the CPU 3 receives this via the interface 6 and stores it in the map storage unit 5 and then stores the floor map or the like. Used for display.

  After switching to the display of the loupe mode by the process of step S2 (see FIG. 4A), the CPU 3 next performs the user's finger as shown in FIG. 4B with respect to the displayed loupe mark LM. It is monitored whether or not a tap operation (that is, a selection operation of the loupe mark LM) has been performed by F (step S3). When the tap operation is not performed on the loupe mark LM in the monitoring in step S3 (step S3; NO), the CPU 3 confirms with the user whether or not to continue the loupe mode by a predetermined display or the like (step S4). In the confirmation in step S4, for example, when the user performs an operation to continue the loupe mode in the operation unit 1 (step S4; YES), the CPU 3 returns to step S2 and continues displaying the loupe mode. On the other hand, in the monitoring in step S4, when an operation for not continuing the loupe mode is performed (step S4; NO), the CPU 3 proceeds to the process in step S15.

  On the other hand, when the tap operation is performed on the loupe mark LM in the monitoring in step S3 (step S3; YES), the CPU 3 next displays the loupe symbol LS at the center of the map MP as illustrated in FIG. 4B. (Step S5). The loupe symbol LS is selected when a facility for displaying detailed information is selected on the touch panel by performing a drag operation (that is, a movement operation of the loupe symbol LS) on the loupe symbol LS by the user's finger F, for example. This is a symbol (object) used for. This loupe symbol LS corresponds to an example of an “object” according to the present application. At this time, the CPU 3 displays a trash can symbol DB as illustrated in FIG. 4B at a position outside the region where the map MP of the display 2 is displayed. This trash can symbol DB is for the user to specify that the loupe mode is ended by moving the loupe symbol LS to the position of the trash can symbol DB by, for example, a drag operation when the loupe mode according to the embodiment is ended. Symbol.

  When the loupe symbol LS and the trash can symbol DB are displayed, the CPU 3 next moves the loupe symbol LS to the position mark M by a drag operation on the loupe symbol LS with the user's finger F as illustrated in FIG. It is monitored whether any of them has been moved to the displayed position (step S6). When the drag operation is not performed on the loupe symbol LS in the monitoring of step S6 (step S6; NO), the CPU 3 continues to display the loupe symbol LS.

  At this time, if there is a situation in which the display of the loupe symbol LS continues to interfere with other operations, for example, the CPU 3 continues to display the loupe symbol LS for a predetermined time, for example, If the drag operation on the loupe symbol LS is not performed after the predetermined time has elapsed, the loupe mode according to the embodiment may be terminated.

  On the other hand, when a drag operation is performed on the loupe symbol LS in the monitoring in step S6 (step S6; YES), the CPU 3 next confirms the position of the loupe symbol LS at the end of the drag operation (step S7). . Then, the CPU 3 determines whether or not the confirmed position is a position where any position mark M is displayed (step S8). If it is determined in step S8 that the loupe symbol LS is dragged to the position of any position mark M (step S8; YES), the CPU 3 next executes the loupe symbol LS as illustrated in FIG. 5A. On the other hand, for example, it is monitored whether or not a tap operation has been performed with the user's finger F at that position (step S9). When the tap operation is not performed in the determination in step S9 (step S9; NO), the CPU 3 returns to the determination in step S8. On the other hand, when the tap operation is performed in the determination in step S9 (step S9; YES), the CPU 3 displays detailed information on the facility indicated by the position mark M corresponding to the position of the loupe symbol LS at that time in FIG. And superimposed on the map MP and displayed (step S10). In the case illustrated in FIG. 5B, the facility indicated by the position mark M corresponding to the position of the loupe symbol LS is “00 building”, and the floor map FM of the floor on which the facility is located indicates the facility floor data. It is read from the map storage unit 5 and displayed. As illustrated in FIG. 5B, the arrow symbol A1 and the arrow symbol A2 that are tapped when displaying the floor map FM of another floor are displayed adjacent to the floor map FM, and one of these is displayed. It is preferable that the display is switched to the floor map FM of another floor corresponding to the tap operation when the user performs the tap operation. In the floor map FM illustrated in FIG. 5B, a rest facility such as a chair is displayed by a black rectangular display at a position such as a rest chair indicated by the rest facility position data. In this case, it is preferable that a loupe-like frame W as illustrated in FIG. 5B is also displayed at the boundary between the floor map FM and the map MP.

  Then, during the display of the detailed information using the floor map FM, as illustrated in FIG. 6A, the CPU 3 performs, for example, the user's finger F with respect to any position in the enlarged display related to the floor map FM. Whether or not a tap operation has been performed is monitored (step S11). When the tap operation is not performed in the determination in step S11 (step S11; NO), the CPU 3 returns to the determination in step S10. On the other hand, when the tap operation is performed in the determination of step S11 (step S11; YES), the CPU 3 ends the display of the detailed information by deleting the floor map FM displayed at that time (step S12). Thereafter, the CPU 3 proceeds to the monitoring in step S6.

  On the other hand, when the position where the drag operation on the loupe symbol LS is not located at any position mark M (step S8; NO), the CPU 3 then moves the loupe symbol LS to the trash can as illustrated in FIG. 6B. It is determined whether or not the drag operation has been performed up to the position of the symbol DB (step S13). When the drag operation is not performed to the position of the trash can symbol DB in the determination in step S13 (step S13; NO), the CPU 3 shifts to the monitoring in step S6. On the other hand, if it is determined in step S13 that the loupe symbol LS has been dragged to the position of the trash can symbol DB as illustrated in FIG. 6B (step S13; YES), the CPU 3 executes the loupe mode to end the loupe mode. The loupe symbol LS and the loupe mark LM are erased from the display 2 (step S14), and then the image display processing according to the embodiment is terminated.

  As described above, according to the image display processing according to the embodiment, the loupe symbol LS determined to have been moved by the user's operation to the position of the position mark M on the map MP is enlarged and displayed. More detailed information than the image at the position is displayed using the loupe symbol LS (that is, together with the magnified loupe-like frame W), so that more detailed information can be displayed simply and intuitively. it can.

  Further, the loupe symbol LS has a loupe-like shape (see FIGS. 4B and 5A), and detailed information such as the floor map FM is displayed together with a frame W corresponding to the loupe symbol LS. It is possible to produce an interesting and effective presentation of information. The symbol in this case may be a symbol having a shape imitating binoculars, for example, in addition to the loupe symbol LS, as long as it imitates a tool used when an object is enlarged and viewed.

  Furthermore, when an operation for changing the content of the detailed information such as the floor map FM in accordance with the map MP is performed on the operation unit 1 (see FIGS. 5B and 6A), the operation corresponds to the operation. Thus, the detailed information is changed and displayed, so that the detailed information can be displayed more conveniently.

  Furthermore, since the detailed floor map FM inside the facility existing in the area displayed as the map MP is displayed as the detailed information image, the details inside the facility can be displayed with a simple operation. At this time, by displaying the position of a resting facility such as a chair together on the floor map FM (see FIG. 5B or 6A), it is possible to make the image display more user-friendly. . In addition, at this time, the position of the person who has the terminal device capable of acquiring the position information is displayed superimposed on the floor map FM based on the position information, so that the congestion status of the person on the floor or floor is also displayed. It can also be configured to be displayed in a recognizable manner.

  In the image display processing according to the above-described embodiment, the floor map FM inside the facility in the map MP is displayed as the loupe mode, but in addition to this, a map enlarged with respect to the map MP is displayed. You may comprise so that it may display as a loupe mode.

  That is, more specifically, the map MP is divided into, for example, four parts as illustrated by using broken lines in FIG. 7A, and the position mark M is displayed at the center of each of the four divided areas. Then, for example, by moving the loupe symbol LS to the position of the position mark M displayed at the center of the upper left area illustrated in FIG. 7A (see step S5 to step S9 in FIG. 3), As illustrated in FIG. 7B, an enlarged map AM obtained by enlarging the vicinity of the center of the upper left area may be displayed at the center of the map MP (see step S10 in FIG. 3). Also in this case, as illustrated in FIG. 7B, it is preferable that the loupe-like frame W is displayed at the boundary between the enlarged map AM and the map MP. Further, in the case illustrated in FIG. 7, the enlarged map AM is displayed by detecting that a drag operation or a tap operation on a direction key (not shown) that moves the range of the enlarged map AM is displayed while the enlarged map AM is displayed. It is preferable that the display range of the enlarged map AM is moved to another area within the frame W with the scale reduced.

  As described above, according to the display control of the enlarged map AM illustrated in FIG. 7, the enlarged map AM with the enlarged scale is displayed, so that the map with the enlarged scale can be displayed with a simple operation. .

  Further, when an operation for moving the area corresponding to the enlarged map AM in correspondence with the map MP is performed on the operation unit 1, the area corresponding to the enlarged map AM is moved and displayed in correspondence with the operation. The convenience of the enlarged map AM can be improved.

  Further, in the above-described embodiment, the case where the detailed information about the map MP originally displayed or the enlarged map AM is displayed has been described. However, for example, the enlarged map AM is originally displayed. It is also possible to apply the present application when switching the display to a wider range of maps. In this way, even when the display is switched from the enlarged map AM to a wider map, an image with a different level of detail is displayed as in the embodiment.

  Further, in the above-described embodiment, the case where the detailed information about the map MP originally displayed or the enlarged map AM is displayed has been described. However, for example, a human face is displayed and the specific part is displayed. It is also possible to apply the present application when displaying an enlarged image.

  Further, the detailed information according to the above-described embodiment may be configured to be displayed not as an image but as text information, for example, so as to be identifiable with respect to the map MP.

  Furthermore, in the above-described embodiment, the case where the embodiment is applied to an image display system including a smartphone has been described. However, the smartphone in this case has, for example, a portable wireless phone having a display screen or a call function. It is also possible to replace it with a portable terminal device that does not. Specifically, the above-described embodiments can be applied to, for example, display control on a display in a personal computer, display control on a tablet terminal, and the like. In this case, the embodiment can also be applied when, for example, a drag operation or a click operation with a mouse is used instead of a tap operation or a drag operation on the touch panel.

  Further, a program corresponding to the flowchart shown in FIG. 3 is recorded on a recording medium such as a flexible disk or a hard disk, or obtained via a network such as the Internet, and is read out to a general-purpose microcomputer or the like. It is possible to cause the microcomputer or the like to function as the CPU 3 according to the embodiment.

1 Operation means (operation unit)
2 Display means (display)
3. Judgment means (CPU)
4 display control means 5 map storage unit 11 processing unit 12 storage unit S image display device T1, T2, Tn smartphone SV server GS image display system D facility data F finger LS loupe symbol LM loupe mark M position mark MP map MG enlargement / reduction Key AM enlarged map DB trash symbol FM floor map

Claims (6)

Display control means for displaying by overlapping the object in the image,
An operation means for receiving a moving operation for moving the position of the object on the image, and an enlargement operation for enlarging the object ;
Equipped with a,
The display control means includes
When the object is enlarged from a predetermined size by the enlargement operation, a detailed image corresponding to the position of the object and including more detailed information than the image is displayed in the enlarged object,
The image display device , wherein the detailed image is not displayed when the object is displayed in the predetermined size . The image display device according to claim 1,
The image display apparatus according to claim 1 , wherein the object is an object representing a tool used when an object is enlarged and viewed. The image display device according to claim 1 or 2 ,
The image is a map image;
A scale changing means for changing the scale of the map image;
The display control means, when the map image is displayed at a predetermined scale, displays the object superimposed on the map image . The image display device according to claim 3 ,
The detailed image includes an enlarged map image whose scale is larger than that of the map image . A display control process for displaying an object superimposed on an image;
An operation accepting step for accepting a moving operation for moving the position of the object on the image, and an enlarging operation for enlarging the object;
Including
In the display control step,
When the object is enlarged from a predetermined size by the enlargement operation, a detailed image corresponding to the position of the object and including more detailed information than the image is displayed in the enlarged object,
An image display method , wherein the detailed image is not displayed when the object is displayed at the predetermined size . A computer included in an image display device that includes an operation unit and displays an image,
Display control means for displaying an object superimposed on an image;
A movement operation for moving the position of the object on the image, and an operation reception means for receiving an enlargement operation for enlarging the object by the operation means;
As well as
The computer that functions as the display control means,
When the object is enlarged from a predetermined size by the enlargement operation, a detailed image corresponding to the position of the object and including more detailed information than the image is displayed in the enlarged object,
An image display program that functions to prevent the detailed image from being displayed when the object is displayed in the predetermined size .