JP2014219753A - Information processing system, information processing device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily obtain information, which is related to information that is to be displayed by display means, from locations other than a system that stores the information to be displayed.SOLUTION: An information processing system using a network includes: display means that displays information; and search means that on the basis of the information displayed by the display means, searches for information related to the displayed information from a first system that stores the information and a second system other than the first system.

Description

  The present invention relates to an information processing system, an information processing apparatus, and a program.

2. Description of the Related Art Conventionally, it is known that documents are managed so as to be searchable in an information processing system.
For example, when a conference is performed using a conference system using a computer, it is often performed to search for materials used in the conference, related materials, minutes, etc. during the conference. In this case, a technique for efficiently retrieving related materials using material (document) information registered in the conference system database, conference information, an access log, or the like is already known.
Document information, meeting information (meeting dates, participants, materials used, etc.), access status of materials and editing logs of materials are saved in the conference system, and searches are performed using those information. Do. By doing so, it was possible to efficiently search for necessary meeting materials and minutes from a large number of materials.

For example, a method is known in which document information and a character string included in a document log are collated, a distance representing how much the character is different is obtained, and document data with the shortest distance is searched as a related document (for example, , See Patent Document 1).
There is also known a method of automatically retrieving related documents from keywords included in a conference agenda and action items (see, for example, Patent Document 2). This method is highly convenient in that the user of the conference system can acquire related information without knowing the document name or the like in advance and without inputting a search condition.

However, a method for obtaining a related document from a collation result of document information and a character string included in a document log described in Patent Document 1, or a keyword included in a conference agenda or action item described in Patent Document 2 The method of searching as a document has the following problems.
That is, since it is possible to search only from materials registered in the conference system, there is a problem that information not registered cannot be searched and only known information can be obtained.

For this reason, when trying to obtain information from other than the conference system, it is necessary to manually input and search for the optimum keyword, which takes time and effort.
Such a problem also occurs in an information processing system other than the conference system.
The present invention has been made in view of the problems of the prior art. That is, an object of the present invention is to make it possible to easily acquire information related to information to be displayed on the display means from a place other than the system that stores the information to be displayed.

  In order to achieve the above object, an information processing system using the network of the present invention includes a display means for displaying information, and information related to the information to be displayed based on the information displayed by the display means. The information processing apparatus includes a first system storing information and a search unit that searches from a second system other than the first system.

  According to the information processing system configured as described above, information related to information to be displayed on the display means can be easily obtained from a place other than the system that stores the information to be displayed.

1 is a block diagram illustrating an overall configuration of a system including a conference system that is an embodiment of an information processing system according to the present invention. It is a block diagram which shows the hardware constitutions of the client apparatus shown in FIG. It is a block diagram which shows the hardware constitutions of the server apparatus shown in FIG. It is a block diagram which shows the hardware constitutions of a file server in case the other system shown in FIG. 1 is a file server. FIG. 2 is a block diagram illustrating a functional configuration of a server device, a client device, an image projection device, a display device, and another system shown in FIG. 1 and a relationship between them. It is a figure which shows the example of the record of the information regarding the document used with the system shown in FIG. It is a figure which shows the example of the record of the information regarding the meeting used with the system shown in FIG. It is a figure which shows the example of the record regarding the relevant information used with the system shown in FIG. It is a figure which shows an example of a meeting management screen. It is a figure which shows an example of a meeting detail screen. It is a figure which shows an example of a document addition screen. 7 shows an example of a flowchart of processing related to retrieval of related information performed by a server device. 7 shows an example of a flowchart of processing related to provision of related information performed by a server device.

  Hereinafter, embodiments for carrying out the present invention will be specifically described with reference to the drawings.

FIG. 1 is a block diagram showing the overall configuration of a system including a conference system that is an embodiment of an information processing system according to the present invention.
In the system shown in FIG. 1, a conference system 100 and a file server 200 are connected via a network 300 so that they can communicate with each other.
Here, the conference system 100 is an embodiment of the information processing system of the present invention, and includes a client device 110, a server device 120, an image projection device 130, and a display device 140 that is an example of display means.

The client device 110 is used by a conference presenter. For example, a personal computer (PC), a portable information terminal such as a PDA (Personal Digital Assistants), and the like can be used, but the present invention is not limited thereto. . Examples of the image projector 130 are projectors, and examples of the display device 140 are electronic blackboards, large monitors, and the like.
The network 300 can use any communication path including a LAN (Local Area Network) or a WAN (Wide Area Network), regardless of whether it is wired or wireless.
The file server 200 is a system different from the conference system 100. Other systems such as a network attached storage (NAS) may be provided in addition to or instead of the file server 200. The number is also arbitrary.

In FIG. 1, the client device 110 has an application for realizing the conference presenter so that the conference presenter can create and display conference information, display documents (meeting materials), and other related information. Implemented. The internal configuration of the apparatus will be described later.
The server device 120 is an embodiment of an information processing device according to the present invention. The server device 120 stores conference information, conference material (document information), related information, and the like in the conference system 100, and provides such information in response to a request from the client device 110.

For example, the client device 110 establishes communication by sending a communication request to the server device 120 when the conference is held, and transmits the conference being held, a document displayed by the client device 110, and the like to the server device 120. The server device 120 stores such information.
Conversely, the user stores in the server device 120 meeting information indicating the contents of the meeting to be held and document information that is the material used in the meeting in association with each other, and the material to be displayed at the meeting is stored in the server. It may be possible to download from the device 120 to the client device 110.
In addition, the server device 120 automatically searches for information related to the information displayed on the client device 110 in response to a request from the client device 110 or at a predetermined timing, and saves it in a storage unit in the conference system 100. To do. In addition, it has a function of sending the retrieved related information to the client device 110. Detailed functions will be described later.

  The image projecting device 130 is a display unit that receives a request from the client device 110 and projects the screen displayed on the client device 110 with an appropriate optical system to display the image on a screen or the like. In addition, an imaging unit or a communication unit, which will be described later, that captures a screen displayed at the projection destination and transmits it to the server device 120 can be provided. Even if the document being displayed is edited, if the client device 110 does not save the content, the document data itself does not change, and the changed content is not transmitted to the server device 120. Even in such a case, the content of the document being edited can be transmitted to the server device 120 as image data by photographing the screen displayed at the projection destination by the photographing unit. Note that the client apparatus 110 may perform this shooting and transmission control.

  The display device 140 is a display unit such as a large display that displays the display screen of the client device projected by the image projection device 130 or transmitted from the client device 110. In addition, a display reading unit and a communication unit, which will be described later, that scan or capture a screen to be displayed and transmit the screen to the server apparatus 120 may be provided. The reason for scanning or capturing the screen to be displayed is the same as in the case of the image projector 130.

Next, the configurations and functions of the devices shown in FIG. 1 and other systems will be described in more detail.
FIG. 2 is a block diagram illustrating a hardware configuration of the client device 110. As shown in FIG. 2, the client device 110 can be configured such that a CPU 111, ROM 112, RAM 113, communication I / F 114, HDD 115, and UI (user interface) unit 116 are connected via a system bus 117.
Then, the CPU 111 executes applications and other programs stored in the ROM 112 or the HDD 115 using the RAM 113 as a work area, thereby controlling the operation of the client device 110 and realizing various functions.

The communication I / F 114 is an interface for communicating with other devices via a network 300 such as a LAN, and can include a LAN terminal, a modem, an antenna for realizing a wireless LAN, and a transceiver.
The UI unit 116 is an operation receiving unit including an operation unit for receiving a user operation and a display unit for presenting information to the user. Of course, an external operation unit or display unit may be used.

The operation unit is, for example, a keyboard for inputting characters and numbers, a mouse for realizing movement of a cursor displayed on the screen, selection of an icon, etc., a finger or a stylus pen (stylus pen), etc. A touch panel that allows input can be employed.
The display unit displays the screen of the conference system, the application of the material used in the conference, and other related information (such as documents in other locations and information on the Web browser). Moreover, a liquid crystal display, CRT, etc. are employable as said display part.

In addition to the HDD 115, a memory card as an external storage device, and an optical disk R / W device such as a CD or a DVD can be provided.
The client device 110 may be a personal computer (PC), a personal digital assistant such as a PDA, or the like as a device that implements the above hardware, but is not limited thereto.

  FIG. 3 is a block diagram illustrating a hardware configuration of the server device 120. The server apparatus 120 can employ a known PC as hardware as appropriate. For example, as shown in FIG. 3, the CPU 121, ROM 122, RAM 123, communication I / F 124, HDD 125, and UI unit 126 can be connected via a system bus 127. The communication I / F 124 and the UI unit 126 are basically the same as the communication I / F 114 and the UI unit 116. The HDD 125 constitutes part or all of the storage means in the present invention, and may be externally attached. There may be a plurality of units. The HDD 125 stores document information and data of a document file registered in the server device 120 from the client device 110, conference information and data, user information, and the like, and has a function as a registration information database described later.

  The CPU 121 executes a control program stored in the ROM 122 or the HDD 125 using the RAM 123 as a work area, thereby controlling the operation of the entire server device 120 and realizing functions as various means as described later.

FIG. 4 is a block diagram showing a hardware configuration of the file server when the other system 200 shown in FIG. 1 is a file server. Hereinafter, reference numeral 200 is used as a code indicating this file server.
The file server 200 can appropriately employ a known PC as hardware. For example, as shown in FIG. 4, the CPU 201, ROM 202, RAM 203, communication I / F 204, HDD 205, and UI unit 206 can be connected via a system bus 207. Communication I / F 204 and UI unit 206 are basically the same as communication I / F 114 and UI unit 116. The HDD 205 is a large-capacity storage unit that stores various documents and data.

  FIG. 5 is a block diagram showing the functional configurations of the client device 110, the server device 120, the image projection device 130, the display device 140, and the file server, which is another system 200, and their relationships.

The client device 110 illustrated in FIG. 5 includes a display control unit 1101, an information management unit 1102, a related information acquisition unit 1103, and a communication unit 1104.
Among these, the display control unit 1101 controls display on the display provided in the UI unit 116, transmits image data to the image projection device 130 and / or the display device 140, and displays a screen being displayed on the display of the client device 110. A function for displaying the same image is provided. The display control unit 1101 displays various screens such as a screen showing the contents of a document (file) opened for display, a screen for editing the contents of the document, and a web page screen acquired via a network by a web browser. Can be considered.

  The information management unit 1102 has a function of accessing the server device 120 and registering and acquiring information related to the conference. Data to be registered includes conference information indicating the content of the conference itself, audio data of the conference content collected and recorded by a microphone (not shown), document data edited by the client apparatus 110 during the conference, and other conferences. Data that should be saved. Examples of the data to be acquired include document data to be displayed on the display control unit 1101.

  The related information acquisition unit 1103 has a function of acquiring, from the server device 120, related information related to information being displayed by the image projection device 130 (or display device 140, hereinafter the same unless otherwise specified). Since the server device 120 transmits the related information in response to a request from the related information acquisition unit 1103 by the function of each unit described later, the related information acquisition unit 1103 passes the information to the display control unit 1101. It can be displayed on the display or projected onto the image projection device 130.

The related information acquisition unit 1103 may have a function of accepting selection of whether or not to display related information and selection of which of the related information is displayed after receiving the information. As will be described later, the related information may be transmitted when the information itself is transmitted, or the information acquisition destination such as a URL may be transmitted, and the client apparatus 110 should acquire the related information from the acquisition destination. .
The communication unit 1104 has a function of transmitting / receiving necessary information to / from other devices such as the server device 120, the image projection device 130, the display device 140, or the file server 200.

  5 includes an information management unit 1200 including a registration information management unit 1201, a registration information analysis unit 1202, a voice information management unit 1203, a voice information analysis unit 1204, and a related information management unit 1205, a search unit 1206, Each of the functions of an OCR (Optical Character Recognition) processing unit 1207, a communication unit 1208, and a registration information database 1209 is provided.

Among these, the information management unit 1200 has a function of managing information such as conferences and documents registered in the registration information database 1209.
When the registration information management unit 1201 registers document information indicating a document related to a conference and conference information indicating the content of the conference in the registration information database 1209, the registration information management unit 1201 creates a document (conference) ID, a document (conference) name, and creates A function of registering information such as a person (organizer), creation date (date and time), and storage destination specific identification information (file path, URL, etc.) in association with document (conference) information is provided.

  The registration information analysis unit 1202 analyzes document information of documents registered in the registration information database 1209, and extracts document names, frequent keywords (extracted from full-text search data, etc.) and the like as related information search keywords. Based on the extracted frequent keywords, the search unit 1206 searches for related information.

When the voice information management unit 1203 registers the voice data such as the voice data of the conference contents in the registration information database 1209, the voice information management unit 1203 uniquely identifies the voice data name, the meeting name, the organizer, the date of the meeting, and the storage location. A function of registering information or the like in association with voice information is provided.
The voice information analysis unit 1204 has a function of analyzing voice information registered in the registration information database 1209 and acquiring text indicating the content of a person's speech in the voice. It also has a function of extracting frequent keywords and the like from the text as related information search keywords. Based on the extracted frequent keywords, the search unit 1206 searches for related information.

  When the search unit 1206 receives a search result from each search target, the related information management unit 1205 includes, as related information, an information name (document name / site name, hit phrase, etc.), storage location (document link destination / database). A folder path / URL). Further, when the client apparatus 110 requests transmission of related information, the related information related to the information displayed on the image projection apparatus 130 by the client apparatus 110 is displayed in the list storing the search results of the search unit 1206. The function to transmit based on is provided. The related information may be transmitted by acquiring the related information itself from the storage location, or transmitting the storage location information and causing the client device 110 to acquire the related information.

  The related information search may be performed in advance by predicting information displayed on the client device 110 before a request is received from the client device 110, or may be displayed at that time after the request is received. It may be done by grasping information. In the former case, a quick response is possible, and in the latter case, it is not necessary to perform a useless search process, so the processing load can be reduced.

  The search unit 1206 has a function of searching for information related to information registered in the registration information database 1209 using the frequent keywords extracted by the registration information analysis unit 1202, the voice information analysis unit 1204, and the like. In this search, the registration information database 1209 is also set as a search range, and the file server 200 which is a system other than the conference system 100 is also set as a search range. In addition to this, the HDD 115 of the client device 110, the server device 120, and any system accessible from the client device 110 may be included in the search range. When a closed system that requires authentication in order to refer to the inside is to be searched, authentication information such as an ID, password, and certificate for receiving authentication in the system is stored in the server device 120 in advance. To do. Further, the entire Internet may be included in the search range using a known search engine.

  The search unit 1206 can also search for information related to the information being displayed based on the image on the display screen that is captured and transmitted by the image projection device 130 or the display device 140. In this case, the OCR processing unit 1207 performs OCR processing on the image, extracts text data of characters included in the image, acquires a frequent keyword from the text data, and uses it as a search keyword.

The OCR processing unit 1207 is an image analysis unit having a function of the OCR processing.
The communication unit 1208 has a function of transmitting and receiving necessary information to and from the client device 110, the image projection device 130, the display device 140, or another device of the file server 200.
The registration information database 1209 is a database that accumulates conference information managed by the conference system 100 and information related to the conference, including conference information, document information, and related information to be described later.

An image projection apparatus 130 illustrated in FIG. 5 includes a projection unit 1301, a photographing unit 1302, and a communication unit 1303.
Among these, the projection unit 1301 has a function of projecting an image delivered from the display control unit 1101 of the client device 110 onto a projection destination so that all the conference participants can refer to the image.

The photographing unit 1302 has a function of photographing a screen displayed at the projection destination and transmitting it to the server device 120.
The communication unit 1303 has a function of transmitting / receiving necessary information to / from other devices such as the client device 110 and the server device 120.
A display device 140 illustrated in FIG. 5 includes a display unit 1401, a display reading unit 1402, and a communication unit 1403.
Among these, the display unit 1401 has a function of displaying an image delivered from the display control unit 1101 of the client device 110.

Further, the display reading unit 1402 has a function of scanning or capturing a screen to be displayed and transmitting it to the server apparatus 120 as image data.
The communication unit 1403 has a function of transmitting / receiving requested information to / from other devices of the client device 110 and the server device 120.

The file server 200 illustrated in FIG. 5 includes a communication unit 2001 and an information management unit 2002.
Among these, the communication unit 2001 has a function of transmitting / receiving necessary information to / from external devices such as the client device 110 and the server device 120.
In addition, the information management unit 2002 has a function of accumulating information such as documents and managing it by attaching an index that can be searched by the search unit 1206.
In this embodiment, the function of each unit shown in FIG. 5 is realized by executing a control program provided in each of the CPUs (not shown for the image projection device 130 and the display device 140) of each device described above. However, it goes without saying that all or part of these functions may be realized by dedicated hardware.

Next, in the conference system 100 described above, the search for information managed by the server device 120 and related information executed by the server device 120 and transmission to the client device 110 will be further described.
First, FIGS. 6 to 8 show record examples of information stored in the registration information database 1209. Here, FIG. 6 is an example of a record of information relating to a document, and FIG. 7 is an example of a record of information relating to a meeting. Moreover, FIG. 8 is a figure which shows the example of the record regarding related information. In these figures, items related to retrieval of related information in each record are mainly shown.

In the document information shown in FIG. 6, one document record (in the figure, extending over two lines) is data indicating one document.
Among these, ID is identification information for identifying a document.
The document name is the file name of the document.
The creator is identification information of the user who created the document.
The creation date is information on the date when the document was created or saved.
The full-text search data is an ID for specifying the full-text search data storing the OCR result for the document when the document is an image. When the document is text, it is not always necessary to create full-text search data, but the text may be used as full-text search data.

The frequent keyword is a high-order predetermined number of frequently used keywords registered in the text in the document or the OCR result text. This frequent keyword is used for the search by the search unit 1206. It may be used on the searching side or on the searching side. In addition, as frequency information, it is also conceivable to use a graphic or an image that appears frequently or frequently in addition to characters.
The use history is a user ID and a meeting ID indicating who used the document in which meeting.
The record of this document is created by the registration information management unit 1201 when the document is registered in the registration information database 1209 regardless of before and after the meeting and during the meeting.

The full text search data is data indicating the OCR result of the image. Some of them indicate an OCR result of an image registered as a document, and some of them indicate an OCR result of a captured image transmitted from the image projection device 130 or the display device 140. Further, as described above, the text file may be OCRed or the text itself may be registered.
Among these, ID is identification information for identifying full-text search data.
The document is the ID of the original document when the image registered as the document is subjected to OCR processing.
Full-text search data is text data of OCR results.
A keyword is a character string that is considered to have a deep relationship with an image or text to be subjected to OCR, such as a character string that appears more than a predetermined number of times in full-text search data. Multiple registrations are also possible.
This full-text search data is created when the OCR processing unit 1207 performs OCR processing.

Next, in the conference information shown in FIG. 7, one conference record (over three lines in the figure) is data indicating one conference.
Among these, ID is identification information for identifying a meeting.
The meeting name is the name of the meeting.
The number of times is information indicating how many times the corresponding meeting is.
The organizer is identification information of a user who hosts the conference.
The participant is identification information of a user who participates in the conference. Multiple registrations are possible.
The document is an ID of the document used or used in the meeting. Multiple registrations are possible.
The related link is information on an address or a link indicating an acquisition destination of information not registered in the registration information database 1209 among information used or used in the conference.

The used device is identification information of the device used or used in the conference. Multiple registrations are possible.
The date and time is information on the date and time when the meeting is scheduled or performed.
The meeting place is information on the place where the meeting is scheduled or performed.
The content of the conference indicates the content of the conference. It can be described in any format, such as voice data recording a meeting, text data of minutes, and reference information to other tables storing these.
The agenda is the conference agenda. It can be described in an arbitrary format such as text data or reference information to another table storing the text data.

The frequent keywords are obtained by performing text information analysis on the content of the meeting as necessary to obtain text data, and registering a predetermined number of keywords that appear frequently or frequently in the text. This frequent keyword is used for the search by the search unit 1206. It may be used on the searching side or on the searching side. An agenda may also be considered.
The conference record may be prepared before the conference, or may be created during or after the conference. What has been prepared in advance may be added or modified as needed according to the progress of the conference.

Next, in the related information management illustrated in FIG. 8, the conference related information (in the figure, spans two lines) is data in which frequent keywords related to one conference information are collected.
Among these, ID is identification information for identifying conference related information.
The conference ID is the ID of the conference record based on the conference related information.
The agenda is information in the agenda section of the conference record. In addition, in the description divided into two by a period such as “Meeting.Agenda”, the type of the record precedes the period, and the item name in the record follows the period.

The conference frequent keyword is a frequent keyword obtained by analyzing the information of the frequent keyword term and the agenda term of the conference record. What is necessary is just to register a high-order predetermined number.
The document is information that summarizes the document of the conference record and the related link section.
The material frequent keyword is a frequent keyword obtained by collecting frequently appearing keywords about documents and related links used in the meeting of the meeting record, and taking out frequently appearing keywords. What is necessary is just to register a high-order predetermined number. This can be thought of as a frequent keyword for the entire material used for the meeting. Documents and related link information used in the conference can be obtained by extracting the material related information described later from the conference ID that has the same ID as the conference ID described in the conference related information. it can.

Lastly, the detected keyword is a merged of the frequently-occurring keyword and the frequently-occurring keyword, and is a frequently-occurring keyword in the entire meeting.
This conference related information is generated by the registered information management unit 1201 when searching for related information for a conference.
Next, the material related information is a collection of text data and frequent keywords for one document or related link.
Among these, ID is identification information for identifying material-related information.
The material ID is an ID of a document record based on the material related information, a URL described in a related link, a folder path, or the like.

The conference ID is an ID of a conference record indicating a conference that refers to the material. If it is referenced in multiple meetings, list multiple.
The text data is data obtained by converting a document or a material acquired from a link destination of related links into text. If the document is an image, it is an OCR result registered in the full-text search data, and if it is a web page, it is a display text extracted from the source of an HTML (HyperText Markup Language) document. If extraction could not be performed, register null.
A frequent keyword is a frequent keyword obtained by analyzing text data. What is necessary is just to register a high-order predetermined number.

This document related information is generated by the registered information management unit 1201 when a document or related link is registered in the conference record, or when related information is searched for the document or material.
Next, the related information search history is a record indicating a search history of related information, which is information related to the conference or the material, based on the conference related information or the material related information.
Among these, ID is identification information for identifying a related information search history.
The search target ID is the conference related information ID of the searched conference or the material related information ID of the searched material.

The search keyword indicates a keyword used for the search. What is necessary is just to copy the information of the frequent keyword in meeting related information or the frequent keyword in document related information.
The search result is an ID for specifying the related information search result storing the search result.
The use count indicates the number of times the related information search result is referred to.
The related information search history is generated by the related information management unit 1205 when related information is searched.

Next, the related information search result is a record indicating a search result using a keyword indicated by the related information search history.
Among these, ID is identification information for identifying a related information search result.
The search result is an array of information for acquiring a document or information hit as a result of searching using a keyword indicated by the related information search history. For each information, a document ID for specifying a document, a path indicating a storage location, address information such as a URL, and the like may be registered.
The related information search history is generated by the search unit 1206 when related information is searched.

By the way, how to proceed with the conference using the conference system 100 is as follows.
The user registers the conference record of the conference and the document record of the material used in the conference before the conference starts as necessary. This registration can be performed by accessing the server apparatus 120 from an arbitrary client apparatus 110.
When a conference is performed, the client device 110 accesses the server device 120 to call the conference information.

  This call can be made from the conference management screen shown in FIG. In this screen, when the user inputs a search condition in the search condition input field 41 and searches for a registered conference, the search results are displayed in a list in the search result display field 42. Therefore, when the radio button 43 for the conference to be held is clicked to select and the conference detail button 44 is clicked, the conference details screen shown in FIG. 10 is displayed.

FIG. 10 is a diagram illustrating an example of a conference detail screen. On this screen, based on the conference record shown in FIG. 7, information on the selected conference is displayed in the conference information display column 51, and materials used in the conference are displayed in the material display column 52.
Then, the user can download the data of the material from the server apparatus 120 to the client apparatus 110 and display the data on the display or the image projection apparatus 130 by clicking the “Yes” link 53.
When the document addition button 54 is clicked, a document can be uploaded and registered from the client device 110 to the server device 120.

  Note that when the user selects a conference and instructs “conference start”, the client device 110 may automatically download and display materials registered for the conference. At this time, if a PDF (Portable Document Format) version of the document is registered, it is preferable to display the document. The original file is used for generating related information.

The material addition screen shown in FIG. 11 is a screen for performing the registration. Here, when the user inputs necessary material information into the material information input unit 61 and presses the save button 62, the client device 110 transmits the specified file to the server device 120. The server device 120 registers the file in the registration information database 1209, creates a document record related to the document, and adds the ID of the document record to the document item of the conference record.
As described above, a document can be additionally registered as a conference material.

During the meeting, the user can edit the material downloaded from the server device 120, display a file that is not registered in the server device 120, or obtain and display a document on the web using a web browser. it can. The document addition function can be used to register the document in association with the conference when a document not registered in the server device 120 is used in the conference.
Further, the user can request the server apparatus 120 to transmit information related to the information currently displayed by operating the client apparatus 110 at an arbitrary timing during the meeting. Upon receiving this request, the server device 120 transmits information related to the information being displayed on the client device 110 or a list of acquisition sources thereof to the client device 110.

By selecting desired information from the list, the user can display information related to the information being displayed on the display of the client device 110 and the image projection device 130. When the data received from the server device 120 is only the information acquisition destination, the client device 110 acquires information to be displayed from the acquisition destination.
If the information displayed by the client device 110 is unregistered, it can be transmitted to the server device 120 at an arbitrary timing such as during a conference or after the conference, and registered in association with the conference.

Next, the search for related information in the server device 120 will be described in more detail.
When the client apparatus 110 requests the server apparatus 120 to transmit related information, the client apparatus 110 also transmits information indicating which information is currently being displayed.
The information displayed by the client device 110 can be broadly classified into documents already registered in the server device 120, unregistered documents in the server device 120, and documents being edited.
Among these, for a document already registered in the server device 120, the ID of the document including the information of the registration information database 1209 may be transmitted as identification information unique to the storage destination. The ID of this document can be acquired together with the document when the client device 110 downloads the document from the server device 120.

For a document that is not registered in the server device 120, the document data itself may be transmitted to the server device 120. As a result, the server device 120 can extract frequent keywords after performing OCR processing as necessary, as in the case of a registered document.
Alternatively, a captured image of the screen being displayed may be transmitted instead of the document.
In the case of a document being edited, it is conceivable that the content at the time of request is temporarily stored and transmitted to the server apparatus 120, or a captured image of the screen being displayed is transmitted.

  In any case, the server device 120 acquires, as related information, other documents having a high matching rate of the frequent keywords based on the frequent keywords extracted from the document being displayed on the client device 110, and lists the list in the client device 110. Can be sent. At this time, not only the database (first system) in which the document being displayed is stored, but also the other database (second system) is used as a search range, so that the user knows the existence. Even if there is no document, what is considered to be highly relevant can be included in the search results. Therefore, it is possible to automatically provide useful information even if the user does not search for keywords by himself / herself.

Note that this search can be performed in advance before the transmission is requested in addition to the transmission of the related information.
For example, when the server device 120 causes the client device 110 to download a document registered in the registration information database 1209, the server device 120 relates to the document in advance in anticipation that transmission of related information is requested later for the document. It is possible to search for information. The server device 120 may perform the search when notified from the client device 110 that the downloaded document is displayed.

In addition, when the client device 110 displays a document, a web page, or the like acquired from other than the server device 120, if the server device 120 is notified of the contents, the server device 120 receives the notification. Information related to the document or the like can be searched for. For example, when a web page is displayed, new page data is downloaded to the server device 120 every time the screen is switched after the new page data is downloaded.
Even when the document itself is not transmitted, the same measures can be taken if the image projecting device 130 captures an image being projected at an appropriate timing such as every predetermined time and transmits it to the server device 120.

  Hereinafter, based on the information displayed on the display unit of the client device 110, information related to the displayed information is stored in the first system in which the server device 120 stores the displayed information and other information. The flow of processing for searching from the system 2 will be described.

FIG. 12 shows an example of a flowchart of processing related to retrieval of related information performed by the CPU 121 of the server device 120.
When the CPU 121 of the server apparatus 120 receives the display content notification from the client apparatus 120 or the image projection apparatus 130, the CPU 121 starts the processing shown in the flowchart of FIG. The notification of the display content is performed together with a request for transmitting related information or at any time.
In the process of FIG. 12, the CPU 121 first determines whether or not the displayed document is a document registered in the registration information database 1209 (S1).

As described above, this determination can be made based on, for example, whether or not the notified display content has received an ID of a document including information in the registration information database 1209 as identification information unique to the storage location. Alternatively, it may be determined based on whether or not the ID of the document in the format used in the registration information database 1209 has been received.
If it is determined that the document displayed on the client device 110 or the image projection device 130 is a document registered in the registration information database 1209 (Y in S1), the related information search for the document has already been performed. It is executed, and it is determined whether or not the result is stored in the registration information database 1209 (S2). That is, it is determined whether or not the related information search history shown in FIG. 8 has already been created for the document.

As a result, if the related information search of the document has already been executed and the search result has been saved (Y in S2), the search process is not necessary again, and the process is ended as it is.
Next, when it is determined in step S2 that the related information search of the document has not been executed (N in S2), a related information search keyword is acquired from the document information of the document (S3). The search keyword can be acquired from the frequently used keyword section in the document information shown in FIG.

Next, based on the extracted related information search keyword, a search is performed for a document or information having a high keyword matching rate at each search target location (S4), and a search result is acquired (S5).
The search target is not only the document data registered in the registration information database 1209, but also a search of a web browser, a folder below an arbitrary folder of the client device 110, a file server which is another system connectable from the server device 120 and the client device 110 200 mag. In addition, any location accessible from the server device 120 can be added to the search target.

In the case of a client device 110, another system 200, or the like as a search target, the information is used when authentication is required for access, and if only a specific location is to be searched, the location is specified as the conference system 100. It is good also as a structure which can be set as this setting information.
Next, the CPU 121 stores the search result in step S5 and ends the process (S6). This storage can be performed by creating the related information search history and the related information search result shown in FIG. 8 for the corresponding document and storing them in the registration information database 1209. Further, the storage here may be only the storage location of the found document or the like. However, if the document or the like is found from other than the registration information database 1209, the document or the like itself can be downloaded and saved sooner. To the client device 110.

On the other hand, when the document displayed on the client device 110 or the image projection device 130 is not a document registered in the registration information database 1209 (N in S1), the CPU 121 searches the registration information database 1209 for related information. Unable to get keywords for
Therefore, if the displayed document includes text data such as a source of information (Y in S7), the CPU 121 acquires text information such as the source (S8). In this processing, the CPU 121 can obtain the document data itself from the client device 110 or the like, can be notified of the storage location of the document and can download the document data therefrom, or the information is displayed in text on the web browser. If feasible.

Next, the CPU 121 analyzes the obtained text information and extracts related information search keywords (S9). This extraction may be performed in the same manner as the frequent keyword extraction shown in FIG.
Then, the CPU 121 executes a search at each search target location based on the extracted related information search keyword (S10), and acquires a search result (S11). Thereafter, the retrieved result is temporarily stored (S12), and the process is terminated.
This search can be performed in the same manner as in steps S4 and S5. Saving may be performed in the same manner as in step S6. However, the temporarily saved search result is data that may be discarded when the screen changes (when another display content is transmitted next), and thus a simpler saving method may be used.

On the other hand, when the displayed document does not include text data such as the source of information (N in S7), the CPU 121 acquires the image data of the display screen (S13). Then, the image data is OCR processed to obtain text information (S14).
Since the processing of the next steps S15 to S18 is the same as the processing of the above steps S9 to S12, description thereof will be omitted.
With the above processing, the CPU 121 can create a list of related information related to the document being displayed on the client device 110 and the image projection device 130.

FIG. 13 is a flowchart of processing related to provision of related information executed by the CPU 121 of the server apparatus 120. A process of providing related information to the client apparatus 110 will be described with reference to the flowchart of FIG.
When the CPU 121 detects a related information transmission request from the client apparatus 110, the CPU 121 starts the process shown in the flowchart of FIG. 13. First, it is determined whether or not related information relating to the current display content has been searched (S21). That is, it is determined whether or not related information search results are stored in steps S6 and S12 of FIG.

  If the related information has already been searched (Y in S21), the server device 120 matches the current display content from the related information search result stored in the registration information database 1209 or temporarily stored. Is taken out (S22). Then, the server device 120 transmits the extracted related information to the client device 110 (S23).

If the related information has not yet been searched in S21 (N in S21), the server device 120 executes the process shown in the flowchart of FIG. 12 (S24), and saves or temporarily stores the search result in the registration information database 1209. save.
Then, from the saved or temporarily saved related information search result, a result that matches the current display content is extracted (S22). Then, the server device 120 transmits the extracted related information to the client device 110 (S23).
As described above, the server apparatus 120 can transmit the related information (or the acquisition destination) related to the document being displayed on the client apparatus 110 and the image projection apparatus 130 to the client apparatus 110.

Although the description of the embodiment is finished as described above, in the present invention, the specific configuration of each device, the contents of processing, the configuration of data, the number of devices used, and the like are not limited to those described in the embodiment. .
For example, not only the OCR processing of the image file on the screen but, for example, when the URL as the information storage location can be notified to the server device 120, the folder path or the like can be notified from the source of the URL, When data that actually exists in the folder can be referred to, a character string serving as a search keyword may be extracted from the data.

  Further, instead of using the image projection device 130 and the display device 140, all the conference participants use the client device 110, and an image to be viewed by all the members is distributed from the server device 120 to the client device 110 of each participant to perform the conference. May be. Even in that case, it goes without saying that the image projection device 130 or the display device 140 may be used together as appropriate.

Furthermore, when a character string is added to the display device 140 by hand during a meeting, the character string may be subjected to OCR processing and acquired as a search keyword. By recognizing handwritten characters and using them as search keyword extraction targets, additional searches to related information searches that are automatically executed, search corrections, and the like can be easily performed.
In addition, the search keyword may be acquired from a combination of part or all of document information and conference information and text information obtained by OCR processing or the like.

You may extract the word used as a search keyword from text data and speech data according to a certain rule (appearance frequency or addition of an accent symbol (bold or underlined) that is regarded as an important word). As described above, the accuracy of the related information search can be improved by using various types of information as search keyword extraction targets.
In the above-described embodiment, the example in which the frequent keyword is used as the frequent element used for the search has been described. However, in addition to characters, related information may be searched using graphics or images.

In addition to searching for related information for each displayed document or the like, it is also possible to search and save related information from conference information registered in advance.
For example, a search keyword is set from an agenda registered as conference information, a keyword extracted from audio data, a keyword extracted from a document of a conference material, a keyword extracted from a reference destination source of a reference URL, or the like. The related information of the conference itself can be searched.

  Further, for each document or URL registered as a meeting material or reference URL, a search keyword is extracted and related information is searched and stored in advance. Then, when those documents and URLs are displayed, it is possible to efficiently provide related information at a high speed without performing a search again.

As described above, every time the display information changes from the document or information displayed during the meeting, the information is sequentially acquired and the search is executed, and the search is executed in advance from the information registered as the meeting information. You may use together the process to preserve | save.
Prior to receiving a request for displaying information related to the information from the client apparatus 110, the system automatically searches for information candidates displayed by the display means in the background and stores the search results in the storage means. It is preferable to leave it. By doing so, it is possible to display a result as soon as a related information display request is received from the client device, and it is possible to increase the accuracy of the related information search and to increase the speed from the display request to the result display.

Of course, the present invention can be applied to any information processing system other than the conference system.
In this case, the functions of the devices such as the client device 110 and the server device 120 described above do not have to be configured by a single device. A configuration in which a plurality of devices cooperate to realize the function of each device may be employed. Conversely, there may be a device having the functions of a plurality of devices. For example, the function of the server device 120 is provided in a PC that controls the projector.

  Moreover, the program which is embodiment of this invention is a program for implementing the function of the information processing system mentioned above by making one computer or several computers cooperate. Then, by causing the computer to execute such a program, the above-described effects can be obtained.

  Such a program may be stored in a ROM or other nonvolatile storage medium (flash memory, EEPROM, etc.) provided in the computer from the beginning. However, the recording medium is a CD-ROM or a non-volatile recording medium such as a memory card, flexible disk, MO, CD-R, CD-RW, DVD + R, DVD + RW, DVD-R, DVD-RW, or DVD-RAM. It can also be recorded and provided. Each procedure described above can be executed by installing the program recorded in the recording medium in a computer and executing the program.

  Furthermore, it is also possible to download from an external device that is connected to a network and includes a recording medium that records the program, or an external device that stores the program in a storage unit, and install and execute the program on a computer.

As mentioned above, although embodiment for implementing invention was described, this invention is not limited to embodiment mentioned above. Modifications can be made without departing from the spirit of the present invention.
Further, it goes without saying that the configurations of the embodiments, operations, and modifications described above can be implemented in any combination as long as they do not contradict each other.

100: Conference system (first system) 110: Client device 120: Server device (information processing device) 130: Image projection device 140: Display device 200: Other system (second system) 300 : Network, 1101: Display control unit, 1102: Information management unit, 1103: Related information acquisition unit, 1104: Communication unit, 1201: Registration information management unit, 1202: Registration information analysis unit, 1203: Audio information management unit, 1204: Audio information analysis unit, 1205: related information management unit, 1206: search unit, 1207: OCR processing unit, 1208: communication unit, 1209: registration information database, 1301: projection unit, 1302: photographing unit, 1303: communication unit, 1401 : Display unit, 1402: Display reading unit, 1403: Communication unit, 2001: Communication unit, 2002: Information management unit

JP 2011-059920 A JP 2011-191881 A

Claims (8)

An information processing system using a network,
Display means for displaying information;
Search based on information displayed by the display means for retrieving information related to the information to be displayed from the first system storing the information to be displayed and the second system other than the first system. And an information processing system. Storage means for storing a document in association with information on frequent elements in the document;
The retrieval unit, when the information to be displayed is a document stored in the storage unit, retrieves the related information using a frequent element corresponding to the document. Item 4. The information processing system according to Item 1.   The search means determines whether or not the information to be displayed is a document stored in the storage means based on whether or not the information to be displayed is a document including identification information unique to a storage destination. The information processing system according to claim 2, wherein:   When the information to be displayed is not a document stored in the information processing apparatus, the search means analyzes the information to be displayed to acquire a frequent element in the displayed information, and uses the frequent element The information processing system according to claim 1, wherein the related information is searched. Furthermore, the image analysis means for analyzing the image and obtaining the text data of the characters included in the image,
The display means is means for displaying an image,
The search means analyzes the text data when the text data corresponding to the information to be displayed can be acquired from any storage destination, and if the corresponding text data cannot be acquired, the search means displays an image of the information to be displayed. The information processing system according to claim 1, wherein the frequent element is obtained by analyzing text data obtained by analysis by an image analysis unit.   The search means includes means for searching the related information for information candidates displayed by the display means before receiving a display request and storing the results in a storage means. The information processing system according to any one of claims 1 to 5. Display control means for controlling the display means to display information;
Search based on information to be displayed on the display means, searching for information related to the information to be displayed from the first system storing the information to be displayed and the second system other than the first system And an information processing apparatus. Computer
Display control means for controlling the display means to display information;
Search based on information to be displayed on the display means, searching for information related to the information to be displayed from the first system storing the information to be displayed and the second system other than the first system Program to function as a means.