JP2020198078A - Information processing apparatus, information processing system, and information processing method - Google Patents

Abstract

To provide an information processing apparatus that can avoid mixing of meetings held in virtual places.SOLUTION: An information processing apparatus manages a plurality of users operating a plurality of communication terminals to participate in meetings held in virtual places, and comprises: management means that manages participant users participating in the same meeting based on notifications from the communication terminals using a unique identifier for each of the virtual places; creation means that creates data for displaying a web page on web browsers of the communication terminals operated by the participant users; and transmission means that transmits the created data to the communication terminals operated by the participant users. The management means determines exit of all the participant users from the meeting based on the notifications from the communication terminals, and ends the meeting to solve the above-mentioned problem.SELECTED DRAWING: Figure 29

Description

The present invention relates to an information processing apparatus, an information processing system and an information processing method.

For example, various contents (data) created by each known system by integrating individual known systems that support the conference, which have various functions such as video / audio recording / playback function, board writing function, and personal memo function, are conferenced. There was a conference support system that could manage the contents in association with each other and refer to and utilize the managed contents in association with each other (see, for example, Patent Document 1).

If a traditional conference system cannot recognize the end of a real conference in a virtual conference room, then even if the previous real conference ends and the next real conference begins, the previous real conference Since the meeting is managed as if it is ongoing, there is a problem that the previous real meeting is confused with the next real meeting. The conference support system of Patent Document 1 cannot solve the above-mentioned problem.

One embodiment of the present invention aims to provide an information processing device capable of avoiding confusion of a meeting held in a virtual place.

In order to achieve the above object, one embodiment of the present invention is an information processing device that manages a plurality of users operating a plurality of communication terminals so as to participate in a meeting held in a virtual place. Based on the notification from the communication terminal using a unique identifier for each virtual place, the management means for managing the participating users who participate in the same meeting and the web browser of the communication terminal operated by the participating user are displayed on the web. The management means includes a creation means for creating data for displaying a page and a transmission means for transmitting the created data to the communication terminal operated by the participating user, and the management means notifies from the communication terminal. Based on the above, it is characterized in that all the participating users are determined to leave the meeting and the meeting is terminated.

According to one embodiment of the present invention, confusion of meetings held in a virtual place can be avoided.

It is an overall overview diagram of the information sharing system during a meeting. It is a figure of an example explaining the outline of the personal portal in an information sharing system. It is a hardware block diagram of an example of the computer which concerns on this embodiment. It is a hardware block diagram of an example of the smartphone which concerns on this embodiment. It is a hardware block diagram of an example of the projector which concerns on this embodiment. It is a hardware block diagram of an example of IWB which concerns on this embodiment. It is a functional block diagram of each terminal and server which constitutes an information sharing system. It is an image diagram of an example of a personal board screen before the display of the projection screen and the first screen capture are performed. It is an image diagram of an example explaining a change of a personal board screen by a user's participation in a room and leaving a room. It is an image diagram of an example of a personal board screen on which a projection screen is displayed. It is an image diagram of an example of a personal board screen in which the first screen capture was performed. It is an image diagram of an example of a personal board screen after the meeting. It is an image diagram of an example of a personal board screen that accepts sheet editing from a user during a meeting. It is a block diagram of an example of a personal memo management DB. It is a block diagram of an example of a shared memo management DB. It is a block diagram of an example of a personal memo DB. It is a block diagram of an example of a shared memo DB. It is a block diagram of an example of interest degree management DB. It is a block diagram of an example of a conference association DB. It is a block diagram of an example of a conference DB. It is a block diagram of an example of a user DB. It is a flowchart of an example which showed the processing of the information sharing system which concerns on this embodiment. It is a sequence diagram of an example of the process from the meeting preparation to the display of the personal board screen. It is an image diagram of an example of the address bar displayed on a permanent terminal. It is a block diagram of an example of a conference data stored in a conference DB. It is a sequence diagram of an example of the process until the projection screen is displayed on the personal board screen. It is an image diagram of an example of a screen for selecting a target to be screen-transmitted to a shared screen. It is a sequence diagram of an example of the process of capturing the captured image of the projection screen and making a memo in the captured image and the text memo area. It is a sequence diagram of an example of a process in which a user leaves a conference being held and the conference ends. It is a block diagram of an example of a conference data stored in a conference DB. It is a sequence diagram of an example of a process in which a participant looks back on a memo of a meeting from a personal terminal. It is a figure which showed the display example of the personal portal screen. It is a figure which showed the display example of a bibliographic information screen. It is explanatory drawing of an example of the capture information of a bibliographic information screen. It is explanatory drawing of an example of the capture information of a bibliographic information screen. It is an overall overview diagram of the information sharing system during a meeting.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In this embodiment, an example of an information sharing system used for a conference and in which a shared board and an individual board can be used will be described, but the present invention is not limited to this. This embodiment is not limited to meetings, and can be applied to various information processing systems as long as it is an event held by a plurality of people such as seminars, lectures, and classes. In addition, each person may actually gather at the same place to participate in the event to be held, or each person may participate in another place. Further, in the present embodiment, an example of a remote conference in which there are users who are remotely connected is described, but all the users may be in the same room, and the users are physically separated from each other. Does not have to be present in.

[First Embodiment]
<Overview of the information sharing system during the meeting>
First, the overall outline of the information sharing system during the meeting will be described with reference to FIG. FIG. 1 is an overall overview view of the information sharing system during the meeting. Here, a state is shown in which users A and B in the conference room X of the company and user C in the home Y are holding a remote conference using the information sharing system. User A brings in a personal terminal 2a and user B brings in a personal terminal 2b into the conference room X. Further, in the conference room X, a permanent terminal 4 that can be shared by a plurality of users is installed. The permanent terminal 4 is not indispensable. The information sharing system may be configured without the permanent terminal 4. User C brings a personal terminal 2c to his home Y. In the following, when the generic names of the personal terminals 2a, 2b, and 2c are shown, they are referred to as "personal terminal 2".

The personal terminal 2 is a computer that can be used individually (dedicated) and viewed (referenced) by each user. The permanent terminal 4 is a computer that can be used and viewed by a plurality of users jointly.

The personal terminal 2 is, for example, a notebook PC (Personal Computer), a desktop PC, a mobile phone, a smartphone, a tablet terminal, a wearable PC, or the like. The personal terminal 2 and the permanent terminal 4 are examples of communication terminals (or information processing terminals).

The permanent terminal 4 is, for example, a PJ (Projector: projector), an IWB (Interactive White Board: a white board having an electronic blackboard function capable of intercommunication), a digital signage, a display to which a stick PC is connected, and the like. The permanent terminal 4 is an example of a communication terminal (or information processing terminal) with a monitor intended to be permanently installed in the conference room. The permanent terminal 4 is, for example, an information processing terminal with a large monitor that is permanently installed in a conference room, and a usage pattern such as displaying a screen shared by a plurality of users is assumed. The permanent terminal 4 is not an essential configuration.

The personal terminal 2 and the permanent terminal 4 can communicate with the content management server 6 via a communication network 9 such as the Internet. The communication network 9 may be one or more LANs (Local Area Network) inside the firewall, or may include the Internet outside the firewall in addition to the LANs. In addition, VPN (Virtual Private Network) and wide area Ethernet (registered trademark) may be included. The communication network 9 may be constructed by either wired or wireless, and may be a combination of wired and wireless. Further, when connected by a mobile phone network such as 3G, LTE (Long Term Evolution), 4G, LAN may not be required.

The content management server 6 is a computer having a function as a web (Web) server (or HTTP server) that stores and manages content data to be transmitted to the personal terminal 2 and the permanent terminal 4. The content management server 6 includes a storage unit 6000, which will be described later.

The storage unit 6000 is constructed with a storage position (or storage area) for realizing the personal boards dc1 to dc3 that can be accessed only from each personal terminal 2. Only personal terminals 2a, 2b, and 2c can access the personal boards dc1, dc2, and dc3, respectively. In the following, when the general term of the personal board dc1, dc2, dc3 is shown, it is described as "personal board dc". The content management server 6 may support cloud computing. Cloud computing refers to a usage pattern in which resources on a network are used without being aware of specific hardware resources.

Further, the storage unit 6000 of the content management server 6 has a storage position (or storage area) for realizing a shared board cc that can be accessed from each personal terminal 2. Further, the storage unit 6000 of the content management server 6 has a storage position (or storage area) for realizing a shared screen ss that can be accessed from each personal terminal 2.

The personal board dc and the shared board cc are virtual spaces created in the storage position (or storage area) of the storage unit 6000 of the content management server 6. The personal board dc and the shared board cc can be accessed by, for example, a web application having a function of viewing and editing contents by using a Canvas element and JavaScript (registered trademark) or the like. A web application operates by coordinating a program in a script language (for example, JavaScript) that operates on a web browser application (hereinafter referred to as a web browser) and a program on the web server side, and is used on the web browser. Shows the software or its mechanism. The personal board dc and the shared board cc have a finite or infinite area within the storage area of the storage unit 6000. For example, the personal board dc and the shared board cc may be finite or infinite in both the vertical and horizontal directions, or may be finite or infinite in either the vertical and horizontal directions.

Further, the shared screen ss is a virtual space created in the storage position (or storage area) of the storage unit 6000 of the content management server 6. Unlike the personal board dc and the shared board cc, this shared screen ss simply holds the data of the content to be transmitted (distributed) to the personal terminal 2 or the permanent terminal 4, and the previous content is stored until the next content is acquired. It has a function to hold. The shared screen ss can be accessed by a web application having a function of browsing the contents.

Further, the personal board dc is an electronic space dedicated to each individual of the users participating in the remote conference. Each user's personal terminal 2 can access only the personal board dc dedicated to each user, and can view and edit (input, delete, copy, etc.) contents such as characters and images. The shared board cc is an electronic space shared by each user participating in the remote conference. Each user's personal terminal 2 can access the shared board cc, and can view and edit contents such as characters and images.

The shared screen ss is an electronic space shared by each user participating in the remote conference. Each user's personal terminal 2 can access the shared screen ss and browse the shared screen ss. Unlike the personal board dc and the shared board cc, the shared screen ss simply retains the data of the content to be transmitted (distributed) to the personal terminal 2 or the permanent terminal 4, and retains the previous content until the next content is acquired. It has a function.

For example, when the content data is transmitted from the personal terminal 2a to the shared screen ss and then the content data is transmitted from the personal terminal 2b to the shared screen ss, the content data held by the shared screen ss is the most recently received individual. It is the data transmitted from the terminal 2b. For example, on the shared screen ss, a computer screen such as an application screen shared by each user is displayed.

The content management server 6 associates information such as the content developed on the shared screen ss, the shared board cc, and the personal board dc for each conference held in the virtual conference room (hereinafter, simply referred to as a room). I manage it. As a result, even if the content management server 6 manages a plurality of rooms, the content data is not communicated between different rooms.

Each personal terminal 2 can display the contents of the personal board dc, the shared board cc, and the shared screen ss of the conference in which the user participated by the web application of the installed web browser, so that the contents of the shared screen ss can be displayed in the actual conference room. You can hold a close meeting.

With such an information sharing system, the user opens a personal file with an application and shares it on the shared screen ss, shares handwriting and object arrangement on the shared board cc, and shares it on the shared screen ss. The content can be imported into the personal board dc as personal material, and the handwriting and object arrangement can be left as personal memos on the personal board dc.

The information sharing system of FIG. 1 is an example, and it is not necessary to have any one or more of the shared screen ss, the shared board cc, and the personal board dc. For example, the information sharing system of FIG. 36 is an example in which the shared board cc is not provided and the shared screen ss and the personal board dc are configured. In the information sharing system of FIG. 36, each personal terminal 2 can display the contents of the personal board dc and the shared screen ss of the room in which the user participates by the web application of the installed web browser.

<Overview of personal portal in information sharing system>
Next, the outline of the personal portal will be described with reference to FIG. FIG. 2 is an example diagram illustrating an outline of a personal portal in an information sharing system. The content management server 6 generates data on the personal portal screens dp1, dp2, and dp3 dedicated to each personal terminal 2 and displays them on each personal terminal 2. In the following, when the generic name of the personal portal screen dp1, dp2, dp3 is shown, it is described as "personal portal screen dp".

The content management server 6 stores the shared memo cm, which is the content edited during the meeting on the shared board cc of FIG. 1, and the personal memo dm1, dm2, dm3, which is the content edited on the personal board dc. Be managed. In the following, when the generic name of the personal memo dm1, dm2, dm3 is shown, it is described as "personal memo dm". Each user can display a list of conferences in which the user who operates the personal terminal 2 participates by accessing the dedicated personal portal screen dp of each personal terminal 2.

The user can display the shared memo cm, the personal memo dm, and the bibliographic information of the conference of each conference from the list of conferences displayed on the personal portal screen dp as described later. Therefore, the user can easily display the desired shared memo cm, personal memo dm, and bibliographic information of the conference when looking back on the contents of the conference. In addition, each user accesses the dedicated personal portal screen dp of each personal terminal 2, and from the list of meetings of the user who operates the personal terminal 2, the desired meeting is referred to as a keyword (character) as described later. You can search. As the search target of the character search, bibliographic information of the conference, text data and handwritten characters included in the personal memo dm, evaluation of the conference by the user, and the like are used. The bibliographic information of the conference is included in the conference information.

<Hardware configuration>
<< Computer >>
The content management server 6 is realized by, for example, the computer 500 having the hardware configuration shown in FIG. Further, when the personal terminal 2 is a PC which is an example of an information processing terminal, it is realized by, for example, the computer 500 having the hardware configuration shown in FIG.

FIG. 3 is a hardware configuration diagram of an example of the computer 500 according to the present embodiment. As shown in FIG. 3, the computer 500 includes a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, an HD504, an HDD (Hard Disk Drive) controller 505, and a display 506. , External device connection I / F (Interface) 508, Network I / F 509, Data bus 510, Keyboard 511, Pointing device 512, DVD-RW (Digital Versatile Disk Rewritable) drive 514, Media I / F 516.

Of these, the CPU 501 controls the operation of the entire computer 500. The ROM 502 stores a program used to drive the CPU 501 such as an IPL. The RAM 503 is used as a work area of the CPU 501. The HD504 stores various data such as programs. The HDD controller 505 controls reading or writing of various data to the HD 504 according to the control of the CPU 501.

The display 506 displays various information such as cursors, menus, windows, characters, or images. The external device connection I / F 508 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory, a printer, or the like. The network I / F 509 is an interface for performing data communication using the communication network 9. The data bus 510 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 501.

The keyboard 511 is a kind of input means including a plurality of keys for inputting characters, numerical values, various instructions, and the like. The pointing device 512 is a kind of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. The DVD-RW drive 514 controls reading or writing of various data to the DVD-RW 513 as an example of the removable recording medium. In addition, it is not limited to DVD-RW, and may be DVD-R or the like. The media I / F 516 controls reading or writing (storage) of data to a recording medium 515 such as a flash memory.

<< Smartphone >>
The personal terminal 2, which is an example of the information processing terminal, may be realized by, for example, the smartphone 600 having the hardware configuration shown in FIG.

FIG. 4 is a hardware configuration diagram of an example of the smartphone 600 according to the present embodiment. As shown in FIG. 4, the smartphone 600 includes a CPU 601, a ROM 602, a RAM 603, an EEPROM 604, a CMOS sensor 605, an image sensor I / F606, an acceleration / orientation sensor 607, a media I / F609, and a GPS receiver 611. There is.

Of these, the CPU 601 controls the operation of the entire smartphone 600. The ROM 602 stores a program used to drive the CPU 601 such as the CPU 601 and the IPL. The RAM 603 is used as a work area of the CPU 601. The EEPROM 604 reads or writes various data such as a smartphone program under the control of the CPU 601.

The CMOS (Complementary Metal Oxide Semiconductor) sensor 605 is a kind of built-in imaging means that acquires image data by imaging a subject (mainly a self-portrait) under the control of the CPU 601. Instead of the CMOS sensor 605, an image pickup means such as a CCD (Charge Coupled Device) sensor may be used. The image sensor I / F606 is a circuit that controls the drive of the CMOS sensor 605. The acceleration / orientation sensor 607 is a variety of sensors such as an electronic magnetic compass, a gyro compass, and an acceleration sensor that detect the geomagnetism.

The media I / F 609 controls reading or writing (storage) of data to a recording medium 608 such as a flash memory. The GPS receiving unit 611 receives GPS signals from GPS satellites.

In addition, the smartphone 600 includes a long-distance communication circuit 612, a CMOS sensor 613, an image sensor I / F 614, a microphone 615, a speaker 616, a sound input / output I / F 617, a display 618, an external device connection I / F 618, and a short-range communication circuit 620. , The antenna 620a of the short-range communication circuit 620, and the touch panel 621 are provided.

Of these, the telecommunications circuit 612 is a circuit that communicates with other devices via the communication network 9. The CMOS sensor 613 is a kind of built-in imaging means that images a subject and obtains image data under the control of the CPU 601. The image sensor I / F 614 is a circuit that controls the drive of the CMOS sensor 613. The microphone 615 is a built-in circuit that converts sound into an electrical signal. The speaker 616 is a built-in circuit that converts an electric signal into physical vibration to produce sounds such as music and voice.

The sound input / output I / F 617 is a circuit that processes sound signal input / output between the microphone 615 and the speaker 616 under the control of the CPU 601. The display 618 is a kind of display means such as a liquid crystal or an organic EL (Electro Luminescence) for displaying an image of a subject, various icons, and the like.

The external device connection I / F619 is an interface for connecting various external devices. The short-range communication circuit 620 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The touch panel 621 is a kind of input means for operating the smartphone 600 by the user pressing the display 618.

In addition, the smartphone 600 is provided with a bus line 610. The bus line 610 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 601 shown in FIG.

<< Projector >>
The projector 700, which is an example of the permanent terminal 4, may be realized by, for example, the hardware configuration shown in FIG.

FIG. 5 is a hardware configuration diagram of an example of the projector 700 according to the present embodiment. As shown in FIG. 5, the projector 700 includes a CPU 701, a ROM 702, a RAM 703, a media I / F 707, an operation unit 708, a power switch 709, a bus line 710, a network I / F 711, an LED (Light Emitting Diode) drive circuit 714, and an LED. It includes a light source 715, a projection device 716, a projection lens 717, an external device connection I / F718, a fan drive circuit 719, and a cooling fan 720.

Of these, the CPU 701 controls the operation of the entire projector 700. The ROM 702 stores a program used to drive the CPU 701. The RAM 703 is used as a work area for the CPU 701. The media I / F 707 controls reading or writing (storage) of data to a recording medium 706 such as a flash memory.

The operation unit 708 is provided with various keys, buttons, LEDs, and the like, and is used for performing various operations other than turning on / off the power of the projector 700 by the user. For example, the operation unit 708 receives instruction operations such as a projected image size adjustment operation, a color tone adjustment operation, a focus adjustment operation, and a keystone adjustment operation, and outputs the received operation contents to the CPU 701.

The power switch 709 is a switch for switching ON / OFF of the power supply of the projector 700. The bus line 710 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 701 shown in FIG. The network I / F711 is an interface for data communication using a communication network 9 such as the Internet.

The LED drive circuit 714 controls the lighting and extinguishing of the LED light source 715 under the control of the CPU 701. When the LED light source 715 is turned on under the control of the LED drive circuit 714, it irradiates the projection device 716 with projected light. The projection device 716 transmits the modulated light obtained by modulating the projected light from the LED light source 715 by the spatial light modulation method based on the image data given via the external device connection I / F718 or the like through the projection lens 717. , Project as an image on the projection surface of the screen. As the projection device 716, for example, a liquid crystal panel or a DMD (Digital Micromirror Device) or the like is used.

The LED drive circuit 714, the LED light source 715, the projection device 716, and the projection lens 717 function as a projection unit (projection means) for projecting a projected image on the projection surface based on the image data as a whole.

The external device connection I / F718 is directly connected to a PC (Personal Computer) and acquires control signals and image data from the PC. Further, the external device connection I / F718 is an interface for connecting various external devices (stick PC730 and the like). The fan drive circuit 719 is connected to the CPU 701 and the cooling fan 720, and drives / stops the cooling fan 720 based on the control signal from the CPU 701. The cooling fan 720 rotates to exhaust the air inside the projector 700 and cool the inside of the projector 700.

Further, when the power supply power is supplied, the CPU 701 is activated according to the control program stored in advance in the ROM 702, gives a control signal to the LED drive circuit 714 to light the LED light source 715, and controls the fan drive circuit 719. A signal is given to rotate the cooling fan 720 at a predetermined rated speed. Further, when the power supply power from the power supply circuit is started to be supplied to the projector 700, the projection device 716 is in a state where the image can be displayed, and power is further supplied from the power supply circuit to various other components. Further, when the power switch 709 is turned off in the projector 700, a power OFF signal is sent from the power switch 709 to the CPU 701.

When the CPU 701 detects the power OFF signal, it gives a control signal to the LED drive circuit 714 to turn off the LED light source 715. After that, when a predetermined time elapses, the CPU 701 gives a control signal to the fan drive circuit 719 to stop the cooling fan 720, terminates its own control process, and finally gives an instruction to the power supply circuit to supply power. Stop the supply of.

<< IWB >>
The IWB 800, which is an example of the permanent terminal 4, may be realized by, for example, the hardware configuration shown in FIG.

FIG. 6 is a hardware configuration diagram of an example of the IWB 800 according to the present embodiment. As shown in FIG. 6, the IWB 800 includes a CPU 801 and a ROM 802, a RAM 803, an SSD (Solid State Drive) 804, a network I / F805, and an external device connection I / F806.

Of these, the CPU 801 controls the operation of the entire IWB 800. The ROM 802 stores a program used to drive the CPU 801 such as the CPU 801 and the IPL. The RAM 803 is used as a work area of the CPU 801. The SSD 804 stores various data such as a program for IWB. The network I / F805 controls communication with the communication network 9. The external device connection I / F806 is an interface for connecting various external devices. The external device in this case is, for example, a USB memory 830, an external device (microphone 840, speaker 850, camera 860).

Further, the IWB 800 includes a capture device 811, a GPU 812, a display controller 813, a contact sensor 814, a sensor controller 815, an electronic pen controller 816, a short-range communication circuit 819, and an antenna 819a, a power switch 822, and a selection switch of the short-range communication circuit 819. It has a class 823.

Of these, the capture device 811 causes the display of the external PC 870 to display the video information as a still image or a moving image. The GPU (Graphics Processing Unit) 812 is a semiconductor chip that specializes in graphics. The display controller 813 controls and manages the screen display in order to output the output image from the GPU 812 to the display 880 or the like.

The contact sensor 814 detects that the electronic pen 890, the user's hand H, or the like touches the display 880. The sensor controller 815 controls the processing of the contact sensor 814. The contact sensor 814 inputs coordinates and detects coordinates by an infrared blocking method. In the method of inputting the coordinates and detecting the coordinates, two light receiving and emitting devices installed at both upper ends of the display 880 radiate a plurality of infrared rays in parallel with the display 880 and are provided around the display 880. This is a method of receiving light that is reflected by a reflecting member and returns on the same optical path as the light path emitted by the light receiving element.

The contact sensor 814 outputs an infrared ID emitted by two light emitting / receiving devices blocked by the object to the sensor controller 815, and the sensor controller 815 specifies a coordinate position which is a contact position of the object. By communicating with the electronic pen 890, the electronic pen controller 816 determines whether or not there is a touch of the pen tip or a touch of the pen tail on the display 880. The short-range communication circuit 819 is a communication circuit such as NFC or Bluetooth. The power switch 822 is a switch for switching ON / OFF of the power supply of the IWB 800. The selection switches 823 are, for example, a group of switches for adjusting the brightness and color tone of the display of the display 880.

In addition, the IWB 800 is equipped with a bus line 810. The bus line 810 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 801 shown in FIG.

The contact sensor 814 is not limited to the infrared blocking method, but is a capacitive touch panel that specifies a contact position by detecting a change in capacitance, and a contact position is specified by a voltage change between two opposing resistance films. Various detection means such as a resistance film type touch panel and an electromagnetic induction type touch panel that detects the electromagnetic induction generated when a contact object comes into contact with the display unit and specifies the contact position may be used. Further, the electronic pen controller 816 may determine whether or not there is a touch not only on the pen tip and pen end of the electronic pen 890 but also on the portion gripped by the user of the electronic pen 890 and other electronic pen portions.

<Functional configuration>
The functional configuration of each terminal and server constituting the information sharing system will be described with reference to FIG. 7. FIG. 7 is a functional block diagram of each terminal and server constituting the information sharing system.

<< Functional configuration of personal terminal >>
First, the functional configuration of the personal terminal 2a will be described. As shown in FIG. 7, the personal terminal 2a includes a transmission / reception unit 21a, a reception unit 22a, an image processing unit 23a, a display control unit 24a, a determination unit 25a, a storage / reading processing unit 29a, and a communication management unit 30a. Have. Each of these parts is a function realized or a means for functioning by operating any of the components shown in FIG. 3 by an instruction from the CPU 501 according to a program developed on the RAM 503 from the HD 504. is there. Further, the personal terminal 2a has a storage unit 2000a constructed by the RAM 503 and the HD 504 shown in FIG.

The transmission / reception unit 21a, the reception unit 22a, the image processing unit 23a, the display control unit 24a, the judgment unit 25a, and the storage / reading processing unit 29a are realized by a web browser (web application) that displays a personal board screen described later. Will be done. The communication management unit 30a is realized by a dedicated communication application.

(Each function configuration)
Next, each functional configuration of the personal terminal 2a will be described in detail. The transmission / reception unit 21a transmits / receives various data (or information) to / from another terminal, device, server, or the like via the communication network 9. For example, the transmission / reception unit 21a receives content data described in HTML, CSS (Cascade Style Sheet), and JavaScript (registered trademark) from the content management server 6. In addition, the transmission / reception unit 21a transmits the operation information input by the user to the content management server 6.

The reception unit 22a receives various inputs from the keyboard 511 and the pointing device 512 by the user. The image processing unit 23a performs processing such as creating vector data (or stroke data) according to the drawing of the user, for example. Further, the image processing unit 23a has a function as a capture unit, and captures a captured image by, for example, capturing a capture of the shared screen ss.

The display control unit 24a causes the display 506 to display a personal board screen or a shared board screen, which will be described later. The determination unit 25a makes various determinations. The storage / reading processing unit 29a is executed by a command from the CPU 501, an HDD controller 505, a media I / F 516, and a DVD-RW drive 514, and stores various data in the storage unit 2000a, the DVD-RW 513, and the recording media 515. It also performs processing such as reading various data from the storage unit 2000a, the DVD-RW513, and the recording medium 515.

The communication management unit 30a is mainly realized by an instruction from the CPU 501 shown in FIG. 3, and inputs / outputs data to / from the transmission / reception unit 21a and the like. The communication management unit 30a further includes a transmission / reception unit 31a, an acquisition unit 33a, and a determination unit 35a.

Of these, the transmission / reception unit 31a transmits and receives various data (or information) to and from the content management server 6 via the communication network 9 independently of the transmission / reception unit 21a. The capturing unit 33a basically has the same function as the function as the capturing unit of the image processing unit 23a. For example, the capture unit 33a captures the captured image by performing a screen capture of the shared screen ss described later. The determination unit 35a makes various determinations, and determines, for example, whether or not the captured image is referenced by the user. Since the functional configurations of the personal terminals 2b and 2c are the same as the functional configurations of the personal terminal 2a, the description thereof will be omitted.

<< Functional configuration of permanent terminal >>
Subsequently, the functional configuration of the permanent terminal 4 will be described. As shown in FIG. 7, the permanent terminal 4 includes a transmission / reception unit 41, a reception unit 42, an image processing unit 43, a display control unit 44, a determination unit 45, a storage / reading processing unit 49, and a communication management unit 50. Have. Each of these parts has a function or a function realized by operating any of the components shown in FIG. 5 or the like by an instruction from the CPU 701 according to a program developed on the RAM 702 from the recording medium 706. It is a means to do.

It should be noted that each part is a function realized by operating any of the components shown in FIG. 5 by a command from the CPU of the stick PC 730 according to a program developed on the RAM of the stick PC 730. , Or it may be a functioning means. Further, the permanent terminal 4 has a storage unit 4000 constructed by the RAM 703 shown in FIG. 5 and the like. A shared memo DB 4002 is constructed in the storage unit 4000 of the permanent terminal 4.

The transmission / reception unit 41, the reception unit 42, the image processing unit 43, the display control unit 44, the judgment unit 45, the storage / reading processing unit 49, the communication management unit 50, and the storage unit 4000 in the permanent terminal 4 are individuals. Since it is the same as the transmission / reception unit 21a, the reception unit 22a, the image processing unit 23a, the display control unit 24a, the judgment unit 25a, the storage / reading processing unit 29a, the communication management unit 30, and the storage unit 2000a in the terminal 2a, the description is omitted. To do. Further, the communication management unit 50 in the permanent terminal 4 has a transmission / reception unit 51, an acquisition unit 53, and a determination unit 55, which are the same as the transmission / reception unit 31a, the acquisition unit 33a, and the determination unit 35a, respectively. Since it is a function, the description thereof will be omitted.

The transmission / reception unit 41, the reception unit 42, the image processing unit 43, the display control unit 44, the judgment unit 45, and the storage / reading processing unit 49 are realized by a web browser (web application) that displays a shared board screen. .. The communication management unit 50 is realized by a dedicated communication application.

<< Functional configuration of content management server >>
Subsequently, the functional configuration of the content management server 6 will be described. As shown in FIG. 7, the content management server 6 includes a transmission / reception unit 61, a schedule interlocking unit 62, an image processing unit 63, a creation unit 64, a judgment unit 65, a web page creation unit 66, a search unit 67, and an authentication unit. It has 68 and a storage / reading processing unit 69. Each of these parts is a function realized or a means for functioning by operating any of the components shown in FIG. 3 by an instruction from the CPU 501 according to a program developed on the RAM 503 from the HD 504. is there. Further, the content management server 6 has a storage unit 6000 constructed by the RAM 503 and the HD 504 shown in FIG.

(Each function configuration)
Next, each functional configuration of the content management server 6 will be described in detail. The transmission / reception unit 61 transmits / receives various data (or information) to / from another terminal, device, server, or the like via the communication network 9. The schedule interlocking unit 62 acquires schedule information including bibliographic information of a meeting in which a user participates from a schedule management server 8 connected to a communication network 9 so as to be able to send and receive various data (or information). The schedule management server 8 stores schedule information (meeting (list) information) for each user (for each user ID).

The bibliographic information included in the schedule information includes information on the date and time of the schedule (meeting), start / end time, meeting name, place, scheduled attendees, and schedule registrants. The content management server 6 can register the bibliographic information of the acquired schedule information as the bibliographic information of the meeting of the shared memo management DB 6005. In particular, when the user creates a new meeting on the content management server 6 based on the acquired schedule, the schedule registrant included in the bibliographic information of the schedule is set as the meeting organizer and the schedule is registered. The role of the organizer is assigned to the user ID of the person and registered.

The image processing unit 63 has a function as a capture unit, and captures the captured image by performing screen capture of the shared screen ss described later. The creation unit 64 creates a unique content ID, personal memo ID, shared memo ID, and the like. The determination unit 65 determines whether or not the content ID, personal memo ID, shared memo ID, and the like have been received by the transmission / reception unit 61.

The web page creation unit 66 creates web page data to be displayed on the web browsers of the personal terminal 2 and the permanent terminal 4. The search unit 67 receives a search request from the personal portal screen described later displayed on the web browsers of the personal terminal 2 and the permanent terminal 4, and performs a search according to the search request. In addition, the authentication unit 68 performs the user authentication process. The authentication unit 68 may be other than the content management server 6, and may use, for example, an authentication server connected to the communication network 9.

The storage / reading processing unit 69 is executed by a command from the CPU 501, an HDD controller 505, a media I / F 516, and a DVD-RW drive 514, and stores various data in the storage unit 6000, the DVD-RW 513, and the recording media 515. It also performs processing such as reading various data from the storage unit 6000, the DVD-RW 513, and the recording medium 515.

In addition, personal memo DB 6001, shared memo DB 6002, interest level management DB 6003, personal memo management DB 6004, shared memo management DB 6005, conference DB 6006, user DB 6007, and conference association DB 6008 are constructed in the storage unit 6000 of the content management server 6. ing.

Note that these data may be stored in another server other than the content management server 6. In that case, the timing of data acquisition / transmission may be acquired from another server each time data acquisition / transmission is requested from the personal terminal 2, or the user refers to the personal board dc and the shared board cc during the conference. While it is being stored, it may be stored in the content management server 6, deleted from the content management server 6 after the end of the conference or reference (or after a certain period of time), and sent to another server.

The device group described in the present embodiment is merely one of a plurality of computing environments for implementing the embodiment disclosed in the present specification. In certain embodiments, the content management server 6 includes a plurality of computing devices, such as a server cluster. The plurality of computing devices are configured to communicate with each other via any type of communication link, including networks, shared memory, and the like, and perform the processes disclosed herein. Similarly, the personal terminal 2 and the permanent terminal 4 can include a plurality of computing devices configured to communicate with each other.

Further, the content management server 6, the personal terminal 2, and the permanent terminal 4 can be configured to share the disclosed processing steps, such as FIGS. 23, 26, and 28, in various combinations. For example, a part of the process executed by the content management server 6 can be executed by the personal terminal 2 and the permanent terminal 4. Further, each element of the content management server 6, the personal terminal 2, and the permanent terminal 4 may be integrated into one device, or may be divided into a plurality of devices. This information sharing system may be used in conference rooms, seminar venues, business negotiation spaces, etc. where the permanent terminal 4 is not installed. In this case, the permanent terminal 4 is not an indispensable configuration, and the content management server 6 and a plurality of them are used. It may be configured by the personal terminal 2 of the above.

<Display example of personal board screen>
An example of displaying the personal board screen 1000 until the end of the conference will be described with reference to FIGS. 8 to 11. The personal board screen 1000 is a screen for displaying information to be presented to a user by a GUI (Graphical User Interface) and receiving an operation from the user, and is a display form of a web browser or application software. ..

As shown in FIGS. 8 to 11, the personal board screen 1000 until the end of the conference has a projection area for displaying the projection screen on the left side and a memo area on the right side. The shared screen ss is displayed as a projection screen in the projection area. In the memo area, each combination of the captured image 1022 of the projection screen and the text memo area 1024 accompanying the captured image 1022 is displayed on the sheet 1020.

By pressing the capture button 1016, the user takes a capture of the projection screen displayed in the projection area, and displays the set of the captured image 1022 and the text memo area 1024 on the sheet 1020. Can be additionally displayed in the memo area. The operation of pressing the capture button 1016 is an example, and may be, for example, an operation of pressing a shortcut key from the keyboard or a gesture operation from the touch panel.

FIG. 8 is an image diagram of an example of the personal board screen 1000 before the projection screen is displayed and the first screen capture is performed. For example, on the personal board screen 1000 of FIG. 8, a guidance message "display the projection screen here" is displayed in the projection area. Further, in the memo area of FIG. 8, a guidance message "The captured image is displayed" is displayed as the captured image 1022. By displaying such a guidance message, on the personal board screen of FIG. 8, the user can imagine the screen image after the screen capture is performed before the first screen capture is performed. The guidance message may not be displayed. Further, even before the first screen capture is performed, the input from the user to the text memo area 1024 may be accepted.

The user can join (log in) to the room and leave the room from the personal board screen 1000 of FIG. The display on the upper right of the personal board screen 1000 becomes as shown in FIG. 9, for example, due to participation in the room and exit from the room. FIG. 9 is an image diagram of an example for explaining changes in the personal board screen 1000 due to the user's participation in the room and exit from the room.

FIG. 9A shows the display on the upper right of the personal board screen 1000 immediately after the user “Mr. A” joins the room. The user "Mr. A" presses the login button 1034 to perform a participation operation (for example, inputting a user ID, password, etc.) to join the room.

The user name of the user "Mr. A" who joined the room with the participation of the user "Mr. A" is displayed in a pop-up window. The number of participants display column 1032 in the room represents the number of users participating in the room. The number of people represented by the number of participants display column 1032 in the room has increased to two due to the participation of the user "Mr. A".

In FIG. 9B, the login button 1034 is changed to the user name display field 1036 due to the participation of the user “Mr. A” in the room. In FIG. 9B, the user “Mr. A” is displayed in the user name display field 1036 of the user. By moving the pointer to or clicking the number of participants display field 1032 in the room in FIG. 9B, a list of users participating in the room can be displayed.

FIG. 9C shows the display on the upper right of the personal board screen 1000 immediately after the user “Mr. A” leaves the room. When the user "Mr. A" exits the room, the user name of the user "Mr. A" who has exited the room is displayed in a pop-up window on the personal board screen 1000. The number of people represented by the number of participants display column 1032 in the room has decreased to one due to the exit of the user "Mr. A".

The exit operation for leaving the room includes, for example, an operation of clicking the user name display field 1036 of the user and selecting the exit from the room. Further, as an exit operation for leaving the room, for example, there is an operation of pressing the home button on the upper left of the personal board screen 1000 to transition to the personal portal screen 5000.

The following situations in which the session with the content management server 6 is cut off (two-way communication between the personal board dc and the web browser is cut off) are treated as leaving the user's room. For example, moving to a different URL such as another site, closing the tab displayed by the web browser, turning off the power of the personal terminal 2, the personal terminal 2 is shafted down, or the personal terminal 2 is put into sleep mode. The situation is such as transition.

When content data such as stream data is transmitted to the shared screen ss, the personal board screen 1000 of FIG. 8 becomes the personal board screen 1000 as shown in FIG. FIG. 10 is an image diagram of an example of the personal board screen 1000 on which the projection screen 1040 is displayed. In the projection area of FIG. 10, a screen of contents such as stream data transmitted to the shared screen ss is displayed as a projection screen 1040.

When the personal board screen 1000 of FIG. 10 receives an operation of pressing the capture button 1016 from the user, the personal board screen 1000 of FIG. 11 becomes the personal board screen 1000 of FIG. FIG. 11 is an image diagram of an example of the personal board screen 1000 in which the first screen capture was performed. For example, the personal board screen 1000 of FIG. 11 is a UI example for displaying the shared screen ss and the personal board dc in one screen. The personal board screen 1000 may be a UI for switching the display of the shared screen ss and the personal board dc by switching tabs.

By pressing the capture button 1016, the user can capture the capture of the projection screen 1040 at that time and display the capture image 1022 of the projection screen 1040 in the memo area. In addition, the user can display the text memo area 1024 attached to the captured image 1022 in the memo area. The captured image 1022 and the text memo area 1024 attached to the captured image 1022 are displayed on, for example, one sheet 1020, so that the combination of the captured image 1022 and the text memo area 1024 is displayed in an easy-to-understand manner. .. When the operation of pressing the capture button 1016 is received from the user, the projection screen 1040 at that time is compared with the captured image 1022 of the captured projection screen 1040 displayed in the memo area, and the same content is captured. You may not shoot.

In addition, the mouse cursor is set to the first line of the newly displayed text memo area 1024 by pressing the capture button 1016 of the user. Therefore, the user can easily shift from the operation of pressing the capture button 1016 to the text memo operation to the text memo area 1024. The text memo area 1024 extends downward finitely or infinitely by inputting a text memo by the user.

An object can also be drawn on the captured image 1022 using a pen tool or the like. On the personal board screen 1000, a tool palette displaying a hand tool button 1002, a pen tool button 1004, a text tool button 1006, an Endo button 1008, a Redo button 1010, an HTML save button 1012, a PDF save button 1014, and a capture button 1016 is displayed. Has been done.

The hand tool button 1002 is a button for the user to start using the hand tool. By using the hand tool, the user can select the object drawn on the captured image 1022 and move it by dragging and dropping. The pen tool button 1004 is a button for the user to start using the pen tool. By using the pen tool, the user can select a color and a line thickness and draw an object on the captured image 1022.

The text tool button 1006 is a button for the user to start using the text tool. By using the text tool, the user can generate a text area on the captured image 1022 and input text. The Undo button 1008 is a button for undoing the work performed. The Redo button 1010 is a button for advancing the work returned by the Endo button 1008.

The HTML save button 1012 is a button for locally saving the information of the personal board screen 1000 as an HTML file. The PDF save button 1014 is a button for locally saving the captured image 1022 and the text memo area 1024 displayed in the memo area of the personal board screen 1000 as a PDF file. The capture button 1016 is a button for taking a capture of the projection screen 1040 displayed in the projection area and additionally displaying the sheet 1020 in which the combination of the captured image 1022 and the text memo area 1024 is displayed in the memo area. ..

The object drawn on the captured image 1022 may be deleted by pressing the Delete key or the BackSpace key. Further, the sheet 1020 may also be deleted by pressing the Delete key or the BackSpace key.

During editing such as drawing an object on the captured image 1022 and inputting a text memo on the text memo area 1024, even if the projection area is reduced and the memo area is enlarged so that the editing operation is easy. Good. The projection area may be reduced and the memo area may be enlarged automatically by the web application, or by the user's operation of moving the tool palette to the left.

Further, as shown in FIG. 13, on the personal board screen 1000 during the meeting, the sheet 1020 selected by the user from the memo area may be displayed as the enlarged sheet 1122, or may be displayed in a separate window 1121. It may be. FIG. 13 is an image diagram of an example of a personal board screen 1000 that accepts sheet editing from a user during a meeting.

Further, the sheet 1020 in which the captured image 1022 or the text memo area 1024 is being edited may be surrounded by a frame line or the color of the sheet 1020 may be changed so as to be visually discriminated.

The memo area is not limited to the right side of the personal board screen 1000, and may be displayed on the left side or the lower side. By pressing the capture button 1016, the user takes a capture of the projection screen 1040 displayed in the projection area, and displays the sheet 1020 in which the combination of the captured image 1022 and the text memo area 1024 is displayed. Can be additionally displayed in the memo area.

Further, the personal board screen 1000 that receives the operation of pressing the capture button 1016 from the user a plurality of times displays a plurality of sheets 1020 in the memo area. The personal board screen 1000 is additionally displayed so that a plurality of sheets 1020 are lined up in the vertical direction of the memo area each time the user presses the capture button 1016.

Next, a display example of the personal board screen 1100 after the end of the meeting will be described with reference to FIG. The personal board screen 1100 is a screen for displaying information to be presented to the user by GUI and accepting an operation from the user, and is a display form of a web browser or application software.

FIG. 12 is an image diagram of an example of the personal board screen 1100 after the end of the meeting. The personal board screen 1100 after the meeting shown in FIG. 12 has a memo area similar to that of the personal board screen 1000 on the right side and an enlarged sheet area on the left side. In the enlarged sheet area, the enlarged sheet 1122 of the sheet 1120 selected by the user from the memo area is displayed. The enlarged sheet 1122 can be edited by the user, such as drawing an object in the captured image 1022 and inputting a text memo in the text memo area 1024, as in the case of the conference.

All sheets 1120 are listed vertically in the memo area of the personal board screen 1100. The user can scroll the memo area up and down. The user can display the sheet 1120 selected from the memo area as the enlarged sheet 1122 in the enlarged sheet area on the left side.

As will be described later, the personal terminal 2 that displays the personal board screen 1100 displays the information of the sheet 1120 selected by the user from the memo area and the information of the sheet 1120 displayed as the enlarged sheet 1122 for a certain period of time or longer as the content management server 6. Is sent to and recorded as the number of references on the sheet 1120. Further, the reference count of the sheet 1120 may be considered so that the first sheet, which is more easily displayed in the memo area, is not excessively counted.

Further, the personal terminal 2 may transmit the edited contents to the sheet 1120 or the enlarged sheet 1122 to the content management server 6 at the timing when the click operation other than the selected sheet 1120 or the enlarged sheet 1122 is accepted. .. Further, the display of the memo area as shown in FIG. 12 is an example, and the number or character outline of the sheet 1120 may be displayed instead of the sheet 1120.

<DB configuration>
<< Personal memo management DB >>
FIG. 14 is a configuration diagram of an example of the personal memo management DB 6004. A personal memo management DB 6004 as shown in FIG. 14 is constructed in the storage unit 6000 of the content management server 6. The personal memo management DB 6004 of FIG. 14 manages the personal memo ID, the user ID, the room ID, the sheet ID, and the captured image in association with each other.

The item "personal memo ID" is an example of personal memo identification information that identifies the personal memo dm of the personal board dc. The item "user ID" is an example of user identification information that identifies a user. The item "meeting ID" is an example of meeting identification information that identifies a meeting held in a room. The item "sheet ID" is an example of sheet identification information that identifies the sheets 1020 and 1120. The item “captured image” is an example of image file identification information that identifies an image file in which a capture of the projection screen 1040 is taken.

If the user ID of the user who operates the personal terminal 2 is specified by the personal memo management DB 6004 of FIG. 14, the conference ID and the personal memo ID of the conference held in the room in which the user participates can be specified. it can. Further, the personal memo management DB 6004 of FIG. 14 can identify, for example, the sheet 1020 displayed on the personal board screen 1000 and the image file of the captured image 1022 displayed on the sheet 1020, which are specified from the personal memo ID.

<< Shared memo management DB >>
FIG. 15 is a configuration diagram of an example of the shared memo management DB 6005. A shared memo management DB 6005 as shown in FIG. 15 is constructed in the storage unit 6000 of the content management server 6. The shared memo management DB 6005 of FIG. 15 manages the shared memo ID, the conference ID, and the bibliographic information of the conference in association with each other.

The item "shared memo ID" is an example of shared memo identification information for specifying the shared memo cm of the shared board cc. The item "meeting ID" is an example of meeting identification information that identifies a meeting held in a room. The item "meeting bibliographic information" is the bibliographic information of the meeting specified by the meeting ID. If the conference ID is specified by the shared memo management DB 6005 of FIG. 15, the bibliographic information of the conference can be specified.

<< Personal memo DB >>
FIG. 16 is a configuration diagram of an example of the personal memo DB 2001a. A personal memo DB 2001a as shown in FIG. 16 is constructed in the storage unit 2000a of the personal terminal 2a. Since the personal memo DB 2001a is created in the cache of the web browser, it exists only while the web browser is running.

The data managed by the personal memo DB 2001a is the same as the data for each personal terminal 2 managed by the personal memo DB 6001 in the content management server 6. The personal terminal 2a acquires the data for the personal terminal 2a out of the data of each personal terminal 2 managed by the content management server 6 and manages it in the personal memo DB 2001a. The personal memo DB 2001a of FIG. 16 manages the personal memo ID, the sheet ID, the content ID, the content data, and the display position in association with each other.

The item "personal memo ID" is an example of personal memo identification information that identifies the personal memo dm of the personal board dc. The item "sheet ID" is an example of sheet identification information that identifies the sheets 1020 and 1120. The item "content ID" is an example of content identification information that identifies each content such as a text memo or a drawn object input to the sheets 1020 and 1120.

The item "content data" is data such as text memos and drawn objects input to the sheets 1020 and 1120. For example, the content data of the content ID "c101" is a "text memo" whose type is input to the text memo area 1024 or the like, a font type is "Mincho", a size is "20", and the input text. An example is shown in which the character is "aiueo".

Further, the content data of the content ID "c103" is vector data whose type is drawn on the captured image 1022 or the like, and shows an example in which the vector data is represented by numerical data. In the case of text input to the captured image 1022 or the like by using the text tool, for example, by expressing the type of content data by "text" or the like, the text input to the captured image 1022 or the like and the text memo area 1024 It can be distinguished from the text memo entered in.

The item "display position" indicates the display position of the text memo or the drawn object input to the sheets 1020 and 1120. For example, the display position of the content input to the captured image 1022 or the like is represented by, for example, coordinates. Further, the display position of the text memo input in the text memo area 1024 or the like is represented by, for example, the number of lines and the number of characters.

Since the personal memo DB 6001 has the same data structure as the personal memo DB 2001a, the description thereof will be omitted. However, the personal memo DB 6001 has all the data of the personal memo DB 2001a, 2001b, 2001c.

<< Shared memo DB >>
FIG. 17 is a configuration diagram of an example of the shared memo DB 2002a. A shared memo DB 2002a as shown in FIG. 17 is constructed in the storage unit 2000a of the personal terminal 2a. Since the shared memo DB 2002a is created in the cache of the web browser, it exists only while the web browser is running. Since the shared memo DB 6002 has the same data structure as the shared memo DB 2002a, the description thereof will be omitted.

The data managed by the shared memo DB 2002a is the same as the data managed by the shared memo DB 6002 in the content management server 6. The personal terminal 2a acquires the data managed by the shared memo DB 6002 of the content management server 6 and manages it by the shared memo DB 2002a.

In the shared memo DB 2002a, a set of the content ID, the content data, and the display position of the content data is managed in association with the shared memo ID for specifying the shared memo of the shared board cc.

The item "content ID" is an example of content identification information for identifying each content. The item "content data" is content data such as text input to the shared board cc, pasted images, and vector data obtained by drawing. The item "display position" indicates the display position of the content on the shared board.

<< Interest level management DB >>
FIG. 18 is a configuration diagram of an example of interest level management DB 6003. The interest level management DB 6003 as shown in FIG. 18 is constructed in the storage unit 6000 of the content management server 6. The interest level management DB 6003 of FIG. 18 manages the personal memo ID, the number of streaming captures, the number of capture references, the number of writes, the DL in PDF, the conference participation time, and the conference exit time in association with each other.

The item "personal memo ID" is an example of personal memo identification information that identifies the personal memo dm of the personal board dc. The item "streaming capture count" is the number of times the user has taken a capture of the projection screen 1040 on the personal board screen 1000 of the conference specified by the personal memo ID.

The item "capture reference count" is an example of the reference count of the total number of captures and the reference for each capture as an example of the reference count of the user referring to the sheet 1120 on the personal board screen 1100 of the conference specified by the personal memo ID after the conference. It represents the number of times and the reference time.

The number of references and the reference time for each capture are the number of times and the date and time for each sheet 1120 in which the user referred to the sheet 1120 on the personal board screen 1100 of the conference specified by the personal memo ID. The number of references to the total number of captures is the total number of times for each sheet 1120 that the user referred to the sheet 1120.

The item "number of writes" is the number of writes written by the user on the sheet 1020 or 1120 on the personal board screen 1000 or 1100 of the conference specified by the personal memo ID. In the interest level management DB 6003 of FIG. 18, as an example of the number of writes, the total number of text characters for each personal memo, the number of text characters for each capture in the personal memo, the number of handwritten objects (lines, stamps, etc.), and the number of handwritten objects (lines, stamps, etc.) in the personal memo. It represents the number of handwritten objects for each capture and the number of handwritten characters for each capture.

The total number of text characters for each personal memo is the total number of text characters obtained by adding the number of text characters for each text memo area 1024 such as the sheet 1020. The number of text characters for each capture in the personal memo is the number of text characters for each text memo area 1024 such as the sheet 1020.

The number of handwritten objects (lines, stamps, etc.) is the total number of objects obtained by adding the number of handwritten objects for each captured image 1022 such as the sheet 1020. The number of handwritten objects for each capture in the personal memo is the number of handwritten objects for each captured image 1022 such as the sheet 1020. The number of handwritten characters for the capture is the total number of characters obtained by adding the number of handwritten characters for each captured image 1022 such as the sheet 1020.

The item "DL with PDF" indicates whether or not the captured image 1022 and the text memo area 1024 displayed in the memo area of the personal board screen 1000 are locally saved (downloaded) as a PDF file by the above-mentioned PDF save button 1014. Represents.

The item "meeting participation time" represents the date and time when the user joined the room from the personal board screen 1000. The conference participation time is the time when the content management server 6 is accessed from the personal terminal in FIG. 23 to connect to the conference in S32 or S48, or the time when the user is invited to join the conference in S34 or S49. It is recorded by registering it as the meeting participation time in association with the user ID or personal memo ID. The meeting participation time may be stored together with the processing of S34 and S49.

In addition, the item "meeting exit time" indicates the date and time when the user left the room. The meeting exit time is the time when the content management server 6 is accessed from the personal terminal in FIG. 29 to exit the conference in S202 or S216, the time when the user is exited from the conference in S204 or S206, or the like. , The time when the content management server 6 detects that there is a disconnection between the personal terminal and the content management server 6 or a disconnection between the Web browser of the personal terminal and the personal board of the content management server 6. It is recorded by registering it as the meeting exit time in association with each user ID or personal memo ID. The meeting exit time may be stored in the processing of S204 or S206.

If a participant with the same user ID participates in and leaves the conference multiple times in one conference, all the conference participation times and conference exit times may be memorized and displayed, or the conference participation time may be displayed. It is also possible to memorize only the first time for the time, while updating the meeting exit time to the last one, and record and display only one conference participation time and conference exit time.

<< Meeting Linkage DB >>
FIG. 19 is a configuration diagram of an example of the conference association DB6008. A conference association DB 6008 as shown in FIG. 19 is constructed in the storage unit 6000 of the content management server 6. The conference association DB 6008 of FIG. 19 manages the identifier and the conference ID in association with each other.

The item "identifier" may be any identification information available to users participating in the same conference, such as the ID of the permanent terminal 4 that identifies the permanent terminal 4. The requirement for the identifier is that it is unique in the content management server 6.

Therefore, the identifier may be, for example, the MAC address of the LAN or an arbitrary PIN code, or any arbitrary person such as "apple", "first sales department", or "●● dedicated" that does not overlap with other people. It may be a character string.

In this embodiment, no restrictions are set on the form or type of the identifier. The item "meeting ID" is an example of meeting identification information that identifies a meeting held in a room. The conference ID is recreated every time the conference held in the room ends.

Unless during a conference, the identifier of the conference association DB6008 in FIG. 19 is not associated with the conference ID. Further, if the conference is in progress, the identifier of the conference association DB 6008 in FIG. 19 is associated with the conference ID. Therefore, the content management server 6 can determine whether or not a conference associated with the identifier is being held by referring to the conference association DB 6008 of FIG.

<< Meeting DB >>
FIG. 20 is a configuration diagram of an example of the conference DB 6006. A conference DB 6006 as shown in FIG. 20 is constructed in the storage unit 6000 of the content management server 6. The conference DB 6006 of FIG. 20 manages the conference ID, the conference name, the conference room, the participating users, and the status in association with each other. The item "meeting ID" is an example of meeting identification information that identifies a meeting held in a room.

The item "meeting name" is the name of the meeting specified by the meeting ID. The item "meeting room" is an example of identification information indicating a place such as a meeting room in which the permanent terminal 4 is installed. The item "participating user" represents an array of user IDs of users who participated in the conference specified by the conference ID. The item "status" represents the status of the conference (for example, during the conference, the end of the conference, etc.) specified by the conference ID. The conference DB 6006 of FIG. 20 can identify the user ID of the user who participated in the conference specified by the conference ID.

<< User DB >>
FIG. 21 is a configuration diagram of an example of the user DB 6007. A user DB 6007 as shown in FIG. 21 is constructed in the storage unit 6000 of the content management server 6. The user DB 6007 in FIG. 21 manages the user ID, the user name, and the email in association with each other. The item "user ID" is an example of user identification information that identifies a user. The item "user name" is the name of the user specified by the user ID. The item "email" is a user's email address specified by the user ID.

<Processing or operation>
Subsequently, the processing or operation of the present embodiment will be described. In the present embodiment, in a conference held in a room, an example of a user who operates the personal terminal 2b by streaming transmission to the shared screen ss by a presenter (user A) who is an example of a user who operates the personal terminal 2a. An example in which a participant (user B) who is a participant (user B) participates in a conference will be described.

FIG. 22 is a flowchart of an example showing the processing of the information sharing system according to the present embodiment. In step S10, the information sharing system prepares for the meeting. In the conference preparation, based on the connection (participation) from the personal terminal 2a and the personal terminal 2b to the room, the conference to be held in the room is created, and the user participates in the conference to be held in the room. The personal board screen 1000 as shown in FIG. 8 is displayed on the personal terminal 2a and the personal terminal 2b connected to the room.

In step S12, a meeting is held in the information sharing system. In response to the request from the presenter's personal terminal 2, the information sharing system performs streaming transmission to the conference sharing screen ss, and causes each personal terminal 2 to display the projection screen 1040 as shown in the personal board screen 1000 of FIG. .. While referring to the projection screen 1040 displayed on the personal board screen 1000, the participant performs an operation of pressing the capture button 1016 displayed on the personal board screen 1000 at the timing when he / she wants to take a capture.

The personal board screen 1000 that has received the operation of pressing the capture button 1016 by the participant captures the captured image 1022 of the projection screen 1040 at that time. Then, for example, like the memo area of the personal board screen 1000 shown in FIG. 11, the captured image 1022 and the text memo area 1024 attached to the captured image 1022 are displayed on one sheet 1020.

In this way, the participant can additionally display the captured image 1022 of the projection screen 1040 and the text memo area 1024 accompanying the captured image 1022 in the memo area at an arbitrary timing. Participants enter memos such as inputting text memos in the text memo area 1024 displayed in the memo area as shown in FIG. 11 and drawing objects (inputting handwritten memos) in the captured image 1022 displayed in the memo area. I do. The contents of the various DBs described above are updated according to the contents of the memo entry.

In step S14, in the information sharing system, by displaying the personal board screen 1100 as shown in FIG. 12 on each personal terminal 2, the participant browses the personal memo dm in which the memo is entered during the meeting (review of the memo). And can look back on the memos of the meeting. Note that the personal board screen 1100 as shown in FIG. 12 can be edited by the user, such as drawing an object in the captured image 1022 and inputting a text memo in the text memo area 1024, as in the case of the conference. The information on the review of the memo of the meeting by the participants is transmitted to the content management server 6 for updating the interest level management DB 6003.

Further, in step S16, in the information sharing system, the display and utilization of the degree of interest of the participants in the contents of the meeting will be described later based on how the participants take the personal memo dm and look back on the personal memo dm. To do.

For example, the display of the degree of interest of participants in the content of the conference may be viewed not only by the presenter and the organizer but also by the participants by abstracting the content. In addition, the display of the degree of interest of the participants in the content of the conference may be viewed only by the presenter or the organizer by restricting access. Presenters and organizers can view the degree of interest of participants in the content of the conference and utilize it for approaching participants (sales, etc.) and feedback to the next conference as described later.

According to steps S12 and S14, the operability and usability of the user can be improved by the UI that makes it easy to take personal memo dm. Further, according to step S16, by visualizing and providing the degree of interest of the participants in the content of the meeting, it is possible to promote the utilization for the approach to the participants (sales, etc.) and the feedback to the next meeting.

FIG. 23 is a sequence diagram of an example of the process from the conference preparation to the display of the personal board screen 1000. FIG. 23 shows a case where the permanent terminal 4 is used. In step S20, the permanent terminal 4 is in a state of being able to perform two-way communication with the content management server 6 at all times regardless of whether or not a meeting is being held.

For example, the permanent terminal 4 may display the address bar 5500 as shown in FIG. 24 and inform the users participating in the conference of the connection address of the content management server 6 and the ID of the permanent terminal 4. FIG. 24 is an image diagram of an example of the address bar 5500 displayed on the permanent terminal 4. The address bar 5500 has a button 5502, a capture button 5506, a two-dimensional code display button 5508, a connection address 5510 including the ID of the permanent terminal 4, and an exit button 5512.

Button 5502 is a button that omits / displays the right side from button 5502 of the address bar 5500. The capture button 5506 is a button that captures the shared screen ss and pastes it on the shared memo cm. The two-dimensional code display button 5508 is a button that displays the connection address 5510 including the ID of the permanent terminal 4 with a two-dimensional code. The user can input the connection address 5510 including the ID of the permanent terminal 4 to the personal terminal 2 by photographing the two-dimensional code with the personal terminal 2. The exit button 5512 is a button for exiting the conference in which the permanent terminal 4 is participating.

For example, the address bar 5500 is displayed by an application mounted on the permanent terminal 4 (including the case where it is mounted on a stick PC 730 connected to the permanent terminal 4). A similar function may be realized by a web application. Further, the application mounted on the permanent terminal 4 may be provided by using a cloud service. When the participant recognizes the connection address 5510 including the ID of the permanent terminal 4 in advance, the permanent terminal 4 is not necessarily indispensable.

In step S22, the presenter (user A) who operates the personal terminal 2a activates the web browser. In step S24, the presenter who operates the personal terminal 2a inputs the connection address 5510 including the ID of the permanent terminal 4 displayed by the permanent terminal 4 into the web browser to instruct the start of the conference.

Proceeding to step S26, the personal terminal 2a accesses the content management server 6 based on the connection address 5510 including the ID of the permanent terminal 4 input to the web browser, and enters the conference associated with the ID of the permanent terminal 4. Requests for participation and establishment of WebSocket communication. WebSocket communication is a communication method different from HTTP for performing two-way communication (socket communication) between a web server and a web browser.

According to the WebSocket communication, a TCP connection is established between the content management server 6 and the personal terminal 2 while the page (here, the personal board screen 1000) to be the target of the WebSocket communication is displayed, and the content management server 6 And the web browser of the personal terminal 2 continue to communicate at the timing. That is, at the time of accessing the personal board screen 1000, communication is performed by HTTP including the handshake. Further, after opening the personal board screen 1000, the communication is switched to WebSocket communication to perform two-way communication. When the personal board screen 1000 is closed, the WebSocket communication of the page ends.

Proceeding to step S28, the content management server 6 refers to the conference linking DB 6008 of FIG. 19 to see whether or not a meeting linked to the ID of the permanent terminal 4 passed from the personal terminal 2a is being held in the participation request of step S26. To judge. Here, the description will be continued on the assumption that the meeting associated with the ID of the permanent terminal 4 has not been held. Since the conference associated with the ID of the permanent terminal 4 is not held, the content management server 6 creates a conference, links the conference ID of the created conference with the ID of the permanent terminal 4, and associates the conference ID of FIG. 19 with the conference association DB6008. Set to.

Further, the content management server 6 stores the conference data as shown in FIG. 25 (A) in the conference DB 6006, for example. FIG. 25 is a configuration diagram of an example of conference data stored in the conference DB 6006. The content management server 6 returns the conference URL and the conference ID, which are examples of the information for participating in the conference created in step S28, to the personal terminal 2a.

In step S30, the presenter operates the personal terminal 2a to instruct the connection to the conference. Proceeding to step S32, the personal terminal 2a requests the content management server 6 to connect to the conference by using the conference URL and the conference ID returned from the content management server 6 and the user ID of the presenter.

Proceeding to step S34, the content management server 6 registers the user ID of the presenter in the field of participants (Participants) provided in the conference data of FIG. 25 (B), for example. That is, the user ID registered in the field of the participants of the conference data stored in the conference DB 6006 represents the participants participating in the conference of the conference data.

The content management server 6 notifies the presenter who operates the personal terminal 2a that he / she has participated in the conference by causing the personal terminal 2a to display the display as shown in FIG. 9A on the upper right of the personal board screen 1000, for example. .. Further, in step S36, the content management server 6 notifies the permanent terminal 4 already connected to the conference of the participation of a new user. Proceeding to step S38, the permanent terminal 4 displays the participation of a new user.

In step S40, the participant (user B) who operates the personal terminal 2b activates the web browser. In step S42, the participant who operates the personal terminal 2b inputs the connection address 5510 including the ID of the permanent terminal 4 displayed by the permanent terminal 4 into the web browser to instruct the participant to participate in the conference.

Proceeding to step S44, the personal terminal 2b accesses the content management server 6 based on the connection address 5510 including the ID of the permanent terminal 4 input to the web browser, and enters the conference associated with the ID of the permanent terminal 4. Requests for participation and establishment of WebSocket communication. The content management server 6 determines whether or not a meeting associated with the ID of the permanent terminal 4 passed from the personal terminal 2b is being held in the participation request of step S44 with reference to the conference association DB 6008 of FIG. Here, since the conference ID of the conference created in step S28 and the ID of the permanent terminal 4 are associated and set in the conference association DB6008 of FIG. 19, the conference associated with the ID of the permanent terminal 4 is performed. It is determined that there is. Therefore, the content management server 6 does not create a conference.

In step S46, the participant operates the personal terminal 2b to instruct the connection to the conference. Proceeding to step S48, the personal terminal 2b requests the content management server 6 to connect to the conference by using the conference URL and the conference ID returned from the content management server 6 and the user ID of the participant.

Proceeding to step S49, the content management server 6 registers the user ID of the participant who operates the personal terminal 2b in the field of the participant (Participants) provided in the conference data of FIG. 25C, for example. The content management server 6 notifies the participants who operate the personal terminal 2b that they have participated in the conference by causing the personal terminal 2b to display the display as shown in FIG. 9 (A) on the upper right of the personal board screen 1000, for example. ..

Further, in step S50, the content management server 6 notifies the permanent terminal 4 already connected to the conference of the participation of a new user. Proceeding to step S52, the permanent terminal 4 displays the participation of a new user. Further, in step S54, the content management server 6 notifies the personal terminal 2a already connected to the conference of the participation of a new user. Proceeding to step S56, the personal terminal 2a displays the participation of a new user.

The sequence diagram of FIG. 23 is an example. For example, the process of step S26 based on the connection address 5510 including the ID of the permanent terminal 4 is performed, the access to the content management server 6 and the request for establishing WebSocket communication, and the permanent terminal 4 It may be performed separately from the request for participation in the conference associated with the ID of.

In addition, the participation request by the participants is such that the connection address displayed on the permanent terminal 4 is input to the browser on each of the plurality of personal terminals as described above, and the two-dimensional code displayed on the permanent terminal 4 is input on each personal terminal. It is also possible by methods other than requesting participation based on shooting.

For example, by installing a short-range wireless device equipped with a short-range wireless function such as NFC or BLE in a conference room and holding each individual terminal over the short-range wireless device, a connection including an address and a terminal ID can be performed. It is also possible to acquire the information of the above from a short-range wireless device to each personal terminal and request participation from the browser of each personal terminal.

In this case, according to the acquisition of the connection information from the short-range wireless device, the browser of the personal terminal is activated and the connection information is passed to the browser for access, and the personal board or authentication information input screen ( A screen such as the login screen) may be automatically opened on the browser. In addition, a device that visually displays the connection address and two-dimensional code to participants, a short-range wireless device that acquires connection information, etc. are installed simultaneously in one conference room, and multiple participation request methods can be used in one conference. It is also possible to have it.

FIG. 26 is a sequence diagram of an example of processing until the projection screen 1040 is displayed on the personal board screen 1000. Proceeding to step S142, the presenter who operates the personal terminal 2a selects a target to be screen-transmitted from the screen 1200 as shown in FIG. 27 to the shared screen ss, for example. FIG. 27 is an image diagram of an example of a screen for selecting a target to be screen-transmitted to the shared screen ss. The screen of FIG. 27 shows an example of targeting the target to be screen-transmitted to the shared screen ss from "share the full screen", "share the window of the application", and "share the tab of the browser".

Screen 1200 in FIG. 27 is an example in which the presenter selects "Share full screen". The screen 1200 shows an example in which the "screen 1" of the entire desktop or another screen "screen 2" displayed on the dual display is an option. In addition, when "Share application window" is selected on the screen 1200, a plurality of running applications (including an application that displays material files for meetings and presentations) are displayed as options. In addition, when "Share browser tab" is selected on the screen 1200, the tab of the running web browser is displayed as an option.

Proceeding to step S144, the personal terminal 2a specifies the conference ID or the personal board ID, and transmits the streaming of the target to be screen-transmitted to the shared screen ss of the specific conference by WebRTC. WebRTC is a standard that realizes high-speed data communication via a web browser, and is one of HTML's APIs. WebRTC can send and receive large-capacity data such as video and audio in real time.

Proceeding to step S146, the content management server 6 performs streaming distribution by WebRTC to the personal terminal 2a, the personal terminal 2b, and the personal board screen 1000 of the permanent terminal 4 associated with the conference ID specified in step S144.

In step S148, the personal terminal 2a can display the streamed projection screen 1040 in the projection area of the personal board screen 1000 displayed by the web browser, for example, as shown in FIG. Further, in step S150, the personal terminal 2b can display the streamed projection screen 1040 in the projection area of the personal board screen 1000 displayed by the web browser, for example, as shown in FIG. Further, in step S152, the permanent terminal 4 can display the streamed projection screen 1040 in the projection area of the personal board screen 1000 displayed by the web browser, for example, as shown in FIG.

For example, a participant who operates the personal terminal 2b can capture the captured image 1022 of the projection screen 1040 and make a memo to the captured image 1022 and the text memo area 1024 by the procedure shown in the sequence diagram of FIG. 28.

FIG. 28 is a sequence diagram of an example of a process of capturing the captured image 1022 of the projection screen 1040 and making a memo in the captured image 1022 and the text memo area 1024.

Participants who operate the personal terminal 2b in step S60 perform an operation of pressing the capture button 1016. The personal terminal 2b makes a capture shooting request to the content management server 6. In step S62, the content management server 6 captures the capture of the projection screen 1040 at that time, and returns the image file of the captured captured image 1022 to the personal terminal 2b.

In the sequence diagram of FIG. 28, the content management server 6 captures the projection screen 1040, but the personal terminal 2b or the permanent terminal 4 may capture the capture of the projection screen 1040. For example, when the permanent terminal 4 captures the projection screen 1040, the content management server 6 that receives the capture capture request from the personal terminal 2b makes a capture capture request to the permanent terminal 4.

The permanent terminal 4 takes a capture of the projection screen 1040 and returns the image file of the captured captured image 1022 to the content management server 6. The content management server 6 transmits the returned image file of the captured image 1022 to the personal terminal 2b. When the permanent terminal 4 captures the projection screen 1040 in this way, for example, the presenter or the participant can capture the capture of the projection screen 1040 that can be viewed simultaneously on the permanent terminal 4.

The personal terminal 2b that has received the image file of the captured image 1022 from the content management server 6 proceeds to step S66, and additionally displays the captured image 1022 of the projection screen 1040 in the memo area using the received image file, for example, as shown in FIG. To do. Further, the personal terminal 2b displays the text memo area 1024 attached to the captured image 1022 on the same sheet 1020 as the additionally displayed captured image 1022, as shown in FIG. 11, for example.

Proceeding to step S68, the participant who operates the personal terminal 2b draws an object on the captured image 1022 on the additionally displayed sheet 1020 and inputs a text memo to the text memo area 1024.

In the sequence of FIG. 28, only the image file of the captured image 1022 is transmitted from the content management server 6 to the personal terminal 2b. In this case, Javascript, which is included in the data of the web page and operates on the browser of the personal terminal 2b, may create a text memo area.

Further, the content management server 6 may transmit the data of the sheet 1020 including the image of the captured image 1022 and the text memo area 1024. Further, the display position of the captured image 1022 and the sheet 1020 at this time may be determined by a program such as a script executed by the browser of the personal terminal 2b, or the content management server 6 specifies the display position and is an individual. It may be transmitted to the terminal 2b.

Further, the content management server 6 may generate a sheet 1020 in which the acquired image of the captured image 1022 and the text memo area 1024 are combined. The area of the sheet 1020 other than the captured image 1022 and the text memo area 1024 can be an area where handwriting can be performed or an area where handwriting cannot be performed.

When a sheet other than the additionally displayed sheet 1020 (selected sheet 1020) is clicked, the personal terminal 2b determines that the editing is temporarily completed, and proceeds to step S70. In step S70, the personal terminal 2b transmits the information regarding the additionally displayed sheet 1020 and the edited contents for the sheet 1020 to the content management server 6. In step S70, the personal terminal 2b may transmit the information about all the sheets 1020 and the edited contents for all the sheets 1020 to the content management server 6.

The content management server 6 updates the contents of the various DBs described above by the received information about the sheet 1020 and the edited contents for the sheet 1020. In this way, the captured image 1022 captured on the personal board screen 1000, the handwritten memo on the captured image 1022, and the text memo input in the text memo area 1024 are associated with each other by the sheet 1020 and saved in the content management server 6. Will be done.

FIG. 29 is a sequence diagram of an example of a process in which a user leaves the ongoing conference and the conference ends. FIG. 29 shows a case where the permanent terminal 4 is used. In step S200, the participant who operates the personal terminal 2b performs an exit operation to exit the conference and instructs the participant to exit the conference.

Proceeding to step S202, the personal terminal 2b requests the content management server 6 to leave the conference using the conference ID and the user ID. The content management server 6 proceeds to step S204, and selects, for example, the user ID of the participant who is the user B of the personal terminal 2b from the field of the participant provided in the conference data of FIG. 30 (A).

Then, the content management server 6 assigns the exit flag "left" to the user ID of the participant of the personal terminal 2b registered in the field of the participant, so that the participant who is the user B of the personal terminal 2b can be assigned. Exit the meeting. The exited flag "left" indicates that the user who has participated in the conference once has already exited the conference. When a user who has left the conference rejoins the same conference, the exit flag "left" is deleted. In addition to the case where the personal terminal 2b explicitly requests to leave as in step S202, the content management server 6 determines that the session between the personal terminal 2b and the content management server 6 has expired, that is, Even if there is no notification from the personal terminal 2b for a certain period of time or more, it is determined that the participant corresponding to the personal terminal 2b whose session has expired has left the meeting. Therefore, even when the session between the personal terminal 2b and the content management server 6 is terminated, the exit flag "left" is added to the user ID corresponding to the personal terminal 2b whose session has expired. Here, the exit flag "left" may be added to the user ID corresponding to the personal terminal 2b whose session has expired, even after a certain period of time has passed since the session expired, and the content is managed from the personal terminal 2b within a certain time. When the server 6 is reconnected, the exit flag "left" may not be added.

Further, in step S206, the content management server 6 notifies the permanent terminal 4 connected to the conference of the exit of the user B. Proceeding to step S208, the permanent terminal 4 displays the exit of the user B. Further, in step S210, the content management server 6 notifies the personal terminal 2a connected to the conference of the exit of the user B. Proceeding to step S212, the personal terminal 2a displays the exit of the user B.

In step S214, the presenter, who is the user A who operates the personal terminal 2a, performs an exit operation to exit the conference and instructs the exit from the conference. Proceeding to step S216, the personal terminal 2a requests the content management server 6 to leave the conference using the conference ID and the user ID. The content management server 6 proceeds to step S218, and selects, for example, the user ID of the participant of the personal terminal 2a from the field of the participant provided in the conference data of FIG. 30 (B).

Then, the content management server 6 assigns the exit flag "left" to the user ID of the presenter of the personal terminal 2a registered in the participant's field, thereby causing the participant of the personal terminal 2a to leave the conference.

Further, in step S220, the content management server 6 notifies the permanent terminal 4 connected to the conference of the exit of the presenter. Proceeding to step S222, the permanent terminal 4 displays the exit of the presenter (user A).

In step S224, the content management server 6 considers that the meeting has ended because the exit flag "left" is given to all the user IDs registered in the participant's field. The content management server 6 terminates the conference by adding the conference end flag "Finished" to the conference data shown in FIG. 30C.

Further, in step S226, the content management server 6 notifies the permanent terminal 4 connected to the conference of the end of the conference. The process proceeds to step S228, and the permanent terminal 4 displays the end of the conference. When the conference end flag "Finished" is given to the conference data, the conference ID managed in association with the ID of the permanent terminal 4 which is an example of the identifier is deleted in the conference association DB 6008 of FIG.

In addition, when the exit flag is given to all user IDs and the meeting end flag is given to the meeting data, if there is a shared screen during the meeting displayed on the permanent terminal 4, the shared screen is displayed. The screen may be deleted or changed to another screen such as a screen for the next meeting or a standby screen such as a service guidance screen.

Therefore, when a request to participate in the conference associated with the ID of the permanent terminal 4 is made after the conference is completed, the content management server 6 determines that the conference associated with the ID of the permanent terminal 4 is not being held. Create a new meeting.

In this way, in the information sharing system according to the present embodiment, by managing the withdrawal of the participants who participated in the conference from the conference, the conference can be terminated by the withdrawal of all the participants who participated in the conference. it can. In step S224, when the exit flag "left" is given to the user IDs of all the participants participating in the conference, it is determined that the conference has ended. However, in determining the end of the conference, the conference is further determined. After the exit flag "left" is given to the user IDs of all the participants participating in the conference, it may be determined that the conference has ended when a predetermined fixed time has elapsed. As a result, if a participant accidentally presses the exit button, or if the browser is accidentally closed, the conference can be continued by reconnecting within a certain period of time, and the end of the conference can be determined. It is possible to improve the accuracy of.

If the leaving user is the presenter (or organizer), that is, if the role of the leaving user is the presenter or the organizer, content management is performed even if the participants of other conferences have not left. The server 6 may stop the screen sharing function, hide the button for starting screen sharing, or change the display color. This may prevent a person who is not the presenter from accidentally starting screen sharing.

Participants and presenters can look back on the memos of the conference and display and utilize the degree of interest of the participants in the content of the conference as follows, for example. In addition, here, an example in which a participant looks back on the memo of the meeting from the personal terminal 2b will be described.

FIG. 31 is a sequence diagram of an example of a process in which a participant looks back on a memo of a meeting from a personal terminal 2b. In step S80, the participant who operates the personal terminal 2b performs an access operation to the personal portal screen 5000 as shown in FIG. 32. FIG. 32 is a diagram showing a display example of the personal portal screen 5000.

The personal portal screen 5000 of FIG. 32 displays a list 5010 of meetings in which participants who operate the personal terminal 2b participated. The conference list 5010 can be created by using the personal memo management DB 6004, the shared memo management DB 6005, and the interest level management DB 6003 described above.

In the example of the conference list 5010 of FIG. 32, the date and time, the conference name, the place, the personal memo button 5030, the shared memo button 5040, the self-evaluation, and the bibliographic information button 5050 are displayed as items for each conference. According to the personal portal screen 5000 of FIG. 32, the participant can confirm the list 5010 of the conference in which he / she participated. Self-evaluation is an example of evaluation information.

The personal memo button 5030 is linked to the personal board screen 1100 that displays the personal memo dm of the conference. The shared memo button 5040 is linked to a shared memo screen that displays the shared memo cm of the conference. The bibliographic information button 5050 is linked to the bibliographic information screen 5100 that displays the bibliographic information of the conference.

When the bibliographic information button 5050 on the personal portal screen 5000 is pressed, the personal terminal 2b displays the bibliographic information screen 5100 corresponding to the pressed bibliographic information button 5050. FIG. 33 is a diagram showing a display example of the bibliographic information screen 5100. The "holding information" displayed at the upper part of the bibliographic information screen 5100 is, for example, the "meeting bibliographic information" of the shared memo management DB 6005 of FIG. Further, the "capture information" displayed at the bottom of the bibliographic information screen 5100 is created by using, for example, the interest level management DB 6003 of FIG. The details of the "capture information" displayed at the bottom of the bibliographic information screen 5100 will be described later.

The access operation to the personal portal screen 5000 in step S80 may be to input the connection address to the personal portal screen 5000 into the web browser or to select the personal portal screen 5000 using the bookmark.

Proceeding to step S82, the web browser of the personal terminal 2b accesses the personal portal screen 5000. In step S84, the content management server 6 performs an authentication process for the participant who operates the personal terminal 2b. Here, the explanation will be continued assuming that the authentication is successful. The content management server 6 proceeds to step S86 and reads the data for the personal portal screen 5000 from the storage unit 6000.

For example, the content management server 6 identifies the conference ID corresponding to the conference in which the user participates from the personal memo management DB 6004 of the storage unit 6000 using the user ID of the authenticated participant as a key. Further, the content management server 6 specifies the bibliographic information of the conference from the shared memo management DB 6005 of the storage unit 6000 using the specified conference ID as a key.

In this way, if the user ID of the participant can be specified, the content management server 6 can acquire the data necessary for creating the personal portal screen 5000 of FIG. 32 from various DBs of the storage unit 6000.

Proceeding to step S88, the content management server 6 creates the data of the web page of the personal portal screen 5000 from the acquired data for the personal portal screen 5000. Proceeding to step S90, the content management server 6 transmits the data of the web page for the personal portal screen 5000 to the personal terminal 2b.

Proceeding to step S92, the personal terminal 2b can display the personal portal screen 5000 as shown in FIG. 32. On the personal portal screen 5000 of FIG. 32, a list 5010 of the conferences in which the participants operating the personal terminal 2b participated is displayed. In step S94, the participant who operates the personal terminal 2b presses the personal memo button 5030 of the conference for which he / she wants to display the personal board screen 1100.

Proceeding to step S96, the web browser of the personal terminal 2b makes a request to the content management server 6 for the personal board screen 1100 linked to the personal memo button 5030 that has received the operation to be pressed. Proceeding to step S98, the content management server 6 creates the data of the web page of the personal board screen 1100 requested from the personal terminal 2b. Proceeding to step S100, the content management server 6 transmits the data of the web page for the personal board screen 1100 to the personal terminal 2b.

Proceeding to step S102, the personal terminal 2b can display the personal board screen 1100 as shown in FIG. Here, the participant of the personal terminal 2b selects the sheet 1120 of the personal board screen 1100, and makes a handwritten memo on the captured image 1022 of the selected sheet 1120 and a text memo on the text memo area 1024 (writing on the sheet 1120). I will explain it as if I had done it.

In step S104, the participant of the personal terminal 2b selects the sheet 1120 of the personal board screen 1100 and writes to the selected sheet 1120. The capture reference information regarding the sheet 1120 referred to by the participants of the personal terminal 2b in step S104 and the information written to the selected sheet 1120 are transmitted from the personal terminal 2b to the content management server 6 in step S106.

The capture reference information is, for example, when the personal terminal 2b determines that a specific captured image is displayed on the screen of the personal terminal 2b, the content management server provides the capture reference information indicating that the captured image is displayed once. 6 may be transmitted, or when it is determined by the personal terminal 2b that the specific captured image is displayed in a specific area of the personal terminal 2b, for example, an area within a certain range from the center of the screen of the personal terminal 2b for a certain period of time or longer. The capture reference information indicating that the captured image has been displayed once may be transmitted to the content management server 6.

The capture reference information can also include the display time of the captured image. The personal terminal 2b may count the display time of the captured image if it is displayed on any of the screens of the personal terminal 2b, or a specific area of the screen of the personal terminal 2b, for example, a certain range from the center. You may want to count only the time displayed in the area of.

Proceeding to step S108, the content management server 6 updates the interest level management DB 6003 and the like in FIG. 18 based on the capture reference information and the written information (review information of the conference memo by the participants) received from the personal terminal 2b.

Further, here, in step S110, the participant of the personal terminal 2b presses the bibliographic information button 5050 of the conference in which he / she wants to display the bibliographic information screen 5100. Proceeding to step S112, the web browser of the personal terminal 2b makes a request to the content management server 6 for the bibliographic information screen 5100 corresponding to the bibliographic information button 5050 that has received the operation to be pressed.

Proceeding to step S114, the content management server 6 creates the data of the web page of the bibliographic information screen 5100 requested from the personal terminal 2b. Proceeding to step S116, the content management server 6 transmits the data of the web page for the bibliographic information screen 5100 to the personal terminal 2b. Proceeding to step S118, the personal terminal 2b can display the bibliographic information screen 5100 as shown in FIG. 33.

Although the sequence diagram of FIG. 31 shows an example in which the user of the personal terminal 2b displays the bibliographic information screen 5100 of FIG. 33, the presenter of the personal terminal 2a may display the bibliographic information screen 5100 of FIG. Good. Further, the content displayed on the bibliographic information screen 5100 of FIG. 33 may be changed depending on the role of the presenter, the participant, the organizer, or the like of the user who operates the personal terminal 2.

Further, the bibliographic information screen 5100 of FIG. 33 uses "capture information" as shown in FIG. 34 or 35, for example, and the interest level management DB 6003 of FIG. 18 to indicate the degree of interest in the presentation contents of the participants and the like. By displaying "information", it is possible to display and utilize the degree of interest of participants in the content of the conference.

FIG. 34 is an explanatory diagram of an example of the captured information of the bibliographic information screen 5100. FIG. 34 shows the captured image 1022 of the projection screen 1040 captured by any participant in the conference and the number of times the captured image 1022 is captured. According to the capture information shown in FIG. 34, the projection screen 1040 of high interest can be measured based on the captured image 1022 of the captured projection screen 1040 and the number of captures of the captured image 1022.

FIG. 35 is an explanatory diagram of an example of the captured information of the bibliographic information screen 5100. In FIG. 35, the captured image 1022 of the projection screen 1040 captured at the conference and the content of the text memo input to the text memo area 1024 accompanying the captured image 1022 are displayed for each participant. Further, in FIG. 35, the meeting participation time, the meeting exit time, and the degree of interest are displayed for each participant.

The degree of interest is displayed by calculating a relative evaluation based on, for example, the number of captured images 1022, the number of memos, the length of the meeting participation time, and the like. The content of the captured information on the bibliographic information screen 5100 may be changed based on the roles of the organizer, presenter, participant, etc. who operate the personal terminal 2. For example, if it is an organizer or a presenter, the capture information of all the participants may be displayed, or if it is a participant, only the capture information of each participant may be displayed.

In the example of FIG. 35, since the number of captured images 1022 of the user ID “User-a” is larger than that of other participants and the number of memos is larger than that of other participants, the meeting participation time is also longer than that of other participants. It can be judged that the degree of interest in the content of the meeting is higher than that of other participants. The captured information displayed at the bottom of the bibliographic information screen 5100 may be, for example, a part or all of the information of the interest level management DB 6003 of FIG.

Bibliographic information including captured images, memos, meeting participation time, meeting exit time, and meeting interest level is generated for each meeting and for each user. For example, when the user ID "User-a" participates in the conference X and exits, and joins a new conference Y, the content management server sends the user ID "User-a" from the personal terminal before leaving the conference X. Based on the bibliographic information (capture information / interest level information) created based on the acquired information such as captured images, and the information acquired by the content management server from the personal terminal with the user ID "User-a" after participating in the conference Y. Two bibliographic information, the created bibliographic information (capture information / interest level information), is generated, and these are displayed as different bibliographic information.

<Summary>
According to the information sharing system according to the present embodiment, the concept of a real conference and the concept of a virtual conference room (room) where the actual conference was held can be associated one-to-one, and the conference reservation can be made. The conference in the information sharing system can be terminated when the number of participants in the virtual conference room becomes 0 without relying on the system or the user's instruction to end the conference.

Therefore, it is possible to avoid confusion of a real conference held in a virtual conference room. For example, even if the previous real-life meeting ends and the next real-life meeting is started, it is not confused as if the previous real-life meeting is continuing, and the shared memo cm of the previous real-life meeting is the next. It will not be reflected as a shared memo cm in an actual meeting. Even if another conference is held continuously in the same place (meeting room), the conference information is leaked without leaving the information of the previous conference on the screen because the conference is automatically terminated by judging the exit of each terminal. Can also be prevented.

[Other Embodiments]
Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and substitutions can be added without departing from the gist of the present invention. For example, the information sharing system according to this embodiment can be used in the following situations.

In the general seminar, the customer corresponds to the participant of this embodiment, and the sales representative corresponds to the presenter or organizer of this embodiment, and the interest of the participant can be visualized. In school use, the student corresponds to the participant of this embodiment, the teacher corresponds to the presenter or organizer of this embodiment, and the degree of concentration of the student in the lesson can be analyzed. In the general meeting, the employee corresponds to the participant of this embodiment, the manager corresponds to the presenter and the organizer of this embodiment, and the manager can grasp the meeting situation in the company.

Each function of the embodiment described above can be realized by one or more processing circuits. Here, the "processing circuit" in the present specification is a processor programmed to execute each function by software such as a processor implemented by an electronic circuit, or a processor designed to execute each function described above. It shall include devices such as ASIC (Application Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array) and conventional circuit modules.

The virtual conference room is an example of a virtual place described in the claims. A meeting held in a virtual meeting room is an example of a meeting held in a virtual place. The projection area is an example of the first area. The memo area is an example of the second area. The determination unit 65 is an example of management means. The web page creation unit 66 is an example of the creation means. The transmission / reception unit 61 is an example of transmission means.

2a, 2b, 2c personal terminal (example of communication terminal)
4 Permanent terminal (example of communication terminal)
6 Content management server (an example of information processing device)
8 Schedule management server 9 Communication network 61 Transmission / reception unit 62 Schedule interlocking unit 63 Image processing unit 64 Creation unit 65 Judgment unit 66 Web page creation unit 67 Search unit 68 Authentication unit 69 Storage / reading processing unit 1000, 1100 Personal board screen 1016 Capture button 1020 Sheet 1022 Captured image 1024 Text memo area 1040 Projection screen 5000 Personal portal screen 5100 Bibliographic information screen 6000 Storage unit 6001 Personal content management DB
6002 Shared content management DB
6003 Interest level management DB
6004 Personal memo management DB
6005 Shared memo management DB
6006 Conference DB
6007 User DB
6008 Meeting Linkage DB
ss shared screen cc shared board dc1, dc2, dc3, dc personal board cm shared memo dm1, dm2, dm3, dm personal memo df1, pd2, dp3, pp personal portal

Japanese Unexamined Patent Publication No. 2006-146514

Claims (10)

An information processing device that manages a plurality of users who operate a plurality of communication terminals so as to participate in a meeting held in a virtual place.
A management means for managing participating users who participate in the same meeting based on a notification from the communication terminal using a unique identifier for each virtual place, and
A creating means for creating data for displaying a web page on the web browser of the communication terminal operated by the participating user, and
A transmission means for transmitting the created data to the communication terminal operated by the participating user, and
Have,
The information processing device is characterized in that the management means determines the exit of all the participating users from the meeting based on the notification from the communication terminal, and terminates the meeting. Even if the management means is a notification from the communication terminal using a unique identifier for each of the same virtual venues, the meeting in which the participating users participate is before and after the meeting is terminated. The information processing apparatus according to claim 1, wherein the information processing apparatus is different. The management means refers to the information that associates the unique identifier for each virtual field with the unique identifier for each meeting, and the unique identifier for each virtual field used for the notification from the communication terminal is obtained. If it is not associated with a unique identifier for each meeting, the meeting held in the virtual place is created, managed as the participating user of the meeting, and the virtual used for notification from the communication terminal. The information processing apparatus according to claim 1 or 2, wherein if the unique identifier for each place is associated with the unique identifier for each meeting, the information processing apparatus is managed as the participating user of the created meeting. .. Claim 1 is characterized in that the management means manages the participating user to leave the meeting based on an explicit notification of leaving the meeting from the participating user who operates the communication terminal. 3. The information processing apparatus according to any one of the following items. Any of claims 1 to 4, wherein the management means manages the participating user so as to leave the meeting based on the notification of the termination of the web browser from the communication terminal operated by the participating user. The information processing device described in item 1. One of claims 1 to 5, wherein the management means manages the participating user so as to leave the meeting based on the network interruption with the communication terminal operated by the participating user. The information processing device described. The web page
The first area for displaying the shared screen shared by the plurality of communication terminals, and
The claim is characterized by having a second area including at least an editable area and an image of the shared screen displayed in response to an acquisition request for an image of the shared screen received by the communication terminal. The information processing apparatus according to any one of 1 to 6. Claim 1 is characterized in that the management means terminates the meeting when a certain period of time elapses after determining the withdrawal of all the participating users from the meeting based on the notification from the communication terminal. 7. The information processing apparatus according to any one of the items. It is an information processing method executed by an information processing device that manages a plurality of users who operate a plurality of communication terminals to participate in a meeting held in a virtual place.
A management step for managing participating users who participate in the same meeting based on a notification from the communication terminal using a unique identifier for each virtual place, and
A creation step of creating data for displaying a web page on the web browser of the communication terminal operated by the participating user, and
A transmission step of transmitting the created data to the communication terminal operated by the participating user, and
Have,
The information processing step is an information processing method characterized in that, based on a notification from the communication terminal, all the participating users are determined to leave the meeting and the meeting is terminated. An information processing system including a plurality of communication terminals and an information processing device that manages a plurality of users operating the plurality of communication terminals so as to participate in a meeting held in a virtual place.
The information processing device
A management means for managing participating users who participate in the same meeting based on a notification from the communication terminal using a unique identifier for each virtual place, and
A creating means for creating data for displaying a web page on the web browser of the communication terminal operated by the participating user, and
A transmission means for transmitting the created data to the communication terminal operated by the participating user, and
Have,
The plurality of communication terminals
A display control means for displaying a web page based on the data received from the information processing device.
Have,
The information processing system is characterized in that the management means determines the exit of all the participating users from the meeting based on the notification from the communication terminal, and terminates the meeting.

Images