WO2015178014A1 - Learning support system, learning support server, learning support method, and learning support program - Google Patents
Learning support system, learning support server, learning support method, and learning support program Download PDFInfo
- Publication number
- WO2015178014A1 WO2015178014A1 PCT/JP2015/002510 JP2015002510W WO2015178014A1 WO 2015178014 A1 WO2015178014 A1 WO 2015178014A1 JP 2015002510 W JP2015002510 W JP 2015002510W WO 2015178014 A1 WO2015178014 A1 WO 2015178014A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- page
- learning support
- information
- unit
- learner
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 22
- 239000000463 material Substances 0.000 claims abstract description 139
- 238000004891 communication Methods 0.000 claims abstract description 17
- 230000005540 biological transmission Effects 0.000 claims description 74
- 238000000605 extraction Methods 0.000 description 27
- 238000010586 diagram Methods 0.000 description 23
- 238000012545 processing Methods 0.000 description 22
- 239000000284 extract Substances 0.000 description 6
- 238000012986 modification Methods 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 3
- 239000012776 electronic material Substances 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 238000010079 rubber tapping Methods 0.000 description 2
- 238000009966 trimming Methods 0.000 description 2
- 241001290864 Schoenoplectus Species 0.000 description 1
- 208000003464 asthenopia Diseases 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
Definitions
- the present invention relates to a learning support system, a learning support server, a learning support method, and a learning support program that support learning using teaching materials.
- Such a learning support system is configured, for example, by connecting a learner terminal such as a tablet terminal and a learning support server via a communication network.
- the learning support server provides learning content (text, images, audio, video, etc.) such as lectures, exercises, and commentary on the exercises to the learner terminal, and the learner outputs the learning content at the learner terminal and learns I do.
- the exercise problem is transmitted from the learning support server to the learner terminal
- the learner's answer to the exercise problem is transmitted from the learner terminal to the learning support server
- the explanation content for the exercise problem is transmitted from the learning support server to the learner terminal.
- a bidirectional learning support system for transmitting is also known (for example, Patent Documents 1 and 2).
- such a learning support system provides efficient learning support using information processing, such as managing the learner's learning history and presenting problems according to the learner's academic ability. Yes.
- An object of the present invention is to provide a novel learning support system, a learning support server, a learning support method, and a learning support program that support learning of a learner who learns using teaching materials.
- a learning support system includes a first control unit for generating problem information indicating the content of a problem included in a teaching material, a comment content storage unit that stores comment content, and the problem information And a second control unit that retrieves the commentary content corresponding to the problem and acquires the corresponding commentary content from the commentary content storage unit.
- the block diagram which shows the structure of the learner terminal of the 1st Embodiment of this invention The figure which shows the example of a screen of the display panel at the time of designation
- designated of the question location of the 1st Embodiment of this invention The figure which shows the example of a screen of the designated question location of the 1st Embodiment of this invention
- the block diagram which shows the structure of the learning assistance server of the 1st Embodiment of this invention The figure which shows the data structure of the reference page information database of the 1st Embodiment of this invention
- the figure which shows the data structure of the problem database of the 1st Embodiment of this invention The figure which shows the data structure of the description content database of the 1st Embodiment of this invention
- the figure which shows the data structure of the comment content link database of the 2nd Embodiment of this invention The figure which shows the example of the search result screen of the 2nd Embodiment of this invention
- the figure which shows the data structure of the teaching material database of the 3rd Embodiment of this invention The figure which shows the data structure of the reference page information database of the 3rd Embodiment of this invention.
- the learning support system according to the embodiment of the present invention will be described.
- the embodiment described below shows an example when the present invention is implemented, and the present invention is not limited to the specific configuration described below.
- a specific configuration according to the embodiment may be adopted as appropriate.
- the 1-1 aspect of the present invention is the first control unit for generating problem information indicating the content of the problem included in the teaching material, the comment content storage unit for storing comment content, and the problem information
- a learning support system comprising: a second control unit that searches for commentary content corresponding to a problem and obtains the corresponding commentary content from the commentary content storage unit.
- a 1-2 aspect of the present invention is the learning support system according to the 1-1 aspect, wherein the learning support system includes a learner terminal and a learning support server that can communicate with each other via a communication network.
- the first control unit is provided in the learner terminal
- the comment content storage unit and the second control unit are provided in the learning support server
- the learner terminal further includes the first control.
- a terminal transmission unit that transmits the problem information generated by the unit to the learning support server, and the learning support server further includes a server reception unit that receives the problem information transmitted from the terminal transmission unit; And a server transmission unit that transmits the comment content acquired by the second control unit to the learner terminal.
- a 1-3 aspect of the present invention is the learning support system according to the 1-1 or 1-2 aspect, wherein the problem information is a problem image obtained by photographing the teaching material. To do. With this configuration, the learner can easily generate problem information with a simple operation of photographing the teaching material.
- the problem information is a feature amount extracted from a problem image obtained by photographing a teaching material. It is characterized by being. With this configuration, it is not necessary to send an image from the learner terminal to the learning support server, and the communication load can be reduced.
- the commentary content is a moving image.
- a learning support server capable of communicating with a learner terminal via a communication network, a receiving unit for receiving problem information transmitted from the learner terminal, and an explanation content.
- the learning support server automatically acquires the commentary content corresponding to the problem information, Since it is transmitted to the learner's terminal, the learner can obtain explanation content for the problem transmitted by himself / herself relatively quickly.
- a 1-7th aspect of the present invention is a learning support method in a learning support server that is communicable with a learner terminal via a communication network and includes a comment content storage unit that stores comment content.
- the learning support method includes a reception step of receiving problem information transmitted from the learner terminal, an acquisition step of acquiring comment content corresponding to the problem indicated by the problem information from the comment content storage unit, and the acquisition step. And transmitting the comment content acquired in this way to the learner's terminal.
- commentary content is prepared in the commentary content storage unit, and when the learner's terminal sends problem information to the learning support server, the learning support server automatically searches for commentary content corresponding to the problem information and learns. Since it is transmitted to the learner terminal, the learner can obtain the explanation content for the problem transmitted by himself / herself relatively quickly.
- a computer of a learning support server that is communicable with a learner terminal via a communication network and includes a comment content storage unit that stores comment content is provided by the learner terminal.
- a receiving unit that receives the transmitted problem information, a control unit that acquires comment content corresponding to the problem indicated by the problem information from the comment content storage unit, and the comment content acquired by the control unit as the learner It has a configuration that functions as a transmission unit that transmits to a terminal.
- a 2-1 aspect of the present invention is a learning support system that supports learning using a learning material, and includes a page information generation unit for generating page information that is information on a page of the learning material, and the page information generation A reference page for storing reference page information indicating the contents of each of a plurality of pages of the teaching material, and a specification information generation unit for generating question part specification information for specifying a question part in the page information generated by the part A page search unit that searches a page corresponding to the page information generated by the page information generation unit from an information storage unit, and a plurality of items corresponding to a plurality of problems included in the page searched by the page search unit
- the system includes a comment content specifying unit that specifies comment content corresponding to the problem specified by the question location specifying information from the comment content.
- This configuration also enables learners to learn using non-electronic materials such as textbooks and problem collections.
- the page is first searched to identify the page, and then the commentary content is identified using the question location designation information. This makes it easy to identify the commentary content requested by the learner. .
- the reference page information storage unit uses, as the reference page information, a feature amount extracted from each of a plurality of pages of the teaching material.
- the page search unit is generated by the page information generation unit using the feature amount stored in the reference page information storage unit and the feature amount extracted from the page of the teaching material.
- a learning support system that searches for a page corresponding to the page information. With this configuration, it is possible to search for pages quickly and accurately using feature amounts.
- a 2-3 aspect of the present invention is the learning support system according to the 2-2 aspect, comprising a learner terminal and a learning support server, wherein the page information generation unit and the designation information generation unit Provided in the learner terminal, wherein the page search unit and the comment content specifying unit are provided in the learning support server, and the learner terminal transmits the page information and the question location designation information to the learning support server.
- the learning support server further includes a feature amount extraction unit that extracts a feature amount from the page information, and the page search unit includes the feature amount extracted by the feature amount extraction unit and the reference page information storage unit.
- the page corresponding to the page information generated by the page information generation unit is searched using the feature amount stored in the page, and the learning support server is further specified by the comment content specifying unit
- the commentary content A learning support system comprising the server transmission unit for transmitting to the serial learner terminal.
- the 2-4th aspect of the present invention is the learning support system according to the 2nd-2 aspect, comprising a learner terminal and a learning support server, wherein the page information generation unit and the designation information generation unit Provided in the learner terminal, the learner terminal further comprising a feature quantity extraction unit that extracts a feature quantity from the page information, and the page search unit and the comment content specifying unit are provided in the learning support server.
- the page information generation unit uses the feature amount as the page information, the learner terminal transmits the page information and the question location designation information to the learning support server, and the page search unit includes the feature amount.
- the support server further includes the explanation console.
- a learning support system comprising the server transmission unit that transmits the commentary content identified in the learner terminal by Ntsu particular unit. With this configuration, data transmitted from the learner terminal to the learning support server can be reduced.
- a 2-5th aspect of the present invention is the learning support system according to the 2nd-2 aspect, comprising a learner terminal and a learning support server, wherein the page information generation unit, the specified information generation unit, and the page search Is provided in the learner terminal, the commentary content specifying unit is provided in the learning support server, and the learner terminal receives the page search result and the question location designation information in the page search unit.
- the learning support server transmits the comment content specified by the comment content specifying unit to the learner terminal. With this configuration, data transmitted from the learner terminal to the learning support server can be further reduced.
- the question location specifying information indicates a point position of the question location in the page information. It is characterized by being information. With this configuration, the learner can specify the question part by a simple operation of specifying one point in the generated page information.
- the question location specifying information is information indicating a region of the question location in the page information It is characterized by.
- the learning support server sends the explanation content from the learning support server to the learner terminal.
- a search result screen generation unit that generates a search result screen including link information for transmitting the search information, and the learning support server transmits the search result screen to the learner support terminal, and from the learner terminal.
- the commentary content storage unit stores commentary content corresponding to the problem included in each of the plurality of pages stored in the reference page information storage unit The comment content requested to be transmitted is read out and transmitted to the learner terminal.
- the learner first receives a search result screen including link information, confirms that the commentary content has been properly identified, and then instructs the learning support server that transmits the commentary content. Can do.
- the reference page information storage section associates teaching material information with the reference page information.
- the page search unit refers to the learning material storage unit that stores information on the learning material used by the user for each user of the learner terminal, narrows the learning material, and then selects the page. It is characterized by searching a page corresponding to information. With this configuration, first, the learning material is specified, and then the page for the page information is searched with reference to the reference page information of the corresponding learning material, so that the search accuracy is improved.
- the 2-10th aspect of the present invention is the learning support system according to any one of the 2-1 to 2-8 aspects, wherein the page search unit cannot search a page corresponding to the page information.
- a screen for inputting information of the teaching material of the page information generated by the page information generation unit is presented to the learner.
- the learning support server can know the teaching material in which the reference page information is not stored in the reference page information storage unit, and the administrator of the learning support server effectively stores the reference page in the reference page information storage unit. Information can be enhanced.
- the 2nd-11th aspect of the present invention is the learning support system according to any one of the 2-1st to 2-8th aspects, wherein the page search unit cannot search a page corresponding to the page information.
- a message that prompts the learner to generate page information is output to the learner.
- the learner terminal can regenerate the page information so that the corresponding commentary content can be obtained.
- the 2nd-12th aspect of the present invention is the learning support system according to any one of the 2nd-1st to 2-8th aspects, in the case where the page retrieval unit cannot retrieve a page corresponding to the page information.
- a message notifying that the learning material is not registered is output to the learner.
- the learner terminal cannot obtain the corresponding commentary content because it is not a deficiency in the page information generation method, it can be known that the teaching material has not been registered, the generation of page information wasted, And repeated transmissions can be avoided.
- a 2nd-13th aspect of the present invention is a learning support system for supporting learning using a learning material, comprising a page information generating unit for generating page information which is information on a page of the learning material, and a plurality of learning materials.
- a page search unit that searches for a page corresponding to the page information generated by the page information generation unit from a reference page information storage unit that stores reference page information indicating the contents of each page for each page, and the reference Problems included in pages searched by the page search unit from the description content link storage unit storing link information to the description content corresponding to the problems included in each of the plurality of pages stored in the page information storage unit
- a search result screen generation unit that reads the link information corresponding to the link information, generates a search result screen including the read link information, and a display unit that displays the search result screen.
- a feature amount extraction unit for extracting feature amounts as page information of the page from the image of the teaching material page, and question location designation information for designating a question location in the image are generated.
- a learning support server that constitutes a learning support system together with a learner terminal including a designation information generation unit that performs, and a transmission unit that transmits the feature amount and the question location designation information to the learning support server, wherein the learner From the receiving unit that receives the feature amount and the question location designation information transmitted from the terminal, and from the reference page information storage unit that stores the feature amount extracted from each of a plurality of pages of the teaching material as the reference page information, the receiving unit A page search unit for searching for a page having a feature quantity as reference page information corresponding to the feature quantity received in the step, and a plurality of explanations corresponding to a plurality of problems included in the page searched by the page search unit.
- a comment content specifying unit for specifying commentary content corresponding to the problem specified by the question location specification information, and transmission for transmitting link information to the commentary content specified by the comment content specifying unit to the learner terminal And a section.
- a feature amount extraction unit for extracting feature amounts as page information of the page from the image of the teaching material page, and question location designation information for designating a question location in the image are generated.
- a learning support method in a learning support server that constitutes a learning support system together with a learner terminal including a designation information generation unit that performs transmission, and a transmission unit that transmits the feature amount and the question location designation information to the learning support server.
- a comment content specifying step for identifying comment content corresponding to the problem specified by the question location specification information, and the comment content specified in the comment content specifying step Transmitting the link information to the learner terminal. Also with this configuration, first, a page search is performed to identify the page, and then the commentary content is identified using the question location designation information. Therefore, it is easy to identify the commentary content requested by the learner.
- a 3-1 aspect of the present invention is a learning support system that supports learning using a learning material, and includes a problem information generation unit for generating problem information indicating the content of a problem included in the learning material, The comment content corresponding to the problem indicated by the problem information generated by the problem information generation unit with reference to the comment content link storage unit storing the link information of the problem comment content included in each of the plurality of pages
- a search result screen generation unit that generates a search result screen indicating a search result using the read link information and the problem information generated by the problem information generation unit, and the search And an output unit for outputting the search result screen generated by the result screen generation unit.
- This configuration also enables learners to learn using non-electronic materials such as textbooks and problem collections.
- the search result screen is generated using information indicating the content of the learner's teaching material, so that the convenience of the learner is improved.
- a third aspect of the present invention is characterized in that in the learning support system according to the third aspect, the problem information is an image obtained by imaging the teaching material.
- the system further comprises a problem identification unit that identifies a problem corresponding to the problem information generated by the problem information generation unit, and the search result screen generation unit includes commentary content corresponding to the problem identified by the problem identification unit
- the link information is read out.
- the search result screen generation unit reads the link information in the image generated by the problem information generation unit.
- the search result screen is generated with a mark indicating that the link information exists at the position of the problem.
- the search result screen generating unit generates the search result screen including the link information in the mark. To do.
- the learner terminal can request transmission of commentary content through an intuitive operation of instructing a mark.
- the search result screen generating unit includes the search result screen including a representative image of the commentary content corresponding to the read link information. Is generated.
- the learner terminal can request transmission of the commentary content after confirming the representative image of the commentary content.
- the 3-7th aspect is characterized in that, in the learning support system according to the 3-6th aspect, the search result screen generation unit generates the search result screen including the link information in the representative image.
- the learner terminal can request transmission of commentary content through an intuitive operation of instructing a representative image.
- the learner terminal can specify the question location in the teaching material image, so that convenience when asking a question is improved.
- the search result screen generation unit includes the question location designation information in the image generated by the problem information generation unit.
- the search result screen is generated using the image of the question location specified by the above.
- the search result screen includes the image of the question part specified on the learner's terminal, so the image of the part that is not related to the question is excluded and It is possible to confirm the presence / absence of the link information of the commentary content only for the relevant part.
- a learning support server that constitutes a learning support system together with a learner terminal having a problem information generating unit for generating problem information indicating the content of a problem included in a teaching material.
- the learning support server refers to the comment content link storage unit that stores link information of the comment content of the problem included in each of the plurality of pages of the teaching material, and the problem information generated by the problem information generation unit A search that reads the link information of the commentary content corresponding to the problem indicated by, and generates a search result screen showing the search result using the read link information and the problem information generated by the problem information generation unit A result screen generation unit, and a transmission unit that transmits the search result screen generated by the search result screen generation unit to the learner terminal.
- the search result screen is generated using information indicating the contents of the learner's teaching materials, so that the convenience of the learner is improved.
- the third to eleventh aspects of the present invention provide learning support in a learning support server that constitutes a learning support system together with a learner terminal that includes a problem information generation unit for generating problem information indicating the content of a problem included in a teaching material.
- This learning support method is generated by the problem information generation unit with reference to a description content link storage unit that stores link information of problem description content included in each of a plurality of pages of the teaching material.
- the search result screen showing the search result using the link information of the commentary content corresponding to the problem indicated by the problem information and using the read link information and the problem information generated by the problem information generating unit
- Tsu characterized in that it comprises a flop. Even with this configuration, in the learner terminal, the search result screen is generated using information indicating the contents of the learner's teaching materials, so that the convenience of the learner is improved
- FIG. 1 is a diagram showing the overall configuration of the learning support system according to the first embodiment of this invention.
- the learning support system 100 includes a learner terminal 10 and a learning support server 20.
- the learning support server 20 is connected to the network NW.
- the learner terminal 10 performs information communication with the learning support server 20 via the network NW.
- the learner terminal 10 is connected to the network NW by performing wireless communication with a wireless base station connected to the network NW.
- the learner terminal 10 is realized, for example, by installing a learning support application program in a portable information terminal such as a smartphone or a tablet PC, or a computer such as a personal computer.
- the learning support server 20 includes a web server and a database.
- the network NW is the Internet.
- the learner terminal 10 is a terminal used by the learner S at an arbitrary place.
- the learner S who is a user learns using a non-electronic teaching material (hereinafter simply referred to as “teaching material”) such as a textbook or a collection of questions about a portion that needs to be explained.
- a non-electronic teaching material such as a textbook or a collection of questions about a portion that needs to be explained.
- the non-electronic teaching material is typically a paper-based teaching material, but an electronic book that does not include a link to an address on the network is also included in the non-electronic teaching material.
- Learning support of the learner S is performed by the learning support system 100 as follows, for example.
- the learner terminal 10 a learning support application program (hereinafter referred to as “application”) is launched, and a corresponding portion of the teaching material is photographed according to the guidance of the application. Then, the image data of the learning material obtained by photographing is transmitted from the learner terminal 10 to the learning support server 20.
- application a learning support application program
- the database of the learning support server 20 stores commentary contents (in this embodiment, commentary videos) for each part of the teaching material.
- the learning support server 20 extracts commentary content corresponding to the location indicated by the image data transmitted from the learner terminal 10 from the database, and transmits it to the learner terminal 10.
- the learner S can receive the commentary content at the learner terminal 10 and view it. That is, the learner S can view commentary contents such as commentary videos at a point where a part that is not known during learning using the teaching material is photographed and transmitted.
- commentary contents in this embodiment, commentary videos
- FIG. 2 is a block diagram illustrating a configuration of the learner terminal according to the first embodiment of this invention.
- the learner terminal 10 includes an input unit 11, an output unit 12, a control unit 13, an image generation unit 14, and a transmission / reception unit 15.
- the control unit 13 includes a designation information generation unit 131 and a transmission data generation unit 132.
- the input unit 11 includes a touch panel, physical buttons, and a microphone.
- the learner S can make various inputs via the input unit 11.
- the output unit 12 includes a display panel and a speaker. The learner S can make various inputs according to the screen displayed on the display panel.
- the comment content received from the learning support server 20 is output from the output unit 12. When the commentary content is a moving image, the moving image is displayed on the display panel, and sound is output from the speaker.
- the control unit 13 is realized by a computer including a processor, a RAM, a storage, and the like of the learner terminal 10 executing a learning support application program.
- the processing includes generation of question location designation information and generation of transmission data, which will be described later.
- these processing functions are expressed as a designation information generation unit 131 and a transmission data generation unit 132.
- the image generation unit 14 is a camera that generates an image by photographing.
- the image generation unit 14 includes an optical system, an image sensor, and an image processing circuit, and converts an optical image incident on the image sensor through the optical system into an electrical signal using the image sensor.
- the image processing circuit generates image data based on the electrical signal input from the image sensor.
- the image generated by the image processing circuit is displayed on the display panel at a predetermined frame rate.
- the image processing circuit creates and stores an image file (hereinafter also simply referred to as “image”) from the electrical signal at this time.
- image an image file
- the learner S takes a picture of the question part when there is a part (hereinafter referred to as “question part”) for which explanation is desired during learning using the teaching material.
- the image generation unit 14 generates an image of the teaching material.
- the image generation unit 14 may be a scanner that reads a learning material, and may be a means for capturing a display screen when the learning material is an electronic book.
- the image generation unit 14 corresponds to a “page information generation unit” of the present invention.
- the control unit 13 controls the display on the display panel of the output unit 12 to display a message that prompts the learner S to photograph the entire page of the teaching material.
- the designation information generating unit 131 displays the captured image on the display panel, and the learner S displays an image of the entire page (hereinafter, “page”).
- page The question part in "Image" is specified.
- This page image corresponds to “page information” of the present invention, and this page information corresponds to “problem information” of the present invention.
- FIG. 3 is a diagram showing a screen example of the display panel when the question location is specified according to the first embodiment of this invention.
- a page image is displayed on the screen, and a question location designation frame 121 is displayed superimposed on the page image.
- the question location designation frame 121 is a rectangular frame indicating the region of the question location in the page image, and can be arbitrarily enlarged or reduced in the vertical direction and the horizontal direction.
- the learner S can drag the upper and lower sides of the question location designation frame 121 in the vertical direction and drag the left and right sides in the left and right directions to make the question location designation frame 121 in an arbitrary position and size. .
- FIG. 4 is a diagram illustrating a screen example of a designated question location according to the first embodiment of this invention. The learner S can confirm the designated question location on this screen.
- FIG. 5 is a diagram illustrating a data configuration of transmission data according to the first embodiment of this invention.
- the transmission data generation unit 132 includes date and time information indicating the current date and time, a user ID given to each learner, a page image file that is an image file of a page image generated by photographing in the image generation unit 14, and Transmission data including the question location designation information generated by the designation information generation unit 131 is generated.
- This transmission data corresponds to “problem information” of the present invention.
- the transmission / reception unit 15 transmits the transmission data to the learning support server 20 according to the control of the control unit 13 based on the operation of the learner S.
- the transceiver 15 may be, for example, a wireless LAN communication module or a mobile phone communication module.
- the transmission / reception unit 15 also receives the commentary content transmitted from the learning support server 20.
- the configuration of the learner terminal 10 for viewing the content after the transmission / reception unit 15 receives the commentary content will be described later.
- FIG. 6 is a block diagram illustrating a configuration of the learning support server according to the first embodiment of this invention.
- the learning support server 20 includes a transmission / reception unit 21, a control unit 22, a reference page information database 23, a problem database 24, an explanation content link database 25, and an explanation content database 26.
- the transmission / reception unit 21 transmits various data to the network NW, and receives the data via the network NW.
- the transmission / reception unit 21 particularly receives transmission data (see FIG. 5) from the learner terminal 10 and transmits a search result screen to the learner terminal 10 that has transmitted the transmission data. , Streaming commentary content.
- the control unit 22 is realized by a computer including the processor, RAM, ROM, storage, and the like of the learning support server 20 executing a learning support application program.
- the processing includes extraction of feature values from page images, page search, problem identification, search result screen generation, stream distribution, and the like.
- FIG. 7 is a diagram showing a data configuration of the reference page information database according to the first embodiment of this invention.
- the reference page information database 23 a record is created and stored for each page of a plurality of teaching materials.
- Each record is configured by associating a page ID for specifying a page and a feature amount of a reference page image as reference page information.
- the feature quantity is expressed in the form of a feature vector.
- the alphabet of page ID is information for specifying the teaching material, and the number of page ID indicates the number of pages.
- FIG. 8 is a diagram showing a data configuration of the problem database according to the first embodiment of this invention.
- the problem database 24 stores at least one record for each problem.
- Each record includes the page ID of the page describing the problem, the problem position data indicating the problem position in the page, the problem theme that is a character string indicating the theme of each problem, and the problem ID assigned to each problem. It is stored in association. As shown in FIG. 8, each page ID is associated with a plurality of problem position data included in the page.
- the problem position data is data indicating the position of a point in the page image.
- the point position is set at a location indicating the main contents of each problem.
- a plurality of problem position data may be set for one problem. In this case, a plurality of records are generated and stored for the problem.
- Problem themes include, for example, “distribution law”, “factorization”, “square root”, “square root (sentence problem)”, “expansion”, “circumference angle theorem” (see FIG. 10), “three squares theorem” Use ”(see FIG. 10),“ Parallel to line segment ratio ”(see FIG. 14), and the like.
- FIG. 9 is a diagram showing a data configuration of the commentary content database according to the first embodiment of this invention.
- the comment content link database 25 stores a record for each problem.
- Each record stores a problem ID, link information, and a thumbnail image in association with each other.
- the link information is information for accessing the commentary video file from the learner terminal 10 and requesting streaming delivery of the commentary video file.
- the thumbnail image is a representative image indicating the contents of the commentary video, and in this embodiment, the image at the start of the commentary video is the thumbnail image.
- the comment content link database 25 a plurality of records having different link information (different comment contents) may be created for one problem.
- the commentary video database 26 stores commentary movie files as commentary content.
- the commentary moving image database 26 corresponds to the “description content storage unit” of the present invention.
- the address of the storage area of each commentary video file is stored as link information in the commentary content link database 25.
- the commentary movie file is a commentary movie file.
- the commentary video was created by taking a picture of the teacher explaining the problem using a whiteboard.
- the content of the explanation video is not limited to the content (solution explanation) that explains the solution of the exercise problem associated with the exercise problem in the problem collection, but is associated with, for example, the paragraph or keyword of the explanatory text in the textbook
- the contents (lectures) that explain the corresponding part in detail or simply can be used.
- the content of the commentary movie is a solution explanation, the content is not a general solution to the corresponding exercise problem but a content that explains how to actually solve the exercise problem.
- the feature amount extraction unit 221 extracts a feature amount from a page image of a page image file in the transmission data (hereinafter referred to as “photographed page image”). This photographed page image corresponds to the “problem image” of the present invention.
- the page search unit 222 searches for a page using the feature amount.
- the page search unit 222 uses a feature amount extracted from the photographed page image as a query, and corresponds to the photographed page image from a plurality of pages (hereinafter, “registered pages”) stored in the reference page information database 23. Search the registration page.
- the reference page information database 23 stores the feature amount of the reference page image as reference page information for each page of a plurality of teaching materials. This feature amount is also generated in the same manner as described below.
- the feature amount stored in the reference page information database 23 may be extracted by the feature amount extraction unit 221 or may be extracted by another device.
- a local feature amount is adopted as the feature amount of the image.
- the feature quantity extraction unit 221 first extracts a feature point by applying an algorithm (corner detector) for extracting a corner point (corner) to the photographed page image.
- an algorithm corner detector
- a plurality of feature points are extracted from one image, and the feature amount extraction unit 221 calculates a feature amount for each of the plurality of feature points.
- the feature amount extraction unit 221 performs the following processing for each extracted feature point.
- the feature quantity extraction unit 221 sets a predetermined region in the vicinity of the feature point (for example, a square region of W ⁇ W pixels centered on the feature point) as the neighborhood region, and sets each pixel in the neighborhood region in the x direction and By differentiating each in the y direction, the edge gradient direction and the edge strength are calculated for each pixel in the neighboring region. Then, the feature amount extraction unit 221 generates an edge gradient direction histogram by quantizing the edge gradient direction and taking the sum of the edge intensities for each quantized edge gradient direction of the pixels in the neighborhood region. Is a local feature.
- the page retrieval unit 222 retrieves a plurality of feature points of a plurality of registered pages stored in the reference page information database 23 for each of a plurality of feature points of the photographed page image, and local features of the feature points of the photographed page image. A feature point (corresponding point) having a local feature amount most similar to the amount is searched. At this time, for example, the page search unit 222 can express the local feature amount in a vector format (feature vector), and use the square value of the L2 norm of the feature vector as the similarity between the local feature amounts. Then, as a result of performing this search for a plurality of feature points of the photographed page image, the page search unit 222 determines that the registered page that has the most corresponding points is the registered page corresponding to the photographed page image.
- the page search unit 222 passes the page ID of the registered page to the problem specifying unit 223.
- the problem specifying unit 223 specifies the problem stored in the problem database 24 using the question location designation information in the transmission data and the page ID obtained by the page search unit 222.
- the problem specifying unit 223 refers to the problem database 24, and the point position indicated by the problem position data from the records having the page ID that matches the page ID obtained by the page search unit 222 is the question location designation information. By identifying the record included in the question location shown, the problem specified by the question location specification information is specified.
- the problem identification unit 223 passes the problem ID and problem theme of the identified problem to the search result screen generation unit 224.
- the search result screen generation unit 224 acquires the question link information and the thumbnail image of the record having the question ID obtained by the question specifying unit 223 from the comment content link database 25, and the question from the learner terminal 10 A search result screen that is a screen for responding to is generated.
- the configuration including the problem specifying unit 223 and the search result screen generating unit 224 corresponds to the “explanatory content specifying unit” of the present invention.
- FIG. 10 is a diagram illustrating an example of a search result screen according to the first embodiment of this invention.
- the search result screen includes a trimmed image 51 of the question part and a thumbnail 52 of the explanation movie, and link information is embedded in the thumbnail 52 of the explanation movie.
- the trimmed image 51 is generated using the captured page image and question location designation information included in the transmission data. Specifically, the image is generated by trimming an image within the frame of the question location indicated by the question location designation information from the photographed page image.
- serial number marks 511 and 512 are attached to the trimmed image 51 for each problem. These serial number marks 511 and 512 indicate that there is link information in the problem included in the question part, that is, that there is an explanation movie and it has been searched. Link information is embedded in the serial number marks 511 and 512. The superposition position when superimposing the serial number mark on the trimming image is determined according to the problem position data of the corresponding record among the records stored in the explanation content link database 25. Instead of the serial number marks 511 and 512, simple marks without serial numbers may be employed.
- the thumbnail image of the commentary video is appended with the serial number of the serial number mark and the problem theme acquired from the problem identification unit 223.
- link information is embedded in the thumbnail image, and when the thumbnail image is tapped, distribution of the commentary video is requested using the link information. Further, link information is also embedded in the serial number mark superimposed on the image of the question location, and distribution of the corresponding commentary video is requested by tapping the serial number mark.
- the transmission / reception unit 21 transmits the examination result screen generated by the search result screen generation unit 224 to the learner terminal 10 that has transmitted the transmission data.
- the learner terminal 10 receives the search result screen transmitted from the learning support server 20, and the control unit 13 displays the search result screen on the display panel of the output unit 12.
- the control unit 13 uses the link information and the learning support server A distribution request command for requesting the distribution of the commentary video is transmitted to 20.
- the transmission / reception unit 21 of the learning support server 20 When the transmission / reception unit 21 of the learning support server 20 receives the distribution request command, it passes it to the distribution processing unit 225.
- the distribution processing unit 24 reads the commentary moving image file designated by the distribution request command from the commentary content database 26 and performs streaming distribution to the learner terminal 10 via the transmission / reception unit 21.
- the learner terminal 10 receives the streaming distribution, displays a moving image on the display panel of the output unit 12, and outputs sound from the speaker.
- the learning support server 20 when a “question” is made by photographing a learning material at the learning terminal 10 and transmitting the image to the learning support server 20, a page is transmitted to the transmission data. Since the entire image and the question location designation information are included, the learning support server 20 first performs a search by image matching on the entire page image in the page search unit 222, and then in the problem identification unit 223. The problem at the position designated as the question part can be specified. This improves the accuracy of problem identification.
- the question location designation information is obtained by searching the page having the problem position data existing in the frame indicated by the question location designation information. You can identify problems that exist in the frame shown. This process merely involves examining the inclusive relation between the frame and the point position, and the processing load can be reduced.
- the learner S uses a learning material in which the commentary video is not stored in the commentary content database 26 of the learning support server 20, and the page is generated by photographing such a learning material. There is a case in which a photographed page image is transmitted. Further, as described above, when the learner terminal 10 causes the learner S to shoot a learning material, a message prompting the learner S to shoot a page of the learning material or the entire page is displayed on the display panel. Even if the learner S does not shoot a page or the entire page despite this message, the page search unit 222 may not be able to search for a page.
- the page search unit 222 searches the reference page information database 23 and, if the corresponding record is not searched, determines whether the page image in the transmission data is a page or the entire page. Specifically, the page search unit 222 determines whether or not there is an image edge corresponding to the edge of the page of the teaching material at the top and bottom of the photographed page image. If the edge of the image cannot be detected in the upper and lower parts of the photographed page image, the page search unit 222 returns error information indicating that the entire page is not photographed to the learner terminal 10 via the transmission / reception unit 21. .
- the page search unit 222 searches the reference page information database 23, and when the corresponding record is not searched, when the edge of the image is detected at the upper part and the lower part of the photographed page image, the explanation content of the teaching material is learned. Error information that is not stored in the support server 20 (the teaching material is not registered) is transmitted to the learning terminal 10.
- the learner terminal 10 When the learner terminal 10 receives the error information, the learner terminal 10 displays a message prompting again to shoot the entire page according to the content, or displays a message indicating that the teaching material is not registered. When a message indicating that the learning material is not registered is displayed, the message display screen includes an input field for the learner S to enter the name of the learning material that the learner S is using.
- the learner S When the message indicating that the learning material is not registered is displayed, the learner S enters the name of his / her learning material in the input field.
- the transmission / reception unit 15 of the learner terminal 10 transmits the name of the unregistered teaching material input in the input field to the learning support server 20 under the control of the control unit 13 based on the operation of the learner S.
- the learner server 20 stores the name of the transmitted unregistered teaching material in a storage medium (not shown).
- the operator of the learning support server 20 can know the learning materials used by the learner S by referring to the information of the unregistered learning materials, and prepare a new commentary content for the learning materials. Can do.
- FIG. 11 is a block diagram showing the configuration of the learner terminal of the learning support system according to the second embodiment of the present invention
- FIG. 12 shows the learning support of the learning support system according to the second embodiment of the present invention. It is a block diagram which shows the structure of a server.
- the learner S takes a page image so that one page of the teaching material fits in the image when making a question.
- the question part is not specified, and link information and thumbnail images are provided from the learning support server 20 'for all problems included in the photographed page image.
- the same components as those of the first embodiment are denoted by the same reference numerals, and the description thereof is omitted as appropriate.
- the control unit 13 does not include the designation information generation unit 131 as compared with the learner terminal 10 of the first embodiment.
- the transmission data generation unit 132 generates transmission data including date and time information, a user ID, and a page image file, and transmits the transmission data to the learning support terminal 20 ′.
- FIG. 13 is a diagram illustrating a data structure of the comment content link database according to the second embodiment of this invention.
- the comment content link database 25 ′ of the present embodiment stores a page ID, problem position data, problem theme, link information, and thumbnail image file in association with each record.
- the page search unit 222 refers to the reference page information database 23 to search for a registered page corresponding to the photographed page image included in the transmission data.
- the page ID of the page is generated as a search result screen.
- the search result screen 223 refers to the explanation content link database 25 'and generates a search result screen using all records having the corresponding page ID.
- FIG. 14 is a diagram illustrating an example of a search result screen according to the second embodiment of this invention.
- the search result screen includes a photographed page image 53 and a commentary video thumbnail 54.
- explanation movie reproduction marks 531 to 534 are added so as to be superimposed on the problem in which the explanation movie is obtained.
- These marks 531 to 534 indicate that a commentary video about the problem can be provided.
- link information to the corresponding commentary video is embedded in the marks 531 to 534.
- the learner S does not need to specify the question part after shooting the page including the part to be asked, Operation can be simplified.
- the photographed page image of the search result screen transmitted from the image support server 20 ′ to the learner terminal 10 ′ is marked with a problem that does not require commentary, and link information to the commentary video is provided.
- the learner S only needs to ignore the mark and request distribution of commentary videos for problems that do not require commentary, and there is no particular inconvenience.
- FIG. 15 is a block diagram illustrating a configuration of a learning support server in the learning support system according to the third embodiment of this invention.
- the page search unit 222 searches for records having reference page information corresponding to the photographed page image among the records stored in the reference page information database 23.
- the learning support server 20 ′′ performs this page search after narrowing down teaching materials.
- the learning support server 20 ′′ of the present embodiment includes a teaching material database 27 as shown in FIG.
- FIG. 16 is a diagram illustrating a data configuration of the teaching material database according to the third embodiment of this invention. As shown in FIG. 16, in the learning material database, for each learner who is a user, the user ID and the learning material ID of the learning material used by the user are associated.
- the learner can register his / her teaching materials in the teaching material database 27 from the learner terminal 10.
- the learning support server 20 ′′ provides a screen for learning material registration to the learner terminal 10. On this screen, it is possible to select a learning material that can be registered, that is, a learning material for which explanation content is prepared in the learning support server 20 ′′.
- the learning material database 27 stores the learning material ID of the learning material for the user.
- FIG. 17 is a diagram showing a data configuration of the reference page information database according to the third embodiment of the present invention.
- Each page record stores a learning material ID, a page ID, and a feature amount extracted from the reference page image in association with each other.
- the page search unit 222 ′′ receives the transmission data from the learner terminal 10, the page search unit 222 ′′ refers to the learning material database 27 and acquires the learning material ID corresponding to the user ID included in the transmission data.
- the page search unit 222 ′′ refers to the record having the acquired teaching material ID among the records stored in the reference page information database 23, and searches the registered page corresponding to the captured page image included in the transmission data. If there is no corresponding record in the above search, the page search unit 222 ′′ also searches for records of other teaching materials. That is, the page search unit 222 ′′ searches the learning material database 27 with priority on the learning material page associated with the user ID of the learner.
- the page search unit 222 ′′ passes the result to the problem specifying unit 223, and uses the learning material ID and the user ID associated with the corresponding registered page. In association therewith, it is added to the teaching material database 27. That is, the page search unit 222 ′′ automatically registers the learning material in the learning material database 27 when the photographed page image is matched with the image of the learning material not registered in the learning material database 27.
- the search of the page is performed with priority given to the learning material used by the learner, so that the search of the page becomes faster and the question is asked.
- the waiting time of the learner from when the search result screen is returned can be reduced.
- the image generation unit 14 generates a page image as page information indicating the entire page of the teaching material
- the reference page information database 23 stores the feature amount of the reference page image as reference page information.
- the page search unit searches for the corresponding page using the feature amount of the page image and the feature amount of the reference page image.
- the page information indicating the entire page of the teaching material is not limited to the image, and character information, audio information, etc. Other types of information may be used.
- the photographed page image is transmitted as page information from the learner terminal 10 to the learning support server 20, and the photographed page image is extracted by the feature amount extraction unit 221 of the learning support server 20.
- the learner terminal 10 is provided with a feature amount extraction unit 221, and the learner terminal 10 receives not the captured page image but the feature amount extracted therefrom from the learner terminal 10. You may make it transmit as page information.
- the feature amount extraction unit 221 provided in the learner terminal 10 corresponds to the “page information generation unit” of the present invention together with the image generation unit 14. That is, the page information, which is information on the entire page of the teaching material, may be a page image or a feature amount extracted from the page image. The feature amount at this time corresponds to “problem information” of the present invention.
- the learner terminal 10 includes not only the feature amount extraction unit 221 but also a page search unit 222, and the registered page corresponding to the photographed page image is referred to the reference page information database 23 using the extracted feature amount of the photographed page image. May be extracted from In this case, from the learner terminal 10, the search result in the page search unit 222 (that is, the page ID of the registered page searched) and the question location designation information are transmitted to the learning support server 20. In this case, the reference page information database 23 may be provided in the learner terminal 10. This search result corresponds to “problem information” of the present invention.
- the learner terminal 10 includes not only the feature amount extraction unit 221 and the page search unit 222 but also a problem specifying unit 223, and specifies a problem from the searched registration page based on the question location designated by the learner. May be.
- the problem ID of the identified problem is transmitted from the learner terminal 10 to the learning support server 20.
- the reference page information database 23 and the problem database 24 may be provided in the learner terminal 10.
- the problem ID corresponds to “problem information” of the present invention.
- the learner terminal 10 may include a search result screen generation unit 224 as well as the feature amount extraction unit 221, the page search unit 222, and the problem identification unit 223. In this case, that is, all the functions of the control unit 22 of the learning support server 20 may be provided in the learner terminal 10. Further, the learning support system 100 may be configured by the learner terminal 10 alone, and communication may not be required for the learning support operation described above.
- the problem identification unit 223 uses the question location designation information in the transmission data and the page ID obtained by the page search unit 222 to store the problem stored in the problem database 24.
- the search result screen generation unit 224 acquires the link information and the thumbnail image of the problem of the record having the problem ID obtained by the problem identification unit 223 from the comment content link database 25.
- the problem database 24 and the comment content database 25 are not provided separately, but as a single database, each problem record in the database is the page ID of the page in which the problem is described, and the problem position in the page.
- the problem position data indicating the link information to the commentary content may be stored in association with each other.
- the configuration including the problem specifying unit 223 and the search result screen generating unit 224 also specifies the commentary content corresponding to the problem specified by the question location specification information from the one database as the commentary content specifying unit. Then, a search result screen using the link information may be generated.
- the learning support server determines whether or not the captured page image of the entire page has been obtained. However, whether or not the captured page image is an image of the entire page. This determination may be made at the learner terminal. In this case, when the learner terminal determines that the photographed page image is not a photograph of the entire page, the learner terminal cancels the photographed page image and prompts the user to redo the photographing so as to photograph the page or the entire page. Display a message.
- the reference page information database 23 stores a plurality of feature values extracted from the image of the registered page as reference page information. Instead of this feature value, reference page information is used as reference page information. Text data of character strings included in each page of each learning material may be stored.
- the page search unit 222 performs character recognition on the captured page image in the transmission image and acquires text data. Then, the page search unit 222 performs page search by matching the text data obtained by character recognition with the text data stored in the reference page information database 23.
- the reference page information database 23 may store image data of a registered page as reference page information.
- data indicating the point position in the page image is stored in the problem database 24 as the problem position data indicating the position of each problem.
- each data in the page image is stored.
- Data indicating the problem area may be stored.
- the problem specifying unit 223 specifies the problem when a predetermined ratio (for example, 70%) or more of the area is included in the frame indicated by the question location specifying information included in the transmission data.
- the question location designation information is information indicating the region in the captured page image.
- the question location specifying information is information indicating the point position in the captured page image as the question location. May be.
- the problem specifying unit 223 determines that the problem is the point position problem closest to the point position indicating the question location. Identify.
- the problem specifying unit 223 specifies a problem in an area including a point position indicating a question location included in transmission data. Is identified.
- problem position data indicating the position of each problem is stored in the problem database 24.
- an image of each problem hereinafter referred to as a “reference problem image”
- the problem specifying unit 223 performs matching between the partial image of the area specified by the question location specifying information in the captured page image included in the transmission data and the reference problem image stored in the problem database 23. The page is searched.
- the search result screen including link information to the commentary content is first transmitted to the learner terminal, and distribution is performed when the learner S requests a commentary video using the link information.
- the processing unit 225 has streamed the commentary video, the transmission of the search result screen may be omitted.
- each explanation movie file is stored in the explanation content database 26 in association with the problem ID.
- the delivery processing unit 225 delivers the commentary video associated with the identified problem ID to the learner terminal by streaming.
- streaming distribution may be performed in order, and link information and thumbnail images may be transmitted to the learner terminal for comment content waiting for the turn.
- the components of the learning support server in the above embodiment may be provided in a separate device.
- the comment content database 26 and the distribution processing unit 225 may be provided in a comment content server different from other configurations.
- all the databases, the transmission / reception unit, and the control unit may be configured as separate devices.
- the commentary content is a moving image, but the commentary content is not limited to this, and may be various types of content that can be distributed from the learning support server, such as images, sounds, and texts.
- the learner S has taken an image of the entire page in order to acquire the information of the entire page of the learning material.
- the registered page is searched using information on a partial area of the learning material page. It may be possible.
- an image of only a partial area of the page (hereinafter referred to as “captured partial image”) is obtained by the learner terminal 10 shooting a partial area of the page.
- This captured partial image also corresponds to the “problem image” of the present invention, like the above-described captured page image.
- the question part may be specified as in the first embodiment or not as in the second embodiment.
- FIG. 18 is a diagram showing an example of the data structure of the reference problem information database of this modification.
- the reference problem information database 23 ′ can be used in place of the reference page information database 23 of the above embodiment.
- a record is created and stored for each problem.
- Each problem is given a problem ID, and the feature value of the problem is associated with each problem ID in the form of a feature vector in the reference problem information database 23 ′.
- the feature amount extraction unit 221 extracts feature amounts from the captured partial images in the same manner as in the above embodiment.
- the page search unit 222 uses a feature amount extracted from the captured partial image as a query, and uses a plurality of problems stored in the reference problem information database 23 '(hereinafter referred to as "registration problem"). Search the registration problem corresponding to the captured partial image.
- the reference page information database 23 of the above embodiment may be used instead of the reference problem information database 23 ′.
- the page search unit 222 determines that the registered page including the most corresponding points is the registered page corresponding to the captured partial image, as in the above embodiment.
- the image generation unit 14 takes a picture by the operation of the learner S to generate a page image file, and the transmission data including the page image file is generated by the operation of the learner S. That is, the shooting of the teaching material is a still shooting in which one image file is generated according to the release operation by the learner S.
- AR Augmented ity Reality
- processing may be performed. In the AR processing, even if there is no release operation of the learner S, capture is repeatedly performed by the image sensor of the image generation unit 14, and the subsequent processing is performed each time.
- an image of a teaching material photographed at a predetermined frame rate is displayed on the display panel of the learner terminal 10 and is superposed on the image, and a serial number mark including link information to an explanation video (see FIG. 10) is displayed.
- the search result screen generation unit 224 is provided in the learner terminal 10. Instead of generating the search result screen, the search result screen generation unit 224 generates a serial number mark to be superimposed on the image, and adds the generated mark to the image captured at a predetermined frame rate and displayed on the display panel. Superimpose.
- the learner S simply holds the learner terminal 10 over the learning material, and obtains an image of the learning material on which a mark including link information to the explanation video is superimposed on the display panel of the learner terminal 10. be able to.
- the problem information is an image file or a feature amount obtained from an image.
- the problem information of the present invention is not limited to this.
- the problem information may be text data obtained by performing character recognition on an image, for example.
- the problem information is generated by photographing the teaching material with the image generation unit 14, but the problem information may be generated by the learner S reading the question part of the teaching material. That is, the problem information may be voice data, feature data extracted from the voice data, or text data obtained by performing voice recognition on the voice data (hereinafter, “voice recognition text”). .
- the reference page information database 23 stores feature data for each page of a plurality of teaching materials or for each problem of a plurality of pages of a plurality of teaching materials. .
- a voice recognition process is performed instead of the feature quantity extraction process in the feature quantity extraction unit 221, and each page of a plurality of teaching materials is stored in the reference page information database 23, or Text data is stored for each question on a plurality of pages of a plurality of teaching materials.
- the search result screen generation unit 224 generates a search result screen including link information to the commentary video.
- the content of the voice recognized on the search result screen may be displayed as text.
- the search result screen generation unit 224 may be omitted, and if the problem identification unit 223 succeeds in identifying the problem, the distribution processing unit 225 may start distributing the corresponding commentary video without generating the search result screen. .
- commentary videos for learners have been provided on the Internet.
- the learner views the video in order according to the order provided by the explanation video provider, or an index attached to the explanation video (for example, the video).
- the present invention is based on conventional learning using non-electronic teaching materials such as learners actively reading textbooks and solving problem collections, and distribution of commentary videos there. Planning a combined learning support.
- the learner when a learner makes a question while learning using a learning material, the learner is provided with a commentary video about the question portion of the learning material.
- An operation for a question to a learner terminal by a learner is equivalent to an action of asking a teacher a question that is not known in conventional learning.
- the content of the commentary video is not a general solution, it is a content that explains how to actually solve the exercise problem, so it is exactly the same as a teacher teaching you how to solve a problem you do not understand An effect is obtained. That is, according to the learning support system of the embodiment of the present invention, a learning environment is provided in which questions can be asked to the teacher anytime and anywhere in learning using textbooks and problem collections.
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Tourism & Hospitality (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Electrically Operated Instructional Devices (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
This learning support system (100) includes a learner's terminal (10) and a learning support server (20) capable of communicating with each other via a communication network. The learner's terminal (10) includes a control unit (13) for generating problem information representing the content of a problem included in a teaching material, and a transmitter-receiver (25) for transmitting the problem information generated by the control unit (13) to the learning support server (20). The learning support server (20) includes a transmitter-receiver (21) for receiving the problem information transmitted from the transmitter-receiver (15), a teaching content database (26) for storing teaching content, and a control unit (22) for acquiring, from the teaching content database (26), teaching content corresponding to a problem indicated by the problem information. The transmitter-receiver (21) transmits the teaching content acquired by the control unit (22) to the learner's terminal (10).
Description
本発明は、教材を用いた学習を支援する学習支援システム、学習支援サーバ、学習支援方法、及び学習支援プログラムに関するものである。
The present invention relates to a learning support system, a learning support server, a learning support method, and a learning support program that support learning using teaching materials.
近年、学習者による学習を情報処理技術及び通信技術を用いて支援する学習支援システムが活用されている。このような学習支援システムは、例えば、タブレット端末等の学習者端末と学習支援サーバとが通信ネットワークで接続されて構成されている。学習支援サーバは、学習者端末に講義、演習問題、演習問題に対する解説等の学習コンテンツ(テキスト、画像、音声、動画等)を提供し、学習者は学習者端末で学習コンテンツを出力して学習を行う。
In recent years, learning support systems that support learning by learners using information processing technology and communication technology have been utilized. Such a learning support system is configured, for example, by connecting a learner terminal such as a tablet terminal and a learning support server via a communication network. The learning support server provides learning content (text, images, audio, video, etc.) such as lectures, exercises, and commentary on the exercises to the learner terminal, and the learner outputs the learning content at the learner terminal and learns I do.
また、学習支援サーバから学習者端末に演習問題を送信し、学習者端末から学習支援サーバに演習問題に対する学習者の解答を送信し、その演習問題に対する解説コンテンツを学習支援サーバから学習者端末に送信する双方向の学習支援システムも知られている(例えば特許文献1、2)。
In addition, the exercise problem is transmitted from the learning support server to the learner terminal, the learner's answer to the exercise problem is transmitted from the learner terminal to the learning support server, and the explanation content for the exercise problem is transmitted from the learning support server to the learner terminal. A bidirectional learning support system for transmitting is also known (for example, Patent Documents 1 and 2).
さらに、このような学習支援システムによって、学習者の学習履歴を管理し、学習者の学力に応じた問題を提示するなど、情報処理を駆使して効率的な学習支援を行うことも提案されている。
Furthermore, it has been proposed that such a learning support system provides efficient learning support using information processing, such as managing the learner's learning history and presenting problems according to the learner's academic ability. Yes.
本発明は、教材を利用して学習する学習者の学習支援を行う新規な学習支援システム、学習支援サーバ、学習支援方法、及び学習支援プログラムを提供することを目的とする。
An object of the present invention is to provide a novel learning support system, a learning support server, a learning support method, and a learning support program that support learning of a learner who learns using teaching materials.
本発明の一態様の学習支援システムは、教材に含まれる問題の内容を示す問題情報を生成するための第1の制御部と、解説コンテンツを記憶する解説コンテンツ記憶部と、前記問題情報が示す問題に対応する解説コンテンツを検索して、前記解説コンテンツ記憶部から前記対応する解説コンテンツを取得する第2の制御部とを備えた構成を有している。
A learning support system according to an aspect of the present invention includes a first control unit for generating problem information indicating the content of a problem included in a teaching material, a comment content storage unit that stores comment content, and the problem information And a second control unit that retrieves the commentary content corresponding to the problem and acquires the corresponding commentary content from the commentary content storage unit.
以下、本発明の実施の形態の学習支援システムについて説明する。なお、以下に説明する実施の形態は、本発明を実施する場合の一例を示すものであって、本発明を以下に説明する具体的構成に限定するものではない。本発明の実施にあたっては、実施の形態に応じた具体的構成が適宜採用されてよい。
Hereinafter, the learning support system according to the embodiment of the present invention will be described. The embodiment described below shows an example when the present invention is implemented, and the present invention is not limited to the specific configuration described below. In carrying out the present invention, a specific configuration according to the embodiment may be adopted as appropriate.
本発明の第1-1の態様は、教材に含まれる問題の内容を示す問題情報を生成するための第1の制御部と、解説コンテンツを記憶する解説コンテンツ記憶部と、前記問題情報が示す問題に対応する解説コンテンツを検索して、前記解説コンテンツ記憶部から前記対応する解説コンテンツを取得する第2の制御部とを備えたことを特徴とする学習支援システムである。
The 1-1 aspect of the present invention is the first control unit for generating problem information indicating the content of the problem included in the teaching material, the comment content storage unit for storing comment content, and the problem information A learning support system comprising: a second control unit that searches for commentary content corresponding to a problem and obtains the corresponding commentary content from the commentary content storage unit.
学習者による学習(例えば、問題演習)をすべて学習者端末で行うと、紙面の文字を読み、紙面に解答を書くという従来の学習方法とは異なり、すべて学習者端末への入力(マウスによる入力、タッチパネルによる入力、ペンタブレットによる入力等)で行うこととなり、入力作業の手間による学習効率の低下、学習者端末を長時間利用することによる目の疲れ、実際の試験での解答方式(解答用紙への記入)との相違等が懸念されるところ、第1-1の態様によれば、教科書、問題集等の非電子的な教材を用いて学習する学習者の学習支援を行うことができる。
When all learning by a learner (for example, problem exercises) is performed on the learner's terminal, input to the learner's terminal (input with the mouse) is different from the conventional learning method of reading the letters on the paper and writing the answers on the paper. , Touch panel input, pen tablet input, etc.), learning efficiency decreases due to labor of input work, eye fatigue due to prolonged use of learner terminal, answer method in actual test (answer sheet) However, according to Aspect 1-1, it is possible to provide learning support for learners who use non-electronic materials such as textbooks and problem collections. .
本発明の第1-2の態様は、第1-1の態様の学習支援システムにおいて、前記学習支援システムは、通信ネットワークを介して互いに通信可能な学習者端末と学習支援サーバとを備え、前記第1の制御部は、前記学習者端末に備えられ、前記解説コンテンツ記憶部及び前記第2の制御部は、前記学習支援サーバに備えられ、前記学習者端末は、さらに、前記第1の制御部にて生成された前記問題情報を前記学習支援サーバに送信する端末送信部を備え、前記学習支援サーバは、さらに、前記端末送信部より送信された前記問題情報を受信するサーバ受信部と、前記第2の制御部にて取得された前記解説コンテンツを前記学習者端末に送信するサーバ送信部とを備えたことを特徴とする。この構成により、学習者端末が学習支援サーバに問題情報を送ると、学習支援サーバではその問題情報に対応する解説コンテンツが自動で取得されて、学習者端末に送信されるので、学習者は、自らが送信した問題に対する解説コンテンツを比較的速やかに得ることができる。
A 1-2 aspect of the present invention is the learning support system according to the 1-1 aspect, wherein the learning support system includes a learner terminal and a learning support server that can communicate with each other via a communication network. The first control unit is provided in the learner terminal, the comment content storage unit and the second control unit are provided in the learning support server, and the learner terminal further includes the first control. A terminal transmission unit that transmits the problem information generated by the unit to the learning support server, and the learning support server further includes a server reception unit that receives the problem information transmitted from the terminal transmission unit; And a server transmission unit that transmits the comment content acquired by the second control unit to the learner terminal. With this configuration, when the learner terminal sends problem information to the learning support server, the learning support server automatically acquires the comment content corresponding to the problem information and transmits it to the learner terminal. It is possible to obtain explanation content for the problem that the user has sent relatively quickly.
本発明の第1-3の態様は、第1-1又は1-2の態様の学習支援システムにおいて、前記問題情報は、前記教材を撮影することで得られた問題画像であることを特徴とする。この構成により、学習者は教材を撮影するという簡単な操作で容易に問題情報を生成できる。
A 1-3 aspect of the present invention is the learning support system according to the 1-1 or 1-2 aspect, wherein the problem information is a problem image obtained by photographing the teaching material. To do. With this configuration, the learner can easily generate problem information with a simple operation of photographing the teaching material.
本発明の第1-4の態様は、第1-1又は第1-2の態様の学習支援システムにおいて、前記問題情報は、教材を撮影することで得られた問題画像から抽出された特徴量であることを特徴とする。この構成により、学習者端末から学習支援サーバに対して画像を送る必要がなく、通信負荷を軽減できる。
In the 1-4 aspect of the present invention, in the learning support system according to the 1-1 or 1-2 aspect, the problem information is a feature amount extracted from a problem image obtained by photographing a teaching material. It is characterized by being. With this configuration, it is not necessary to send an image from the learner terminal to the learning support server, and the communication load can be reduced.
本発明の第1-5の態様は、第1-1ないし第1-4のいずれかの態様の学習支援システムにおいて、前記解説コンテンツは動画像であることを特徴とする。この構成により、学習者は動画像で解説を視聴することができる。
According to a first to fifth aspect of the present invention, in the learning support system according to any one of the first to first to fourth aspects, the commentary content is a moving image. With this configuration, the learner can view the commentary with a moving image.
本発明の第1-6の態様は、通信ネットワークを介して学習者端末と通信可能な学習支援サーバであって、前記学習者端末より送信された問題情報を受信する受信部と、解説コンテンツを記憶する解説コンテンツ記憶部と、前記解説コンテンツ記憶部から前記問題情報が示す問題に対応する解説コンテンツを取得する制御部と、前記制御部にて取得された前記解説コンテンツを前記学習者端末に送信する送信部とを備えた構成を有している。この構成によれば、解説コンテンツが解説コンテンツ記憶部に用意され、学習者端末が学習支援サーバに問題情報を送ると、学習支援サーバではその問題情報に対応する解説コンテンツが自動で取得されて、学習者端末に送信されるので、学習者は、自らが送信した問題に対する解説コンテンツを比較的速やかに得ることができる。
According to a first to sixth aspect of the present invention, there is provided a learning support server capable of communicating with a learner terminal via a communication network, a receiving unit for receiving problem information transmitted from the learner terminal, and an explanation content. A comment content storage unit to be stored, a control unit that acquires comment content corresponding to the problem indicated by the problem information from the comment content storage unit, and the comment content acquired by the control unit is transmitted to the learner terminal And a transmission unit. According to this configuration, when the commentary content is prepared in the commentary content storage unit and the learner terminal sends the problem information to the learning support server, the learning support server automatically acquires the commentary content corresponding to the problem information, Since it is transmitted to the learner's terminal, the learner can obtain explanation content for the problem transmitted by himself / herself relatively quickly.
本発明の第1-7の態様は、通信ネットワークを介して学習者端末と通信可能であり、かつ解説コンテンツを記憶する解説コンテンツ記憶部を備えた学習支援サーバにおける学習支援方法であって、前記学習支援方法は、前記学習者端末より送信された問題情報を受信する受信ステップと、前記解説コンテンツ記憶部から前記問題情報が示す問題に対応する解説コンテンツを取得する取得ステップと、前記取得ステップにて取得された前記解説コンテンツを前記学習者端末に送信する送信ステップとを含む構成を有している。この構成によっても、解説コンテンツが解説コンテンツ記憶部に用意され、学習者端末が学習支援サーバに問題情報を送ると、学習支援サーバではその問題情報に対応する解説コンテンツが自動で検索されて、学習者端末に送信されるので、学習者は、自らが送信した問題に対する解説コンテンツを比較的速やかに得ることができる。
A 1-7th aspect of the present invention is a learning support method in a learning support server that is communicable with a learner terminal via a communication network and includes a comment content storage unit that stores comment content. The learning support method includes a reception step of receiving problem information transmitted from the learner terminal, an acquisition step of acquiring comment content corresponding to the problem indicated by the problem information from the comment content storage unit, and the acquisition step. And transmitting the comment content acquired in this way to the learner's terminal. Even with this configuration, commentary content is prepared in the commentary content storage unit, and when the learner's terminal sends problem information to the learning support server, the learning support server automatically searches for commentary content corresponding to the problem information and learns. Since it is transmitted to the learner terminal, the learner can obtain the explanation content for the problem transmitted by himself / herself relatively quickly.
本発明の第1-8の態様は、通信ネットワークを介して学習者端末と通信可能であり、かつ解説コンテンツを記憶した解説コンテンツ記憶部を備えた学習支援サーバのコンピュータを、前記学習者端末より送信された問題情報を受信する受信部、前記解説コンテンツ記憶部から前記問題情報が示す問題に対応する解説コンテンツを取得する制御部、及び前記制御部にて取得された前記解説コンテンツを前記学習者端末に送信する送信部として機能させる構成を有している。
According to a 1-8th aspect of the present invention, a computer of a learning support server that is communicable with a learner terminal via a communication network and includes a comment content storage unit that stores comment content is provided by the learner terminal. A receiving unit that receives the transmitted problem information, a control unit that acquires comment content corresponding to the problem indicated by the problem information from the comment content storage unit, and the comment content acquired by the control unit as the learner It has a configuration that functions as a transmission unit that transmits to a terminal.
本発明の第2-1の態様は、教材を用いた学習を支援する学習支援システムであって、教材の頁の情報である頁情報を生成するための頁情報生成部と、前記頁情報生成部で生成された前記頁情報の中の質問箇所を指定する質問箇所指定情報を生成する指定情報生成部と、教材の複数の頁の各々について頁の内容を示す参照頁情報を記憶した参照頁情報記憶部から、前記頁情報生成部で生成された前記頁情報に対応する頁を検索する頁検索部と、前記頁検索部にて検索された頁に含まれる複数の問題に対応する複数の解説コンテンツから、前記質問箇所指定情報が指定する問題に対応する解説コンテンツを特定する解説コンテンツ特定部とを備えた構成を有している。
A 2-1 aspect of the present invention is a learning support system that supports learning using a learning material, and includes a page information generation unit for generating page information that is information on a page of the learning material, and the page information generation A reference page for storing reference page information indicating the contents of each of a plurality of pages of the teaching material, and a specification information generation unit for generating question part specification information for specifying a question part in the page information generated by the part A page search unit that searches a page corresponding to the page information generated by the page information generation unit from an information storage unit, and a plurality of items corresponding to a plurality of problems included in the page searched by the page search unit The system includes a comment content specifying unit that specifies comment content corresponding to the problem specified by the question location specifying information from the comment content.
この構成によっても、教科書、問題集等の非電子的な教材を用いて学習する学習者の学習支援を行うことができる。特に、上記の構成により、まず、頁検索を行って頁を特定した上で、質問箇所指定情報を用いて解説コンテンツを特定するので、学習者が要求している解説コンテンツの特定を容易にできる。
This configuration also enables learners to learn using non-electronic materials such as textbooks and problem collections. In particular, with the above configuration, the page is first searched to identify the page, and then the commentary content is identified using the question location designation information. This makes it easy to identify the commentary content requested by the learner. .
本発明の第2-2の態様は、第2-1の態様の学習支援システムにおいて、前記参照頁情報記憶部は、前記参照頁情報として、教材の複数の頁の各々から抽出した特徴量を記憶しており、前記頁検索部は、前記参照頁情報記憶部に記憶された特徴量と、前記教材の頁から抽出された特徴量とを用いて、前記頁情報生成部にて生成された前記頁情報に対応する頁を検索することを特徴とする学習支援システムである。この構成により、特徴量を用いて高速かつ正確に頁の検索ができる。
According to a 2-2 aspect of the present invention, in the learning support system according to the 2-1 aspect, the reference page information storage unit uses, as the reference page information, a feature amount extracted from each of a plurality of pages of the teaching material. The page search unit is generated by the page information generation unit using the feature amount stored in the reference page information storage unit and the feature amount extracted from the page of the teaching material. A learning support system that searches for a page corresponding to the page information. With this configuration, it is possible to search for pages quickly and accurately using feature amounts.
本発明の第2-3の態様は、第2-2の態様の学習支援システムにおいて、学習者端末と学習支援サーバとを備え、前記頁情報生成部、及び前記指定情報生成部は、前記学習者端末に備えられ、前記頁検索部、及び前記解説コンテンツ特定部は、前記学習支援サーバに備えら、前記学習者端末は、前記頁情報及び前記質問箇所指定情報を前記学習支援サーバに送信し、前記学習支援サーバは、さらに、前記頁情報から特徴量を抽出する特徴量抽出部を備え、前記頁検索部は、前記特徴量抽出部にて抽出された特徴量と前記参照頁情報記憶部に記憶された特徴量とを用いて、前記頁情報生成部にて生成された前記頁情報に対応する頁を検索し、前記学習支援サーバは、さらに、前記解説コンテンツ特定部にて特定された前記解説コンテンツを前記学習者端末に送信するサーバ送信部を備えたことを特徴とする学習支援システムである。この構成により、学習者端末が担当する処理を軽くすることができる。
A 2-3 aspect of the present invention is the learning support system according to the 2-2 aspect, comprising a learner terminal and a learning support server, wherein the page information generation unit and the designation information generation unit Provided in the learner terminal, wherein the page search unit and the comment content specifying unit are provided in the learning support server, and the learner terminal transmits the page information and the question location designation information to the learning support server. The learning support server further includes a feature amount extraction unit that extracts a feature amount from the page information, and the page search unit includes the feature amount extracted by the feature amount extraction unit and the reference page information storage unit. The page corresponding to the page information generated by the page information generation unit is searched using the feature amount stored in the page, and the learning support server is further specified by the comment content specifying unit The commentary content A learning support system comprising the server transmission unit for transmitting to the serial learner terminal. With this configuration, the process handled by the learner terminal can be reduced.
本発明の第2-4の態様は、第2-2の態様の学習支援システムにおいて、学習者端末と学習支援サーバとを備え、前記頁情報生成部、及び前記指定情報生成部は、前記学習者端末に備えられ、前記学習者端末は、さらに、前記頁情報から特徴量を抽出する特徴量抽出部を備え、前記頁検索部、及び前記解説コンテンツ特定部は、前記学習支援サーバに備えられ、前記頁情報生成部は、前記特徴量を前記頁情報とし、前記学習者端末は、前記頁情報及び前記質問箇所指定情報を前記学習支援サーバに送信し、前記頁検索部は、前記特徴量抽出部にて抽出された特徴量と前記参照頁情報記憶部に記憶された特徴量とを用いて、前記頁情報生成部にて生成された前記頁情報に対応する頁を検索し、前記学習支援サーバは、さらに、前記解説コンテンツ特定部にて特定された前記解説コンテンツを前記学習者端末に送信するサーバ送信部を備えたことを特徴とする学習支援システムである。この構成により、学習者端末から学習支援サーバに送信されるデータを軽くすることができる。
The 2-4th aspect of the present invention is the learning support system according to the 2nd-2 aspect, comprising a learner terminal and a learning support server, wherein the page information generation unit and the designation information generation unit Provided in the learner terminal, the learner terminal further comprising a feature quantity extraction unit that extracts a feature quantity from the page information, and the page search unit and the comment content specifying unit are provided in the learning support server. The page information generation unit uses the feature amount as the page information, the learner terminal transmits the page information and the question location designation information to the learning support server, and the page search unit includes the feature amount. Using the feature amount extracted by the extraction unit and the feature amount stored in the reference page information storage unit, the page corresponding to the page information generated by the page information generation unit is searched, and the learning The support server further includes the explanation console. A learning support system comprising the server transmission unit that transmits the commentary content identified in the learner terminal by Ntsu particular unit. With this configuration, data transmitted from the learner terminal to the learning support server can be reduced.
本発明の第2-5の態様は、第2-2の態様の学習支援システムにおいて、学習者端末と学習支援サーバとを備え、前記頁情報生成部、前記指定情報生成部、及び前記頁検索部は、前記学習者端末に備えられ、前記解説コンテンツ特定部は、前記学習支援サーバに備えられ、前記学習者端末は、前記頁検索部における頁の検索の結果及び前記質問箇所指定情報を前記学習支援サーバに送信し、前記学習支援サーバは、前記解説コンテンツ特定部にて特定された前記解説コンテンツを前記学習者端末に送信することを特徴とする。この構成により、学習者端末から学習支援サーバに送信されるデータをさらに軽くすることができる。
A 2-5th aspect of the present invention is the learning support system according to the 2nd-2 aspect, comprising a learner terminal and a learning support server, wherein the page information generation unit, the specified information generation unit, and the page search Is provided in the learner terminal, the commentary content specifying unit is provided in the learning support server, and the learner terminal receives the page search result and the question location designation information in the page search unit. The learning support server transmits the comment content specified by the comment content specifying unit to the learner terminal. With this configuration, data transmitted from the learner terminal to the learning support server can be further reduced.
本発明の第2-6の態様は、第2-1ないし第2-5のいずれかの態様の学習支援システムにおいて、前記質問箇所指定情報は、前記頁情報中の質問箇所の点位置を示す情報であることを特徴とする。この構成により、学習者は、生成された頁情報中の一点を指定するという簡単な操作で質問箇所を指定することができる。
According to a 2-6th aspect of the present invention, in the learning support system according to any one of the 2nd to 2-5th aspects, the question location specifying information indicates a point position of the question location in the page information. It is characterized by being information. With this configuration, the learner can specify the question part by a simple operation of specifying one point in the generated page information.
第2-7の態様は、第2-1ないし第2-5のいずれかの態様の学習支援システムにおいて、前記質問箇所指定情報は、前記頁情報中の質問箇所の領域を示す情報であることを特徴とする。この構成により、学習者は、生成された頁情報中の領域を指定することで質問箇所を指定することができる。
In a second to seventh aspect, in the learning support system according to any one of the second to second to fifth aspects, the question location specifying information is information indicating a region of the question location in the page information It is characterized by. With this configuration, the learner can specify a question location by specifying an area in the generated page information.
本発明の第2-8の態様は、第2-3ないし第2-5のいずれかの態様の学習支援システムにおいて、前記学習支援サーバは、前記学習支援サーバから前記学習者端末に前記解説コンテンツを送信するためのリンク情報を含む検索結果画面を生成する検索結果画面生成部をさらに備え、前記学習支援サーバは、前記検索結果画面を前記学習者支援端末に送信するとともに、前記学習者端末から、前記リンク情報を用いて前記解説コンテンツの送信を要求されたときに、前記参照頁情報記憶部に記憶された複数の頁の各々に含まれる問題に対応する解説コンテンツを記憶した解説コンテンツ記憶部から、送信の要求をされた前記解説コンテンツを読み出して、前記学習者端末に送信することを特徴とする。この構成により、学習者は、まずリンク情報を含む検索結果画面を受信することで、解説コンテンツが適切に特定されたことを確認してから、その解説コンテンツを送信する学習支援サーバに指示することができる。
According to a 2-8th aspect of the present invention, in the learning support system according to any one of the 2-3th to 2-5 aspects, the learning support server sends the explanation content from the learning support server to the learner terminal. A search result screen generation unit that generates a search result screen including link information for transmitting the search information, and the learning support server transmits the search result screen to the learner support terminal, and from the learner terminal When the transmission of the commentary content is requested using the link information, the commentary content storage unit stores commentary content corresponding to the problem included in each of the plurality of pages stored in the reference page information storage unit The comment content requested to be transmitted is read out and transmitted to the learner terminal. With this configuration, the learner first receives a search result screen including link information, confirms that the commentary content has been properly identified, and then instructs the learning support server that transmits the commentary content. Can do.
本発明の第2-9の態様は、第2-1ないし第2-8のいずれかの態様の学習支援システムにおいて、前記参照頁情報記憶部には、前記参照頁情報に教材の情報が関連付けられて記憶されており、前記頁検索部は、前記学習者端末のユーザごとに、当該ユーザが使用する教材の情報を記憶した教材記憶部を参照して、教材を絞り込んだ上で、前記頁情報に対応する頁を検索することを特徴とする。この構成により、まず教材を特定してから該当する教材の参照頁情報を参照して頁情報に対する頁を検索するので、検索精度が向上する。
According to a 2-9th aspect of the present invention, in the learning support system according to any one of the 2nd to 2-8th aspects, the reference page information storage section associates teaching material information with the reference page information. The page search unit refers to the learning material storage unit that stores information on the learning material used by the user for each user of the learner terminal, narrows the learning material, and then selects the page. It is characterized by searching a page corresponding to information. With this configuration, first, the learning material is specified, and then the page for the page information is searched with reference to the reference page information of the corresponding learning material, so that the search accuracy is improved.
本発明の第2-10の態様は、第2-1ないし第2-8のいずれかの態様の学習支援システムにおいて、前記頁検索部が前記頁情報に対応する頁を検索できなかった場合に、前記頁情報生成部で生成された前記頁情報の教材の情報を入力するための画面を学習者に提示することを特徴とする。この構成により、学習支援サーバでは、参照頁情報記憶部に参照頁情報が記憶されていない教材を知ることができ、学習支援サーバの管理者は、有効に参照頁情報記憶部に記憶する参照頁情報の充実化を図ることができる。
The 2-10th aspect of the present invention is the learning support system according to any one of the 2-1 to 2-8 aspects, wherein the page search unit cannot search a page corresponding to the page information. A screen for inputting information of the teaching material of the page information generated by the page information generation unit is presented to the learner. With this configuration, the learning support server can know the teaching material in which the reference page information is not stored in the reference page information storage unit, and the administrator of the learning support server effectively stores the reference page in the reference page information storage unit. Information can be enhanced.
本発明の第2-11の態様は、第2-1ないし第2-8のいずれかの態様の学習支援システムにおいて、前記頁検索部が前記頁情報に対応する頁を検索できなかった場合に、頁の情報を生成するよう促すメッセージを学習者に対して出力することを特徴とする。この構成により、学習者端末では、対応する解説コンテンツが得られるように、頁情報の生成をし直すことができる。
The 2nd-11th aspect of the present invention is the learning support system according to any one of the 2-1st to 2-8th aspects, wherein the page search unit cannot search a page corresponding to the page information. A message that prompts the learner to generate page information is output to the learner. With this configuration, the learner terminal can regenerate the page information so that the corresponding commentary content can be obtained.
本発明の第2-12の態様は、第2-1ないし第2-8のいずれかの態様の学習支援システムにおいて、前記頁検索部が前記頁情報に対応する頁を検索できなかった場合に、教材が登録されていないことを通知するメッセージを学習者に対して出力することを特徴とする。この構成により、学習者端末では、対応する解説コンテンツが得られないのは、頁情報の生成方法の不備ではなく、教材が登録されていないことを知ることができ、無駄に頁情報の生成、及び送信を繰り返すことを回避できる。
The 2nd-12th aspect of the present invention is the learning support system according to any one of the 2nd-1st to 2-8th aspects, in the case where the page retrieval unit cannot retrieve a page corresponding to the page information. A message notifying that the learning material is not registered is output to the learner. With this configuration, the learner terminal cannot obtain the corresponding commentary content because it is not a deficiency in the page information generation method, it can be known that the teaching material has not been registered, the generation of page information wasted, And repeated transmissions can be avoided.
本発明の第2-13の態様は、教材を用いた学習を支援する学習支援システムであって、教材の頁の情報である頁情報を生成するための頁情報生成部と、教材の複数の頁の各々について各頁の内容を示す参照頁情報を記憶した参照頁情報記憶部から、前記頁情報生成部にて生成された前記頁情報に対応する頁を検索する頁検索部と、前記参照頁情報記憶部に記憶された複数の頁の各々に含まれる問題に対応する解説コンテンツへのリンク情報を記憶した解説コンテンツリンク記憶部から、前記頁検索部にて検索された頁に含まれる問題に対応するリンク情報を読み出して、読み出したリンク情報を含む検索結果画面を生成する検索結果画面生成部と、前記検索結果画面を表示する表示部とを備えたことを特徴とする。この構成により、頁の内容を示す頁情報を用いて検索を行って頁を特定することでその頁に含まれる問題を特定するので、問題特定の確度を向上できる。
A 2nd-13th aspect of the present invention is a learning support system for supporting learning using a learning material, comprising a page information generating unit for generating page information which is information on a page of the learning material, and a plurality of learning materials. A page search unit that searches for a page corresponding to the page information generated by the page information generation unit from a reference page information storage unit that stores reference page information indicating the contents of each page for each page, and the reference Problems included in pages searched by the page search unit from the description content link storage unit storing link information to the description content corresponding to the problems included in each of the plurality of pages stored in the page information storage unit A search result screen generation unit that reads the link information corresponding to the link information, generates a search result screen including the read link information, and a display unit that displays the search result screen. With this configuration, the problem included in the page is specified by performing a search using page information indicating the contents of the page and specifying the page, so that the accuracy of specifying the problem can be improved.
本発明の第2-14の態様は、教材の頁の画像から当該頁の頁情報として特徴量を抽出する特徴量抽出部と、前記画像の中の質問箇所を指定する質問箇所指定情報を生成する指定情報生成部と、前記特徴量と前記質問箇所指定情報を前記学習支援サーバに送信する送信部とを備えた学習者端末とともに学習支援システムを構成する学習支援サーバであって、前記学習者端末から送信された前記特徴量と前記質問箇所指定情報を受信する受信部と、教材の複数の頁の各々から抽出した特徴量を参照頁情報として記憶した参照頁情報記憶部から、前記受信部にて受信した前記特徴量に対応する参照頁情報としての特徴量を有する頁を検索する頁検索部と、前記頁検索部にて検索された頁に含まれる複数の問題に対応する複数の解説コンテンツから、前記質問箇所指定情報が指定する問題に対応する解説コンテンツを特定する解説コンテンツ特定部と、前記解説コンテンツ特定部にて特定された前記解説コンテンツへのリンク情報を前記学習者端末に送信する送信部とを備えたことを特徴とする。この構成により、まず、頁検索を行って頁を特定した上で、質問箇所指定情報を用いて解説コンテンツを特定するので、学習者が要求している解説コンテンツの特定を容易にできる。
According to the 2-14th aspect of the present invention, a feature amount extraction unit for extracting feature amounts as page information of the page from the image of the teaching material page, and question location designation information for designating a question location in the image are generated. A learning support server that constitutes a learning support system together with a learner terminal including a designation information generation unit that performs, and a transmission unit that transmits the feature amount and the question location designation information to the learning support server, wherein the learner From the receiving unit that receives the feature amount and the question location designation information transmitted from the terminal, and from the reference page information storage unit that stores the feature amount extracted from each of a plurality of pages of the teaching material as the reference page information, the receiving unit A page search unit for searching for a page having a feature quantity as reference page information corresponding to the feature quantity received in the step, and a plurality of explanations corresponding to a plurality of problems included in the page searched by the page search unit. Content A comment content specifying unit for specifying commentary content corresponding to the problem specified by the question location specification information, and transmission for transmitting link information to the commentary content specified by the comment content specifying unit to the learner terminal And a section. With this configuration, first, a page search is performed to identify the page, and then the comment content is identified using the question location designation information. Therefore, it is possible to easily identify the comment content requested by the learner.
本発明の第2-15の態様は、教材の頁の画像から当該頁の頁情報として特徴量を抽出する特徴量抽出部と、前記画像の中の質問箇所を指定する質問箇所指定情報を生成する指定情報生成部と、前記特徴量と前記質問箇所指定情報を前記学習支援サーバに送信する送信部とを備えた学習者端末とともに学習支援システムを構成する学習支援サーバにおける学習支援方法であって、前記学習者端末から送信された前記特徴量と前記質問箇所指定情報を受信する受信ステップと、教材の複数の頁の各々から抽出した特徴量を参照頁情報として記憶した参照頁情報記憶部から、前記受信ステップにて受信した前記特徴量に対応する前記参照頁情報としての特徴量を有する頁を検索する頁検索ステップと、前記頁検索ステップにて検索された頁に含まれる複数の問題に対応する複数の解説コンテンツから、前記質問箇所指定情報が指定する問題に対応する解説コンテンツを特定する解説コンテンツ特定ステップと、前記解説コンテンツ特定ステップにて特定された前記解説コンテンツへのリンク情報を前記学習者端末に送信する送信ステップとを含むことを特徴とする。この構成によっても、まず、頁検索を行って頁を特定した上で、質問箇所指定情報を用いて解説コンテンツを特定するので、学習者が要求している解説コンテンツの特定を容易にできる。
According to a 2-15th aspect of the present invention, a feature amount extraction unit for extracting feature amounts as page information of the page from the image of the teaching material page, and question location designation information for designating a question location in the image are generated. A learning support method in a learning support server that constitutes a learning support system together with a learner terminal including a designation information generation unit that performs transmission, and a transmission unit that transmits the feature amount and the question location designation information to the learning support server. A receiving step for receiving the feature amount and the question location designation information transmitted from the learner terminal, and a reference page information storage unit storing the feature amount extracted from each of a plurality of pages of the teaching material as reference page information A page search step for searching for a page having a feature quantity as the reference page information corresponding to the feature quantity received in the reception step, and a page searched in the page search step. A comment content specifying step for identifying comment content corresponding to the problem specified by the question location specification information, and the comment content specified in the comment content specifying step Transmitting the link information to the learner terminal. Also with this configuration, first, a page search is performed to identify the page, and then the commentary content is identified using the question location designation information. Therefore, it is easy to identify the commentary content requested by the learner.
本発明の第3-1の態様は、教材を用いた学習を支援する学習支援システムであって、教材に含まれる問題の内容を示す問題情報を生成するための問題情報生成部を備え、教材の複数の頁の各々に含まれる問題の解説コンテンツのリンク情報を記憶した解説コンテンツリンク記憶部を参照して、前記問題情報生成部にて生成された前記問題情報が示す問題に対応する解説コンテンツのリンク情報を読み出して、読み出した前記リンク情報、及び前記問題情報生成部にて生成された前記問題情報を用いて、検索結果を示す検索結果画面を生成する検索結果画面生成部と、前記検索結果画面生成部にて生成された前記検索結果画面を出力する出力部とを備えたことを特徴とする。
A 3-1 aspect of the present invention is a learning support system that supports learning using a learning material, and includes a problem information generation unit for generating problem information indicating the content of a problem included in the learning material, The comment content corresponding to the problem indicated by the problem information generated by the problem information generation unit with reference to the comment content link storage unit storing the link information of the problem comment content included in each of the plurality of pages A search result screen generation unit that generates a search result screen indicating a search result using the read link information and the problem information generated by the problem information generation unit, and the search And an output unit for outputting the search result screen generated by the result screen generation unit.
この構成によっても、教科書、問題集等の非電子的な教材を用いて学習する学習者の学習支援を行うことができる。特に、上記の構成によれば、学習者の教材の内容を示す情報を用いて検索結果画面が生成されるので、学習者の利便性が向上する。
This configuration also enables learners to learn using non-electronic materials such as textbooks and problem collections. In particular, according to the above configuration, the search result screen is generated using information indicating the content of the learner's teaching material, so that the convenience of the learner is improved.
本発明の第3-2の態様は、第3-1の態様の学習支援システムにおいて、前記問題情報は、前記教材を撮像して得られる画像であることを特徴とする。この構成により、学習者による教材への書き込み等も含む自らの教材の画像に、リンク情報が付加された検索結果画面を出力することができるので、学習者の利便性が向上する。
A third aspect of the present invention is characterized in that in the learning support system according to the third aspect, the problem information is an image obtained by imaging the teaching material. With this configuration, since the search result screen in which the link information is added to the image of the learning material including the writing to the learning material by the learner can be output, the convenience of the learner is improved.
本発明の第3-3の態様は、第3-1又は第3-2の態様の学習支援システムにおいて、教材の複数の頁の各々に含まれる問題を記憶した問題記憶部を参照して、前記問題情報生成部にて生成された前記問題情報に対応する問題を特定する問題特定部をさらに備え、前記検索結果画面生成部は、前記問題特定部にて特定された問題に対応する解説コンテンツのリンク情報を読み出すことを特徴とする。この構成により、問題情報に対応する解問題を特定して、特定された問題に対応する解説コンテンツのリンク情報を検索結果画面に含めることができる。
According to a 3-3 aspect of the present invention, in the learning support system according to the 3-1 or 3-2 aspect, with reference to the problem storage unit that stores the problems included in each of the plurality of pages of the teaching material, The system further comprises a problem identification unit that identifies a problem corresponding to the problem information generated by the problem information generation unit, and the search result screen generation unit includes commentary content corresponding to the problem identified by the problem identification unit The link information is read out. With this configuration, it is possible to identify the solution problem corresponding to the problem information and include the link information of the commentary content corresponding to the identified problem in the search result screen.
本発明の第3-4の態様は、第3-2の態様の学習支援システムにおいて、前記検索結果画面生成部は、前記問題情報生成部にて生成された前記画像における、前記リンク情報を読み出した問題の位置に、前記リンク情報があることを示すマークを付した前記検索結果画面を生成することを特徴とする。この構成により、学習者端末では、自らが質問をして、解説コンテンツが検索された問題を確認できる。
According to a 3-4th aspect of the present invention, in the learning support system according to the 3-2nd aspect, the search result screen generation unit reads the link information in the image generated by the problem information generation unit. The search result screen is generated with a mark indicating that the link information exists at the position of the problem. With this configuration, the learner terminal can ask a question by himself and confirm the problem that the commentary content has been searched.
本発明の第3-5の態様は、第3-4の態様の学習支援システムにおいて、前記検索結果画面生成部は、前記マークに前記リンク情報を含む前記検索結果画面を生成することを特徴とする。この構成により、学習者端末では、マークを指示するという直観的な操作で解説コンテンツの送信を要求できる。
According to a 3-5th aspect of the present invention, in the learning support system according to the 3-4th aspect, the search result screen generating unit generates the search result screen including the link information in the mark. To do. With this configuration, the learner terminal can request transmission of commentary content through an intuitive operation of instructing a mark.
本発明の第3-6の態様は、第3-2の態様の学習支援システムにおいて、前記検索結果画面生成部は、読み出した前記リンク情報に対応する解説コンテンツの代表画像を含む前記検索結果画面を生成することを特徴とする。この構成により、学習者端末では、解説コンテンツの代表画像を確認した上で、解説コンテンツの送信を要求できる。
According to a 3-6th aspect of the present invention, in the learning support system according to the 3-2nd aspect, the search result screen generating unit includes the search result screen including a representative image of the commentary content corresponding to the read link information. Is generated. With this configuration, the learner terminal can request transmission of the commentary content after confirming the representative image of the commentary content.
第3-7の態様は、第3-6の態様の学習支援システムにおいて、前記検索結果画面生成部は、前記代表画像に前記リンク情報を含む前記検索結果画面を生成することを特徴とする。この構成により、学習者端末では、代表画像を指示するという直観的な操作で解説コンテンツの送信を要求できる。
The 3-7th aspect is characterized in that, in the learning support system according to the 3-6th aspect, the search result screen generation unit generates the search result screen including the link information in the representative image. With this configuration, the learner terminal can request transmission of commentary content through an intuitive operation of instructing a representative image.
本発明の第3-8の態様は、第3-2の態様の学習支援システムにおいて、前記問題情報生成部で生成された前記画像の中の質問箇所を指定する質問箇所指定情報を生成する指定情報生成部をさらに備え、前記検索結果画面生成部は、前記指定情報生成部にて生成された前記質問箇所指定情報が指定する問題に対応する解説コンテンツのリンク情報を読み出すことを特徴とする。この構成により、学習者端末では、教材の画像の中の質問箇所を指定できるので、質問をする際の利便性が向上する。
According to a 3-8th aspect of the present invention, in the learning support system according to the 3-2 aspect, designation for generating question location designation information for designating a question location in the image generated by the problem information generation section An information generation unit is further provided, wherein the search result screen generation unit reads link information of commentary content corresponding to a problem designated by the question location designation information generated by the designation information generation unit. With this configuration, the learner terminal can specify the question location in the teaching material image, so that convenience when asking a question is improved.
本発明の第3-9の態様は、第3-8の態様の学習支援システムにおいて、前記検索結果画面生成部は、前記問題情報生成部にて生成された前記画像における、前記質問箇所指定情報によって指定された質問箇所の画像を用いて、前記検索結果画面を生成することを特徴とする。この構成により、検索結果画面には、学習者端末にて指定した質問箇所の画像が含められるので、質問に係らない部分の画像を排除して、自らが撮影した画像中の、自らの質問に係る部分のみについて、解説コンテンツのリンク情報の有無を確認できる。
According to a 3-9th aspect of the present invention, in the learning support system according to the 3-8th aspect, the search result screen generation unit includes the question location designation information in the image generated by the problem information generation unit. The search result screen is generated using the image of the question location specified by the above. With this configuration, the search result screen includes the image of the question part specified on the learner's terminal, so the image of the part that is not related to the question is excluded and It is possible to confirm the presence / absence of the link information of the commentary content only for the relevant part.
本発明の第3-10の態様は、教材に含まれる問題の内容を示す問題情報を生成するための問題情報生成部を備えた学習者端末とともに学習支援システムを構成する学習支援サーバであって、この学習支援サーバは、教材の複数の頁の各々に含まれる問題の解説コンテンツのリンク情報を記憶した解説コンテンツリンク記憶部を参照して、前記問題情報生成部にて生成された前記問題情報が示す問題に対応する解説コンテンツのリンク情報を読み出して、読み出した前記リンク情報、及び前記問題情報生成部にて生成された前記問題情報を用いて、検索結果を示す検索結果画面を生成する検索結果画面生成部と、前記検索結果画面生成部にて生成された前記検索結果画面を前記学習者端末に送信する送信部とを備えたことを特徴とする。この構成によっても、学習者端末では、学習者の教材の内容を示す情報を用いて検索結果画面が生成されるので、学習者の利便性が向上する。
According to a third to tenth aspect of the present invention, there is provided a learning support server that constitutes a learning support system together with a learner terminal having a problem information generating unit for generating problem information indicating the content of a problem included in a teaching material. The learning support server refers to the comment content link storage unit that stores link information of the comment content of the problem included in each of the plurality of pages of the teaching material, and the problem information generated by the problem information generation unit A search that reads the link information of the commentary content corresponding to the problem indicated by, and generates a search result screen showing the search result using the read link information and the problem information generated by the problem information generation unit A result screen generation unit, and a transmission unit that transmits the search result screen generated by the search result screen generation unit to the learner terminal. Even with this configuration, in the learner terminal, the search result screen is generated using information indicating the contents of the learner's teaching materials, so that the convenience of the learner is improved.
本発明の第3-11の態様は、教材に含まれる問題の内容を示す問題情報を生成するための問題情報生成部を備えた学習者端末とともに学習支援システムを構成する学習支援サーバにおける学習支援方法であって、この学習支援方法は、教材の複数の頁の各々に含まれる問題の解説コンテンツのリンク情報を記憶した解説コンテンツリンク記憶部を参照して、前記問題情報生成部にて生成された前記問題情報が示す問題に対応する解説コンテンツのリンク情報を読み出して、読み出した前記リンク情報、及び前記問題情報生成部にて生成された前記問題情報を用いて、検索結果を示す検索結果画面を生成する検索結果画面生成ステップと、前記検索結果画面生成ステップにて生成された前記検索結果画面を前記学習者端末に送信する送信ステップとを含むことを特徴とする。この構成によっても、学習者端末では、学習者の教材の内容を示す情報を用いて検索結果画面が生成されるので、学習者の利便性が向上する。
The third to eleventh aspects of the present invention provide learning support in a learning support server that constitutes a learning support system together with a learner terminal that includes a problem information generation unit for generating problem information indicating the content of a problem included in a teaching material. This learning support method is generated by the problem information generation unit with reference to a description content link storage unit that stores link information of problem description content included in each of a plurality of pages of the teaching material. The search result screen showing the search result using the link information of the commentary content corresponding to the problem indicated by the problem information and using the read link information and the problem information generated by the problem information generating unit A search result screen generation step for generating the search result screen, and a transmission step for transmitting the search result screen generated in the search result screen generation step to the learner terminal. Tsu, characterized in that it comprises a flop. Even with this configuration, in the learner terminal, the search result screen is generated using information indicating the contents of the learner's teaching materials, so that the convenience of the learner is improved.
以下、図面を参照しながら本発明の実施の形態を説明する。
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(第1の実施の形態)
図1は、本発明の第1の実施の形態の学習支援システムの全体の構成を示す図である。学習支援システム100は、学習者端末10と学習支援サーバ20を含んでいる。学習支援サーバ20はネットワークNWに接続されている。学習者端末10は、ネットワークNWを介して学習支援サーバ20との間で情報通信を行う。学習者端末10は、ネットワークNWと接続された無線基地局と無線通信を行うことでネットワークNWに接続される。 (First embodiment)
FIG. 1 is a diagram showing the overall configuration of the learning support system according to the first embodiment of this invention. Thelearning support system 100 includes a learner terminal 10 and a learning support server 20. The learning support server 20 is connected to the network NW. The learner terminal 10 performs information communication with the learning support server 20 via the network NW. The learner terminal 10 is connected to the network NW by performing wireless communication with a wireless base station connected to the network NW.
図1は、本発明の第1の実施の形態の学習支援システムの全体の構成を示す図である。学習支援システム100は、学習者端末10と学習支援サーバ20を含んでいる。学習支援サーバ20はネットワークNWに接続されている。学習者端末10は、ネットワークNWを介して学習支援サーバ20との間で情報通信を行う。学習者端末10は、ネットワークNWと接続された無線基地局と無線通信を行うことでネットワークNWに接続される。 (First embodiment)
FIG. 1 is a diagram showing the overall configuration of the learning support system according to the first embodiment of this invention. The
学習者端末10は、例えば、スマートフォン、タブレットPC等の携帯情報端末、パーソナルコンピュータ等のコンピュータに学習支援アプリケーションプログラムがインストールされることで実現される。学習支援サーバ20は、Webサーバとデータベースから構成される。ネットワークNWは、インターネットである。
The learner terminal 10 is realized, for example, by installing a learning support application program in a portable information terminal such as a smartphone or a tablet PC, or a computer such as a personal computer. The learning support server 20 includes a web server and a database. The network NW is the Internet.
本実施の形態の学習支援システム100では、学習者端末10は、学習者Sによって任意の場所で使用される端末であることを想定している。ユーザである学習者Sは、教科書や問題集等の非電子的な教材(以下、単に「教材」という。)を用いて学習をしている際に、解説が必要な箇所について、学習支援サーバ20から電子的な解説コンテンツを受信して、この解説コンテンツを学習者端末10で閲覧ないし視聴することで、学習の支援を受けることができる。なお、非電子的な教材とは、典型的には紙媒体の教材であるが、ネットワーク上のアドレスへのリンクを含まない電子書籍も非電子的な教材に含まれる。
In the learning support system 100 of the present embodiment, it is assumed that the learner terminal 10 is a terminal used by the learner S at an arbitrary place. The learner S who is a user learns using a non-electronic teaching material (hereinafter simply referred to as “teaching material”) such as a textbook or a collection of questions about a portion that needs to be explained. By receiving electronic commentary content from 20 and viewing or viewing this commentary content on the learner terminal 10, learning support can be obtained. Note that the non-electronic teaching material is typically a paper-based teaching material, but an electronic book that does not include a link to an address on the network is also included in the non-electronic teaching material.
学習支援システム100によって例えば以下のようにして学習者Sの学習支援が行われる。学習者Sは、例えば自宅で教材を用いた学習をしている際に、教材に記載されている問題が解けず、あるいは、教材に記載されている事項が理解できない場合には、学習者端末10で学習支援アプリケーションプログラム(以下、「アプリ」という。)を立ち上げて、アプリの案内に従って、その教材の該当箇所を撮影する。そして、撮影によって得られた教材の画像データを学習者端末10から学習支援サーバ20に送信する。
Learning support of the learner S is performed by the learning support system 100 as follows, for example. For example, when the learner S does not solve the problem described in the teaching material or understands the matter described in the teaching material when learning using the teaching material at home, the learner terminal 10, a learning support application program (hereinafter referred to as “application”) is launched, and a corresponding portion of the teaching material is photographed according to the guidance of the application. Then, the image data of the learning material obtained by photographing is transmitted from the learner terminal 10 to the learning support server 20.
学習支援サーバ20のデータベースには、教材の各箇所についてそれぞれ解説コンテンツ(本実施の形態では、解説動画)が保存されている。学習支援サーバ20は、学習者端末10から送信されてきた画像データが示す箇所に対応する解説コンテンツをデータベースから抽出して、学習者端末10に送信する。学習者Sは、学習者端末10でこの解説コンテンツを受信して、これを視聴することができる。即ち、学習者Sは、教材を用いた学習をしている際に、分からない箇所があるときは、それを撮影して送信すれば、その箇所の解説動画等の解説コンテンツを視聴できる。以下、このような学習支援システムを実現するための具体的な構成を説明する。
The database of the learning support server 20 stores commentary contents (in this embodiment, commentary videos) for each part of the teaching material. The learning support server 20 extracts commentary content corresponding to the location indicated by the image data transmitted from the learner terminal 10 from the database, and transmits it to the learner terminal 10. The learner S can receive the commentary content at the learner terminal 10 and view it. That is, the learner S can view commentary contents such as commentary videos at a point where a part that is not known during learning using the teaching material is photographed and transmitted. Hereinafter, a specific configuration for realizing such a learning support system will be described.
図2は、本発明の第1の実施の形態の学習者端末の構成を示すブロック図である。学習者端末10は、入力部11、出力部12、制御部13、画像生成部14、及び送受信部15を備えている。また、制御部13は、指定情報生成部131及び送信データ生成部132を備えている。
FIG. 2 is a block diagram illustrating a configuration of the learner terminal according to the first embodiment of this invention. The learner terminal 10 includes an input unit 11, an output unit 12, a control unit 13, an image generation unit 14, and a transmission / reception unit 15. The control unit 13 includes a designation information generation unit 131 and a transmission data generation unit 132.
入力部11は、タッチパネル、物理ボタン、マイクを含む。学習者Sは、入力部11を介して各種の入力を行うことができる。出力部12は、表示パネル及びスピーカを含む。学習者Sは、表示パネルに表示される画面に従って各種の入力を行うことができる。また、学習支援サーバ20から受信した解説コンテンツは、出力部12から出力される。解説コンテンツが動画である場合には、その動画が表示パネルに表示され、スピーカから音声が出力される。
The input unit 11 includes a touch panel, physical buttons, and a microphone. The learner S can make various inputs via the input unit 11. The output unit 12 includes a display panel and a speaker. The learner S can make various inputs according to the screen displayed on the display panel. The comment content received from the learning support server 20 is output from the output unit 12. When the commentary content is a moving image, the moving image is displayed on the display panel, and sound is output from the speaker.
制御部13は、学習者端末10のプロセッサ、RAM、ストレージ等からなるコンピュータが学習支援アプリケーションプログラムを実行することで実現される。その処理には、後述する質問箇所指定情報の生成、送信データの生成の処理が含まれ、図2では、これらの処理機能を指定情報生成部131、送信データ生成部132と表現している。
The control unit 13 is realized by a computer including a processor, a RAM, a storage, and the like of the learner terminal 10 executing a learning support application program. The processing includes generation of question location designation information and generation of transmission data, which will be described later. In FIG. 2, these processing functions are expressed as a designation information generation unit 131 and a transmission data generation unit 132.
画像生成部14は、撮影によって画像を生成するカメラである。画像生成部14は、光学系、撮像素子、画像処理回路を備えており、光学系を通して撮像素子に入射する光学像を、撮像素子にて電気信号に変換する。画像処理回路は、撮像素子から入力した電気信号に基づいて画像データを生成する。画像処理回路で生成された画像は、所定のフレームレートで表示パネルに表示される。学習者Sが入力部11に対してレリーズ操作がされると、画像処理回路はこのときの電気信号から画像ファイル(以下、単に「画像」ともいう。)を作成して、記憶する。以下、この画像ファイルを生成する動作を「撮影」という。
The image generation unit 14 is a camera that generates an image by photographing. The image generation unit 14 includes an optical system, an image sensor, and an image processing circuit, and converts an optical image incident on the image sensor through the optical system into an electrical signal using the image sensor. The image processing circuit generates image data based on the electrical signal input from the image sensor. The image generated by the image processing circuit is displayed on the display panel at a predetermined frame rate. When the learner S performs a release operation on the input unit 11, the image processing circuit creates and stores an image file (hereinafter also simply referred to as “image”) from the electrical signal at this time. Hereinafter, the operation of generating the image file is referred to as “photographing”.
本実施の形態では、学習者Sは、教材を用いた学習の際に、解説を欲する箇所(以下、「質問箇所」という。)があると、当該質問箇所を撮影する。これによって、画像生成部14は、教材の画像を生成する。なお、画像生成部14は、教材を読み取るスキャナであってよく、教材が電子書籍である場合には、その表示画面をキャプチャする手段であってもよい。画像生成部14は、本発明の「頁情報生成部」に相当する。
In the present embodiment, the learner S takes a picture of the question part when there is a part (hereinafter referred to as “question part”) for which explanation is desired during learning using the teaching material. Thereby, the image generation unit 14 generates an image of the teaching material. The image generation unit 14 may be a scanner that reads a learning material, and may be a means for capturing a display screen when the learning material is an electronic book. The image generation unit 14 corresponds to a “page information generation unit” of the present invention.
制御部13は、出力部12の表示パネルにおける表示を制御して、学習者Sに教材の1頁の全体を撮影するように促すメッセージを表示させる。そして、学習者Sが、質問箇所を含む教材の頁全体を撮影すると、指定情報生成部131は、その撮影画像を表示パネルに表示して、学習者Sに頁全体の画像(以下、「頁画像」という。)の中の質問箇所を指定させる。この頁画像は、本発明の「頁情報」に相当し、この頁情報は、本発明の「問題情報」に相当する。
The control unit 13 controls the display on the display panel of the output unit 12 to display a message that prompts the learner S to photograph the entire page of the teaching material. When the learner S captures the entire page of the teaching material including the question part, the designation information generating unit 131 displays the captured image on the display panel, and the learner S displays an image of the entire page (hereinafter, “page”). The question part in "Image") is specified. This page image corresponds to “page information” of the present invention, and this page information corresponds to “problem information” of the present invention.
図3は、本発明の第1の実施の形態の質問箇所の指定の際の表示パネルの画面例を示す図である。画面には、頁画像が表示され、それに重畳して、質問箇所指定枠121が表示されている。質問箇所指定枠121は、頁画像中の質問箇所の領域を示す矩形の枠であり、縦方向及び横方向に任意に拡大、縮小することができる。学習者Sは、質問箇所指定枠121の上下の辺を上下方向にドラッグし、左右の辺を左右方向にドラッグすることで、質問箇所指定枠121を任意の位置及び大きさにすることができる。
FIG. 3 is a diagram showing a screen example of the display panel when the question location is specified according to the first embodiment of this invention. A page image is displayed on the screen, and a question location designation frame 121 is displayed superimposed on the page image. The question location designation frame 121 is a rectangular frame indicating the region of the question location in the page image, and can be arbitrarily enlarged or reduced in the vertical direction and the horizontal direction. The learner S can drag the upper and lower sides of the question location designation frame 121 in the vertical direction and drag the left and right sides in the left and right directions to make the question location designation frame 121 in an arbitrary position and size. .
学習者Sが、質問箇所を囲うように質問箇所指定枠121を設定した後に、「OK」ボタンを押すと、指定情報生成部131は、この枠の位置及び大きさの情報を質問箇所指定情報として確定する。図4は、本発明の第1の実施の形態の指定された質問箇所の画面例を示す図である。学習者Sは、この画面によって、指定した質問箇所を確認することができる。
When the learner S sets the question location designation frame 121 so as to surround the question location and then presses an “OK” button, the designation information generation unit 131 displays the position and size information of this frame as question location designation information. Confirm as FIG. 4 is a diagram illustrating a screen example of a designated question location according to the first embodiment of this invention. The learner S can confirm the designated question location on this screen.
指定情報生成部131にて指定情報が生成されると、送信データ生成部132は、送信データを生成する。図5は、本発明の第1の実施の形態の送信データのデータ構成を示す図である。送信データ生成部132は、その時点の日時を示す日時情報、学習者ごとに与えられているユーザID、画像生成部14にて撮影によって生成された頁画像の画像ファイルである頁画像ファイル、及び指定情報生成部131にて生成された質問箇所指定情報を含む送信データを生成する。この送信データは、本発明の「問題情報」に相当する。
When the designation information generation unit 131 generates the specification information, the transmission data generation unit 132 generates transmission data. FIG. 5 is a diagram illustrating a data configuration of transmission data according to the first embodiment of this invention. The transmission data generation unit 132 includes date and time information indicating the current date and time, a user ID given to each learner, a page image file that is an image file of a page image generated by photographing in the image generation unit 14, and Transmission data including the question location designation information generated by the designation information generation unit 131 is generated. This transmission data corresponds to “problem information” of the present invention.
送受信部15は、学習者Sの操作に基づく制御部13の制御に従って、送信データを学習支援サーバ20に送信する。送受信部15は、例えば、無線LANの通信モジュールであってよく、携帯電話の通信モジュールであってもよい。送受信部15は、また、学習支援サーバ20から送信されてきた解説コンテンツを受信する。送受信部15が解説コンテンツを受信した後にそれを視聴するための学習者端末10の構成については、後述する。
The transmission / reception unit 15 transmits the transmission data to the learning support server 20 according to the control of the control unit 13 based on the operation of the learner S. The transceiver 15 may be, for example, a wireless LAN communication module or a mobile phone communication module. The transmission / reception unit 15 also receives the commentary content transmitted from the learning support server 20. The configuration of the learner terminal 10 for viewing the content after the transmission / reception unit 15 receives the commentary content will be described later.
図6は、本発明の第1の実施の形態の学習支援サーバの構成を示すブロック図である。学習支援サーバ20は、送受信部21、制御部22、参照頁情報データベース23、問題データベース24、解説コンテンツリンクデータベース25、及び解説コンテンツデータベース26を備えている。
FIG. 6 is a block diagram illustrating a configuration of the learning support server according to the first embodiment of this invention. The learning support server 20 includes a transmission / reception unit 21, a control unit 22, a reference page information database 23, a problem database 24, an explanation content link database 25, and an explanation content database 26.
送受信部21は、各種のデータをネットワークNWに向けて送信し、また、ネットワークNWを介して受信する。本実施の形態では、送受信部21は、特に、学習者端末10から送信データ(図5参照)を受信するとともに、送信データを送信してきた学習者端末10に対して、検索結果画面を送信し、解説コンテンツをストリーミング配信する。
The transmission / reception unit 21 transmits various data to the network NW, and receives the data via the network NW. In the present embodiment, the transmission / reception unit 21 particularly receives transmission data (see FIG. 5) from the learner terminal 10 and transmits a search result screen to the learner terminal 10 that has transmitted the transmission data. , Streaming commentary content.
制御部22は、学習支援サーバ20のプロセッサ、RAM、ROM、ストレージ等からなるコンピュータが学習支援アプリケーションプログラムを実行することで実現される。その処理には、頁画像からの特徴量の抽出、頁の検索、問題の特定、検索結果画面の生成、ストリーム配信等の処理が含まれ、図6では、これらの処理機能をそれぞれ特徴量抽出部221、頁検索部222、問題特定部223、検索結果画面生成部224、配信処理部225と表現している。
The control unit 22 is realized by a computer including the processor, RAM, ROM, storage, and the like of the learning support server 20 executing a learning support application program. The processing includes extraction of feature values from page images, page search, problem identification, search result screen generation, stream distribution, and the like. In FIG. A section 221, a page search section 222, a problem identification section 223, a search result screen generation section 224, and a distribution processing section 225.
図7は、本発明の第1の実施の形態の参照頁情報データベースのデータ構成を示す図である。参照頁情報データベース23には、複数の教材の各頁についてレコードが作成されて記憶されている。各レコードは、頁を特定するための頁IDと、参照頁情報としての参照頁画像の特徴量とが関連付けられて構成されている。特徴量は特徴ベクトルの形式で表現されている。なお、図7において、頁IDのアルファベットは教材を特定するための情報であり、頁IDの数字は頁数を示している。
FIG. 7 is a diagram showing a data configuration of the reference page information database according to the first embodiment of this invention. In the reference page information database 23, a record is created and stored for each page of a plurality of teaching materials. Each record is configured by associating a page ID for specifying a page and a feature amount of a reference page image as reference page information. The feature quantity is expressed in the form of a feature vector. In FIG. 7, the alphabet of page ID is information for specifying the teaching material, and the number of page ID indicates the number of pages.
図8は、本発明の第1の実施の形態の問題データベースのデータ構成を示す図である。問題データベース24には、各問題について少なくとも1つのレコードが記憶されている。各レコードには、当該問題が記載された頁の頁ID、頁内の問題位置を示す問題位置データ、各問題のテーマを示す文字列である問題テーマ、問題ごとに付与された問題IDが互いに関連付けて記憶されている。図8に示すように、各頁IDには、その頁に含まれる複数の問題位置データが関連付けられている。
FIG. 8 is a diagram showing a data configuration of the problem database according to the first embodiment of this invention. The problem database 24 stores at least one record for each problem. Each record includes the page ID of the page describing the problem, the problem position data indicating the problem position in the page, the problem theme that is a character string indicating the theme of each problem, and the problem ID assigned to each problem. It is stored in association. As shown in FIG. 8, each page ID is associated with a plurality of problem position data included in the page.
問題位置データは、頁画像中の点位置を示すデータである。点位置は、各問題の主要な内容を示している箇所に設定される。1つの問題について、複数の問題位置データが設定されてよく、この場合には当該問題について複数のレコードが生成され記憶されている。問題テーマは、例えば、「分配法則」、「因数分解」、「平方根」、「平方根(文章問題)」、「展開」、「円周角の定理」(図10参照)、「三平方の定理の利用」(図10参照)、「平行と線分の比」(図14参照)等である。
The problem position data is data indicating the position of a point in the page image. The point position is set at a location indicating the main contents of each problem. A plurality of problem position data may be set for one problem. In this case, a plurality of records are generated and stored for the problem. Problem themes include, for example, “distribution law”, “factorization”, “square root”, “square root (sentence problem)”, “expansion”, “circumference angle theorem” (see FIG. 10), “three squares theorem” Use ”(see FIG. 10),“ Parallel to line segment ratio ”(see FIG. 14), and the like.
図9は、本発明の第1の実施の形態の解説コンテンツデータベースのデータ構成を示す図である。解説コンテンツリンクデータベース25には、問題ごとに、レコードが記憶されている。各レコードには、問題ID、リンク情報、サムネイル画像が関連付けられて記憶されている。
FIG. 9 is a diagram showing a data configuration of the commentary content database according to the first embodiment of this invention. The comment content link database 25 stores a record for each problem. Each record stores a problem ID, link information, and a thumbnail image in association with each other.
リンク情報は、学習者端末10から解説動画ファイルにアクセスして解説動画ファイルのストリーミング配信を要求するための情報である。サムネイル画像は、解説動画の内容を示す代表画像であり、本実施の形態では、解説動画の開始時点の画像がサムネイル画像とされている。なお、解説コンテンツリンクデータベース25において、1つの問題について、リンク情報の異なる(解説コンテンツの異なる)複数のレコードが作成されていてよい。
The link information is information for accessing the commentary video file from the learner terminal 10 and requesting streaming delivery of the commentary video file. The thumbnail image is a representative image indicating the contents of the commentary video, and in this embodiment, the image at the start of the commentary video is the thumbnail image. In the comment content link database 25, a plurality of records having different link information (different comment contents) may be created for one problem.
解説動画データベース26には、解説コンテンツとして、解説動画ファイルが記憶されている。解説動画データベース26は、本発明の「解説コンテンツ記憶部」に相当する。各解説動画ファイルの記憶領域のアドレスは、解説コンテンツリンクデータベース25にリンク情報として記憶されている。解説動画ファイルは、解説動画のファイルである。解説動画は、講師がホワイトボードの板書を用いて問題を解説する様子を撮影することで生成されたものである。なお、解説動画の内容は、問題集の演習問題に関連付けられた、当該演習問題の解法を解説する内容(解法解説)に限らず、例えば、教科書中の説明文の段落やキーワードに関連付けられた、該当部分を詳しく、ないしは平易に説明する内容(講義)であってもよい。解説動画の内容が解法解説である場合には、その内容は、対応する演習問題に対する一般的な解法ではなく、実際に当該演習問題を解く方法を説明する内容である。
The commentary video database 26 stores commentary movie files as commentary content. The commentary moving image database 26 corresponds to the “description content storage unit” of the present invention. The address of the storage area of each commentary video file is stored as link information in the commentary content link database 25. The commentary movie file is a commentary movie file. The commentary video was created by taking a picture of the teacher explaining the problem using a whiteboard. Note that the content of the explanation video is not limited to the content (solution explanation) that explains the solution of the exercise problem associated with the exercise problem in the problem collection, but is associated with, for example, the paragraph or keyword of the explanatory text in the textbook The contents (lectures) that explain the corresponding part in detail or simply can be used. When the content of the commentary movie is a solution explanation, the content is not a general solution to the corresponding exercise problem but a content that explains how to actually solve the exercise problem.
送受信部21が学習者端末10から送信データを受信すると、特徴量抽出部221は、送信データ中の頁画像ファイルの頁画像(以下、「撮影頁画像」という。)から特徴量を抽出する。なお、この撮影頁画像は、本発明の「問題画像」に相当する。特徴量抽出部221にて特徴量が抽出されると、頁検索部222は、この特徴量を用いて頁の検索を行う。頁検索部222は、撮影頁画像から抽出された特徴量をクエリとして、参照頁情報データベース23に記憶されている複数の頁(以下、「登録頁」)の中から、撮影頁画像に対応する登録頁を検索する。
When the transmission / reception unit 21 receives transmission data from the learner terminal 10, the feature amount extraction unit 221 extracts a feature amount from a page image of a page image file in the transmission data (hereinafter referred to as “photographed page image”). This photographed page image corresponds to the “problem image” of the present invention. When the feature amount is extracted by the feature amount extraction unit 221, the page search unit 222 searches for a page using the feature amount. The page search unit 222 uses a feature amount extracted from the photographed page image as a query, and corresponds to the photographed page image from a plurality of pages (hereinafter, “registered pages”) stored in the reference page information database 23. Search the registration page.
特徴量抽出部221における特徴量の抽出、及び頁検索部222における登録頁の検索には、既知の画像マッチングによる検索技術を採用することができるが、以下ではその一例を説明する。なお、上述のように、参照頁情報データベース23には、複数の教材の各頁について参照頁情報として参照頁画像の特徴量が記憶されているが、この特徴量も以下と同様にして生成される。参照頁情報データベース23に記憶される特徴量は、特徴量抽出部221によって抽出されたものであってもよいし、別の装置によって抽出されたものであってもよい。
A search technique based on known image matching can be adopted for the feature quantity extraction in the feature quantity extraction unit 221 and the search for registered pages in the page search unit 222. An example will be described below. As described above, the reference page information database 23 stores the feature amount of the reference page image as reference page information for each page of a plurality of teaching materials. This feature amount is also generated in the same manner as described below. The The feature amount stored in the reference page information database 23 may be extracted by the feature amount extraction unit 221 or may be extracted by another device.
本実施の形態では、画像の特徴量として局所特徴量を採用する。特徴量抽出部221は、まず、撮影頁画像に対して、コーナー点(角)を抽出するアルゴリズム(コーナディテクタ)を適用して、特徴点を抽出する。一般的には1つの画像から複数の特徴点が抽出され、特徴量抽出部221は、複数の特徴点の各々について特徴量を求める。特徴量抽出部221は、抽出された特徴点の各々について、以下の処理を行う。
In this embodiment, a local feature amount is adopted as the feature amount of the image. The feature quantity extraction unit 221 first extracts a feature point by applying an algorithm (corner detector) for extracting a corner point (corner) to the photographed page image. In general, a plurality of feature points are extracted from one image, and the feature amount extraction unit 221 calculates a feature amount for each of the plurality of feature points. The feature amount extraction unit 221 performs the following processing for each extracted feature point.
特徴量抽出部221は、特徴点の近傍の所定の領域(例えば、特徴点を中心とするW×Wピクセルの正方形の領域)を近傍領域として設定し、近傍領域内の各ピクセルをx方向及びy方向にそれぞれ微分することで、近傍領域内の各ピクセルについて、エッジ勾配方向及びエッジ強度を算出する。そして、特徴量抽出部221は、エッジ勾配方向を量子化して、近傍領域内のピクセルの量子化されたエッジ勾配方向ごとにエッジ強度の和をとることで、エッジ勾配方向ヒストグラムを生成し、これを局所特徴量とする。
The feature quantity extraction unit 221 sets a predetermined region in the vicinity of the feature point (for example, a square region of W × W pixels centered on the feature point) as the neighborhood region, and sets each pixel in the neighborhood region in the x direction and By differentiating each in the y direction, the edge gradient direction and the edge strength are calculated for each pixel in the neighboring region. Then, the feature amount extraction unit 221 generates an edge gradient direction histogram by quantizing the edge gradient direction and taking the sum of the edge intensities for each quantized edge gradient direction of the pixels in the neighborhood region. Is a local feature.
頁検索部222は、撮影頁画像の複数の特徴点の各々について、参照頁情報データベース23に記憶された複数の登録頁の複数の特徴点を検索して、撮影頁画像の特徴点の局所特徴量に最も類似する局所特徴量を有する特徴点(対応点)を探索する。このとき、頁検索部222は、例えば、局所特徴量をベクトル形式で表現して(特徴ベクトル)、特徴ベクトルのL2ノルムの二乗の値を局所特徴量同士の類似度とすることができる。そして、頁検索部222は、この探索を撮影頁画像の複数の特徴点について行った結果、対応点を最も多く含む登録頁を、撮影頁画像に対応する登録頁であると判断する。
The page retrieval unit 222 retrieves a plurality of feature points of a plurality of registered pages stored in the reference page information database 23 for each of a plurality of feature points of the photographed page image, and local features of the feature points of the photographed page image. A feature point (corresponding point) having a local feature amount most similar to the amount is searched. At this time, for example, the page search unit 222 can express the local feature amount in a vector format (feature vector), and use the square value of the L2 norm of the feature vector as the similarity between the local feature amounts. Then, as a result of performing this search for a plurality of feature points of the photographed page image, the page search unit 222 determines that the registered page that has the most corresponding points is the registered page corresponding to the photographed page image.
頁検索部222は、対応する登録頁が検索できると、その登録頁の頁IDを問題特定部223に渡す。問題特定部223は、送信データ中の質問箇所指定情報、及び頁検索部222で得られた頁IDを用いて、問題データベース24に記憶されている問題を特定する。問題特定部223は、問題データベース24を参照して、頁検索部222で得られた頁IDと一致する頁IDを有するレコードの中から、問題位置データの示す点位置が、質問箇所指定情報の示す質問箇所に含まれるレコードを特定することにより、質問箇所指定情報によって指定された問題を特定する。
When the corresponding registered page can be searched, the page search unit 222 passes the page ID of the registered page to the problem specifying unit 223. The problem specifying unit 223 specifies the problem stored in the problem database 24 using the question location designation information in the transmission data and the page ID obtained by the page search unit 222. The problem specifying unit 223 refers to the problem database 24, and the point position indicated by the problem position data from the records having the page ID that matches the page ID obtained by the page search unit 222 is the question location designation information. By identifying the record included in the question location shown, the problem specified by the question location specification information is specified.
問題特定部223は、特定した問題の問題ID及び問題テーマを検索結果画面生成部224に渡す。検索結果画面生成部224は、解説コンテンツリンクデータベース25から、問題特定部223にて得られた問題IDを有するレコードの問題のリンク情報、及びサムネイル画像を取得して、学習者端末10からの質問への応答をするための画面である検索結果画面を生成する。この問題特定部223及び検索結果画面生成部224からなる構成は、本発明の「解説コンテンツ特定部」に相当する。
The problem identification unit 223 passes the problem ID and problem theme of the identified problem to the search result screen generation unit 224. The search result screen generation unit 224 acquires the question link information and the thumbnail image of the record having the question ID obtained by the question specifying unit 223 from the comment content link database 25, and the question from the learner terminal 10 A search result screen that is a screen for responding to is generated. The configuration including the problem specifying unit 223 and the search result screen generating unit 224 corresponds to the “explanatory content specifying unit” of the present invention.
図10は、本発明の第1の実施の形態の検索結果画面の例を示す図である。検索結果画面には、質問箇所のトリミング画像51及び、解説動画のサムネイル52が含まれ、解説動画のサムネイル52にはリンク情報が埋め込まれる。トリミング画像51は、送信データに含まれる撮影頁画像と質問箇所指定情報を用いて生成される。具体的には、撮影頁画像から、質問箇所指定情報が示す質問箇所の枠内の画像をトリミングすることによって生成される。
FIG. 10 is a diagram illustrating an example of a search result screen according to the first embodiment of this invention. The search result screen includes a trimmed image 51 of the question part and a thumbnail 52 of the explanation movie, and link information is embedded in the thumbnail 52 of the explanation movie. The trimmed image 51 is generated using the captured page image and question location designation information included in the transmission data. Specifically, the image is generated by trimming an image within the frame of the question location indicated by the question location designation information from the photographed page image.
また、トリミング画像51には、問題ごとに連番マーク511、512が付される。この連番マーク511、512は、質問箇所に含まれる問題にリンク情報があること、即ち解説動画があってそれが検索されたことを示している。この連番マーク511、512にはリンク情報が埋め込まれている。この連番マークをトリミング画像に重畳する際の重畳位置は、解説コンテンツリンクデータベース25に記憶されたレコードのうちの、該当するレコードの問題位置データに従って決定される。なお、連番マーク511、512に代えて、連番の付されていない単なるマークを採用してもよい。
Further, serial number marks 511 and 512 are attached to the trimmed image 51 for each problem. These serial number marks 511 and 512 indicate that there is link information in the problem included in the question part, that is, that there is an explanation movie and it has been searched. Link information is embedded in the serial number marks 511 and 512. The superposition position when superimposing the serial number mark on the trimming image is determined according to the problem position data of the corresponding record among the records stored in the explanation content link database 25. Instead of the serial number marks 511 and 512, simple marks without serial numbers may be employed.
解説動画のサムネイル画像は、上記の連番マークの連番、問題特定部223から取得した問題テーマが付加される。上述のように、このサムネイル画像にはリンク情報が埋め込められており、サムネイル画像をタップするとリンク情報を用いて解説動画の配信が要求される。また、質問箇所の画像に重畳された連番マークにもリンク情報が埋め込まれており、この連番マークをタップすることで該当する解説動画の配信が要求される。
The thumbnail image of the commentary video is appended with the serial number of the serial number mark and the problem theme acquired from the problem identification unit 223. As described above, link information is embedded in the thumbnail image, and when the thumbnail image is tapped, distribution of the commentary video is requested using the link information. Further, link information is also embedded in the serial number mark superimposed on the image of the question location, and distribution of the corresponding commentary video is requested by tapping the serial number mark.
送受信部21は、検索結果画面生成部224にて生成された検査結果画面を、送信データを送信してきた学習者端末10に送信する。
The transmission / reception unit 21 transmits the examination result screen generated by the search result screen generation unit 224 to the learner terminal 10 that has transmitted the transmission data.
学習者端末10は、学習支援サーバ20から送信されてきた検索結果画面を受信して、制御部13は、この検索結果画面を出力部12の表示パネルに表示させる。制御部13は、検索結果画面を表示した状態で入力部11にリンク情報の指定(リンク情報が埋め込まれたサムネイル画像又は連番マークのタップ)があると、当該リンク情報を用いて学習支援サーバ20に対して解説動画の配信を要求する配信要求コマンドを送信する。
The learner terminal 10 receives the search result screen transmitted from the learning support server 20, and the control unit 13 displays the search result screen on the display panel of the output unit 12. When the input of the link information is specified in the input unit 11 in a state where the search result screen is displayed (the thumbnail image or the tapping of the serial number mark in which the link information is embedded), the control unit 13 uses the link information and the learning support server A distribution request command for requesting the distribution of the commentary video is transmitted to 20.
学習支援サーバ20の送受信部21は、配信要求コマンドを受信すると、これを配信処理部225に渡す。配信処理部24は、配信要求コマンドで指定された解説動画ファイルを解説コンテンツデータベース26から読み出して、送受信部21を介して学習者端末10にストリーミング配信する。学習者端末10では、このストリーミング配信を受信して、出力部12の表示パネルに動画を表示し、スピーカから音声を出力する。
When the transmission / reception unit 21 of the learning support server 20 receives the distribution request command, it passes it to the distribution processing unit 225. The distribution processing unit 24 reads the commentary moving image file designated by the distribution request command from the commentary content database 26 and performs streaming distribution to the learner terminal 10 via the transmission / reception unit 21. The learner terminal 10 receives the streaming distribution, displays a moving image on the display panel of the output unit 12, and outputs sound from the speaker.
以上のように、本実施の形態の学習支援システムによれば、学習端末10にて教材を撮影してその画像を学習支援サーバ20に送信することで「質問」をするに際して、送信データに頁全体の画像と質問箇所指定情報と含めるので、学習支援サーバ20では、まず、頁検索部222にて、頁全体の画像について、画像マッチングによる検索を行って、その後に、問題特定部223にて質問箇所として指定された位置にある問題を特定することができる。これにより、問題特定の確度が向上する。
As described above, according to the learning support system of the present embodiment, when a “question” is made by photographing a learning material at the learning terminal 10 and transmitting the image to the learning support server 20, a page is transmitted to the transmission data. Since the entire image and the question location designation information are included, the learning support server 20 first performs a search by image matching on the entire page image in the page search unit 222, and then in the problem identification unit 223. The problem at the position designated as the question part can be specified. This improves the accuracy of problem identification.
そして、該当する頁が検索された後には、上述のように、当該頁について、質問箇所指定情報が示す枠の中に存在する問題位置データを有するレコードを検索することで、質問箇所指定情報が示す枠の中に存在する問題を特定できる。この処理は、単に枠と点位置との包含関係を調べるだけであり、処理負荷が軽くてすむ。
Then, after the corresponding page is searched, as described above, the question location designation information is obtained by searching the page having the problem position data existing in the frame indicated by the question location designation information. You can identify problems that exist in the frame shown. This process merely involves examining the inclusive relation between the frame and the point position, and the processing load can be reduced.
以上、学習者端末10から質問をしてから学習者端末10において解説動画を出力するまで処理を説明した。以下では、学習者端末10から質問をするが学習支援サーバ20において該当する解説コンテンツを検索できない場合の処理について説明する。
As described above, the process is described from when a question is asked from the learner terminal 10 until the explanation video is output at the learner terminal 10. In the following, a process when a question is asked from the learner terminal 10 but the corresponding commentary content cannot be searched in the learning support server 20 will be described.
該当する解説コンテンツが検索できない場合として、学習者Sが、学習支援サーバ20の解説コンテンツデータベース26に解説動画が記憶されていない教材を使用しており、そのような教材の頁を撮影して生成された撮影頁画像を送信してきた場合がある。また、上述のように、学習者端末10では、学習者Sに教材の撮影をさせる場合に、表示パネルに、学習者Sに教材の頁ないし頁全体を撮影するよう促すメッセージを表示するが、仮に学習者Sがこのメッセージにもかかわらず、頁ないし頁全体を撮影しなかった場合にも、頁検索部222にて頁を検索できないことがある。
In the case where the corresponding commentary content cannot be searched, the learner S uses a learning material in which the commentary video is not stored in the commentary content database 26 of the learning support server 20, and the page is generated by photographing such a learning material. There is a case in which a photographed page image is transmitted. Further, as described above, when the learner terminal 10 causes the learner S to shoot a learning material, a message prompting the learner S to shoot a page of the learning material or the entire page is displayed on the display panel. Even if the learner S does not shoot a page or the entire page despite this message, the page search unit 222 may not be able to search for a page.
そこで、頁検索部222は、参照頁情報データベース23を検索して、該当するレコードが検索されない場合には、送信データ中の頁画像が頁ないし頁全体を撮影したものであるかを判断する。具体的には、頁検索部222は、撮影頁画像の上部及び下部に、教材の頁の端部に相当する画像のエッジがあるか否かを判断する。頁検索部222は、撮影頁画像の上部及び下部に画像のエッジを検出できない場合には、送受信部21を介して、頁全体を撮影していない旨のエラー情報を学習者端末10に返信する。
Therefore, the page search unit 222 searches the reference page information database 23 and, if the corresponding record is not searched, determines whether the page image in the transmission data is a page or the entire page. Specifically, the page search unit 222 determines whether or not there is an image edge corresponding to the edge of the page of the teaching material at the top and bottom of the photographed page image. If the edge of the image cannot be detected in the upper and lower parts of the photographed page image, the page search unit 222 returns error information indicating that the entire page is not photographed to the learner terminal 10 via the transmission / reception unit 21. .
頁検索部222は、参照頁情報データベース23を検索して、該当するレコードが検索されない場合において、撮影頁画像の上部及び下部に画像のエッジが検出されたときは、その教材の解説コンテンツが学習支援サーバ20に記憶されていない(その教材が未登録である)旨のエラー情報を学習端末10に送信する。
The page search unit 222 searches the reference page information database 23, and when the corresponding record is not searched, when the edge of the image is detected at the upper part and the lower part of the photographed page image, the explanation content of the teaching material is learned. Error information that is not stored in the support server 20 (the teaching material is not registered) is transmitted to the learning terminal 10.
学習者端末10では、エラー情報を受けると、その内容に応じて頁全体を撮影するよう再度促すメッセージを表示し、又は、その教材が未登録であることを示すメッセージを表示する。教材が未登録である旨のメッセージを表示する場合には、当該メッセージ表示画面には、学習者Sが自己の使用している教材の名称を記入するための入力欄が含まれる。
When the learner terminal 10 receives the error information, the learner terminal 10 displays a message prompting again to shoot the entire page according to the content, or displays a message indicating that the teaching material is not registered. When a message indicating that the learning material is not registered is displayed, the message display screen includes an input field for the learner S to enter the name of the learning material that the learner S is using.
学習者Sは、教材が未登録である旨のメッセージが表示されると、入力欄に自己の教材の名称を入力する。学習者端末10の送受信部15は、学習者Sの操作に基づいて、制御部13の制御に従って、入力欄に入力された未登録の教材の名称を学習支援サーバ20に送信する。
When the message indicating that the learning material is not registered is displayed, the learner S enters the name of his / her learning material in the input field. The transmission / reception unit 15 of the learner terminal 10 transmits the name of the unregistered teaching material input in the input field to the learning support server 20 under the control of the control unit 13 based on the operation of the learner S.
学習者サーバ20では、送信されてきた未登録の教材の名称を図示しない記憶媒体に記憶する。学習支援サーバ20の運営者は、この未登録教材の情報を参照することで、学習者Sが使用している教材を知ることができ、それらの教材について解説コンテンツを新たに用意する等の対応をすることができる。
The learner server 20 stores the name of the transmitted unregistered teaching material in a storage medium (not shown). The operator of the learning support server 20 can know the learning materials used by the learner S by referring to the information of the unregistered learning materials, and prepare a new commentary content for the learning materials. Can do.
(第2の実施の形態)
図11は、本発明の第2の実施の形態の学習支援システムの学習者端末の構成を示すブロック図であり、図12は、本発明の第2の実施の形態の学習支援システムの学習支援サーバの構成を示すブロック図である。 (Second Embodiment)
FIG. 11 is a block diagram showing the configuration of the learner terminal of the learning support system according to the second embodiment of the present invention, and FIG. 12 shows the learning support of the learning support system according to the second embodiment of the present invention. It is a block diagram which shows the structure of a server.
図11は、本発明の第2の実施の形態の学習支援システムの学習者端末の構成を示すブロック図であり、図12は、本発明の第2の実施の形態の学習支援システムの学習支援サーバの構成を示すブロック図である。 (Second Embodiment)
FIG. 11 is a block diagram showing the configuration of the learner terminal of the learning support system according to the second embodiment of the present invention, and FIG. 12 shows the learning support of the learning support system according to the second embodiment of the present invention. It is a block diagram which shows the structure of a server.
本実施の形態の学習支援システムでは、第1の実施の形態と同様に、学習者Sは、質問をする際に教材の1頁がすべて画像内に収まるように頁画像の撮影を行うが、この撮影頁画像において、質問箇所を指定することはせず、この撮影頁画像に含まれるすべての問題について、学習支援サーバ20´からリンク情報とサムネイル画像を提供する。以下の説明において、第1の実施の形態の構成と同じ構成については、同一の符号を付して適宜説明を省略する。
In the learning support system of the present embodiment, as in the first embodiment, the learner S takes a page image so that one page of the teaching material fits in the image when making a question. In this photographed page image, the question part is not specified, and link information and thumbnail images are provided from the learning support server 20 'for all problems included in the photographed page image. In the following description, the same components as those of the first embodiment are denoted by the same reference numerals, and the description thereof is omitted as appropriate.
図11に示すように、学習者端末10´は、第1の実施の形態の学習者端末10と比較すると、制御部13が指定情報生成部131を備えていない。画像生成部14が頁画像を生成すると、送信データ生成部132は、日時情報と、ユーザIDと、頁画像ファイルを含む送信データを生成して、学習支援端末20´に送信する。
As shown in FIG. 11, in the learner terminal 10 ′, the control unit 13 does not include the designation information generation unit 131 as compared with the learner terminal 10 of the first embodiment. When the image generation unit 14 generates a page image, the transmission data generation unit 132 generates transmission data including date and time information, a user ID, and a page image file, and transmits the transmission data to the learning support terminal 20 ′.
また、図12に示すように、学習支援サーバ20´は、第1の実施の形態の学習支援サーバ20と比較すると、問題特定部223及び問題データベース24を備えていない。図13は、本発明の第2の実施の形態の解説コンテンツリンクデータベースのデータ構造を示す図である。図13に示すように、本実施の形態の解説コンテンツリンクデータベース25´には、各レコードにおいて、頁ID、問題位置データ、問題テーマ、リンク情報、サムネイル画像ファイルが関連付けられて記憶されている。
Also, as shown in FIG. 12, the learning support server 20 ′ does not include the problem specifying unit 223 and the problem database 24 as compared with the learning support server 20 of the first embodiment. FIG. 13 is a diagram illustrating a data structure of the comment content link database according to the second embodiment of this invention. As shown in FIG. 13, the comment content link database 25 ′ of the present embodiment stores a page ID, problem position data, problem theme, link information, and thumbnail image file in association with each record.
頁検索部222は、参照頁情報データベース23を参照して、送信データに含まれる撮影頁画像に対応する登録頁を検索し、頁が特定されると、その頁の頁IDを検索結果画面生成部224に渡す。検索結果画面223は、解説コンテンツリンクデータベース25´を参照して、該当する頁IDを持つすべてのレコードを用いて、検索結果画面を生成する。
The page search unit 222 refers to the reference page information database 23 to search for a registered page corresponding to the photographed page image included in the transmission data. When the page is specified, the page ID of the page is generated as a search result screen. To part 224. The search result screen 223 refers to the explanation content link database 25 'and generates a search result screen using all records having the corresponding page ID.
図14は、本発明の第2の実施の形態の検索結果画面の例を示す図である。図14に示すように、検索結果画面には、撮影頁画像53、解説動画のサムネイル54が含まれている。また、撮影頁画像53には、解説動画が得られた問題に重畳するように、解説動画再生用のマーク531~534が付加されている。
FIG. 14 is a diagram illustrating an example of a search result screen according to the second embodiment of this invention. As shown in FIG. 14, the search result screen includes a photographed page image 53 and a commentary video thumbnail 54. In addition, on the photographed page image 53, explanation movie reproduction marks 531 to 534 are added so as to be superimposed on the problem in which the explanation movie is obtained.
このマーク531~534は、その問題についての解説動画が提供可能であることを示している。また、マーク531~534には、対応する解説動画へのリンク情報が埋め込まれており、検索結果画面を学習者端末10´で表示させてこのマーク531~534を指示すると、学習者端末10´から学習支援サーバ20´に解説動画の配信が要求される。なお、第1の実施の形態と同様に、サムネイル54を指示することでもその解説動画の配信を要求することができる。
These marks 531 to 534 indicate that a commentary video about the problem can be provided. In addition, link information to the corresponding commentary video is embedded in the marks 531 to 534. When the search result screen is displayed on the learner terminal 10 ′ and the marks 531 to 534 are instructed, the learner terminal 10 ′ is displayed. Therefore, the learning support server 20 ′ is requested to distribute the explanation video. As in the first embodiment, it is possible to request distribution of the commentary movie by designating the thumbnail 54.
以上のように、本発明の第2の実施の形態の学習支援システムによれば、学習者Sは、質問したい箇所が含まれる頁を撮影した後に、質問箇所を指定する必要がなく、質問のための操作を簡素化できる。
As described above, according to the learning support system of the second embodiment of the present invention, the learner S does not need to specify the question part after shooting the page including the part to be asked, Operation can be simplified.
なお、画像支援サーバ20´より学習者端末10´に送信されてくる検索結果画面の撮影頁画像には、解説が不要な問題にまでマークが付され、解説動画へのリンク情報が提供されるが、学習者Sは、解説が不要な問題についてはマークを無視して解説動画の配信を要求しなければよく、特に不都合はない。
The photographed page image of the search result screen transmitted from the image support server 20 ′ to the learner terminal 10 ′ is marked with a problem that does not require commentary, and link information to the commentary video is provided. However, the learner S only needs to ignore the mark and request distribution of commentary videos for problems that do not require commentary, and there is no particular inconvenience.
(第3の実施の形態)
図15は、本発明の第3の実施の形態の学習支援システムにおける学習支援サーバの構成を示すブロック図である。第1及び第2の実施の形態では、頁検索部222が参照頁情報データベース23に記憶されたレコードのうち、撮影頁画像に対応する参照頁情報を有するレコードを検索したが、本実施の形態の学習支援サーバ20´´は、教材を絞り込んだ上で、この頁検索を行う。 (Third embodiment)
FIG. 15 is a block diagram illustrating a configuration of a learning support server in the learning support system according to the third embodiment of this invention. In the first and second embodiments, thepage search unit 222 searches for records having reference page information corresponding to the photographed page image among the records stored in the reference page information database 23. The learning support server 20 ″ performs this page search after narrowing down teaching materials.
図15は、本発明の第3の実施の形態の学習支援システムにおける学習支援サーバの構成を示すブロック図である。第1及び第2の実施の形態では、頁検索部222が参照頁情報データベース23に記憶されたレコードのうち、撮影頁画像に対応する参照頁情報を有するレコードを検索したが、本実施の形態の学習支援サーバ20´´は、教材を絞り込んだ上で、この頁検索を行う。 (Third embodiment)
FIG. 15 is a block diagram illustrating a configuration of a learning support server in the learning support system according to the third embodiment of this invention. In the first and second embodiments, the
教材を絞り込むために、本実施の形態の学習支援サーバ20´´は、図15に示すように、教材データベース27を備えている。図16は、本発明の第3の実施の形態の教材データベースのデータ構成を示す図である。図16に示すように、教材データベースには、ユーザである学習者ごとに、ユーザIDと当該ユーザの使用している教材の教材IDが関連付けられている。
In order to narrow down teaching materials, the learning support server 20 ″ of the present embodiment includes a teaching material database 27 as shown in FIG. FIG. 16 is a diagram illustrating a data configuration of the teaching material database according to the third embodiment of this invention. As shown in FIG. 16, in the learning material database, for each learner who is a user, the user ID and the learning material ID of the learning material used by the user are associated.
学習者は、学習者端末10から教材データベース27に自己の使用している教材を登録することができる。このために、学習支援サーバ20´´は、教材登録のための画面を学習者端末10に提供する。この画面では登録可能な教材、即ち、学習支援サーバ20´´にて解説コンテンツが用意されている教材が選択可能となっている。学習者は、この画面で教材を選択して、自己のユーザIDとともに学習支援端末20´´に送信すると、教材データベース27にはそのユーザにつき、当該教材の教材IDが記憶される。
The learner can register his / her teaching materials in the teaching material database 27 from the learner terminal 10. For this purpose, the learning support server 20 ″ provides a screen for learning material registration to the learner terminal 10. On this screen, it is possible to select a learning material that can be registered, that is, a learning material for which explanation content is prepared in the learning support server 20 ″. When the learner selects a learning material on this screen and transmits it to the learning support terminal 20 ″ together with his / her user ID, the learning material database 27 stores the learning material ID of the learning material for the user.
図17は、本発明の第3の実施の形態の参照頁情報データベースのデータ構成を示す図である。各頁のレコードには、教材ID、頁ID、及び参照頁画像から抽出した特徴量が関連付けられて記憶されている。頁検索部222´´は、学習者端末10から送信データを受信すると、教材データベース27を参照して、送信データに含まれるユーザIDに対応する教材IDを取得する。
FIG. 17 is a diagram showing a data configuration of the reference page information database according to the third embodiment of the present invention. Each page record stores a learning material ID, a page ID, and a feature amount extracted from the reference page image in association with each other. When the page search unit 222 ″ receives the transmission data from the learner terminal 10, the page search unit 222 ″ refers to the learning material database 27 and acquires the learning material ID corresponding to the user ID included in the transmission data.
頁検索部222´´は、参照頁情報データベース23に記憶されたレコードのうち、取得した教材IDを有するレコードを参照して、送信データに含まれる撮影頁画像に対応する登録頁を検索する。頁検索部222´´は、上記の検索で該当するレコードがなかった場合には、他の教材のレコードも検索する。即ち、頁検索部222´´は、教材データベース27において、当該学習者のユーザIDに関連付けられている教材の頁を優先して検索する。
The page search unit 222 ″ refers to the record having the acquired teaching material ID among the records stored in the reference page information database 23, and searches the registered page corresponding to the captured page image included in the transmission data. If there is no corresponding record in the above search, the page search unit 222 ″ also searches for records of other teaching materials. That is, the page search unit 222 ″ searches the learning material database 27 with priority on the learning material page associated with the user ID of the learner.
他の教材のレコードで該当するものが検索されたときは、頁検索部222´´は、その結果を問題特定部223に渡すとともに、対応する登録頁に関連付けられた教材IDとユーザIDとを関連付けて、教材データベース27に追加する。即ち、頁検索部222´´は、撮影頁画像が、教材データベース27に登録されていない教材の画像とマッチングされたときには、当該教材を教材データベース27に自動的に登録する。
When a corresponding record in another learning material is searched, the page search unit 222 ″ passes the result to the problem specifying unit 223, and uses the learning material ID and the user ID associated with the corresponding registered page. In association therewith, it is added to the teaching material database 27. That is, the page search unit 222 ″ automatically registers the learning material in the learning material database 27 when the photographed page image is matched with the image of the learning material not registered in the learning material database 27.
以上のように、本発明の第3の実施の形態の学習支援システムよれば、学習者が使用している教材を優先して頁の検索を行うので、頁の検索が速くなり、質問をしてから検索結果画面が返信されてくるまでの学習者の待ち時間を少なくできる。
As described above, according to the learning support system of the third embodiment of the present invention, the search of the page is performed with priority given to the learning material used by the learner, so that the search of the page becomes faster and the question is asked. The waiting time of the learner from when the search result screen is returned can be reduced.
(変形例)
以下、上記の実施の形態の学習支援システムの変形例を説明する。 (Modification)
Hereinafter, modifications of the learning support system according to the above embodiment will be described.
以下、上記の実施の形態の学習支援システムの変形例を説明する。 (Modification)
Hereinafter, modifications of the learning support system according to the above embodiment will be described.
上記の実施の形態の学習システムでは、画像生成部14が教材の頁全体を示す頁情報として頁画像を生成し、参照頁情報データベース23には参照頁情報として参照頁画像の特徴量が記憶され、頁検索部は頁画像の特徴量及び参照頁画像の特徴量を用いて対応する頁の検索を行ったが、教材の頁全体を示す頁情報は画像に限られず、文字情報、音声情報等の他の形式の情報であってもよい。
In the learning system of the above embodiment, the image generation unit 14 generates a page image as page information indicating the entire page of the teaching material, and the reference page information database 23 stores the feature amount of the reference page image as reference page information. The page search unit searches for the corresponding page using the feature amount of the page image and the feature amount of the reference page image. However, the page information indicating the entire page of the teaching material is not limited to the image, and character information, audio information, etc. Other types of information may be used.
また、上記の実施の形態の学習システムでは、学習者端末10から学習支援サーバ20に頁情報として撮影頁画像を送信して、学習支援サーバ20の特徴量抽出部221にて、この撮影頁画像の特徴量を抽出したが、これに代えて、学習者端末10が特徴量抽出部221を備え、学習者端末10から学習支援サーバ20には撮影頁画像ではなく、そこから抽出した特徴量を頁情報として送信するようにしてもよい。この場合には、学習者端末10に備えられた特徴量抽出部221が画像生成部14とともに、本発明の「頁情報生成部」に相当する。即ち、教材の頁全体の情報である頁情報は、頁画像であってもよいし、そこから抽出された特徴量であってもよい。このときの特徴量は、本発明の「問題情報」に相当する。
In the learning system of the above-described embodiment, the photographed page image is transmitted as page information from the learner terminal 10 to the learning support server 20, and the photographed page image is extracted by the feature amount extraction unit 221 of the learning support server 20. However, instead of this, the learner terminal 10 is provided with a feature amount extraction unit 221, and the learner terminal 10 receives not the captured page image but the feature amount extracted therefrom from the learner terminal 10. You may make it transmit as page information. In this case, the feature amount extraction unit 221 provided in the learner terminal 10 corresponds to the “page information generation unit” of the present invention together with the image generation unit 14. That is, the page information, which is information on the entire page of the teaching material, may be a page image or a feature amount extracted from the page image. The feature amount at this time corresponds to “problem information” of the present invention.
また、学習者端末10が特徴量抽出部221のみならず、頁検索部222を備え、抽出した撮影頁画像の特徴量を用いて、その撮影頁画像に対応する登録頁を参照頁情報データベース23から抽出してよい。この場合は、学習者端末10からは、頁検索部222における検索の結果(即ち、検索された登録頁の頁ID)、及び質問箇所指定情報が学習支援サーバ20に送信される。また、この場合に、参照頁情報データベース23は学習者端末10に備えられていてよい。この検索結果は、本発明の「問題情報」に相当する。
Further, the learner terminal 10 includes not only the feature amount extraction unit 221 but also a page search unit 222, and the registered page corresponding to the photographed page image is referred to the reference page information database 23 using the extracted feature amount of the photographed page image. May be extracted from In this case, from the learner terminal 10, the search result in the page search unit 222 (that is, the page ID of the registered page searched) and the question location designation information are transmitted to the learning support server 20. In this case, the reference page information database 23 may be provided in the learner terminal 10. This search result corresponds to “problem information” of the present invention.
さらに、学習者端末10が、特徴量抽出部221及び頁検索部222のみならず、問題特定部223を備え、検索された登録頁から、学習者が指定した質問箇所に基づいて問題を特定してもよい。この場合には、特定された問題の問題IDが学習者端末10から学習支援サーバ20に送信される。この場合に、参照頁情報データベース23及び問題データベース24は学習者端末10に備えられていてよい。この場合には、問題IDが本発明の「問題情報」に相当する。
Further, the learner terminal 10 includes not only the feature amount extraction unit 221 and the page search unit 222 but also a problem specifying unit 223, and specifies a problem from the searched registration page based on the question location designated by the learner. May be. In this case, the problem ID of the identified problem is transmitted from the learner terminal 10 to the learning support server 20. In this case, the reference page information database 23 and the problem database 24 may be provided in the learner terminal 10. In this case, the problem ID corresponds to “problem information” of the present invention.
さらに、学習者端末10が、特徴量抽出部221、頁検索部222、及び問題特定部223のみならず、検索結果画面生成部224を備えていてもよい。この場合に、即ち、学習支援サーバ20の制御部22の機能がすべて学習者端末10に備えられていてよい。また、学習者端末10単体で学習支援システム100が構成され、上記の学習支援の動作に通信を要しないものとしてよい。
Further, the learner terminal 10 may include a search result screen generation unit 224 as well as the feature amount extraction unit 221, the page search unit 222, and the problem identification unit 223. In this case, that is, all the functions of the control unit 22 of the learning support server 20 may be provided in the learner terminal 10. Further, the learning support system 100 may be configured by the learner terminal 10 alone, and communication may not be required for the learning support operation described above.
また、上記の実施の形態では、問題特定部223にて、送信データ中の質問箇所指定情報、及び頁検索部222で得られた頁IDを用いて、問題データベース24に記憶されている問題を特定し、検索結果画面生成部224にて、解説コンテンツリンクデータベース25から、問題特定部223にて得られた問題IDを有するレコードの問題のリンク情報、及びサムネイル画像を取得したが、これに限られない。例えば、問題データベース24と解説コンテンツデータベース25とを別々に設けるのではなく、1つのデータベースとして、そのデータベースに、各問題のレコードとして、当該問題が記載された頁の頁ID、頁内の問題位置を示す問題位置データ、及び解説コンテンツへのリンク情報が関連付けられて記憶されていてよい。この場合には、問題特定部223及び検索結果画面生成部224からなる構成も、解説コンテンツ特定部として、上記の1つのデータベースから、質問箇所指定情報が指定する問題に対応する解説コンテンツを特定して、そのリンク情報を用いた検索結果画面を生成してよい。
In the above embodiment, the problem identification unit 223 uses the question location designation information in the transmission data and the page ID obtained by the page search unit 222 to store the problem stored in the problem database 24. The search result screen generation unit 224 acquires the link information and the thumbnail image of the problem of the record having the problem ID obtained by the problem identification unit 223 from the comment content link database 25. I can't. For example, the problem database 24 and the comment content database 25 are not provided separately, but as a single database, each problem record in the database is the page ID of the page in which the problem is described, and the problem position in the page. The problem position data indicating the link information to the commentary content may be stored in association with each other. In this case, the configuration including the problem specifying unit 223 and the search result screen generating unit 224 also specifies the commentary content corresponding to the problem specified by the question location specification information from the one database as the commentary content specifying unit. Then, a search result screen using the link information may be generated.
また、上記の実施の形態の学習支援システムでは、頁全体の撮影頁画像が得られているか否かを学習支援サーバにて判断したが、撮影頁画像が頁全体を撮影したものであるか否かの判断は、学習者端末において行ってもよい。この場合には、学習者端末は、撮影頁画像が頁全体を撮影したものでないと判断されると、その撮影頁画像をキャンセルして、頁ないし頁全体を撮影するように撮影のやり直しを促すメッセージを表示する。
In the learning support system of the above embodiment, the learning support server determines whether or not the captured page image of the entire page has been obtained. However, whether or not the captured page image is an image of the entire page. This determination may be made at the learner terminal. In this case, when the learner terminal determines that the photographed page image is not a photograph of the entire page, the learner terminal cancels the photographed page image and prompts the user to redo the photographing so as to photograph the page or the entire page. Display a message.
また、上記の実施の形態では、参照頁情報データベース23に参照頁情報として、登録頁の画像から抽出された複数の特徴量が記憶されていたが、この特徴量の代わりに、参照頁情報として各教材の各頁に含まれる文字列のテキストデータが記憶されていてもよい。この場合には、頁検索部222は、送信画像中の撮影頁画像に対して文字認識を行って、テキストデータを取得する。そして、頁検索部222は、文字認識によって得られたテキストデータと、参照頁情報データベース23に記憶されたテキストデータとのマッチングを行うことで、頁の検索を行う。また、参照頁情報データベース23に、参照頁情報として登録頁の画像データが記憶されていていてもよい。
In the above embodiment, the reference page information database 23 stores a plurality of feature values extracted from the image of the registered page as reference page information. Instead of this feature value, reference page information is used as reference page information. Text data of character strings included in each page of each learning material may be stored. In this case, the page search unit 222 performs character recognition on the captured page image in the transmission image and acquires text data. Then, the page search unit 222 performs page search by matching the text data obtained by character recognition with the text data stored in the reference page information database 23. The reference page information database 23 may store image data of a registered page as reference page information.
また、上記の実施の形態では、問題データベース24に各問題の位置を示す問題位置データとして、頁画像中の点位置を示すデータが記憶されていたが、これに代えて、頁画像中の各問題の領域を示すデータが記憶されていてもよい。この場合には、問題特定部223は、当該領域の所定の割合(例えば70%)以上が、送信データに含まれる質問箇所指定情報が示す枠に含まれている場合に、当該問題が指定されていると判断する。
In the above embodiment, data indicating the point position in the page image is stored in the problem database 24 as the problem position data indicating the position of each problem. Instead, each data in the page image is stored. Data indicating the problem area may be stored. In this case, the problem specifying unit 223 specifies the problem when a predetermined ratio (for example, 70%) or more of the area is included in the frame indicated by the question location specifying information included in the transmission data. Judge that
また、上記の実施の形態では、質問箇所指定情報が、撮影頁画像中の領域を示す情報であったが、これに代えて、質問箇所として、撮影頁画像中の点位置を示す情報であってもよい。この場合において、問題データベース24に問題位置データとして、点位置のデータが記憶されている場合は、問題特定部223は、質問箇所を示す点位置と最も近い点位置の問題を指定された問題と特定する。また、問題データベース24に問題位置データとして、領域のデータが記憶されている場合は、問題特定部223は、送信データに含まれる質問箇所を示す点位置を包含する領域の問題を指定された問題と特定する。
In the above embodiment, the question location designation information is information indicating the region in the captured page image. Instead, the question location specifying information is information indicating the point position in the captured page image as the question location. May be. In this case, when point position data is stored as the problem position data in the problem database 24, the problem specifying unit 223 determines that the problem is the point position problem closest to the point position indicating the question location. Identify. In addition, when area data is stored as problem position data in the problem database 24, the problem specifying unit 223 specifies a problem in an area including a point position indicating a question location included in transmission data. Is identified.
また、上記の実施の形態では、問題データベース24に各問題の位置を示す問題位置データが記憶されていたが、これに代えて、各問題の画像(以下、「参照問題画像」という。)が記憶されていてもよい。この場合には、問題特定部223は、送信データに含まれる撮影頁画像中の質問箇所指定情報によって指定される領域の部分画像と、問題データベース23に記憶された参照問題画像とのマッチングを行うことで、頁の検索を行う。
In the above embodiment, problem position data indicating the position of each problem is stored in the problem database 24. Instead, an image of each problem (hereinafter referred to as a “reference problem image”) is stored. It may be stored. In this case, the problem specifying unit 223 performs matching between the partial image of the area specified by the question location specifying information in the captured page image included in the transmission data and the reference problem image stored in the problem database 23. The page is searched.
また、上記の実施の形態では、学習者端末にまず解説コンテンツへのリンク情報を含む検索結果画面を送信し、学習者Sによる当該リンク情報を用いた解説動画の要求があった場合に、配信処理部225が解説動画のストリーミング配信を行ったが、この検索結果画面の送信を省略してよい。
In the above embodiment, the search result screen including link information to the commentary content is first transmitted to the learner terminal, and distribution is performed when the learner S requests a commentary video using the link information. Although the processing unit 225 has streamed the commentary video, the transmission of the search result screen may be omitted.
この場合には、検索結果画面生成部224及び解説コンテンツリンクデータベース25は省略することができ、その代わりに、解説コンテンツデータベース26には、各解説動画ファイルが問題IDと関連付けられて記憶される。こうすることで、第1の実施の形態の問題特定部223や第2の実施の形態の頁検索部222にて解説動画を配信すべき問題の問題IDが特定されたら、その情報を配信処理部225に渡し、配信処理部225は、特定された問題IDに関連付けられた解説動画を直接学習者端末にストリーミング配信する。
In this case, the search result screen generation unit 224 and the explanation content link database 25 can be omitted. Instead, each explanation movie file is stored in the explanation content database 26 in association with the problem ID. In this way, when the problem identification ID of the problem to which the commentary video should be distributed is specified by the problem specifying unit 223 of the first embodiment or the page search unit 222 of the second embodiment, the information is distributed. The delivery processing unit 225 delivers the commentary video associated with the identified problem ID to the learner terminal by streaming.
なお、複数の問題IDが特定される場合には、順にストリーミング配信を行うとともに、順番待ちの解説コンテンツについて、そのリンク情報とサムネイル画像を学習者端末に送信するようにしてもよい。
In addition, when a plurality of problem IDs are specified, streaming distribution may be performed in order, and link information and thumbnail images may be transmitted to the learner terminal for comment content waiting for the turn.
また、上記の実施の形態における学習支援サーバの構成要素は、その一部が別装置に備えられていてよい。特に、解説コンテンツデータベース26と配信処理部225は、他の構成と別の解説コンテンツサーバに備えられていてよい。また、すべてのデータベースと、送受信部及び制御部とが別々の装置として構成されてよい。
Also, some of the components of the learning support server in the above embodiment may be provided in a separate device. In particular, the comment content database 26 and the distribution processing unit 225 may be provided in a comment content server different from other configurations. Moreover, all the databases, the transmission / reception unit, and the control unit may be configured as separate devices.
また、上記の実施の形態では、解説コンテンツは動画であったが、解説コンテンツはこれに限られず、画像、音声、テキスト等、学習支援サーバから配信可能な各種の形式のコンテンツであってよい。
In the above embodiment, the commentary content is a moving image, but the commentary content is not limited to this, and may be various types of content that can be distributed from the learning support server, such as images, sounds, and texts.
また、上記の実施の形態では、学習者Sに教材の頁全体の情報を取得するために、頁全体の画像を撮影させたが、教材の頁の一部領域の情報でも登録頁の検索を可能としてよい。この変形例では、学習者端末10において、学習者Sが頁の一部領域を撮影することで、頁の一部領域のみの画像(以下、「撮影部分画像」)が得られる。この撮影部分画像も、上記の撮影頁画像と同様に、本発明の「問題画像」に相当する。なお、質問箇所の指定は、第1の実施の形態のようにあってもよく、第2の実施の形態のようになくてもよい。
Further, in the above embodiment, the learner S has taken an image of the entire page in order to acquire the information of the entire page of the learning material. However, the registered page is searched using information on a partial area of the learning material page. It may be possible. In this modification, an image of only a partial area of the page (hereinafter referred to as “captured partial image”) is obtained by the learner terminal 10 shooting a partial area of the page. This captured partial image also corresponds to the “problem image” of the present invention, like the above-described captured page image. The question part may be specified as in the first embodiment or not as in the second embodiment.
図18は、この変形例の参照問題情報データベースのデータ構成の例を示す図である。参照問題情報データベース23´は、上記の実施の形態の参照頁情報データベース23の代わりに用いることができる。参照問題情報データベース23´には、問題ごとにレコードが作成されて記憶されていている。各問題には、問題IDが付与されており、参照問題情報データベース23´には、各問題IDに対して当該問題の特徴量が特徴ベクトルの形態で関連付けられている。
FIG. 18 is a diagram showing an example of the data structure of the reference problem information database of this modification. The reference problem information database 23 ′ can be used in place of the reference page information database 23 of the above embodiment. In the reference problem information database 23 ', a record is created and stored for each problem. Each problem is given a problem ID, and the feature value of the problem is associated with each problem ID in the form of a feature vector in the reference problem information database 23 ′.
特徴量抽出部221は、撮影部分画像から上記の実施の形態と同様にして特徴量を抽出する。頁検索部222も上記の実施の形態と同様にして、撮影部分画像から抽出された特徴量をクエリとして、参照問題情報データベース23´に記憶されている複数の問題(以下、「登録問題」)の中から、撮影部分画像に対応する登録問題を検索する。
The feature amount extraction unit 221 extracts feature amounts from the captured partial images in the same manner as in the above embodiment. Similarly to the above-described embodiment, the page search unit 222 uses a feature amount extracted from the captured partial image as a query, and uses a plurality of problems stored in the reference problem information database 23 '(hereinafter referred to as "registration problem"). Search the registration problem corresponding to the captured partial image.
さらに、この変形例において、参照問題情報データベース23´の代わりに、上記の実施の形態の参照頁情報データベース23を用いるようにしてもよい。この場合には、頁検索部222は、上記の実施の形態と同様にして、対応点を最も多く含む登録頁を、撮影部分画像に対応する登録頁であると判断する。
Furthermore, in this modification, the reference page information database 23 of the above embodiment may be used instead of the reference problem information database 23 ′. In this case, the page search unit 222 determines that the registered page including the most corresponding points is the registered page corresponding to the captured partial image, as in the above embodiment.
また、上記の実施の形態では、学習者Sの操作によって画像生成部14が撮影をして頁画像ファイルを生成し、かつ学習者Sの操作によって頁画像ファイルを含む送信データを生成した。即ち、教材の撮影は、学習者Sによるレリーズ操作に応じて1つの画像ファイルを生成するというスチル撮影であった。これに代えて、AR(Augmented Reality)処理を行ってもよい。AR処理では、学習者Sのレリーズ操作がなくても画像生成部14の撮像素子で繰り返しキャプチャを行って、その都度以降の処理を行う。
In the above embodiment, the image generation unit 14 takes a picture by the operation of the learner S to generate a page image file, and the transmission data including the page image file is generated by the operation of the learner S. That is, the shooting of the teaching material is a still shooting in which one image file is generated according to the release operation by the learner S. Instead of this, AR (Augmented ity Reality) processing may be performed. In the AR processing, even if there is no release operation of the learner S, capture is repeatedly performed by the image sensor of the image generation unit 14, and the subsequent processing is performed each time.
AR処理では、学習者端末10の表示パネルには、所定のフレームレートで撮影した教材の画像が表示されるとともに、その画像に重畳させて、解説動画へのリンク情報を含む連番マーク(図10参照)が表示される。このために、検索結果画面生成部224は、学習者端末10に備えられる。検索結果画面生成部224は、検索結果画面を生成する代わりに、画像に重畳させる連番マークを生成して、所定のフレームレートで撮影されて表示パネルに表示される画像に、生成したマークを重畳する。AR処理を行うことにより、学習者Sは、学習者端末10を教材にかざすだけで、学習者端末10の表示パネルにて解説動画へのリンク情報を含むマークが重畳された教材の画像を得ることができる。
In the AR process, an image of a teaching material photographed at a predetermined frame rate is displayed on the display panel of the learner terminal 10 and is superposed on the image, and a serial number mark including link information to an explanation video (see FIG. 10) is displayed. For this purpose, the search result screen generation unit 224 is provided in the learner terminal 10. Instead of generating the search result screen, the search result screen generation unit 224 generates a serial number mark to be superimposed on the image, and adds the generated mark to the image captured at a predetermined frame rate and displayed on the display panel. Superimpose. By performing the AR process, the learner S simply holds the learner terminal 10 over the learning material, and obtains an image of the learning material on which a mark including link information to the explanation video is superimposed on the display panel of the learner terminal 10. be able to.
また、上記の実施の形態では、問題情報が、画像ファイルや、画像から得られた特徴量であったが、本発明の問題情報はこれに限られない。問題情報は、例えば画像に対して文字認識を行って得られたテキストデータであってもよい。さらに、上記の実施の形態では、画像生成部14にて教材を撮影することで問題情報を生成したが、問題情報は、学習者Sが教材の質問箇所を読み上げることで生成されてもよい。即ち、問題情報は、音声データ、その音声データから抽出された特徴データ、あるいはその音声データに対して音声認識を行って得られたテキストデータ(以下、「音声認識テキスト」)であってもよい。
In the above embodiment, the problem information is an image file or a feature amount obtained from an image. However, the problem information of the present invention is not limited to this. The problem information may be text data obtained by performing character recognition on an image, for example. Furthermore, in the above-described embodiment, the problem information is generated by photographing the teaching material with the image generation unit 14, but the problem information may be generated by the learner S reading the question part of the teaching material. That is, the problem information may be voice data, feature data extracted from the voice data, or text data obtained by performing voice recognition on the voice data (hereinafter, “voice recognition text”). .
音声認識を行う場合には、上記の実施の形態において、画像生成部14における画像生成処理に代えて、音声キャプチャ処理が行われる。また、音声データから特徴データが抽出される場合には、参照頁情報データベース23には、複数の教材の各頁について、又は複数の教材の複数の頁の各問題について、特徴データが記憶される。音声データからテキストデータを取得する場合には、特徴量抽出部221における特徴量抽出処理に代えて、音声認識処理が行われ、参照頁情報データベース23には、複数の教材の各頁について、又は複数の教材の複数の頁の各問題について、テキストデータが記憶される。
When performing voice recognition, voice capture processing is performed instead of image generation processing in the image generation unit 14 in the above embodiment. When feature data is extracted from audio data, the reference page information database 23 stores feature data for each page of a plurality of teaching materials or for each problem of a plurality of pages of a plurality of teaching materials. . When obtaining text data from voice data, a voice recognition process is performed instead of the feature quantity extraction process in the feature quantity extraction unit 221, and each page of a plurality of teaching materials is stored in the reference page information database 23, or Text data is stored for each question on a plurality of pages of a plurality of teaching materials.
また、検索結果画面生成部224は、解説動画へのリンク情報を含む検索結果画面を生成する。この検索結果画面にて認識した音声の内容をテキストで表示してもよい。また、検索結果画面生成部224を省略し、問題特定部223における問題の特定に成功したら、検索結果画面を生成することなく、配信処理部225が対応する解説動画の配信を開始してもよい。
Further, the search result screen generation unit 224 generates a search result screen including link information to the commentary video. The content of the voice recognized on the search result screen may be displayed as text. Further, the search result screen generation unit 224 may be omitted, and if the problem identification unit 223 succeeds in identifying the problem, the distribution processing unit 225 may start distributing the corresponding commentary video without generating the search result screen. .
次に、以上説明した本発明の実施の形態の学習システムを導入することで学習者に提供できる学習環境について説明する。
Next, a learning environment that can be provided to a learner by introducing the learning system according to the embodiment of the present invention described above will be described.
従来より、インターネット上では学習者のための解説動画が提供されている。しかし、学習者は、自らが視聴すべき動画を選択することは容易ではなく、解説動画の提供者が用意する順に従って順に動画を視聴していくか、解説動画に付随するインデクス(例えばその動画のタイトル)を頼りに、自分が学習したい内容に相当する動画を視聴する。このような解説動画の利用方法は、いずれも受動的であり、学習者は単に動画を眺めているだけになりがちであり、高い学習効果は期待できない。そこで、本発明らは、学習者が能動的に教科書を読んだり、問題集を解いたりするといった、非電子的な教材を用いた従来型の学習をベースとしつつ、そこに解説動画の配信を組み合わせる学習支援を企画した。
Traditionally, commentary videos for learners have been provided on the Internet. However, it is not easy for a learner to select a video to be viewed by himself / herself. The learner views the video in order according to the order provided by the explanation video provider, or an index attached to the explanation video (for example, the video). To watch the video corresponding to the content you want to learn. All of the methods of using such commentary videos are passive, and the learner tends to simply look at the videos, and a high learning effect cannot be expected. Therefore, the present invention is based on conventional learning using non-electronic teaching materials such as learners actively reading textbooks and solving problem collections, and distribution of commentary videos there. Planning a combined learning support.
本発明によれば、学習者が教材を用いて学習している際に質問をすると、学習者には、まさにその教材のその質問箇所についての解説動画が提供される。学習者による学習者端末に対する質問のための操作は、ちょうど従来型の学習において分からない点を先生に質問をする行動に相当する。そして、その解説動画の内容は、一般的な解法ではなく、実際に当該演習問題を解く方法を説明する内容であるので、まさに、分からない問題の解法を先生が教えてくれるのと同等の学習効果が得られる。即ち、本発明の実施の形態の学習支援システムによれば、教科書や問題集等を用いた学習において、いつでもどこでも先生に質問ができるという学習環境が与えられる。
According to the present invention, when a learner makes a question while learning using a learning material, the learner is provided with a commentary video about the question portion of the learning material. An operation for a question to a learner terminal by a learner is equivalent to an action of asking a teacher a question that is not known in conventional learning. And since the content of the commentary video is not a general solution, it is a content that explains how to actually solve the exercise problem, so it is exactly the same as a teacher teaching you how to solve a problem you do not understand An effect is obtained. That is, according to the learning support system of the embodiment of the present invention, a learning environment is provided in which questions can be asked to the teacher anytime and anywhere in learning using textbooks and problem collections.
100 学習支援システム
10、10´ 学習者端末
11 入力部
12 出力部
13 制御部
131 指定情報生成部
132 送信データ生成部
14 画像生成部
15 送受信部
20、20´、20´´ 学習支援サーバ
21 送受信部
22 制御部
221 特徴量抽出部
222、222´´ 頁検索部
222 問題特定部
224 検索結果画面生成部
225 配信処理部
23 参照頁情報データベース
24 問題データベース
25、25´ 解説コンテンツリンクデータベース
26 解説コンテンツデータベース
27 教材データベース DESCRIPTION OFSYMBOLS 100 Learning support system 10, 10 'Learner terminal 11 Input part 12 Output part 13 Control part 131 Specification information generation part 132 Transmission data generation part 14 Image generation part 15 Transmission / reception part 20, 20', 20 '' Learning support server 21 Transmission / reception Unit 22 control unit 221 feature amount extraction unit 222, 222 ″ page search unit 222 problem identification unit 224 search result screen generation unit 225 distribution processing unit 23 reference page information database 24 problem database 25, 25 ′ description content link database 26 commentary content Database 27 Teaching material database
10、10´ 学習者端末
11 入力部
12 出力部
13 制御部
131 指定情報生成部
132 送信データ生成部
14 画像生成部
15 送受信部
20、20´、20´´ 学習支援サーバ
21 送受信部
22 制御部
221 特徴量抽出部
222、222´´ 頁検索部
222 問題特定部
224 検索結果画面生成部
225 配信処理部
23 参照頁情報データベース
24 問題データベース
25、25´ 解説コンテンツリンクデータベース
26 解説コンテンツデータベース
27 教材データベース DESCRIPTION OF
Claims (8)
- 教材に含まれる問題の内容を示す問題情報を生成するための第1の制御部と、
解説コンテンツを記憶する解説コンテンツ記憶部と、
前記問題情報が示す問題に対応する解説コンテンツを検索して、前記解説コンテンツ記憶部から前記対応する解説コンテンツを取得する第2の制御部と、
を備えたことを特徴とする学習支援システム。 A first control unit for generating problem information indicating the content of the problem included in the teaching material;
Commentary content storage unit for storing commentary content;
Searching for commentary content corresponding to the problem indicated by the problem information, and acquiring the corresponding commentary content from the commentary content storage unit;
A learning support system characterized by comprising - 前記学習支援システムは、通信ネットワークを介して互いに通信可能な学習者端末と学習支援サーバとを備え、
前記第1の制御部は、前記学習者端末に備えられ、
前記解説コンテンツ記憶部及び前記第2の制御部は、前記学習支援サーバに備えられ、
前記学習者端末は、さらに、前記第1の制御部にて生成された前記問題情報を前記学習支援サーバに送信する端末送信部を備え、
前記学習支援サーバは、さらに、
前記端末送信部より送信された前記問題情報を受信するサーバ受信部と、
前記第2の制御部にて取得された前記解説コンテンツを前記学習者端末に送信するサーバ送信部と、
を備えたことを特徴とする請求項1に記載の学習支援システム。 The learning support system includes a learner terminal and a learning support server that can communicate with each other via a communication network,
The first control unit is provided in the learner terminal,
The comment content storage unit and the second control unit are provided in the learning support server,
The learner terminal further includes a terminal transmission unit that transmits the problem information generated by the first control unit to the learning support server,
The learning support server further includes:
A server receiver that receives the problem information transmitted from the terminal transmitter;
A server transmission unit that transmits the commentary content acquired by the second control unit to the learner terminal;
The learning support system according to claim 1, further comprising: - 前記問題情報は、前記教材を撮影することで得られた問題画像であることを特徴とする請求項1又は2に記載の学習支援システム。 3. The learning support system according to claim 1, wherein the problem information is a problem image obtained by photographing the teaching material.
- 前記問題情報は、教材を撮影することで得られた問題画像から抽出された特徴量であることを特徴とする請求項1又は2に記載の学習支援システム。 3. The learning support system according to claim 1, wherein the problem information is a feature amount extracted from a problem image obtained by photographing a teaching material.
- 前記解説コンテンツは動画像であることを特徴とする請求項1ないし4のいずれか一項に記載の学習支援システム。 5. The learning support system according to claim 1, wherein the commentary content is a moving image.
- 通信ネットワークを介して学習者端末と通信可能な学習支援サーバであって、
前記学習者端末より送信された問題情報を受信する受信部と、
解説コンテンツを記憶する解説コンテンツ記憶部と、
前記解説コンテンツ記憶部から前記問題情報が示す問題に対応する解説コンテンツを取得する制御部と、
前記制御部にて取得された前記解説コンテンツを前記学習者端末に送信する送信部と、
を備えたことを特徴とする学習支援サーバ。 A learning support server capable of communicating with a learner terminal via a communication network,
A receiving unit for receiving problem information transmitted from the learner terminal;
Commentary content storage unit for storing commentary content;
A control unit that acquires commentary content corresponding to the problem indicated by the problem information from the commentary content storage unit;
A transmission unit that transmits the commentary content acquired by the control unit to the learner terminal;
A learning support server characterized by comprising: - 通信ネットワークを介して学習者端末と通信可能であり、かつ解説コンテンツを記憶する解説コンテンツ記憶部を備えた学習支援サーバにおける学習支援方法であって、
前記学習支援方法は、
前記学習者端末より送信された問題情報を受信する受信ステップと、
前記解説コンテンツ記憶部から前記問題情報が示す問題に対応する解説コンテンツを取得する取得ステップと、
前記取得ステップにて取得された前記解説コンテンツを前記学習者端末に送信する送信ステップと、
を含むことを特徴とする学習支援方法。 A learning support method in a learning support server that is communicable with a learner terminal via a communication network and includes a commentary content storage unit that stores commentary content,
The learning support method includes:
A receiving step of receiving problem information transmitted from the learner terminal;
An acquisition step of acquiring commentary content corresponding to the problem indicated by the problem information from the commentary content storage unit;
A transmission step of transmitting the commentary content acquired in the acquisition step to the learner terminal;
The learning support method characterized by including. - 通信ネットワークを介して学習者端末と通信可能であり、かつ解説コンテンツを記憶した解説コンテンツ記憶部を備えた学習支援サーバのコンピュータを、
前記学習者端末より送信された問題情報を受信する受信部、
前記解説コンテンツ記憶部から前記問題情報が示す問題に対応する解説コンテンツを取得する制御部、及び
前記制御部にて取得された前記解説コンテンツを前記学習者端末に送信する送信部、
として機能させることを特徴とする学習支援プログラム。 A computer of a learning support server capable of communicating with a learner terminal via a communication network and having a comment content storage unit storing comment content,
A receiving unit for receiving problem information transmitted from the learner terminal;
A control unit that acquires comment content corresponding to the problem indicated by the problem information from the comment content storage unit; and a transmission unit that transmits the comment content acquired by the control unit to the learner terminal;
Learning support program characterized by functioning as
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2016520934A JPWO2015178014A1 (en) | 2014-05-23 | 2015-05-19 | Learning support system, learning support server, learning support method, and learning support program |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014107553 | 2014-05-23 | ||
JP2014-107553 | 2014-05-23 | ||
JP2014-107544 | 2014-05-23 | ||
JP2014107544 | 2014-05-23 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015178014A1 true WO2015178014A1 (en) | 2015-11-26 |
Family
ID=54553695
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2015/002510 WO2015178014A1 (en) | 2014-05-23 | 2015-05-19 | Learning support system, learning support server, learning support method, and learning support program |
Country Status (2)
Country | Link |
---|---|
JP (1) | JPWO2015178014A1 (en) |
WO (1) | WO2015178014A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6308482B1 (en) * | 2017-03-06 | 2018-04-11 | 弘道 外山 | Learning support system, learning support server, learning support method, learning support program, and operation method of learning support system |
JP2020134878A (en) * | 2019-02-25 | 2020-08-31 | 株式会社教育情報サービス | Learning system, moving image automatic generation method, and program |
JP2021060440A (en) * | 2019-10-03 | 2021-04-15 | Asatec株式会社 | Card learning system and card learning method |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013222406A (en) * | 2012-04-18 | 2013-10-28 | Setsuo Kimura | Image retrieval system, image retrieval device, and computer program |
-
2015
- 2015-05-19 JP JP2016520934A patent/JPWO2015178014A1/en active Pending
- 2015-05-19 WO PCT/JP2015/002510 patent/WO2015178014A1/en active Application Filing
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013222406A (en) * | 2012-04-18 | 2013-10-28 | Setsuo Kimura | Image retrieval system, image retrieval device, and computer program |
Non-Patent Citations (1)
Title |
---|
"Tenohira Katei Kyoshi Snapstudy/Snasuta", IPHONE SAISHIN NINKI APPLICATION RANKING BEST 300 [IOS-APP, 25 February 2014 (2014-02-25), Retrieved from the Internet <URL:http://ios-app.jp/625692675.html> [retrieved on 20150716] * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6308482B1 (en) * | 2017-03-06 | 2018-04-11 | 弘道 外山 | Learning support system, learning support server, learning support method, learning support program, and operation method of learning support system |
JP2018146799A (en) * | 2017-03-06 | 2018-09-20 | 弘道 外山 | Learning support system, learning support server, learning support method, learning support program, and operation method for learning support system |
JP2020134878A (en) * | 2019-02-25 | 2020-08-31 | 株式会社教育情報サービス | Learning system, moving image automatic generation method, and program |
JP2021060440A (en) * | 2019-10-03 | 2021-04-15 | Asatec株式会社 | Card learning system and card learning method |
Also Published As
Publication number | Publication date |
---|---|
JPWO2015178014A1 (en) | 2017-04-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10339383B2 (en) | Method and system for providing augmented reality contents by using user editing image | |
CN103140862B (en) | User interface system and operational approach thereof | |
CN103607457B (en) | Take down notes processing method, device, terminal, server and system | |
CN103310663B (en) | A kind of Intelligent point-reading method, equipment and system | |
JP2014238742A (en) | Information processing system, and information processing method | |
WO2015178014A1 (en) | Learning support system, learning support server, learning support method, and learning support program | |
JP2012190303A (en) | Comment sharing system, method, and program | |
JP2014238815A (en) | Information processing system, information providing method, terminal device, and program | |
JP4818274B2 (en) | Method for distributing multimedia data to a device equipped with an image sensor | |
JP6398552B2 (en) | Display control program, display control method, and display control apparatus | |
CN108351973A (en) | Method of controlling image processing apparatus | |
CN109697242A (en) | It takes pictures and searches topic method, apparatus, storage medium and calculate equipment | |
CN106202539B (en) | Aggregation search method and device | |
US20150039643A1 (en) | System for storing and searching image files, and cloud server | |
JP6324284B2 (en) | Group learning system | |
KR20140025720A (en) | Learning system and method for providing multimedia contents using recongnition code of books | |
CN208922253U (en) | Video intelligent driving means | |
JP2018005931A (en) | Information processing system, information processing method, and external system | |
JP6221107B2 (en) | Control device and program | |
CN112307877A (en) | Information processing method, information processing apparatus, and computer-readable storage medium | |
KR101723500B1 (en) | Device and method for providing information | |
KR20160048916A (en) | Query method, apparatus, system and client for product description | |
KR101700898B1 (en) | The apparatus which supports a self-introduction process using a video contents | |
JP6331777B2 (en) | Augmented reality information providing system, augmented reality information providing method, and augmented reality information providing program | |
Rahman et al. | Mobile pointme based pervasive gaming interaction with learning objects annotated physical atlas |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15796482 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2016520934 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 15796482 Country of ref document: EP Kind code of ref document: A1 |