CN107967110A - Playing method, playing device, electronic equipment and computer readable storage medium - Google Patents
Playing method, playing device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN107967110A CN107967110A CN201711239997.6A CN201711239997A CN107967110A CN 107967110 A CN107967110 A CN 107967110A CN 201711239997 A CN201711239997 A CN 201711239997A CN 107967110 A CN107967110 A CN 107967110A
- Authority
- CN
- China
- Prior art keywords
- audio
- page
- video frequency
- touch area
- frequency content
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000003860 storage Methods 0.000 title claims abstract description 11
- 238000012544 monitoring process Methods 0.000 claims abstract description 16
- 238000004590 computer program Methods 0.000 claims description 20
- 238000012545 processing Methods 0.000 claims description 9
- 239000000463 material Substances 0.000 abstract description 9
- 230000006870 function Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012876 topography Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000007306 turnover Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
- G06F16/432—Query formulation
- G06F16/434—Query formulation using image data, e.g. images, photos, pictures taken by a user
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Mathematical Physics (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention is suitable for the technical field of intelligent equipment, and provides a playing method, a playing device, electronic equipment and a computer readable storage medium, wherein the playing method comprises the following steps: acquiring an image of a page; searching audio and video content associated with the page in a preset database based on the image of the page; monitoring touch operation on the image; when touch operation on the image is monitored, determining a touch area corresponding to the touch operation; and playing the audio and video content corresponding to the touch area in the audio and video content based on the touch area. The invention does not need the user to select or update the textbook (teaching material) file or adjust the page number, and can improve the convenience of reading and playing by the user.
Description
Technical field
The invention belongs to technical field of intelligent equipment, more particularly to a kind of playback method, playing device, electronic equipment and meter
Calculation machine readable storage medium storing program for executing.
Background technology
At present, in the market exist it is many possess a product for reading and (click on and play) function, such as point reader, point reader can be with
The study of guiding children, therefore welcome deeply by parent.
However, existing point reader carries out a mode complex steps for reading broadcasting, it is not convenient enough.For example, first, using
Before, it is necessary to which parent selects to set textbook (teaching material) file corresponding with the grade of the children for children；Second, when in use,
When textbook page turning each time, it is also necessary to also carry out the adjustment of the page number therewith in a reading equipment；3rd, in the textbook of this grade
After (teaching material) update or adapted, the correspondence of point reader and textbook also just loses accuracy.
The content of the invention
In view of this, an embodiment of the present invention provides a kind of playback method, playing device, electronic equipment and computer-readable
Storage medium, the selection or renewal of textbook (teaching material) file can be carried out without user, the adjustment of the page number is carried out without user,
Improve user and carry out a convenience for reading broadcasting.
The first aspect of the embodiment of the present invention provides a kind of playback method, and the playback method includes：
Obtain the image of the page；
Based on the image of the page, searched and the associated audio-video frequency content of the page in default database；
Monitor the touch operation in described image；
When listening to the touch operation in described image, the corresponding touch area of the touch operation is determined；
Based on the touch area, audio-video frequency content corresponding with the touch area in the audio-video frequency content is played.
It is described to be touched based on described in first aspect in the first possible implementation based on the first aspect of the present invention
Region is touched, plays audio-video frequency content corresponding with the touch area in the audio-video frequency content, including：
Determine the positional information of the touch area on the image；
Based on the positional information, play in the audio-video frequency content with the associated audio-video frequency content of the positional information.
It is described to be touched based on described in second of possible implementation of first aspect based on the first aspect of the present invention
Region is touched, plays audio-video frequency content corresponding with the touch area in the audio-video frequency content, including：
Identify the touch area corresponding text message on the image；
Based on the text message, the audio-video frequency content with the associate text information in the audio-video frequency content is played.
, may at the third based on the first aspect of the present invention, and any of the above-described kind of possible implementation of first aspect
Implementation in, the image based on the page, searches in default database and is regarded with the associated sound of the page
Frequency content, including：
Image recognition processing is carried out to described image, obtains the characteristic information of described image；
Based on the characteristic information, the page source of the page is determined；
Based on the page source, the corresponding audio-video frequency content in the page source is searched in default database.
Based on the first aspect of the present invention, and any of the above-described kind of possible implementation of first aspect, in the 4th kind of possibility
Implementation in, it is described obtain the page image after, further include：
Based on the image of the page, searched and the associated content of text of the page in default database；
It is described determine the corresponding touch area of the touch operation after, further include：
Based on the touch area, content of text corresponding with the touch area in the content of text is shown.
The second aspect of the embodiment of the present invention provides a kind of playing device, and the playing device includes：
Image acquisition unit, for obtaining the image of the page；
Audio-video frequency content searching unit, for the described image obtained based on described image acquiring unit, in default number
Searched and the associated audio-video frequency content of the page according in storehouse；
Touch operation monitoring unit, the touch operation in described image for monitoring the acquisition of described image acquiring unit；
Touch area determination unit, for listening to the touch operation in described image when the touch operation monitoring unit
When, determine the corresponding touch area of the touch operation；
Broadcast unit, for the touch area determined based on the touch area determination unit, is played the sound and regarded
Audio-video frequency content corresponding with the touch area in the audio-video frequency content that frequency content search unit is searched.
Based on the second aspect of the present invention, in second aspect in the first possible implementation, the playing device is also
Including：
Positional information determination unit, for determining the touch area that the touch area determination unit determines described
The positional information in described image that image acquisition unit obtains；
The broadcast unit is specifically used for, the positional information determined based on the positional information determination unit, plays
In the audio-video frequency content that the audio-video frequency content searching unit is searched with the associated audio-video frequency content of the positional information.
Based on the second aspect of the present invention, in second of possible implementation of second aspect, the playing device is also
Including：
Text message recognition unit, for identifying the touch area that the touch area determination unit determines described
Corresponding text message in the described image that image acquisition unit obtains；
The broadcast unit is specifically additionally operable to, the text message identified based on the text message recognition unit,
Play in the audio-video frequency content that the audio-video frequency content searching unit is searched with the audio and video of the associate text information
Hold.
The third aspect of the embodiment of the present invention provides a kind of electronic equipment, including memory, processor and is stored in
In the memory and the computer program that can run on the processor, when the processor performs the computer program
Realize as described in any one the step of playback method.
The fourth aspect of the embodiment of the present invention provides a kind of computer-readable recording medium, the computer-readable storage
Media storage has computer program, and the step of the playback method as described in any one is realized when the computer program is executed by processor
Suddenly.
Existing beneficial effect is the embodiment of the present invention compared with prior art：
The present invention is by obtaining the image of the page, and based on the image of the page, searched in default database with
The associated audio-video frequency content of the page；The touch operation in described image is monitored, is grasped when listening to the touch in described image
When making, the corresponding touch area of the touch operation is determined；And be based on the touch area, play in the audio-video frequency content with
The corresponding audio-video frequency content in the touch area.As can be seen that due to search with the associated audio-video frequency content of the page and
The process of audio-video frequency content corresponding with the touch area is automatic progress in the audio-video frequency content, is joined without user
With, therefore avoid the need for user and make choice file, more new file or adjust the troublesome operation of the page number, improve user's progress
Point reads the convenience played.
Brief description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art
Needed in attached drawing be briefly described, it should be apparent that, drawings in the following description be only the present invention some
Embodiment, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these
Attached drawing obtains other attached drawings.
Fig. 1 is that playback method provided in an embodiment of the present invention realizes flow chart；
Fig. 2 is one of step 102 in embodiment illustrated in fig. 1 provided in an embodiment of the present invention and realizes flow chart；
Fig. 3 is that the playback method that another embodiment of the present invention provides realizes flow chart；
Fig. 4 is the structure diagram of playing device provided in an embodiment of the present invention；
Fig. 5 is the schematic diagram of electronic equipment provided in an embodiment of the present invention.
Embodiment
In being described below, in order to illustrate rather than in order to limit, it is proposed that such as tool of particular system structure, technology etc
Body details, to understand thoroughly the embodiment of the present invention.However, it will be clear to one skilled in the art that these are specific
The present invention can also be realized in the other embodiments of details.In other situations, omit to well-known system, device, electricity
Road and the detailed description of method, in case unnecessary details hinders description of the invention.
In order to illustrate technical solutions according to the invention, illustrated below by specific embodiment.
What Fig. 1 showed playback method provided in an embodiment of the present invention realizes flow chart, and details are as follows：
In a step 101, the image of the page is obtained；
In embodiments of the present invention, the image of the page is obtained by the photographing module of terminal, the page is being learned for user
When difficult content is run into during habit, the book page where the difficulty content, alternatively, the page of other carriers where the difficulty content
Face.The present invention can be user play the difficulty content relevant explanation, translate or the difficulty content is read aloud, for
Family is explained the puzzle, and teaches the study of user.
It should be noted that the image of the page obtained, can be the overview image of the page, or including
The parts of images for the difficult content that user is run into, it is preferable that obtain the overview image of the page.
In a step 102, the image based on the page, is searched and the associated sound of the page in default database
Video content；
In embodiments of the present invention, the image information of the every page of the books in advance learnt user, after the informationization
Image, and be stored in the associated audio-video frequency content of image of every page in default database, which can set
Server is placed in, terminal is connected with server communication, in order to obtain related data from the database of server.
Exemplary, default small English learning database is established, by the information of the every page of primary school's english textbook (teaching material)
It is stored in the small English learning database.In addition, in the small English learning database, each page therein is associated with being somebody's turn to do
The corresponding audio-video frequency content of English study content of the page, for example, read aloud for each English text of the page
Audio content, alternatively, carrying out the video content of deduction demonstration for some session operational scenarios of the page.
In embodiments of the present invention, after the image of certain page is got, the image based on the page, it may be determined that should
The relevant information of the page, so can be searched in default database and obtain prestoring in the database with the page
The associated audio-video frequency content in face.
It should be noted that after textbook (teaching material) is updated (revision), can be in the database of server
Renewal is adjusted correspondingly, the user without terminal carries out extra renewal operation.
In step 103, the touch operation in described image is monitored；
In embodiments of the present invention, after the image of the page is got, the touch behaviour of monitoring users on the image
Make, the touch operation of user on the image can further indicate that difficult content that user is run on the page specific
Position.For example, determine the difficult content that the content on the corresponding touch area of touch operation of user is run into user.
In another embodiment, if not hearing the touch behaviour of user on the image within a preset time interval
Make, then all play out the associated audio-video frequency content of the page in a predetermined order.
At step 104, when listening to the touch operation in described image, the corresponding touch of the touch operation is determined
Region；
In the present embodiment, if listening to the touch operation of user on the image, it is determined that the touch operation is corresponding
Touch area, and the touch area is based on, further position the specific audio-video frequency content that user needs to play.
In step 105, based on the touch area, play corresponding with the touch area in the audio-video frequency content
Audio-video frequency content.
In embodiments of the present invention, the touch area based on user on the image, is finding and the page
Further position, determine corresponding with the touch area with the associated audio-video frequency content of the page in associated audio-video frequency content
Audio-video frequency content, and play corresponding with touch area audio-video frequency content.
Optionally, above-mentioned steps 105 can be accomplished by the following way：
Determine the positional information of the touch area on the image；
Based on the positional information, play in the audio-video frequency content with the associated audio-video frequency content of the positional information.
In the present embodiment, described image is the overview image of the page, the touch area based on user on the image, really
The fixed positional information of the touch area on the image, and then according to the positional information, it may be determined that it is corresponding on the page
Audio-video frequency content associated by the word content of position, and the audio-video frequency content is played out.Exemplary, in the audio and video
Holding can be in the corresponding audio recitation content of content of text for touch area position in described image, audio translation
Perhaps other complementary content of multimedia.So as to reach auxiliary user's the destination of study.
Optionally, above-mentioned steps 105 can also be accomplished by the following way：
Identify the touch area corresponding text message on the image；
Based on the text message, the audio-video frequency content with the associate text information in the audio-video frequency content is played.
In the present embodiment, described image can be the overview image of the page, or the Local map of the page
Picture, when described image is the topography of the page, the content which includes is more, is existed based on the topography
Searched in default database higher with the accuracy rate of the associated audio-video frequency content of the page.
In the present embodiment, processing is identified to the corresponding image-region in touch area in described image, this is obtained and touches
Touch region corresponding text message on the image.In default database, the audio-video frequency content that is stored with accordingly
Associate text information, then, based on obtained text message, the corresponding sound of the page can be regarded described in default database
The audio-video frequency content with text information association is searched in frequency content, and the audio-video frequency content is played out.Exemplary, should
Audio-video frequency content can turn over for the corresponding audio recitation content of content of text, the audio for touch area position on image
Translate interior perhaps other complementary content of multimedia.So as to reach auxiliary user's the destination of study.
From the foregoing, it will be observed that the image of the invention by obtaining the page, and based on the image of the page, in default database
Middle lookup and the associated audio-video frequency content of the page；The touch operation in described image is monitored, when listening in described image
Touch operation when, determine the corresponding touch area of the touch operation；And the touch area is based on, play the audio and video
Audio-video frequency content corresponding with the touch area in content.As can be seen that due to searching and the associated audio and video of the page
The process of audio-video frequency content corresponding with the touch area is automatic progress in content and the audio-video frequency content, without
User participates in, therefore avoids the need for user and make choice file, more new file or adjust the troublesome operation of the page number, improves use
Family carries out a convenience for reading broadcasting.
Fig. 2 shows that one of step 102 in embodiment illustrated in fig. 1 provided in an embodiment of the present invention realizes flow chart, in detail
State as follows：
In step 201, image recognition processing is carried out to described image, obtains the characteristic information of described image；
In embodiments of the present invention, processing is identified to the image of the page of acquisition, obtains the spy of described image
Reference ceases, specifically, the characteristic information can be the content of text information of the page, the characteristic information can also be institute
State the pixel characteristic information of the image of the page.
In step 202, based on the characteristic information, the page source of the page is determined；
In the embodiment of the present invention, after the characteristic information of described image is obtained, based on the characteristic information, default
Lookup matching is carried out in database, it may be determined that the page source of the page.
It is exemplary, be stored with default database each page of all english textbooks of primary school (teaching material) information and
Its corresponding image and related audio-video frequency content, described image (the primary school's english textbook one page pair therein obtained according to identification
The image answered) on content of text information, can be determined from the database the corresponding page of the image from it is specific which
A books (teaching material), and which specific page on the books (teaching material), can also search to obtain the corresponding sound of the page
Video content.
In step 203, based on the page source, the corresponding sound in the page source is searched in default database
Video content.
After the page source of the page is determined, based on the page source, and then can be in default database
Lookup obtains the corresponding audio-video frequency content in page source.
Exemplary, according to the content of text information on image, after characteristic matching is carried out, determine page belonging to the image
The page source in face is page 16 in a last term english textbook.So, in default database, can search
To the corresponding audio-video frequency content of page 16 in a last term english textbook.
From the foregoing, it will be observed that the image of the invention by obtaining the page, and based on the image of the page, in default database
Middle lookup and the associated audio-video frequency content of the page；The touch operation in described image is monitored, when listening in described image
Touch operation when, determine the corresponding touch area of the touch operation；And the touch area is based on, play the audio and video
Audio-video frequency content corresponding with the touch area in content.As can be seen that due to searching and the associated audio and video of the page
The process of audio-video frequency content corresponding with the touch area is automatic progress in content and the audio-video frequency content, without
User participates in, therefore avoids the need for user and make choice file, more new file or adjust the troublesome operation of the page number, improves use
Family carries out a convenience for reading broadcasting.
Fig. 3 shows that the playback method that another embodiment of the present invention provides realizes flow chart；Details are as follows：
In the present embodiment, step 301 to step 302 refers to step 101 in embodiment illustrated in fig. 1 to step 102,
This is not repeated.
In step 303, the image based on the page, is searched and the associated text of the page in default database
This content；
In the present embodiment, in the database, in addition to the associated audio-video frequency content of the page, it can also associate
There is content of text corresponding with the page, for example, when the text message on the page is foreign language, in the database
In, it is stored with translator of Chinese content of text corresponding with the foreign language text message on the page.Correspondingly, based on the page
Image, is searched and the associated content of text of the page in default database.
In the present embodiment, step 304 to step 306 specifically refers to step 103 in embodiment illustrated in fig. 1 to step
105, therefore not to repeat here.
In step 307, based on the touch area, text corresponding with the touch area in the content of text is shown
This content.
In the present embodiment, after the definite touch area of user on the image, it will search in the database
To with the associated content of text of the page, content of text corresponding with touch area is shown to user.Exemplary, should
Content of text corresponding with touch area can be the translator of Chinese of touch area corresponding text message on the page.
From the foregoing, it will be observed that the image of the invention by obtaining the page, and based on the image of the page, in default database
Middle lookup and the associated audio-video frequency content of the page；The touch operation in described image is monitored, when listening in described image
Touch operation when, determine the corresponding touch area of the touch operation；And the touch area is based on, play the audio and video
Audio-video frequency content corresponding with the touch area in content.As can be seen that due to searching and the associated audio and video of the page
The process of audio-video frequency content corresponding with the touch area is automatic progress in content and the audio-video frequency content, without
User participates in, therefore avoids the need for user and make choice file, more new file or adjust the troublesome operation of the page number, improves use
Family carries out a convenience for reading broadcasting.
It is to be understood that the size of the sequence number of each step is not meant to the priority of execution sequence, each process in above-described embodiment
Execution sequence should determine that the implementation process without tackling the embodiment of the present invention forms any limit with its function and internal logic
It is fixed.
Fig. 4 shows the structure diagram of playing device provided in an embodiment of the present invention, for convenience of description, illustrate only
With the relevant part of the embodiment of the present invention, details are as follows：
As shown in figure 4, a kind of playing device 4, including：Image acquisition unit 41, audio-video frequency content searching unit 42, touches
Operate monitoring unit 43, touch area determination unit 44 and broadcast unit 45.
Image acquisition unit 41, for obtaining the image of the page；
Audio-video frequency content searching unit 42, for the described image obtained based on image acquisition unit 41, in default number
Searched and the associated audio-video frequency content of the page according in storehouse；
Touch operation monitoring unit 43, the touch operation in described image for monitoring the acquisition of image acquisition unit 41；
Touch area determination unit 44, for listening to the touch operation in described image when touch operation monitoring unit 43
When, determine the corresponding touch area of the touch operation；
Broadcast unit 45, for the touch area determined based on touch area determination unit 44, in playing audio-video
Hold audio-video frequency content corresponding with the touch area in the audio-video frequency content that searching unit 42 is searched.
Optionally, playing device 4 further includes：
Positional information determination unit, for determining that the definite touch area of touch area determination unit 44 is obtained in image
Take the positional information in the described image of the acquisition of unit 41；
Broadcast unit 45 is specifically used for, the positional information determined based on the positional information determination unit, plays sound
Video content searching unit 42 search the audio-video frequency content in the associated audio-video frequency content of the positional information.
Optionally, playing device 4 further includes：
Text message recognition unit, for identifying that the definite touch area of touch area determination unit 44 is obtained in image
Take corresponding text message in the described image of the acquisition of unit 41；
Broadcast unit 45 is specifically additionally operable to, and the text message identified based on the text message recognition unit, is broadcast
Audio-video frequency content in the audio-video frequency content that playback video content searching unit 42 is searched with the associate text information.
From the foregoing, it will be observed that the image of the invention by obtaining the page, and based on the image of the page, in default database
Middle lookup and the associated audio-video frequency content of the page；The touch operation in described image is monitored, when listening in described image
Touch operation when, determine the corresponding touch area of the touch operation；And the touch area is based on, play the audio and video
Audio-video frequency content corresponding with the touch area in content.As can be seen that due to searching and the associated audio and video of the page
The process of audio-video frequency content corresponding with the touch area is automatic progress in content and the audio-video frequency content, without
User participates in, therefore avoids the need for user and make choice file, more new file or adjust the troublesome operation of the page number, improves use
Family carries out a convenience for reading broadcasting.
Fig. 5 is the schematic diagram of electronic equipment provided in an embodiment of the present invention.As shown in figure 5, the electronic equipment 5 of the embodiment
Including：Processor 50, memory 51 and it is stored in the calculating that can be run in the memory 51 and on the processor 50
Machine program 52.The processor 50 realizes the step in above-mentioned each playback method embodiment when performing the computer program 52
Suddenly, such as the step 101 shown in Fig. 1 is to step 105.Alternatively, the processor 50 is realized when performing the computer program 52
The function of each module/unit in above-mentioned each device embodiment, such as the function of unit 41 to 45 shown in Fig. 4.
Exemplary, the computer program 52 can be divided into one or more module/units, it is one or
Multiple module/units are stored in the memory 51, and are performed by the processor 50, to complete the present invention.Described one
A or multiple module/units can be the series of computation machine programmed instruction section that can complete specific function, which is used for
Implementation procedure of the computer program 52 in the electronic equipment 5 is described.For example, the computer program 52 can be divided
Image acquisition unit is cut into, audio-video frequency content searching unit, touch operation monitoring unit, touch area determination unit and broadcasting are single
Member, each unit concrete function are as follows：
Image acquisition unit, for obtaining the image of the page；
Audio-video frequency content searching unit, for the described image obtained based on described image acquiring unit, in default number
Searched and the associated audio-video frequency content of the page according in storehouse；
Touch operation monitoring unit, the touch operation in described image for monitoring the acquisition of described image acquiring unit；
Touch area determination unit, for listening to the touch operation in described image when the touch operation monitoring unit
When, determine the corresponding touch area of the touch operation；
Broadcast unit, for the touch area determined based on the touch area determination unit, is played the sound and regarded
Audio-video frequency content corresponding with the touch area in the audio-video frequency content that frequency content search unit is searched.
The electronic equipment 5 can be that the calculating such as desktop PC, notebook, palm PC and cloud server are set
It is standby.The electronic equipment may include, but be not limited only to, processor 50, memory 51.It will be understood by those skilled in the art that Fig. 5
The only example of electronic equipment 5, does not form the restriction to electronic equipment 5, can include than illustrating more or fewer portions
Part, either combines some components or different components, such as the electronic equipment can also include input-output equipment, net
Network access device, bus etc..
Alleged processor 50 can be central processing unit (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), application-specific integrated circuit
(Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor can also be any conventional processor
Deng.
The memory 51 can be the internal storage unit of the electronic equipment 5, such as the hard disk of electronic equipment 5 or interior
Deposit.The memory 51 can also be the External memory equipment of the electronic equipment 5, such as be equipped with the electronic equipment 5
Plug-in type hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, dodges
Deposit card (Flash Card) etc..Further, the memory 51 can also both include the storage inside list of the electronic equipment 5
Member also includes External memory equipment.The memory 51 is used to store needed for the computer program and the electronic equipment
Other programs and data.The memory 51 can be also used for temporarily storing the data that has exported or will export.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each work(
Can unit, module division progress for example, in practical application, can be as needed and by above-mentioned function distribution by different
Functional unit, module are completed, i.e., the internal structure of described device are divided into different functional units or module, more than completion
The all or part of function of description.Each functional unit, module in embodiment can be integrated in a processing unit, also may be used
To be that unit is individually physically present, can also two or more units integrate in a unit, it is above-mentioned integrated
Unit can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.In addition, each function list
Member, the specific name of module are not limited to the protection domain of the application also only to facilitate mutually distinguish.Said system
The specific work process of middle unit, module, may be referred to the corresponding process in preceding method embodiment, details are not described herein.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and is not described in detail or remembers in some embodiment
The part of load, may refer to the associated description of other embodiments.
Those of ordinary skill in the art may realize that each exemplary list described with reference to the embodiments described herein
Member and algorithm steps, can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
Performed with hardware or software mode, application-specific and design constraint depending on technical solution.Professional technician
Described function can be realized using distinct methods to each specific application, but this realization is it is not considered that exceed
The scope of the present invention.
In embodiment provided by the present invention, it should be understood that disclosed device/electronic equipment and method, can be with
Realize by another way.For example, device described above/electronic equipment embodiment is only schematical, for example, institute
The division of module or unit is stated, is only a kind of division of logic function, there can be other dividing mode when actually realizing, such as
Multiple units or component can combine or be desirably integrated into another system, or some features can be ignored, or not perform.Separately
A bit, shown or discussed mutual coupling or direct-coupling or communication connection can be by some interfaces, device
Or INDIRECT COUPLING or the communication connection of unit, can be electrical, machinery or other forms.
The unit illustrated as separating component may or may not be physically separate, be shown as unit
The component shown may or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
In network unit.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units integrate in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.
If the integrated module/unit realized in the form of SFU software functional unit and as independent production marketing or
In use, it can be stored in a computer read/write memory medium.Based on such understanding, the present invention realizes above-mentioned implementation
All or part of flow in example method, can also instruct relevant hardware to complete, the meter by computer program
Calculation machine program can be stored in a computer-readable recording medium, the computer program when being executed by processor, it can be achieved that on
The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program generation
Code can be source code form, object identification code form, executable file or some intermediate forms etc..The computer-readable medium
It can include：Any entity or device, recording medium, USB flash disk, mobile hard disk, the magnetic of the computer program code can be carried
Dish, CD, computer storage, read-only storage (ROM, Read-Only Memory), random access memory (RAM,
Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It is it should be noted that described
The content that computer-readable medium includes can carry out appropriate increasing according to legislation in jurisdiction and the requirement of patent practice
Subtract, such as in some jurisdictions, according to legislation and patent practice, computer-readable medium do not include be electric carrier signal and
Telecommunication signal.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although with reference to foregoing reality
Example is applied the present invention is described in detail, it will be understood by those of ordinary skill in the art that：It still can be to foregoing each
Technical solution described in embodiment is modified, or carries out equivalent substitution to which part technical characteristic；And these are changed
Or replace, the essence of appropriate technical solution is departed from the spirit and scope of various embodiments of the present invention technical solution, should all
Within protection scope of the present invention.
Claims (10)
1. a kind of playback method, it is characterised in that the playback method includes：
Obtain the image of the page；
Based on the image of the page, searched and the associated audio-video frequency content of the page in default database；
Monitor the touch operation in described image；
When listening to the touch operation in described image, the corresponding touch area of the touch operation is determined；
Based on the touch area, audio-video frequency content corresponding with the touch area in the audio-video frequency content is played.
2. playback method according to claim 1, it is characterised in that it is described to be based on the touch area, play the sound
Audio-video frequency content corresponding with the touch area in video content, including：
Determine the positional information of the touch area on the image；
Based on the positional information, play in the audio-video frequency content with the associated audio-video frequency content of the positional information.
3. playback method according to claim 1, it is characterised in that it is described to be based on the touch area, play the sound
Audio-video frequency content corresponding with the touch area in video content, including：
Identify the touch area corresponding text message on the image；
Based on the text message, the audio-video frequency content with the associate text information in the audio-video frequency content is played.
4. playback method according to any one of claims 1 to 3, it is characterised in that the image based on the page,
Lookup and the associated audio-video frequency content of the page in default database, including：
Image recognition processing is carried out to described image, obtains the characteristic information of described image；
Based on the characteristic information, the page source of the page is determined；
Based on the page source, the corresponding audio-video frequency content in the page source is searched in default database.
5. playback method according to any one of claims 1 to 3, it is characterised in that after the image for obtaining the page,
Further include：
Based on the image of the page, searched and the associated content of text of the page in default database；
It is described determine the corresponding touch area of the touch operation after, further include：
Based on the touch area, content of text corresponding with the touch area in the content of text is shown.
6. a kind of playing device, it is characterised in that the playing device includes：
Image acquisition unit, for obtaining the image of the page；
Audio-video frequency content searching unit, for the described image obtained based on described image acquiring unit, in default database
Middle lookup and the associated audio-video frequency content of the page；
Touch operation monitoring unit, the touch operation in described image for monitoring the acquisition of described image acquiring unit；
Touch area determination unit, for when the touch operation monitoring unit listens to the touch operation in described image,
Determine the corresponding touch area of the touch operation；
Broadcast unit, for the touch area determined based on the touch area determination unit, is played in the audio and video
Hold audio-video frequency content corresponding with the touch area in the audio-video frequency content that searching unit is searched.
7. playing device according to claim 6, it is characterised in that the playing device further includes：
Positional information determination unit, for determining the touch area that the touch area determination unit determines in described image
The positional information in described image that acquiring unit obtains；
The broadcast unit is specifically used for, the positional information determined based on the positional information determination unit, described in broadcasting
Audio-video frequency content searching unit search the audio-video frequency content in the associated audio-video frequency content of the positional information.
8. playing device according to claim 6, it is characterised in that the playing device further includes：
Text message recognition unit, for identifying the touch area that the touch area determination unit determines in described image
Corresponding text message in the described image that acquiring unit obtains；
The broadcast unit is specifically additionally operable to, the text message identified based on the text message recognition unit, is played
Audio-video frequency content in the audio-video frequency content that the audio-video frequency content searching unit is searched with the associate text information.
9. a kind of electronic equipment, including memory, processor and it is stored in the memory and can be on the processor
The computer program of operation, it is characterised in that the processor realizes such as claim 1 to 5 when performing the computer program
The step of any one the method.
10. a kind of computer-readable recording medium, the computer-readable recording medium storage has computer program, its feature exists
In when the computer program is executed by processor the step of realization such as any one of claim 1 to 5 the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711239997.6A CN107967110A (en) | 2017-11-30 | 2017-11-30 | Playing method, playing device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711239997.6A CN107967110A (en) | 2017-11-30 | 2017-11-30 | Playing method, playing device, electronic equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107967110A true CN107967110A (en) | 2018-04-27 |
Family
ID=61999116
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711239997.6A Pending CN107967110A (en) | 2017-11-30 | 2017-11-30 | Playing method, playing device, electronic equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107967110A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108874356A (en) * | 2018-05-31 | 2018-11-23 | 珠海格力电器股份有限公司 | Voice broadcasting method and device, mobile terminal and storage medium |
| CN109241541A (en) * | 2018-08-14 | 2019-01-18 | 平安普惠企业管理有限公司 | Exchange method and terminal device based on voice conversion |
| CN109255346A (en) * | 2018-08-31 | 2019-01-22 | 深圳闳宸科技有限公司 | Reading method, device and electronic equipment |
| CN109670454A (en) * | 2018-12-21 | 2019-04-23 | Oppo广东移动通信有限公司 | A kind of biological information introduces method, biological information introduces device and terminal device |
| CN110232141A (en) * | 2019-05-31 | 2019-09-13 | 三角兽（北京）科技有限公司 | Resource acquiring method, resource acquisition device, storage medium and electronic equipment |
| CN110377218A (en) * | 2019-06-26 | 2019-10-25 | 北京奇艺世纪科技有限公司 | Data processing method, device, computer equipment and storage medium |
| CN110557699A (en) * | 2019-09-11 | 2019-12-10 | 百度在线网络技术（北京）有限公司 | intelligent sound box interaction method, device, equipment and storage medium |
| CN111078081A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Control method of point-to-read mode and electronic equipment |
| CN111343512A (en) * | 2020-02-04 | 2020-06-26 | 聚好看科技股份有限公司 | Information acquisition method, display device and server |
| CN111506744A (en) * | 2020-04-07 | 2020-08-07 | 广东小天才科技有限公司 | Point reading method and terminal equipment |
| CN111695372A (en) * | 2019-03-12 | 2020-09-22 | 阿里巴巴集团控股有限公司 | Click-to-read method and click-to-read data processing method |
| CN112650467A (en) * | 2020-12-24 | 2021-04-13 | 深圳市富途网络科技有限公司 | Voice playing method and related device |
| CN113365132A (en) * | 2021-05-27 | 2021-09-07 | 网易有道信息技术(江苏)有限公司 | Image processing method and device, electronic equipment and storage medium |
| CN113837830A (en) * | 2021-09-13 | 2021-12-24 | 珠海格力电器股份有限公司 | Product display method, display device and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104050838A (en) * | 2014-07-15 | 2014-09-17 | 北京网梯科技发展有限公司 | Reading system, device and method capable of recognizing and reading common printed matter |
| CN104253904A (en) * | 2014-09-04 | 2014-12-31 | 广东小天才科技有限公司 | Method for realizing point-reading learning and smart phone |
| CN106021408A (en) * | 2016-05-13 | 2016-10-12 | 立德高科（昆山）数码科技有限责任公司 | Method for playing selected identification image by reading specified image |
| US20160342613A1 (en) * | 2015-05-22 | 2016-11-24 | Kyocera Document Solutions Inc. | Display device and image forming apparatus |
| CN106980459A (en) * | 2017-03-31 | 2017-07-25 | 广州华多网络科技有限公司 | Reading method and device based on touch-screen equipment |
-
2017
- 2017-11-30 CN CN201711239997.6A patent/CN107967110A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104050838A (en) * | 2014-07-15 | 2014-09-17 | 北京网梯科技发展有限公司 | Reading system, device and method capable of recognizing and reading common printed matter |
| CN104253904A (en) * | 2014-09-04 | 2014-12-31 | 广东小天才科技有限公司 | Method for realizing point-reading learning and smart phone |
| US20160342613A1 (en) * | 2015-05-22 | 2016-11-24 | Kyocera Document Solutions Inc. | Display device and image forming apparatus |
| CN106021408A (en) * | 2016-05-13 | 2016-10-12 | 立德高科（昆山）数码科技有限责任公司 | Method for playing selected identification image by reading specified image |
| CN106980459A (en) * | 2017-03-31 | 2017-07-25 | 广州华多网络科技有限公司 | Reading method and device based on touch-screen equipment |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108874356A (en) * | 2018-05-31 | 2018-11-23 | 珠海格力电器股份有限公司 | Voice broadcasting method and device, mobile terminal and storage medium |
| CN109241541A (en) * | 2018-08-14 | 2019-01-18 | 平安普惠企业管理有限公司 | Exchange method and terminal device based on voice conversion |
| CN109255346A (en) * | 2018-08-31 | 2019-01-22 | 深圳闳宸科技有限公司 | Reading method, device and electronic equipment |
| CN109670454A (en) * | 2018-12-21 | 2019-04-23 | Oppo广东移动通信有限公司 | A kind of biological information introduces method, biological information introduces device and terminal device |
| CN109670454B (en) * | 2018-12-21 | 2020-09-25 | Oppo广东移动通信有限公司 | Biological information introduction method, biological information introduction device and terminal equipment |
| CN111695372A (en) * | 2019-03-12 | 2020-09-22 | 阿里巴巴集团控股有限公司 | Click-to-read method and click-to-read data processing method |
| CN111695372B (en) * | 2019-03-12 | 2023-10-27 | 阿里巴巴集团控股有限公司 | Click-to-read method and click-to-read data processing method |
| CN110232141A (en) * | 2019-05-31 | 2019-09-13 | 三角兽（北京）科技有限公司 | Resource acquiring method, resource acquisition device, storage medium and electronic equipment |
| CN111078081A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Control method of point-to-read mode and electronic equipment |
| CN110377218A (en) * | 2019-06-26 | 2019-10-25 | 北京奇艺世纪科技有限公司 | Data processing method, device, computer equipment and storage medium |
| CN110377218B (en) * | 2019-06-26 | 2021-09-28 | 北京奇艺世纪科技有限公司 | Data processing method, data processing device, computer equipment and storage medium |
| CN110557699B (en) * | 2019-09-11 | 2021-09-07 | 百度在线网络技术（北京）有限公司 | Intelligent sound box interaction method, device, equipment and storage medium |
| CN110557699A (en) * | 2019-09-11 | 2019-12-10 | 百度在线网络技术（北京）有限公司 | intelligent sound box interaction method, device, equipment and storage medium |
| CN111343512A (en) * | 2020-02-04 | 2020-06-26 | 聚好看科技股份有限公司 | Information acquisition method, display device and server |
| CN111506744A (en) * | 2020-04-07 | 2020-08-07 | 广东小天才科技有限公司 | Point reading method and terminal equipment |
| CN111506744B (en) * | 2020-04-07 | 2024-03-19 | 广东小天才科技有限公司 | Click-to-read method and terminal equipment |
| CN112650467A (en) * | 2020-12-24 | 2021-04-13 | 深圳市富途网络科技有限公司 | Voice playing method and related device |
| CN112650467B (en) * | 2020-12-24 | 2023-12-19 | 深圳市富途网络科技有限公司 | Voice playing method and related device |
| CN113365132A (en) * | 2021-05-27 | 2021-09-07 | 网易有道信息技术(江苏)有限公司 | Image processing method and device, electronic equipment and storage medium |
| CN113837830A (en) * | 2021-09-13 | 2021-12-24 | 珠海格力电器股份有限公司 | Product display method, display device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107967110A (en) | Playing method, playing device, electronic equipment and computer readable storage medium | |
| CN107967357B (en) | Friend pushing method and system and terminal equipment | |
| US10127253B2 (en) | Searching method, client and server | |
| CN108733342A (en) | volume adjusting method, mobile terminal and computer readable storage medium | |
| CN108416003A (en) | A kind of picture classification method and device, terminal, storage medium | |
| CN107657973B (en) | Text and audio mixed display method and device, terminal equipment and storage medium | |
| CN107589828A (en) | The man-machine interaction method and system of knowledge based collection of illustrative plates | |
| CN107733984A (en) | A kind of method, terminal and computer-readable recording medium for pushing screen locking information | |
| CN110209809B (en) | Text clustering method and device, storage medium and electronic device | |
| CN109165316A (en) | A kind of method for processing video frequency, video index method, device and terminal device | |
| TWI798652B (en) | A method and system for automatically generating a data collection module | |
| CN110610698B (en) | Voice labeling method and device | |
| CN109814787B (en) | Key information determination method, device, equipment and storage medium | |
| US20190147104A1 (en) | Method and apparatus for constructing artificial intelligence application | |
| CN115952272A (en) | Method, device and equipment for generating dialogue information and readable storage medium | |
| CN104750839A (en) | Data recommendation method, terminal and server | |
| CN104267974B (en) | The call method and device of business interface | |
| CN107944023A (en) | Exercise pushing method and system and terminal equipment | |
| CN112464075B (en) | Application recommendation method and device of intelligent sound box and electronic equipment | |
| CN108958731A (en) | Application program interface generation method, device, equipment and storage medium | |
| CN111858865A (en) | Semantic recognition method and device, electronic equipment and computer-readable storage medium | |
| CN113779934A (en) | Multi-modal information extraction method, device, equipment and computer-readable storage medium | |
| CN106528141B (en) | Task sweep-out method and system | |
| CN107679222A (en) | Image processing method, mobile terminal and computer-readable recording medium | |
| CN111832254A (en) | Drawing label display processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180427 |
|
| RJ01 | Rejection of invention patent application after publication |