CN105959796B - A kind of communication means and device based on image increment information - Google Patents
A kind of communication means and device based on image increment information Download PDFInfo
- Publication number
- CN105959796B CN105959796B CN201610279992.5A CN201610279992A CN105959796B CN 105959796 B CN105959796 B CN 105959796B CN 201610279992 A CN201610279992 A CN 201610279992A CN 105959796 B CN105959796 B CN 105959796B
- Authority
- CN
- China
- Prior art keywords
- information
- data packet
- interaction data
- screen frame
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004891 communication Methods 0.000 title claims abstract description 26
- 230000003993 interaction Effects 0.000 claims abstract description 95
- 230000005540 biological transmission Effects 0.000 claims abstract description 52
- 230000033001 locomotion Effects 0.000 claims abstract description 12
- 230000006378 damage Effects 0.000 claims description 59
- 238000004040 coloring Methods 0.000 claims description 27
- 238000005538 encapsulation Methods 0.000 claims description 21
- 238000000034 method Methods 0.000 claims description 20
- 238000012545 processing Methods 0.000 claims description 14
- 230000009471 action Effects 0.000 claims description 11
- 238000004321 preservation Methods 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 abstract description 2
- 238000007906 compression Methods 0.000 description 12
- 230000006835 compression Effects 0.000 description 11
- 230000008859 change Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000035800 maturation Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64784—Data processing by the network
- H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a kind of communication means and device based on image increment information.It wherein, include: the operation information that user is obtained when listening to screen has operational motion and the screen frame image data of operation front and back for the communication means of transmitting terminal；According to the screen frame image data acquisition image increment information of operation front and back；Receiving end is sent to after operation information and image increment information are encapsulated as interaction data packet.The present invention can effectively reduce the size of interaction data packet by using the transmission mode of increment information, bandwidth resources needed for sufficiently saving transmission；The operation information of user and the increment information overall package of image are convenient for transmitting terminal and receiving end synchronous images information into interaction data packet simultaneously.
Description
Technical field
The present invention relates to wireless communication field more particularly to a kind of communication means and device based on image increment information.
Background technique
Wireless Image Transmission Systems are quickly grown in recent years, with the maturation of underlying network technology, are had become important
New industry.Based on wireless image transmission technology, people obtain the image information in strange land in which can be convenient, be people's lives and
Work is provided convenience.Therefore how in Wireless Image Transmission Systems, to image carry out high quality, in real time transmission at
For the research direction of a core.
In order to realize the low-bandwidth transmission of image, the method generallyd use is to compress before transmission to image data,
The data volume of its transmission is reduced, to reduce the requirement to transmission bandwidth.Image compression encoding be exactly eliminate various redundancies, and
It is characterized under given distortion with bit number few as far as possible and reconstruction image, it is made to meet the requirement of scheduled application occasion.Image
Compressed encoding is divided into two kinds: one is redundancy compressed encoding, Typical Representative has Huffman encoding, Shannon coding and Run- Length Coding
Deng compression ratio is relatively low, this kind of method will not lose data, and complete 100% can recover original image, therefore
Referred to as lossless compression-encoding.Another kind is information content compressed encoding, and Typical Representative has predictive coding, statistical coding and transition coding
Deng this compression method can lose some image informations in compression process, and lost information can not be restored, therefore again
Referred to as lossy compression encodes.
However existing image transmission technology scheme, lossless compression is still either used using lossy compression, is compressed
Than all very littles, it is not still able to satisfy the transmission requirement of low bandwidth in Wireless Image Transmission Systems.The compression ratio of usual lossless compression
Very little, only 2:1~5:1, and lossy compression compression factor is although slightly larger, but will affect the quality of image, it is not achieved certain
The requirement for image superior quality of occasion.Therefore the data volume for reducing image how is realized, to meet wireless image transmission system
System has become the research direction of current one core in the communications field for image superior quality and requirements of real time.
Summary of the invention
Technical problem to be solved by the present invention lies in providing a kind of communication means and device based on image increment information,
The technical issues of how realizing image superior quality and real-time Transmission in Wireless Image Transmission Systems for solving the prior art.
To solve foregoing invention purpose, the present invention uses following technical methods:
One side according to the present invention provides a kind of communication means based on image increment information, is used for transmitting terminal, packet
It includes:
When listening to screen has operational motion, the operation information of user and the screen frame picture number of operation front and back are obtained
According to；
According to the screen frame image data acquisition image increment information of operation front and back；
Receiving end is sent to after the operation information and described image increment information are encapsulated as interaction data packet.
Further, after the screen frame image data before and after the acquisition user's operation, to institute by way of row scanning
Screen frame image data is stated to be encoded.
Further, the screen frame image data acquisition image increment information according to operation front and back, comprising:
Screen frame image data before and after user's operation is compared, the routing information and color letter of pixel variation are obtained
Breath；
Using the colouring information and the routing information as described image increment information.
Further, the interaction data packet includes operation information position, colour bits and path position；Wherein, the operation
Information bit includes revocation position and the operative position that other are operated in addition to destruction operation.
Further, it is described the operation information and described image increment information are encapsulated as interaction data packet after, by institute
Interaction data packet is stated to be cached.
It is further, described that the operation information and described image increment information are encapsulated as interaction data packet, comprising:
Judge whether the operation information is destruction operation:
If destruction operation, then the interaction data packet of last caching is obtained, the revocation position of the interaction data packet is modified；
If not destruction operation then modifies the operative position according to operation information, institute is modified according to described image increment information
State colour bits and path position.
Further, the method also includes:
It repeats to send the interaction data packet within a preset time, if listening to the receiving end in the preset time
What is sent has been received by feedback information, then stops sending.
One side according to the present invention provides a kind of communication means based on image increment information, is used for receiving end, packet
It includes:
Receive the interaction data packet that transmitting terminal is sent；
Operation information and image increment information are obtained according to the interaction data packet；
Incremental processing operation is executed in current screen frame image according to the operation information, image increment information.
It is further, described that operation information and image increment information are obtained according to the interaction data packet, comprising:
It parses and cancels position, colour bits, operative position and path position in the interaction data packet；
The operation information be cancel position indicate destruction operation information and operative position indicate in addition to destruction operation
Other operation informations；
Described image increment information is the pixel variation colouring information that colour bits indicate and the pixel that path position indicates
Change path.
Further, described that increment is executed in current screen frame image according to the operation information, image increment information
Processing operation, comprising:
Destruction operation is judged whether it is according to revocation position:
If not destruction operation then obtains the action type executed, according to the colour bits and the path according to operative position
Position obtains the routing information and colouring information of pixel variation；According to the routing information and colouring information in current screen frame image
It is middle to execute the corresponding operation of the action type；
If destruction operation, then the corresponding operation of the operative position is cancelled.
Further, after the interaction data packet for receiving transmitting terminal transmission, the transmission of Xiang Suoshu transmitting terminal has been received by feedback
Information.
One side according to the present invention provides a kind of communication device based on image increment information, is used for transmitting terminal, packet
It includes:
First acquisition unit, for when listening to screen has operational motion, obtaining the operation information and operation of user
The screen frame image data of front and back；
Second acquisition unit, for the screen frame image data acquisition image increment information according to operation front and back；
Encapsulation unit, for the operation information and described image increment information to be encapsulated as interaction data packet；
Transmission unit, for the interaction data packet to be sent to receiving end.
Further, after the first acquisition unit is also used to obtain the screen frame image data before and after user's operation, lead to
The mode of space scanning encodes the screen frame image data.
Further, the second acquisition unit is specifically used for:
Screen frame image data before and after user's operation is compared, the routing information and face of pixel color variation are obtained
Color information；
Using the colouring information and the routing information as described image increment information.
Further, the interaction data packet of the encapsulation unit encapsulation includes revocation position, colour bits, operative position and path
Position.
Further, described device further includes cache unit, for being cached after encapsulating interaction data packet.
Further, the encapsulation unit is specifically used for:
Judge whether the operation information is destruction operation:
If destruction operation, then the interaction data packet of last preservation is obtained, the revocation position of the interaction data packet is modified；
If not destruction operation then modifies the operative position according to operation information, institute is modified according to described image increment information
State colour bits and path position.
Further, the transmission unit is also used to, and repeats to send the interaction data packet within a preset time, if in institute
State listen to that the receiving end sends in preset time have been received by feedback information, then stop sending.
One side according to the present invention provides a kind of communication device based on image increment information, is used for receiving end, packet
It includes:
Receiving unit, for receiving the interaction data packet of transmitting terminal transmission；
Acquiring unit, for obtaining operation information and image increment information according to the interaction data packet；
Processing unit, for executing increment in current screen frame image according to the operation information, image increment information
Processing operation.
Further, the acquiring unit is specifically used for:
It parses and cancels position, colour bits, operative position and path position in the interaction data packet；
The operation information be cancel position indicate destruction operation information and operative position indicate in addition to destruction operation
Other operation informations；
Described image increment information is the pixel variation colouring information that colour bits indicate and the pixel that path position indicates
Change path.
Further, the processing unit is specifically used for:
Destruction operation is judged whether it is according to revocation position:
If not destruction operation then obtains the action type executed, according to the colour bits and the path according to operative position
Position obtains the routing information and colouring information of pixel variation；According to the routing information and colouring information in current screen frame image
It is middle to execute the corresponding operation of the action type；
If destruction operation, then the corresponding operation of the operative position is cancelled.
Further, described device further includes transmission unit, after the interaction data packet for receiving transmitting terminal transmission, to institute
It states transmitting terminal transmission and has been received by feedback information.
The invention has the following advantages:
Communication means and device provided by the present invention based on image increment information passes through screen after acquisition user's operation
The increment information of middle image, and using increment information as image transmitting information, data volume can be effectively reduced, interaction data is reduced
The size of packet, bandwidth resources needed for sufficiently saving transmission；Simultaneously by the increment information of the operation information of user and image entirety
It is encapsulated into interaction data packet, is convenient for transmitting terminal and receiving end synchronous images information；By distinguishing revocation in interaction data packet
Operation and other operations, provide simple and feasible method for the restoring operation of user；By using monitoring retransmission mechanism, it is ensured that
The case where interaction data packet is not in packet loss in transmission process ensure that the reliability of data transmission.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention,
And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can
It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only
Some embodiments of the present invention, for those of ordinary skill in the art, without any creative labor, also
Other drawings may be obtained according to these drawings without any creative labor.
Fig. 1 is the flow chart of the communication means based on image increment information of transmitting terminal in the embodiment of the present invention；
Fig. 2 is the encapsulation format figure of interaction data packet in one embodiment of the invention；
Fig. 3 is the encapsulation format figure of interaction data packet in one embodiment of the invention；
Fig. 4 is the flow chart of the communication means based on image increment information of receiving end in the embodiment of the present invention；
Fig. 5 is the structural block diagram in the embodiment of the present invention for the communication device based on image increment information of transmitting terminal；
Fig. 6 is the structural block diagram that the communication device based on image increment information of receiving end is used in the embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
The embodiment of the invention provides a kind of communication means based on image increment information, as shown in Figure 1, specifically include as
Lower step:
S101 obtains the operation information of user and the screen frame of operation front and back when listening to screen has operational motion
Image data；
S102, according to the screen frame image data acquisition image increment information of operation front and back；
S103 is sent to receiving end after operation information and image increment information are encapsulated as interaction data packet.
Communication means based on image increment information provided by the embodiment of the present invention passes through screen after acquisition user's operation
The increment information of middle image can effectively reduce the size of interaction data packet as interactive information, sufficiently save transmission bandwidth money
Source；The operation information of user and image increment information are subjected to overall package simultaneously, realize image convenient for transmitting terminal and receiving end
The synchronization of information.
Technology contents of the invention are described in further details in the following with reference to the drawings and specific embodiments.
S101 obtains the operation information of user and the screen frame of operation front and back when listening to screen has operational motion
Image data.
In the embodiment of the present invention, operation information includes the information such as revocation, drafting and erasing.User carries out to image
When operation, the type of operation is generally selected.For example, it is desired to need first to select rendering order when being drawn；When erasing, obtain
Erasing rubber order.
In this step, monitor whether have user's operational motion in screen in real time using monitor in the embodiment of the present invention,
Including revocation, drafting and erasing etc..After monitoring operational motion, the information in screen is acquired, after the completion of obtaining the movement
Screen frame image data carries out the acquisition of a screen frame image data that is, after each operational motion.Then, to screen frame figure
As data carry out pretreatment coding.When carrying out pretreatment coding, screen frame image data divides in accordance with the order from top to bottom
It embarks on journey, sequence from left to right divides in column.By way of row scanning, after the completion of whole column of a line, continue to scan on down
A line realizes the coding of image data.
It, can be from data cached middle acquisition for operating the acquisition of forth screen frame image data.A screen is completed due to every
After the acquisition of curtain frame image data, which is cached, after user's operation next time, by caching
Screen frame image data is as preoperative screen frame image data.
S102, according to the screen frame image data acquisition image increment information of operation front and back.
In this step, image increment information includes the routing information and colouring information of pixel variation.Increase obtaining image
It when measuring information, is compared respectively according to the data of each pixel in the screen frame image before and after user's operation, obtains color and become
The colouring information and coordinate information of pixel after change.The pixel coordinate information of all changes is routing information.
Specifically, it in the embodiment of the present invention, is sequentially obtained in the screen frame image for operating front and back in such a way that row is read
Each pixel color information, and pixel color is compared；If it is different, then using the coordinate position of the pixel as increment
Routing information is stored, while saving the colouring information after pixel variation；If identical, ignore the information of the pixel.
S103 is sent to receiving end after operation information and image increment information are encapsulated as interaction data packet.
In the embodiment of the present invention, interaction data packet includes operation information and image increment information.Wherein, operation information has
Body is subdivided into destruction operation and non-destruction operation.It, can be using the encapsulation lattice in Fig. 2 for the encapsulation format of interaction data packet
Formula.The change that the encapsulation format is suitable for carrying out image single color operates.
Specifically, which includes revocation position, colour bits, operative position and path position.Wherein revocation bit occupancy 1,0
Indicate normal operations, 1 indicates destruction operation；Color bit occupancy 4, indicate 16 kinds of colors；Operation bit occupancy two, can indicate
4 kinds of operands, each operand pair answer a kind of action type, such as drafting or erasing etc., and specific type is without limitation；Afterwards
The content in face is path position, by the coordinate position of row storage pixel variation.Total length (including header) of interaction data packet is no
More than 1400bit.
For the encapsulation format of interaction data packet, it is also an option that format shown in Fig. 3.The encapsulation format is suitable for figure
Change operation as carrying out multiple color.Different from, using colour bits as individual operative position, format shown in Fig. 3 will in Fig. 2
The colour bits of each pixel are packaged with coordinate bit.
Interaction data packet is used in the embodiment of the present invention, destruction operation occupies individual one.When user needs to restore behaviour
When making, an interaction data packet saving recently is replicated, and after setting 1 for destruction operation flag bit, is added in caching, with this
Distinguish whether current operation is destruction operation, the restoring operation for user provides simple and feasible method, convenient in local
And destruction operation is realized in receiving end simultaneously.
Specifically, when according to operation information and image increment information encapsulation interaction data packet, specifically comprise the following steps:
Judge whether operation information is destruction operation:
If it is destruction operation, the interaction data packet of last preservation is obtained, the revocation position of modification interaction data packet is
1；
If non-destruction operation, modifying operative position according to operation information is corresponding operating number, while according to image increment
Information modifies colour bits and path position.
In the embodiment of the present invention, after having encapsulated image interaction data packet, interaction data packet is cached.Specifically,
Level cache, L2 cache and three-level caching are set, cache 5,10,20 interaction data packets respectively.Caching sequence are as follows: first
Level cache is filled up, L2 cache is refilled, finally fills three-level caching.When the number of interaction data packet is more than capacity, then
Abandon the interaction data packet cached at first.By using the mode of hierarchical cache, the processing effect of terminal CPU can be effectively promoted
Rate.After receiving the transmission signal of user, interaction data packet is obtained from hierarchical cache, when the transmission signal for receiving user
Afterwards, interaction data packet is sent to receiving end.
Further, in the embodiment of the present invention, when sending interaction data packet, using UDP (User Datagram
Protocol, user datagram) agreement.Although transmission speed can be made to speed using udp protocol, it also will appear lose simultaneously
The case where packet.Using the transmission mechanism of increment information, sufficient compression and pretreatment are carried out to picture signal, so a number
It is particularly significant according to the information in packet.In order to guarantee in transmission process will not packet loss, transmitting terminal, which uses, monitors retransmission mechanism, passes through
The mode of receiving end active feedback increases the reliability of information transmission while reducing transmission cost.
Specifically, it after sending interaction data packet, needs to repeat within the regular hour to send interaction data packet；If at this
In the section time, after listening to the feedback information of receiving end transmission, then stop continuing to send.If having not been obtained and connecing within the time
The feedback information of receiving end then obtains interaction data packet from caching again, and is re-transmitted to receiving end.
Referring to fig. 4, the present invention also provides a kind of communication means based on image increment information, specifically wrap for receiving end
Include following steps:
S301 receives the interaction data packet that transmitting terminal is sent；
S302 obtains operation information and image increment information according to interaction data packet；
S303 executes incremental processing operation according to operation information, image increment information in current screen frame image.
Specifically, it when obtaining operation information and image increment information according to interaction data packet, parses in interaction data packet
Cancel position, colour bits, operative position and path position；Operation information is the destruction operation information and operative position for cancelling position and indicating
Other operation informations in addition to destruction operation indicated；Image increment information be colour bits indicate pixel variation colouring information with
And the pixel that path position indicates changes path.
Further, incremental processing operation is executed in current screen frame image according to operation information, image increment information,
Include:
Destruction operation is judged whether it is according to revocation position:
If not destruction operation then obtains the action type executed according to operative position, picture is obtained according to colour bits and path position
The routing information and colouring information of element variation；Operation class is executed in previous screen frame image according to routing information and colouring information
The corresponding operation of type；
If destruction operation, the then corresponding operation in destruction operation position.
Further, after receiving the interaction data packet that transmitting terminal is sent, feedback information is had been received by transmitting terminal transmission.
As shown in figure 5, being used for transmitting terminal, tool the present invention also provides a kind of communication device based on image increment information
Body includes:
First acquisition unit, for when listening to screen has operational motion, obtaining the operation information and operation of user
The screen frame image data of front and back；
Second acquisition unit, for the screen frame image data acquisition image increment information according to operation front and back；
Encapsulation unit, for the operation information and described image increment information to be encapsulated as interaction data packet；
Transmission unit, for the interaction data packet to be sent to receiving end.
Further, after the first acquisition unit is also used to obtain the screen frame image data before and after user's operation, lead to
The mode of space scanning encodes the screen frame image data.
Further, the second acquisition unit is specifically used for:
Screen frame image data before and after user's operation is compared, the routing information and face of pixel color variation are obtained
Color information；
Using the colouring information and the routing information as described image increment information.
Further, the interaction data packet of the encapsulation unit encapsulation includes revocation position, colour bits, operative position and path
Position.
Further, described device further includes cache unit, for being cached after encapsulating interaction data packet.
Further, the encapsulation unit is specifically used for:
Judge whether the operation information is destruction operation:
If destruction operation, then the interaction data packet of last preservation is obtained, the revocation position of the interaction data packet is modified；
If not destruction operation then modifies the operative position according to operation information, institute is modified according to described image increment information
State colour bits and path position.
Further, transmission unit is also used to, and repeats to send the interaction data packet in preset time, if described default
The receiving end transmission is listened in time has been received by feedback information, then stops sending.
Referring to Fig. 6, the embodiment of the invention also provides a kind of communication devices based on image increment information, for receiving
End, comprising:
Receiving unit, for receiving the interaction data packet of transmitting terminal transmission；
Acquiring unit, for obtaining operation information and image increment information according to interaction data packet；
Processing unit, for executing incremental processing in current screen frame image according to operation information, image increment information
Operation.
Further, acquiring unit is specifically used for:
It parses and cancels position, colour bits, operative position and path position in the interaction data packet；
The operation information be cancel position indicate destruction operation information and operative position indicate in addition to destruction operation
Other operation informations；
Described image increment information is the pixel variation colouring information that colour bits indicate and the pixel that path position indicates
Change path.
Further, processing unit is specifically used for:
Destruction operation is judged whether it is according to revocation position:
If not destruction operation then obtains the action type executed according to operative position, picture is obtained according to colour bits and path position
The routing information and colouring information of element variation；Operation class is executed in current screen frame image according to routing information and colouring information
The corresponding operation of type；
If destruction operation, the then corresponding operation in destruction operation position.
Further, which further includes transmission unit, after the interaction data packet for receiving transmitting terminal transmission, to transmission
End sends and has been received by feedback information.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, program can be stored in computer-readable storage medium, the journey
Sequence is when being executed, it may include such as the process of the embodiment of above-mentioned each method.
Although describing the application by embodiment, it will be apparent to one skilled in the art that the application is there are many deformation and becomes
Change without departing from the spirit and scope of the present invention.If being wanted in this way, these modifications and changes of the present invention belongs to right of the present invention
Ask and its equivalent technologies within the scope of, then the present invention is also intended to include these modifications and variations.
Claims (18)
1. a kind of communication means based on image increment information is used for transmitting terminal characterized by comprising
When listening to screen has operational motion, the operation information of user and the screen frame image data of operation front and back are obtained；
According to the screen frame image data acquisition image increment information of operation front and back；
Receiving end is sent to after the operation information and described image increment information are encapsulated as interaction data packet；
The method also includes: it repeats to send the interaction data packet within a preset time, if monitoring in the preset time
Feedback information is had been received by what the receiving end was sent, then stops sending.
2. the method as described in claim 1, which is characterized in that the screen frame image data obtained before and after user's operation
Afterwards, the screen frame image data is encoded by way of row scanning.
3. the method as described in claim 1, which is characterized in that the screen frame image data acquisition figure according to operation front and back
As increment information, comprising:
Screen frame image data before and after user's operation is compared, the routing information and colouring information of pixel variation are obtained；
Using the colouring information and the routing information as described image increment information.
4. method as claimed in claim 3, which is characterized in that the interaction data packet include operation information position, colour bits with
And path position；Wherein, the operation information position includes revocation position and the operative position that other are operated in addition to destruction operation.
5. method as claimed in claim 4, which is characterized in that described to seal the operation information and described image increment information
It fills as after interaction data packet, the interaction data packet is cached.
6. method as claimed in claim 5, which is characterized in that described to seal the operation information and described image increment information
Dress is interaction data packet, comprising:
Judge whether the operation information is destruction operation:
If destruction operation, then the interaction data packet of last caching is obtained, the revocation position of the interaction data packet is modified；
If not destruction operation then modifies the operative position according to operation information, the face is modified according to described image increment information
Color bits and path position.
7. a kind of communication means based on image increment information is used for receiving end characterized by comprising
Receive the interaction data packet that transmitting terminal is sent；
Operation information and image increment information are obtained according to the interaction data packet；
Incremental processing operation is executed in current screen frame image according to the operation information, image increment information；
After the interaction data packet for receiving transmitting terminal transmission, the transmission of Xiang Suoshu transmitting terminal has been received by feedback information.
8. the method for claim 7, which is characterized in that it is described according to the interaction data packet obtain operation information and
Image increment information, comprising:
It parses and cancels position, colour bits, operative position and path position in the interaction data packet；
The operation information be cancel position indicate destruction operation information and operative position indicate in addition to destruction operation other
Operation information；
Described image increment information is the pixel variation colouring information that colour bits indicate and the pixel variation that path position indicates
Path.
9. method according to claim 8, which is characterized in that described to be worked as according to the operation information, image increment information
Incremental processing operation is executed in forth screen frame image, comprising:
Destruction operation is judged whether it is according to revocation position:
If not destruction operation then obtains the action type executed according to operative position, obtained according to the colour bits and path position
The routing information and colouring information of capture element variation；It is held in current screen frame image according to the routing information and colouring information
The corresponding operation of the row action type；
If destruction operation, then the corresponding operation of the operative position is cancelled.
10. a kind of communication device based on image increment information is used for transmitting terminal characterized by comprising
First acquisition unit, for when listening to screen has operational motion, obtaining operation information and the operation front and back of user
Screen frame image data；
Second acquisition unit, for the screen frame image data acquisition image increment information according to operation front and back；
Encapsulation unit, for the operation information and described image increment information to be encapsulated as interaction data packet；
Transmission unit, for the interaction data packet to be sent to receiving end；
The transmission unit is also used to, and repeats to send the interaction data packet within a preset time, if in the preset time
Listen to the receiving end transmission has been received by feedback information, then stops sending.
11. device as claimed in claim 10, which is characterized in that before the first acquisition unit is also used to obtain user's operation
After screen frame image data afterwards, the screen frame image data is encoded by way of row scanning.
12. device as claimed in claim 11, which is characterized in that the second acquisition unit is specifically used for:
Screen frame image data before and after user's operation is compared, the routing information and color letter of pixel color variation are obtained
Breath；
Using the colouring information and the routing information as described image increment information.
13. device as claimed in claim 12, which is characterized in that the interaction data packet of the encapsulation unit encapsulation includes revocation
Position, colour bits, operative position and path position.
14. device as claimed in claim 13, which is characterized in that described device further includes cache unit, for handing in encapsulation
It is cached after mutual data packet.
15. device as claimed in claim 14, which is characterized in that the encapsulation unit is specifically used for:
Judge whether the operation information is destruction operation:
If destruction operation, then the interaction data packet of last preservation is obtained, the revocation position of the interaction data packet is modified；
If not destruction operation then modifies the operative position according to operation information, the face is modified according to described image increment information
Color bits and path position.
16. a kind of communication device based on image increment information is used for receiving end characterized by comprising
Receiving unit, for receiving the interaction data packet of transmitting terminal transmission；
Acquiring unit, for obtaining operation information and image increment information according to the interaction data packet；
Processing unit, for executing incremental processing in current screen frame image according to the operation information, image increment information
Operation；
Described device further includes transmission unit, and after the interaction data packet for receiving transmitting terminal transmission, Xiang Suoshu transmitting terminal is sent
Have been received by feedback information.
17. device as claimed in claim 16, which is characterized in that the acquiring unit is specifically used for:
It parses and cancels position, colour bits, operative position and path position in the interaction data packet；
The operation information be cancel position indicate destruction operation information and operative position indicate in addition to destruction operation other
Operation information；
Described image increment information is the pixel variation colouring information that colour bits indicate and the pixel variation that path position indicates
Path.
18. device as claimed in claim 17, which is characterized in that the processing unit is specifically used for:
Destruction operation is judged whether it is according to revocation position:
If not destruction operation then obtains the action type executed according to operative position, obtained according to the colour bits and path position
The routing information and colouring information of capture element variation；It is held in current screen frame image according to the routing information and colouring information
The corresponding operation of the row action type；
If destruction operation, then the corresponding operation of the operative position is cancelled.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610279992.5A CN105959796B (en) | 2016-04-29 | 2016-04-29 | A kind of communication means and device based on image increment information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610279992.5A CN105959796B (en) | 2016-04-29 | 2016-04-29 | A kind of communication means and device based on image increment information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105959796A CN105959796A (en) | 2016-09-21 |
| CN105959796B true CN105959796B (en) | 2019-06-04 |
Family
ID=56916391
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610279992.5A Active CN105959796B (en) | 2016-04-29 | 2016-04-29 | A kind of communication means and device based on image increment information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105959796B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10511858B2 (en) * | 2016-07-13 | 2019-12-17 | Ati Technologies Ulc | Bit packing for delta color compression |
| CN109218748B (en) * | 2017-06-30 | 2020-11-27 | 京东方科技集团股份有限公司 | Video transmission method, device and computer readable storage medium |
| CN108024033B (en) * | 2017-11-24 | 2020-06-09 | 中国航空工业集团公司西安航空计算技术研究所 | Video image sending circuit based on ARINC818 protocol |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102710935A (en) * | 2011-11-28 | 2012-10-03 | 杭州华银教育多媒体科技股份有限公司 | Method for screen transmission between computer and mobile equipment through incremental mixed compressed encoding |
| CN103384328A (en) * | 2012-05-04 | 2013-11-06 | 奇扬网科股份有限公司 | Video coding system and method |
| CN103456195A (en) * | 2012-05-28 | 2013-12-18 | 上海易酷信息技术服务有限公司 | Smart phone based remote question answering and tutoring system and using method thereof |
-
2016
- 2016-04-29 CN CN201610279992.5A patent/CN105959796B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102710935A (en) * | 2011-11-28 | 2012-10-03 | 杭州华银教育多媒体科技股份有限公司 | Method for screen transmission between computer and mobile equipment through incremental mixed compressed encoding |
| CN103384328A (en) * | 2012-05-04 | 2013-11-06 | 奇扬网科股份有限公司 | Video coding system and method |
| CN103456195A (en) * | 2012-05-28 | 2013-12-18 | 上海易酷信息技术服务有限公司 | Smart phone based remote question answering and tutoring system and using method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105959796A (en) | 2016-09-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10602156B2 (en) | Devices and methods for identifying a leading picture | |
| DE112006003371B4 (en) | Display system and method | |
| EP2061255A1 (en) | Information processing device and method | |
| TWI414183B (en) | Information processing apparatus and method and non-temporary computer-readable recording medium | |
| JP6158323B2 (en) | Improved performance in virtual desktop infrastructure (VDI) | |
| CN101707701B (en) | Multi-stream information transmission system and transmission method thereof | |
| EP1892630A1 (en) | A method for remote displaying and processing based on server/client architecture | |
| DE112011105981B4 (en) | Advanced wireless display | |
| CN105959796B (en) | A kind of communication means and device based on image increment information | |
| CN108353177A (en) | For reducing the system and method for slice boundaries visual artifacts in compression DSC is flowed in display | |
| CN102457544A (en) | Method and system for acquiring screen image in screen sharing system based on Internet | |
| CN104253996B (en) | The sending, receiving method and its device and Transmission system of video data | |
| CN107659827A (en) | Desktop video code control system based on content analysis | |
| CN103533358B (en) | Self adaption image collection transmission display device | |
| CN109151481A (en) | The transmission of picture and received method, apparatus and its system | |
| CN110099280A (en) | A kind of video service quality Enhancement Method under wireless self-organization network Bandwidth-Constrained | |
| CN100493193C (en) | A method and device for carrying out buffer control to real time digital video stream | |
| EP2974317A1 (en) | Computer system, distribution control system, distribution control method, and computer-readable storage medium | |
| US20110299605A1 (en) | Method and apparatus for video resolution adaptation | |
| US20230091518A1 (en) | Video Transmission Method, Apparatus, and System | |
| CN102821303B (en) | A kind of Pixel-level video information network real-time graded compression transmitting method | |
| CN103503444A (en) | Signaling number of active layers in video coding | |
| CN111263164A (en) | High frame frequency video parallel coding and recombination method | |
| TWI382766B (en) | A method for compressing a display frame with super resolution and a system thereof | |
| WO2023050921A1 (en) | Video and audio data sending method, display method, sending end and receiving end |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |