WO2013083060A1

WO2013083060A1 - Data exchange system based on mobile terminal state change

Info

Publication number: WO2013083060A1
Application number: PCT/CN2012/086071
Authority: WO
Inventors: 朱召法; 徐建华; 贾红阳; 忻宗杰
Original assignee: 东蓝数码股份有限公司
Priority date: 2011-12-07
Filing date: 2012-12-06
Publication date: 2013-06-13

Abstract

A data exchange system based on mobile terminal state change, including a processing module, a detection module and a storage module connected to each other. The detection module detects state change data of a mobile terminal and stores the state change data of the mobile terminal in the storage module. The detection module reads the state change data of the mobile terminal stored in the storage module and processes same so as to decide on the state change type of the mobile terminal, thus triggering a corresponding event.

Description

Data exchange system based on state change of mobile terminal

Technical field

The present invention relates to mobile terminals, and more particularly to a mobile terminal data exchange system that can trigger an event based on a change in state of the mobile terminal.

Background technique

The emergence of mobile terminals has brought convenience to people's lives. People can work and play at the mobile terminal. However, people are also limited to buttons, and people must trigger the corresponding events by pressing a button to exchange information. For example, when browsing a webpage on a mobile terminal, after browsing a page, it is necessary to trigger a page change event by pressing one of the buttons of the mobile terminal to implement browsing content update. The touch screen is applied to the mobile terminal. On the surface, people get rid of the limitation of the button, and the corresponding event is triggered by the operation of the touch screen, thereby realizing information exchange. In fact, people just get rid of physical buttons, but they are also limited by virtual buttons. Although the icon is displayed on the touch screen, only the position corresponding to the touch icon can trigger the corresponding event. Perhaps, triggering events via buttons is suitable for most situations, but because of its ubiquity, it is not the best solution in some cases. For example, in the Karaoke Hall, the general charging method is charged on time. Usually the singer will reach his best singing state while singing the main song or chorus, and the state of the ending will slip. Therefore, the ending part will be cut off, on the one hand, the singer can maintain the best state, on the other hand, it can save time and sing more songs. But now the cut song operation, you need to find the "cut song" button, press to trigger the cut song event. Fortunately, the cut song button is quickly found, so that the singer can still perform some of the best conditions. If the song-cutting operation cannot be completed quickly, the singer needs to find the best state again, but for the rest of the time, the singer may not be able to find the best state. As a result, the singer's mood will be low. However, in the current karaoke system, all operations are limited to the buttons. It may make the singer sing with a happy mood and leave with disappointment. However, if the singer can complete the song-cutting operation by moving his hand-held mobile terminal, this saves time and keeps the singer's state.

Nowadays, people's awareness of intellectual property is increasing, and people are gradually accepting paid entertainment. Such as the purchase of audio and video products. And now there are many ways to buy audio and video products, which can be purchased at the store or ordered online. The most popular way to buy music is to buy it online. The single is then downloaded to the buyer's mobile terminal. For the above purchases, the copyright fees are paid. However, in the karaoke, the purchaser will encounter the problem of repeated charges. Usually, people usually sing their familiar songs in the karaoke hall, and the familiar songs are purchased and stored in the mobile terminal. It is well known that singing in a karaoke hall is to pay royalties for the songs sung. However, people who bought songs also paid royalties. If the purchase is transferred to the equipment provided by the karaoke hall, the singer only has to pay for the rental of the equipment of the karaoke hall without having to pay the copyright fee repeatedly, thereby reducing the entertainment cost. Similarly, the hardware equipment of the Karaoke Hall will be better than that of the average home. Consumers can purchase the genuine video, download it to the mobile terminal, and rent the hardware of the Karaoke Hall to watch it. But now the Karaoke Hall does not have such conditions. . Summary of the invention

The technical problem to be solved by the present invention is to overcome the existing technical deficiencies and provide a gyro-based human-computer interaction detection and processing method on an intelligent terminal that can control the intelligent terminal without pressing a button and a touch screen.

The technical solution of the present invention is to provide a gyroscope-based human-computer interaction detection and processing method on a smart terminal, which is characterized in that it comprises the following steps:

(1) Establish a three-dimensional coordinate system on the intelligent terminal, the X-axis direction is horizontal from left to right, the Υ-axis direction is vertical from bottom to top, and the ζ-axis direction is perpendicular to the smart terminal screen from back to front;

(2) If the smart terminal holder acts on the intelligent terminal, the gyroscope is used to respectively test the angular rate of the terminal device rotating around the X axis, the angular rate of rotation around the x-axis, and the angular rate of rotation about the x-axis;

(3), by sampling the diagonal rate, respectively, obtaining angular velocity curves for rotation around the X-axis, the Υ-axis, and the Ζ-axis;

(4) Determine the action made by the intelligent terminal according to the waveform diagram of the obtained angular rate of the X-axis, the Υ-axis, and the Ζ axis with respect to the time, and trigger the corresponding event according to the setting.

In the step (4), determining the action performed by the intelligent terminal according to the waveform diagram of the obtained angular rate of the X-axis, the Υ-axis, and the Ζ-axis with respect to the time change means:

If the waveform diagram of the X-axis has obvious troughs in the obtained waveform diagram, and the waveform diagrams of the Υ-axis and the ζ-axis do not change significantly, it is judged that the smart terminal performs the action from the near-out direction;

If the obtained waveform diagram has obvious peaks in the waveform diagram of the X-axis, and the waveform diagrams of the Υ-axis and the ζ-axis do not change significantly, it is judged that the intelligent terminal performs the action from the far-reaching near-turnback; If the waveform diagram obtained, the waveform diagram of the Y-axis has obvious troughs first, and there are obvious peaks afterwards, and the waveform diagrams of the X-axis and the z-axis do not change significantly, then the smart terminal is judged to flip to the left;

If the waveform diagram obtained, the waveform diagram of the Y-axis has obvious peaks first, and after the obvious troughs, the waveform diagrams of the X-axis and the z-axis have no obvious change, then the smart terminal is judged to flip to the right;

If the obtained waveform diagram has obvious troughs in the waveform diagram of the Z-axis, and the waveform diagrams of the Y-axis and the X-axis do not change significantly, it is judged that the smart terminal performs the action from the near-outward direction;

If the waveform diagram obtained has obvious peaks in the waveform diagram of the Z-axis, and the waveform diagrams of the Y-axis and the X-axis do not change significantly, it is judged that the smart terminal performs the action from the far-end to the near-turnback.

The step (4) determines the action made by the smart terminal, and triggers the corresponding event according to the setting: if it is determined that the smart terminal performs the action from the near direction, the event triggered by the smart terminal includes: sending the email, uploading Sending a message, sending a message, sending a message, or launching a weapon in a shooting game; if it is determined that the smart terminal is performing a far-reaching action, the event triggered by the smart terminal includes: receiving a file, downloading a file, and receiving the information;

If the smart terminal performs the action of flipping to the left, the events triggered by the smart terminal include: viewing the previous page, scrolling forward, and viewing the previous item;

If the smart terminal performs the action of flipping to the right, the events triggered by the smart terminal include: viewing the next page, turning over, and viewing the next item.

The obvious trough is as follows: In the waveform diagram, the amplitude of the curve is less than S1 and lasts for more than T seconds. The obvious peak is: In the waveform diagram, the amplitude of the curve is greater than S2 and continues for more than T seconds. In the middle, there is no obvious trough, and there is no obvious peak. It is considered that the waveform has no obvious change. The S1, S2 and T are all settable values, which can be set in the program.

The invention has the following advantages:

The invention overcomes the deficiencies of the prior art, by setting a three-dimensional coordinate system on the intelligent terminal, and using a gyroscope to respectively detect the angular rate of rotation of the device around the X-axis, the Y-axis, and the Z-axis, to know that the handheld person makes the smart terminal What action, and by triggering the corresponding event in the smart terminal corresponding to the action, the somatosensory action is associated with the control of the smart terminal, so that it is not necessary to touch the physical button or touch the screen of the mobile phone, but through By performing actions on the intelligent terminal, the corresponding human-computer interaction operations on the smart terminal, such as sending information, sending mail, downloading files, etc., can be performed, which greatly facilitates the user of the smart terminal. And this way of operation can also bring fun to the user. The technical problem to be solved by the present invention is to overcome the existing technical defects and provide a human-machine interaction detection and processing method based on line acceleration sensor on an intelligent terminal capable of controlling an intelligent terminal without using a button and a touch screen. .

The linear acceleration describes the magnitude and direction of the rigid body linear velocity. The unit of the international unit system is m/s ^A 2 (m/s bisect). The biggest difference between the linear acceleration sensor and the acceleration sensor is: Accelerometer The obtained values include the value of gravity acceleration caused by gravity of the earth, and the linear acceleration does not include gravity acceleration. Because the interference of gravity acceleration is excluded, the application of the linear acceleration sensor in some occasions is more effective than the acceleration sensor.

The technical solution of the present invention is to provide a human-machine interaction detection and processing method based on a linear acceleration sensor on an intelligent terminal, which is characterized in that it comprises the following steps:

(1) Establish a three-dimensional coordinate system on the intelligent terminal, the X-axis direction is horizontal from left to right, the Y-axis direction is vertical from bottom to top, and the Z-axis direction is perpendicular to the smart terminal screen from back to front;

(2) If the smart terminal holder acts on the intelligent terminal, the linear acceleration sensor is used to respectively test the linear acceleration of the terminal device in the three axes of XYZ;

(3) By sampling the linear acceleration, the linear acceleration curves of the three axes of XYZ are obtained for time;

(4) Determine the action made by the intelligent terminal according to the obtained waveform diagram of the X-axis, Y-axis, and Z-axis linear acceleration curve, and trigger the corresponding event according to the setting.

In the step (4), according to the waveform diagram of the obtained line acceleration rate of the X-axis, the Y-axis, and the Z-axis on the curve of time, determining the action performed by the smart terminal means:

If the waveform diagram of the Z-axis has obvious troughs, and the waveform diagrams of the Y-axis and the X-axis do not change significantly, it is judged that the smart terminal performs the action from the near-out direction;

If the obtained waveform diagram has obvious peaks in the waveform diagram of the Z-axis, and the waveform diagrams of the Y-axis and the Z-axis do not change significantly, it is judged that the smart terminal performs the action from the far-end to the near-turnback;

If the waveform diagram is obtained, the waveform of the X-axis has obvious troughs first, and then there are obvious peaks. If the waveforms of the Y-axis and the z-axis do not change significantly, it is judged that the smart terminal performs the flipping to the left;

If the waveform diagram is obtained, the waveform of the X-axis has obvious peaks first, and after the obvious troughs, the waveform diagrams of the Y-axis and the z-axis do not change significantly, then the smart terminal is judged to flip to the right;

If the obtained waveform diagram has obvious troughs in the waveform diagram of the Y-axis, and the waveform diagrams of the X-axis and the z-axis do not change significantly, it is judged that the smart terminal performs the action from the near-outward direction; If the obtained waveform diagram has obvious peaks in the waveform diagram of the Y-axis, and the waveform diagrams of the X-axis and the z-axis do not change significantly, it is judged that the smart terminal performs the action from the far-reaching to the near-turnback.

The invention has the following advantages:

The invention overcomes the deficiencies of the prior art, by setting a three-dimensional coordinate system on the intelligent terminal, and detecting the linear acceleration of the device in the X-axis, the Y-axis, and the Z-axis by using a linear acceleration sensor, respectively, to know that the handheld person makes the smart terminal What action, and by triggering the corresponding event in the smart terminal corresponding to the action, the somatosensory action is associated with the control of the smart terminal, so that it is not necessary to touch the physical button or touch the screen of the mobile phone, but through The action of the intelligent terminal can complete the corresponding human-computer interaction operation of the intelligent terminal, such as sending information, sending mail, downloading files, etc., which greatly facilitates the user of the intelligent terminal. And this way of operation can also bring fun to the user.

It is an object of the present invention to provide a data exchange system based on a change in state of a mobile terminal, characterized in that the data exchange system based on the state change of the mobile terminal can trigger a corresponding event by changing the state of a mobile terminal.

Another object of the present invention is to provide a data exchange system based on a state change of a mobile terminal, characterized in that the data exchange system based on the state change of the mobile terminal transmits information on the mobile terminal to another by changing the state of the mobile terminal. A mobile terminal.

Another object of the present invention is to provide a mobile terminal status information exchange system, The point is that the processing module of the data exchange system based on the state change of the mobile terminal can determine the type of state change of the mobile terminal.

Another object of the present invention is to provide a mobile terminal status information exchange system, characterized in that the processing module of the data exchange system based on the state change of the mobile terminal can trigger a corresponding event by determining to change the state of the mobile terminal.

Another object of the present invention is to provide a data exchange system based on a change in state of a mobile terminal, characterized in that the detection module of the data exchange system based on the state change of the mobile terminal can detect the state of the mobile terminal.

Another object of the present invention is to provide a data exchange system based on a change in state of a mobile terminal, characterized in that the communication module of the data exchange system based on the state change of the mobile terminal can exchange data with other terminals.

Another object of the present invention is to provide an information exchange method based on the state of a mobile terminal, which is characterized in that the information exchange method based on the state of the mobile terminal can trigger a corresponding event by the user holding the mobile terminal and changing its state, thereby Exchange data with other terminals.

Another object of the present invention is to provide a method for determining a type of state change of the mobile terminal, the method determining a type of state change of the mobile terminal based on the detected data provided by the detecting module.

Another object of the present invention is to provide a data exchange system based on a state change of a mobile terminal, characterized in that the data exchange system based on the state change of the mobile terminal provides a data transmission method, and the data transmission method determines the state change of the mobile terminal by The type triggers the corresponding event to send data.

Another object of the present invention is to provide a data exchange system based on a state change of a mobile terminal, characterized in that the data exchange system based on the state change of the mobile terminal provides a method for operating a peripheral device, and the method for operating the peripheral device passes through a mobile terminal An external device is connected to operate the external device by transmitting data to the mobile terminal by another mobile terminal.

In order to achieve the above object, the present invention provides a data exchange system based on a state change of a mobile terminal, including:

a processing module connected to each other, a detecting module and a storage module, wherein the detecting module detects state change data of the mobile terminal, and stores state change data of the mobile terminal in the storage module, the detecting module Reading status change data of the mobile terminal stored in the storage module and processing to determine a type of status change of the mobile terminal, thereby triggering corresponding Event.

In order to achieve the above object, the present invention provides a method of operating an external device by a data exchange system in which a state of a mobile terminal changes, comprising the steps of:

Step 1: receiving the user input, the user input means that the user holds the mobile terminal to make an action, and the mobile terminal changes state, and interacts with the mobile terminal in this manner; Step 2: Determine the mobile Terminal status change type data;

Step 3: Explain the mobile terminal status change type data, the mobile terminal status change type data is interpreted by the interpretation module, and the trigger event data corresponding to the mobile terminal status change type data is obtained, the target object instruction data and the target Data instruction data, the target object instruction data is transmitted to the communication module, and the target data instruction data is transmitted to the data exchange module; Step 4: transmitting the target data to the target object, and transmitting the data acquired from the mobile terminal to the target An object, the target object is another mobile terminal, which is connected to an external device;

Step 5: receiving data input, the data inputting another mobile terminal to receive data transmitted by the mobile terminal, and the data is transmitted to the interpretation module through the communication module;

Step 6: Interpreting the received data, the received data is transmitted by the communication module, and the received data is interpreted by the interpretation module to generate the call instruction data, and the attribute data of the data is then transmitted to the data exchange module;

Step 7: transmitting data to the external device, the call instruction data, the attribute data of the data, and the data itself are transmitted to the external device through the data exchange module;

Step 8: Presenting data, the data being received from the data exchange module, the external device presenting the data through its output device.

In order to achieve the above object, the present invention provides a method of determining a type of state change of the mobile terminal, comprising the steps of:

Step 1: determining whether the instantaneous speed value of a time point in the instantaneous speed value of each time point of the mobile terminal exceeds a preset speed value during the detection period, and if yes, determining that the state of the mobile terminal changes, if No, no longer judged;

Step 2: Establish a three-dimensional coordinate system with the direction of the X-axis from west to east and the positive direction of the X-axis to the east. The direction of the Y axis is from south to north, and the positive direction of the Y axis is north. The Z axis is from the center of the earth to the ground, and the positive direction of the Z axis is toward the ground. The original center of the coordinate axis is the position of the mobile terminal at the start and end time of the detection time period; Step 3: Calculating the displacement of the mobile terminal, the displacement is The displacement component of the displacement on the X axis, a displacement component on the Y axis and a displacement component on the x axis;

Step 4: determining the mobile terminal state change type data, first determining that the displacement is in the displacement component of the displacement on the X axis, the displacement component in the x-axis and the displacement component in the x-axis are the largest, and then determining the maximum value a symbol relationship, thereby determining the mobile terminal state change type data; Step 5: determining that the user holds the action made by the mobile terminal, determining that the user holds the mobile terminal according to determining the mobile terminal state change type data The type of action.

In order to achieve the above object, the present invention provides another method for determining the type of state change of the mobile terminal, including the following steps:

Step 1: determining whether the instantaneous speed value of a time point in the instantaneous angular velocity value of each time point of the mobile terminal exceeds a preset angular velocity value during the detection period, and if yes, determining that the state of the mobile terminal changes, If not, no longer judged;

Step 2: determining the direction of the mobile terminal, determining whether the mobile terminal is held vertically or horizontally by the user, the vertical position is that the user holds the mobile terminal in a vertical manner, and the horizontal holding is a user Holding the mobile terminal in a horizontal manner;

Step 3: Determine whether the rotation mode of the mobile terminal is rotated clockwise or counterclockwise;

Step 4: determining that the type of state change occurs in the mobile terminal;

Step 5: Determine the action performed by the user by the mobile terminal, and determine the action performed by the user by the mobile terminal according to determining the type change data of the mobile terminal state.

The invention is based on a data exchange system in which the state of the mobile terminal is changed, so that the user can operate the mobile terminal without using a finger, thereby liberating the user's finger. When the external device is provided with the data exchange system based on the state change of the mobile terminal of the present invention, or the external device is connected to a data exchange system based on the state change of the mobile terminal of the present invention, the user can change the state change of the mobile terminal to The external device operates to change the way the traditional device operates. Preferably, the external device can be synchronized, and the state of the mobile terminal changes, and immediately reacts to the external device, and the external device immediately responds to the operation. More importantly, if the data exchange system based on the state change of the mobile terminal of the present invention is applied to the audio-visual equipment of the Karaoke Hall, the data exchange system based on the state change of the mobile terminal of the present invention can be stored on the user's mobile terminal. The entertainment content is transmitted to the audio-visual equipment of the Karaoke Hall, thereby solving the problem of duplicate copyright fees. Moreover, the user can operate the audio and video device by making an action on the mobile terminal and changing the state of the mobile terminal. This will simplify the operation of the audio and video equipment. Preferably, when the user acts on the mobile terminal, the video device synchronizes the response. DRAWINGS

Figure 1 is a schematic illustration of a three-dimensional coordinate system employed by the present invention;

2 is a waveform diagram of angular rate versus time change when the smart terminal of the present invention performs trimming; FIG. 3 is a waveform diagram of angular rate versus time change when the smart terminal performs the trimming circuit in the present invention; FIG. 5 is a waveform diagram of an angular rate versus time change when the smart terminal performs a right yaw; FIG. 5 is a waveform diagram of an angular rate of a smart terminal according to the present invention; A waveform diagram of the angular rate versus time for the chirping; FIG. 7 is a waveform diagram of the angular rate versus time for the smart terminal of the present invention when it is tilted out. Figure 8 is a schematic illustration of a three-dimensional coordinate system employed by the present invention;

9 is a waveform diagram of linear acceleration versus time change when the smart terminal of the present invention performs trimming;

Figure 10 is a waveform diagram of linear acceleration versus time change when the smart terminal performs the trimming circuit in the present invention;

FIG. 11 is a waveform diagram of linear acceleration versus time change when the smart terminal performs left yaw; FIG. 12 is a waveform diagram of linear acceleration versus time change when the smart terminal performs right yaw; FIG. a waveform diagram of the linear acceleration of the terminal when the heel is thrown out;

Fig. 14 is a waveform diagram showing the linear acceleration versus time for the smart terminal of the present invention when it is tilted out.

Figure 15 is a block diagram showing the structure of a data exchange system based on a state change of a mobile terminal in accordance with a preferred embodiment of the present invention.

Figure 16 is a block diagram showing the structure of a switch module of a data exchange system based on a state change of a mobile terminal in accordance with a preferred embodiment of the present invention.

Figure 17 is a flow chart of a data transmission method of a data exchange system based on a state change of a mobile terminal in accordance with a preferred embodiment of the present invention.

FIG. 18 is a flowchart of a data exchange system data receiving method based on a mobile terminal state change according to a preferred embodiment of the present invention. 19 is a flow diagram of a method of operating a peripheral device by a data exchange system with a state change of a mobile terminal in accordance with the present invention.

Concrete implementation

According to the claims and the disclosure of the present invention, the technical solution of the present invention is specifically as described below.

The present invention will be further described in detail below in conjunction with the drawings and specific embodiments.

As shown in FIG. 1 , the present invention provides a gyroscope-based human-computer interaction detection and processing method on a smart terminal, which is characterized in that it comprises the following steps:

(1), establish a three-dimensional coordinate system on the intelligent terminal, the X-axis direction is horizontal from left to right, the Y-axis direction is vertical from bottom to top, and the Z-axis direction is perpendicular to the terminal screen from back to front; establishment on the intelligent terminal The three-dimensional coordinate system has been implemented in the Android Android system;

If the intelligent terminal rotates around the X axis, it is defined as trim. If the smart terminal rotates around the Y axis, it is defined as yaw. If the smart terminal rotates around the z axis, it is defined as traverse.

(2) If the smart terminal holder acts on the smart terminal, the gyroscope is used to respectively test the angular rate of the terminal device rotating around the X axis, the angular rate of rotation around the Y axis, and the angular rate of rotation around the z axis; The gyroscope is an angular motion detecting device. Currently, there is such an intelligent terminal with a gyroscope. In the present invention, the gyroscope detects the angular velocity of the terminal device rotating around the X axis, the angular velocity around the Y axis, and the surrounding. The angular rate at which the z-axis rotates.

(3), by sampling the diagonal rate, respectively, obtaining an angular rate change curve with respect to time in three directions of the X axis, the Y axis, and the Z axis;

(4) Determine the action made by the intelligent terminal according to the obtained waveform diagram of the angular rate of the X-axis, the Y-axis, and the Z-axis, and trigger the corresponding event according to the setting.

In the step (4), determining the action made by the smart terminal according to the waveform diagram on the curves of the X-axis, the Y-axis, and the Z-axis means:

In the present invention, the apparent trough refers to: In the waveform diagram, the amplitude of the curve is smaller than S1 and continues for more than T seconds, and the apparent peak refers to: In the waveform diagram, the amplitude of the curve is greater than S2 and continues to exceed T Seconds, if there are no obvious troughs and no obvious peaks in the waveform diagram, it is considered that there is no obvious change in the waveform diagram. The S1, S2 and T are all settable values, which can be set in the program. In this embodiment, S1 is set to -1.5, S2 is 1.5, and T is 0.2. If the waveform diagram of the X-axis has obvious troughs, and the waveform diagrams of the Y-axis and the z-axis do not change significantly, it is judged that the smart terminal performs the action from the near-out direction; as shown in Fig. 2: The waveform diagram of the X-axis appears less than -1.5, and lasts for more than 0.2 seconds. It can be analyzed that the X-axis has obvious troughs, and the Y-axis and Z-axis have no obvious change. At this time, the smart terminal has a trimming out. Action, think that the smart terminal does the action of going far and wide.

If the obtained waveform diagram has obvious peaks in the waveform diagram of the X-axis, and the waveform diagrams of the Y-axis and the z-axis do not change significantly, it is judged that the intelligent terminal performs the action from the far-reaching near-turnback; as shown in Fig. 3: The waveform graph of the axis appears greater than -1.5, and lasts for more than 0.2 seconds. It can be analyzed that there are obvious peaks on the X-axis in the graph, and there is no obvious change in the Y-axis and the Z-axis. At this time, the smart terminal has the function of trimming and detouring. , think that smart terminals do the action from far to near.

If the waveform diagram is obtained, the waveform of the Y-axis has obvious peaks first, and after the obvious troughs, the waveforms of the X-axis and the Z-axis do not change significantly, then the smart terminal is judged to flip to the left; as shown in FIG. 4: The waveform diagram of the Y-axis in the figure first appears less than -1.5, and lasts longer than 0.2 seconds, then appears greater than 1.5, and lasts longer than 0.2 seconds, then the waveform of the Y-axis in the graph is analyzed with obvious troughs. After that, there are obvious peaks, and the waveforms of the X-axis and the Z-axis do not change significantly. At this time, the smart terminal has a left-lateral yaw motion, and the smart terminal is considered to be flipped to the left.

If the obtained waveform diagram, the waveform diagram of the Y-axis has obvious troughs first, and there are obvious peaks afterwards, and the waveform diagrams of the X-axis and the Z-axis do not change significantly, then the smart terminal is judged to flip to the right; as shown in FIG. 5: The waveform graph of the Y-axis in the figure first appears greater than 1.5, and lasts for more than 0.2 seconds, then appears less than -1.5, and lasts longer than 0.2 seconds, then the waveform of the Y-axis in the graph is analyzed with obvious troughs. After the obvious peak, the analysis shows that the waveform of the Y-axis has obvious peaks, and there are obvious troughs. The waveforms of the X-axis and the Z-axis have no obvious change. At this time, the smart terminal has a right-wing motion. , think that the smart terminal does the action of flipping to the right.

If the obtained waveform diagram has obvious troughs in the waveform diagram of the Z-axis, and the waveform diagrams of the Y-axis and the X-axis do not change significantly, judge the action of the smart terminal from the near-outward direction; as shown in Fig. 6: The waveform of the axis appears less than -1.5, and lasts for more than 0.2 seconds. It can be analyzed that the waveform of the Z-axis in the figure has obvious troughs, and the waveforms of the Y-axis and the X-axis have no obvious change. The action of yawing out, thinks that the smart terminal does the action from the near side.

If the obtained waveform diagram has obvious peaks in the waveform diagram of the Z-axis, and the waveform diagrams of the Y-axis and the X-axis do not change significantly, it is judged that the intelligent terminal performs the action from the far-reaching to the near-turnback. As shown in Figure 7: Z-axis in the figure The waveform graph appears greater than 1.5, and lasts for more than 0.2 seconds. It can be analyzed that the waveform of the Z-axis has obvious peaks, and the waveforms of the Y-axis and the X-axis have no obvious change. At this time, the smart terminal has a heel. The action of the back, thinks that the smart terminal does the action from far to near.

The triggering corresponding event can be set as needed in the program of the smart terminal.

As shown in FIG. 8, the present invention provides a human-machine interaction detection and processing method based on a linear acceleration sensor on an intelligent terminal, which is characterized in that it comprises the following steps:

(2) If the smart terminal holder acts on the intelligent terminal, the linear acceleration sensor is used to respectively test the linear acceleration of the terminal device in the three axial directions of XYZ; the linear acceleration sensor is a linear acceleration detecting device, and There is such an intelligent terminal with a linear acceleration sensor. In the present invention, the linear acceleration sensor detects the linear acceleration of the terminal device at three axes of XYZ, respectively.

(3), by sampling the linear acceleration, respectively, the linear acceleration curves of the X-axis, the Y-axis, and the Z-axis are obtained in time;

(4) Determine the action made by the intelligent terminal according to the waveform diagram of the obtained linear acceleration of the X-axis, the Y-axis, and the Z-axis on the time curve, and trigger the corresponding event according to the setting. In the step (4), determining the action made by the smart terminal according to the waveform diagram on the curves of the X-axis, the Y-axis, and the Z-axis means:

In the present invention, the apparent trough refers to: In the waveform diagram, the amplitude of the curve is smaller than S1 and continues for more than T seconds, and the apparent peak refers to: In the waveform diagram, the amplitude of the curve is greater than S2 and continues to exceed T Seconds, if there are no obvious troughs and no obvious peaks in the waveform diagram, it is considered that there is no obvious change in the waveform diagram. The S1, S2 and T are all settable values, which can be set in the program. In this embodiment, S1 is set to -1.5, S2 is 1.5, and T is 0.2.

If the waveform diagram of the Ζ-axis has obvious troughs, and the waveforms of the Υ-axis and the X-axis do not change significantly, judge the action of the smart terminal from the near-out direction; as shown in Figure 9: The waveform of the Ζ axis appears less than -1.5, and lasts for more than 0.2 seconds. It can be analyzed that there are obvious troughs in the Ζ axis, and there is no obvious change in the Υ axis and the X axis. At this time, the smart terminal has the trimming out. Action, think that the smart terminal does the action of going far and wide.

If the obtained waveform diagram has obvious peaks in the waveform diagram of the Ζ axis, and the waveform diagram of the Υ axis and the X axis does not change significantly, it is judged that the intelligent terminal performs the action from the far side to the near side; as shown in Fig. 10: The waveform graph of the axis appears greater than -1.5, and lasts for more than 0.2 seconds. It can be analyzed that there are obvious peaks on the X-axis in the graph, and there is no obvious change in the x-axis and the X-axis. At this time, the smart terminal has the function of trimming and detouring. , think that smart terminals do the action from far to near.

If the waveform diagram is obtained, the waveform of the X-axis has obvious peaks first, and after the obvious troughs, the waveforms of the X-axis and the Υ-axis do not change significantly, then the smart terminal is judged to flip to the left; as shown in FIG. The waveform diagram of the X-axis in the figure first appears less than -1.5, and lasts for more than 0.2 seconds, then appears greater than 1.5, and lasts for more than 0.2 seconds, then the waveform of the X-axis in the figure is analyzed with obvious troughs. After that, there are obvious peaks, and the waveforms of the X-axis and the Υ-axis do not change significantly. At this time, the smart terminal has a left yaw motion, and the smart terminal is considered to be flipped to the left.

If the waveform diagram is obtained, the waveform of the X-axis has obvious troughs first, and then there are obvious peaks. If the waveforms of the X-axis and the Υ-axis do not change significantly, the smart terminal is judged to flip to the right; as shown in Fig. 12: The waveform diagram of the X-axis in the figure first appears greater than 1.5, and lasts for more than 0.2 seconds, then appears less than -1.5, and lasts longer than 0.2 seconds. The analysis shows that the waveform of the X-axis in the figure has obvious troughs. After the obvious peak, the waveform of the X-axis in the figure has obvious peaks first, and then there are obvious troughs. The waveforms of the X-axis and the Υ-axis have no obvious change. At this time, the smart terminal has the right yaw motion. , think that the smart terminal does the action of flipping to the right. If the waveform diagram obtained has obvious troughs in the waveform diagram of the Y-axis, and the waveform diagrams of the Y-axis and the z-axis do not change significantly, it is judged that the smart terminal performs the action from the near-out direction; as shown in Fig. 13: The waveform of the axis appears less than -1.5, and lasts for more than 0.2 seconds. It can be analyzed that the waveform of the Y-axis has obvious troughs, and the waveforms of the Y-axis and the Z-axis have no obvious change. The action of yawing out, thinks that the smart terminal does the action from the near side.

If the obtained waveform diagram has obvious peaks in the waveform diagram of the Y-axis, and the waveform diagrams of the Y-axis and the z-axis do not change significantly, it is judged that the smart terminal performs the action from the far side to the near-turn. As shown in Figure 14: The waveform of the Y-axis in the figure appears greater than 1.5, and lasts for more than 0.2 seconds. It can be analyzed that the waveform of the Y-axis has obvious peaks, and the waveforms of the Y-axis and the Z-axis are not obvious. Change, at this point, the smart terminal has a tumultuous action, and the smart terminal is considered to be moving from far to near.

As shown in FIG. 15, the data exchange system based on the state change of the mobile terminal of the present invention includes a processing module 10, a detecting module 20 and a storage module 30 connected to each other. The detecting module 20 detects state change data of the mobile terminal, and stores the detected data in the storage module 30. The processing module 10 reads the data in the storage module 30. Based on the data, the processing module 10 can determine what action the user has made to change the state of the mobile terminal. That is, the processing module 10 determines the action of the user who has changed the state of the mobile terminal. The processing module 10 triggers a corresponding event after making a determination.

The detection module 20 further includes a timing module 21 and a state detection module 22, and the timing module 21 is coupled to the state detection module 22. The timing module 21 is configured to set a detection period. The state detecting module 22 detects the state of each time point of the mobile terminal. The status detection module 22 is available for inspection The state of the mobile terminal is measured, and the detected status data is then transmitted to the storage module 30. That is, the state detecting module 22 can detect the moving direction of the mobile terminal, the acceleration and acceleration directions, the angular velocity, and the direction of the mobile terminal. The direction of the mobile terminal means that the mobile terminal is in a vertical state, an inverted state, a left horizontal state, a right horizontal state, an up state, or a down state. The positive vertical state refers to the normal erect state of the mobile terminal. The inverted vertical state refers to a state in which the upper and lower portions of the mobile terminal are reversed. The left horizontal state refers to a state in which the mobile terminal in the upright state is placed to the left. The right horizontal state refers to a state in which the mobile terminal in the vertical state is placed to the right. The up state is a state in which the mobile terminal is in the front direction. The tilt state refers to a state in which the back side of the mobile terminal is placed upward. The timing module 21 has a timing mode that starts timing when a change in state of the mobile terminal is detected, and stops when the mobile terminal stops changing state. In other words, the detecting module 20 detects that the acceleration of the mobile terminal changes, and the timing module 21 starts timing. The state detecting module 22 of the detecting module 20 transmits the detected state data of the mobile terminal to the storage module 30. Specifically, the state detecting module 22 sequentially transmits the detected state data of the mobile terminal to the storage module 30 according to the time sequence provided by the timing module 21.

The processing module 10 further includes a state change type decision module 11 and a switch module 12 that are connected to each other. The state change type decision module 11 reads the state data about the mobile terminal in the memory module 30, and then processes to determine what has changed in the state of the mobile terminal. In other words, the state change type determining module 11 can process according to the state data about the mobile terminal provided in the storage module 30, and then determine what action the user of the mobile terminal uses to make the state of the mobile terminal occur. Variety. After the state change type determining module 11 processes the mobile terminal state data, the following data can be obtained. During the detecting time period, the instantaneous speed of each time point of the mobile terminal and/or the instantaneous angular velocity of each time point are detected. The movement trajectory of the mobile terminal during the time period, the position at the beginning of the detection time period, and the position at the end of the detection time period. The state change type determining module 11 may perform the determination by determining the mobile terminal state change method described below, and the determining method includes the following steps:

Step 1: Determine whether the instantaneous speed value of a time point in the instantaneous speed value of each time point of the mobile terminal exceeds the preset speed value during the detection period. If so, it is determined that the state of the mobile terminal has changed. In other words, if there is, it is determined that the user's action causes the state of the mobile terminal to change. If not, it is no longer determined. Step 2: Establish a three-dimensional coordinate system. The direction of the X-axis is from the left hand of the user to the right hand of the user, and the positive direction of the X-axis is to the right of the user. The direction of the Y-axis is from the user's direction away from the user, and the positive direction of the Y-axis is away from the user. The Z axis is from the center of the earth to the ground, and the positive direction of the Z axis is toward the ground. The original center of the coordinate axis is the position of the mobile terminal at the start and end time of the detection period.

Step 3: Calculate the displacement S of the mobile terminal, the displacement S is the displacement component Sx of the displacement on the X axis, the displacement component Sy on the Y axis, and the displacement component S z on the Z axis, and the mobile terminal ends at the detection time Point position coordinates P(x, y, z

In conjunction with the moving direction of the mobile terminal, the position of the mobile terminal is converted into three-dimensional coordinates from the detection time to the end of the detection time. Obtaining coordinates of the last position of the mobile terminal in the three-dimensional coordinate system during the detection period, a displacement S of the mobile terminal in the detection period, and a displacement component Sx of the displacement S on the X-axis, on the Y-axis The displacement component Sy and the displacement component S z on the Z axis.

Step 4: Determine the mobile terminal status change type data. The relationship between the displacement component Sx of the displacement S on the X axis, the displacement component Sy of the Y axis, and the displacement component S z of the Z axis is determined. First, it is determined that the displacement component Sx on the X-axis, the displacement component Sy on the Y-axis, and the displacement component Sz on the Z-axis are the largest, and then the displacement component Sx on the X-axis, the displacement component Sy on the Y-axis, and The sign of the largest value among the displacement components S z of the Z axis.

If the value of Sx is the largest of the three values Sx, Sy, Sz, then the sign of Sx is determined. If the sign of Sx is positive, it is determined that the mobile terminal generates a right 甩, and the right 甩 refers to the mobile terminal The positive direction of the X axis moves. If the sign of Sx is negative, it is determined that the mobile terminal is left-handed, and the left-hand side refers to the mobile terminal moving in the negative direction of the X-axis.

If the value of Sy is the largest of the three values Sx, Sy, Sz, and then determine the sign of Sy, if the sign of Sy is positive, it is determined that the mobile terminal is separated, and the deviation refers to the mobile terminal The positive direction of the Y axis moves. If the sign of Sy is negative, it is determined that the mobile terminal is detoured, and the detour refers to the mobile terminal moving in the negative direction of the Y-axis.

If the value of Sz is the largest of the three values Sx, Sy, Sz, and then determine the sign of Sz, if the sign of Sz is positive, it is determined that the mobile terminal has a cap, and the captain refers to the mobile terminal The positive direction of the Z axis moves. If the sign of Sz is negative, it is determined that the mobile terminal is squatting, and the state change type 6 refers to the mobile terminal moving in the negative direction of the Z axis.

Step 5: Determine the action taken by the user with the mobile terminal. According to the determination of the mobile terminal The state changes the type data to determine the action taken by the user with the mobile terminal.

According to the state change type is right 甩, it is determined that the user makes a right squat action. The right-handed action means that the user moves the mobile terminal to the right of the user by the mobile terminal.

According to the state change type is left 甩, it is determined that the user makes a left 甩 action. The left-handed action means that the user moves the mobile terminal to the left of the user.

According to the state change type, the user is determined to make a detachment action. The detachment action means that the user moves the mobile terminal to the mobile terminal in a direction away from the user.

According to the state change type, the user is determined to make a detour action. The bypass operation means that the user moves the mobile terminal to the mobile terminal in a direction close to the user.

According to the state change type is the upper jaw, it is determined that the user makes the caption action. The captain action means that the user moves the mobile terminal to the mobile terminal by the mobile terminal.

According to the state change type, the user is determined to use the squatting action. The squatting action refers to the user moving the mobile terminal to the ground by the mobile terminal.

It is worth mentioning that the state of the mobile terminal can be further divided according to the displacement value generated by the mobile terminal, so that more events can be triggered and the operation can be enriched. Preferably, a displacement comparison value Sc can be preset. If the value of the displacement S is smaller than the displacement comparison value Sc, it is determined that the degree of change of the state of the mobile terminal is the degree of change. If the value of the displacement S is greater than or equal to the displacement comparison value Sc, it is determined that the degree of state change of the mobile terminal is 甩. This comparison step can be performed between steps 3 and 4. If the subdivision step is performed, the right 甩 can be further divided into a right shot and a right 甩, so that the right squatting action by the user holding the mobile terminal can also be divided into a right slap motion and a right squat motion. Similarly, the left hand can be further divided into a left beat and a left click, so that the user can perform the left click action by the mobile terminal or can be divided into a left beat action and a left click action. The separation can be further divided into a shot and a deviation, so that the user can perform the separation action by the mobile terminal or can be divided into a beat action and a split action. The roundabout can be further divided into beatback and roundabout, so that the user can hold the loopback action by the mobile terminal and can also be divided into a beatback action and a loopback action. The upper jaw can be further divided into an upper shot and a top, so that the user can perform the upper movement by holding the mobile terminal or can be divided into a topping action and a capping action. The lower jaw can be further divided into a lower shot and a lower jaw, so that the user can perform the lower jaw movement by holding the mobile terminal or can be divided into a lower shooting motion and a lower jaw motion.

It is worth mentioning that a displacement threshold can be further set. When the value of the displacement S is less than the displacement threshold, it is determined that the mobile terminal is defective, and the type of state change that occurs in the mobile terminal is: It can be generated by the user holding the mobile terminal to make an action and going back and forth.

The state change type decision module 11 further has another mobile terminal state change determination method, the determination method comprising the following steps:

Step 1: Determine whether the instantaneous speed value of a time point in the instantaneous angular velocity value of each time point of the mobile terminal exceeds the preset angular velocity value during the detection period. If so, it is determined that the state of the mobile terminal has changed. In other words, if there is, it is determined that the user's action causes the state of the mobile terminal to change. If not, it is no longer determined.

Step 2: Determine the direction of the mobile terminal. It is judged whether the mobile terminal is held vertically or horizontally by the user. The vertical holding is that the user holds the mobile terminal in a vertical manner, and the horizontal holding is that the user holds the mobile terminal in a horizontal manner.

Step 3: Determine whether the mobile terminal rotates clockwise or counterclockwise.

Step 4: Determine that the mobile terminal has a status change type.

Step 5: Determine the action taken by the user with the mobile terminal. Based on the determination of the mobile terminal status change type data, the user is determined to perform an action by the mobile terminal.

If the mobile terminal is vertically held by the user and rotated clockwise in a vertical manner, it is determined that the type of state change occurs in the mobile terminal: Vertically, the mobile device can hold the mobile phone by the user. The terminal generates a sticking and clockwise rotation action.

If the mobile terminal is vertically held by the user and rotates in a counterclockwise direction in a vertical manner, it is determined that the type of state change occurs in the mobile terminal: vertical reversal, the vertical reversal action of the mobile terminal may be performed by the user holding the mobile terminal It is produced by vertical and counterclockwise rotation.

If the mobile terminal is horizontally held by the user and rotated clockwise in a horizontal manner, it is determined that the type of state change occurs in the mobile terminal: traverse, the traversing action of the mobile terminal can be held by the user. The terminal generates a horizontally held and clockwise rotation action.

If the mobile terminal is held horizontally by the user and rotated counterclockwise in a horizontal manner, it is determined that the type of state change occurs in the mobile terminal: horizontal reversal, and the horizontal reversal action generated by the mobile terminal can be performed by the user holding the mobile terminal. Produced by a horizontally held and counterclockwise rotation.

It is worth mentioning that the state of occurrence of the mobile terminal can be further divided according to the displacement value generated by the mobile terminal. Increase the angle comparison value. Determine the degree of rotation. If the angle value of the rotation of the mobile terminal is less than the angle comparison value, it is determined that the degree of state change of the mobile terminal is jitter. If the shift When the value of the angle of rotation of the mobile terminal is greater than or equal to the angle comparison value, it is determined that the degree of state change of the mobile terminal is revolution. This step can be performed between steps 3 and 4, such that the mobile terminal state change type: the vertical turn is further divided into vertical and vertical. Thus the mobile terminal state change type: vertical reversal is further divided into vertical inverse and vertical reverse. Thus, the type of state change of the mobile terminal: the traverse is further divided into a horizontal sway and a horizontal sway. Thus, the mobile terminal state change type: The horizontal reverse is further divided into horizontal reverse and horizontal reverse.

After the state change type decision module 11 completes the determination, the generated mobile terminal state change data is transmitted to the switch module 12. The switching module 12 receives the mobile terminal state change data, performs processing, and obtains a corresponding trigger event, and then the switching module 12 can acquire data from the mobile terminal and then exchange with another terminal device. The switching module 12 interprets the received mobile terminal state change data, determines a specific event to be triggered, and then acquires the required data from the mobile terminal to perform a corresponding operation. As shown in FIG. 16, the switch module 12 further includes an interpretation module 121, a data exchange module 122 and a communication module 123. The interpretation module 121 is connected to the data exchange module 122 and the communication module 123, respectively. The interpretation module 121 can interpret the data received by the switching module 12 to determine a corresponding trigger event, data to be acquired to execute the trigger event, and an object to which the data needs to be sent. Preferably, the interpretation module receives data transmitted by the state change type module 11. The interpretation module 121 then generates target data instruction data for transmission to the data exchange module 122, and the interpretation module 121 generates target object instruction data to the communication module 123 for transmission to the data. The data exchange module 122 receives the target data instruction data issued by the interpretation module 121, and then acquires the target data from the mobile terminal, and the acquired target data is transmitted to the communication module 123. After receiving the target object command issued by the interpretation module 121 and the target data sent by the data exchange module 122, the communication module 123 transmits the target data to the target object through the mobile terminal.

Fig. 17 is a flow chart showing the data transmission method 100 of the data exchange system in which the state of the mobile terminal of the present invention is changed. The information transmitting method 100 includes receiving the user input as indicated at block 102. The user input refers to the user holding the mobile terminal to make an action, changing the state of the mobile terminal, and interacting with the mobile terminal in this manner. The information transmitting method 100 further includes determining the mobile terminal state change type data as indicated by block 104. The specific determination method is as described above. The information transmitting method 100 further includes the explanation of the mobile terminal as indicated by block 106. End state change type. Explain the mobile terminal status change type data, and obtain the mobile terminal status change type to obtain its corresponding trigger event data, the target object instruction data and the target data instruction data. Interpreting this event can be performed by the interpretation module 121 of the exchange module 12. The information transmitting method 100 further includes the acquisition target data shown in block 108. The acquisition target data can be performed by the data exchange module 122 of the switch module 12. The information transmitting method 100 further includes transmitting target data shown in block 110 to the target object. After receiving the target object instruction data and the target data, the communication module 123 of the switching module 12 sends the target data to the target object. The following is further illustrated by an example: the user moves the mobile terminal horizontally. The state detecting module 22 of the detecting module 20 detects that the acceleration of the mobile terminal changes, the state of the mobile terminal changes, and the timing module 21 of the detecting module 20 is activated to perform timing. At the same time, the state detecting module 22 of the detecting module 20 transmits the detected moving module change data and the detecting time point data to the storage module 30. In other words, the user interacts with the mobile terminal through an action to generate an input. The detecting module 20 starts receiving data after detecting the change of the mobile terminal. After the user's action is completed, the detection module 20 completes the detection data and transmits all the detected data to the storage module 30. The state change type determining module 11 of the processing module 10 reads data about the state change of the mobile terminal in the storage module, and then the data of the state change of the mobile terminal is processed and determined. It is determined that the mobile terminal generates a state change of 1, and the action made by the user holding the mobile terminal is action 1. The state change type decision module 11 transmits the mobile terminal state change 1 data to the interpretation module 121 of the switch module 12. The interpretation module 121 interprets the mobile terminal status change 1 data, generates trigger event 1 data, the target object instruction data and the target data instruction data. In this example, the trigger event 1 is a send picture, the target object is user B, and the target data is a picture. In practical applications, the trigger event is set by the user. The interpretation module 121 transmits the target data instruction data to the data exchange module 122, and transmits the target object instruction data to the communication module 123. The data exchange module acquires a picture on the mobile terminal, and transmits the picture to the communication module 123 in a data manner. The communication module 123 transmits the picture to the user B through the mobile terminal in the form of data.

FIG. 18 is a data receiving method 200 of an embodiment of a data exchange system based on a state change of a mobile terminal according to the present invention. The data receiving method 200 includes receiving data transmitted by other terminals as indicated at block 202. After the data transmitted by other terminals is received by the mobile terminal, the exchange mode is adopted. The communication module 123 of block 12 is passed to the interpretation module 121 of the switch module 12. The information receiving method 200 further includes interpreting the received data as shown at block 204. The data received by the interpretation module 121. The interpretation module 121 will identify the attribute data for the data. Attribute data refers to the data used for identification, such as data types, such as pictures, music, videos, documents, etc.; such as data formats, such as jpeg, bmp, png, video, wmv, mp4, rmvb, etc. . The interpretation module generates call instruction data for invoking an output device on the mobile terminal according to the attribute data of the data. The interpretation module 121 transmits the call instruction data, the attribute data of the data, and the data to the data exchange module 122. The data receiving method 200 further includes transmitting data as shown at block 206. After receiving the call instruction data, the attribute data of the data, and the data, the data exchange module 122 transmits the data to the mobile terminal. The information receiving method 200 further includes the presentation data shown at block 208. After receiving the call instruction data, the attribute data of the data, and the data, the mobile terminal invokes its output device to present the data to the user of the mobile terminal. An example of receiving data by a mobile terminal is further illustrated. After receiving the data, the mobile terminal transmits the data to the interpretation module 121 of the switching module 12 through the communication module 123 of the switching module 12. After receiving the data, the interpretation module 121 interprets the data, recognizes that the data is a picture, and the format is jpeg, and then generates call instruction data. The interpretation module 121 transmits the call instruction data, the attribute data (picture, jpeg) of the data, and the data to the data exchange module 122. The data exchange module 122 receives the call instruction data, the attribute data (picture, jpeg) of the data and the data, and transmits the data to the mobile terminal. After receiving the call instruction data, the attribute data (picture, jpeg) of the data and the data, the mobile terminal calls the output device of the mobile terminal, in this example, a display screen to display the picture on the display screen.

It is worth mentioning that before the mobile terminal receives the information, it may further have a step: the user can interact with the mobile terminal by acting on the mobile terminal to trigger the receiving of the information event. The mobile terminal can then receive the information.

It is worth mentioning that the data exchange system of the state change of the mobile terminal of the present invention can also be set on other external devices. Such as poorly portable devices, such as audio and video equipment, large display screens, etc.

The invention further provides a method of connecting to other devices. Taking the video terminal as an example, the audio-visual device is connected to a mobile terminal through a data line. More specifically, the data line is respectively connected to a data interface of the audio-visual device and a data interface of the mobile terminal. In this way, the shift The data on the mobile terminal can be transmitted to the audio-visual device, and outputted to the user through the audio-visual device. The audio-visual device can also be connected to the mobile terminal D by other means, such as network, Bluetooth, wireless network, satellite network, and the like. More specifically, the data of the mobile terminal is acquired by the data exchange module 122 of the switching module 12 and transmitted to the communication module 123 of the switching module 12. The communication module 123 transmits the data of the mobile terminal to the audio-visual device through the data line. The audiovisual device displays the data of the mobile terminal. Preferably, the user can perform an action by holding another mobile terminal C, trigger a corresponding event, and operate the video device through the mobile terminal. If the music video (Music Video) on the mobile terminal C is sent to the mobile terminal, it is played on the audio device.

Figure 19 is a diagram showing a method of operating a peripheral device by a data exchange system in which the state of the mobile terminal is changed, in accordance with an embodiment of the present invention. This is further illustrated by playing a music video as an example. A mobile terminal is used as an adapter end, and another data interface of the mobile terminal is connected to an audio-visual device through a data line. Another mobile terminal acts as a control terminal, and operates the audio and video device by triggering an event. Preferably, the user uses an action to change the state of the control end to trigger an event. The connection between the control terminal and the adapter end is selected from the group consisting of a data line, a network, a Bluetooth, a wireless network, a satellite network, a telephone network, and the like. The method 500 of operating a peripheral device further includes receiving user input as shown in block 502. In this example, the user's input is that the user quickly moves to the sky in the vertical direction with the control end. The operational peripheral method 500 further includes determining the mobile terminal state change type data as indicated by block 504. It is determined that the state of the mobile terminal is processed by the state change type determining module 11 of the processing module 10, and the specific determining method is as described above. It is determined that the state change type data of the mobile terminal is a departure. The deviation is then transmitted to the interpretation module 121 of the switching module 12 of the processing module 10. The method of operation 500 further includes interpreting the mobile terminal state change type as indicated by block 506. Interpreting the trigger event 3 can be performed by the interpretation module 121 of the switch module 12. The interpretation module 121 interprets the mobile terminal state change type data deviation, and obtains a trigger event 3, the target object instruction data and the target data instruction data. In this example, triggering event 3 refers to sending a music video to the adapter. The interpretation module 121 transmits the trigger event 3 data: a music video, and the target data command data: the music video to the data exchange module 122 of the switching module 12. The interpretation module 121 transmits the target object instruction data: the adapter end to the communication module 123. The operational peripheral method 500 further includes the acquisition target data shown in block 508. The acquisition target data can be performed by the data exchange module 122 of the switch module 12. The The data exchange module 122 acquires the music video and then transmits the music video to the communication module 123. The operational peripheral method 500 further includes transmitting target data to the target object as shown in block 510. After receiving the target object instruction data and the target data, the communication module 123 of the switching module 12 sends the target data to the target object. The communication module 123 transmits the received music video to the adapter end. The method 500 of operating the peripherals further includes receiving data input as indicated by block 512. The data input refers to data transmitted by other terminals. In this example, the data transmitted by the control terminal. After the data transmitted by the control terminal is received by the mobile terminal, the communication module 123 of the switching module 12 of the processing module 10 transmits the data to the interpretation module 121 of the switching module 12. The operational peripheral method 500 further includes interpreting the received data as indicated at block 514. The data received by the interpretation module 121. The data is a music video in the format mp4. The interpretation module generates call instruction data for invoking an output device on the mobile terminal according to the attribute data of the data. The interpretation module 121 transmits the call instruction data, the attribute data of the data, and the data to the data exchange module 122. The information receiving method 500 further includes transmitting the data to the external device as indicated at block 516. The data exchange module 122 receives the call instruction data, attribute data of the data: music video, MP4 and the music video, and transmits the data to the video terminal through the mobile terminal. The information receiving method 500 further includes the presentation data shown at block 518. After receiving the call instruction data, the attribute data of the music video, and the music video, the video terminal calls its output device to present the data to the user of the mobile terminal. The display device of the audio-visual device outputs a music video, and the sound device of the audio-visual device outputs the sound of the music video. It is worth mentioning that the data exchange system based on the state change of the mobile terminal of the present invention can be set in an adapter and then connected to the data interface of other terminals.

The present invention further includes a mode selection module 40. The mode selection module 40 provides a plurality of trigger event configuration data, and the mode selection module 40 is coupled to the processing module 10 for the processing module 10 to read the trigger event configuration data to adapt to different applications. As in the previous example, the console can invoke an entertainment terminal configuration through the mode selection module, which can be configured with an adapter. The entertainment terminal configuration enables the data exchange system triggering event of the mobile terminal state change of the present invention to be adapted for use in the entertainment terminal. It is worth mentioning that the mode selection module 40 can also customize the event configuration, and the user can define each trigger event by the mode selection module 40.

The invention further includes an adjustment module 50. The adjustment module 50 and the detection module 20 are respectively Connected to the processing module. The adjustment module 50 is configured for the user to adjust the preset speed value, the preset angular velocity value, the displacement threshold, and the displacement comparison value. The adjusting module 50 records, by the detecting module 20, data that the user changes the state of the mobile terminal by performing the same action multiple times by the mobile terminal, and then transmits the data to the processing module 10 for processing, and then obtains the adjusted data. When the preset speed value is adjusted, the adjusting module 50 records, by the detecting module 20, that the mobile terminal changes the data caused by the user performing the same action multiple times, and then transmits the data to the processing module 10 for processing. The adjusted preset speed value is obtained. For the preset angular velocity value, the displacement threshold, the displacement comparison value can also be adjusted in this manner.

The events invoked in the present invention include: send, receive, page, upload, download, confirm, play, stop, forward, and rewind.

The foregoing is an exemplification of the specific embodiments of the present invention, and the device and the structure which are not described in detail are understood to be implemented by the general equipment and the general method which are available in the field.

The above embodiments of the present invention are merely illustrative of the technical solutions of the present invention, and are merely illustrative of the technical solutions of the present invention, and are not intended to limit the technical solutions of the present invention and the scope thereof. The improvement of the technical solutions disclosed in the claims and the description of the present invention by means of equivalent technical means, equivalent equipment and the like should be considered as not departing from the scope of the invention as disclosed in the appended claims.

Claims

Claim

A gyroscope-based human-computer interaction detection and processing method on a smart terminal, characterized in that: the method comprises the following steps:

Step (1), establish a three-dimensional coordinate system on the intelligent terminal, and the X-axis direction is horizontal from left to right.

The Y-axis direction is vertical from bottom to top, and the z-axis direction is perpendicular to the screen of the smart terminal from back to front;

Step (2), if the smart terminal holder acts on the smart terminal, respectively, the gyroscope is used to respectively test the angular rate of the terminal device rotating around the X axis, the angular rate of rotation around the Y axis, and the angular rate of rotation around the Z axis;

Step (3), by sampling the diagonal rate, respectively, obtaining an angular rate change curve with respect to time in three directions of the X axis, the Y axis, and the Z axis;

Step (4), according to the obtained waveform diagram of the angular rate of the X-axis, the Y-axis, and the Z-axis on the time curve, determine the action made by the smart terminal, and trigger the corresponding event according to the setting.

2. The method for detecting and processing human-machine interaction based on a gyroscope according to claim 1, wherein: in the step (4), according to the obtained angular rates of the X-axis, the Y-axis, and the Z-axis For the waveform diagram on the curve of time, judging the action made by the intelligent terminal means:

If the waveform diagram of the X-axis has obvious troughs in the obtained waveform diagram, and the waveform diagrams of the Y-axis and the z-axis do not change significantly, it is judged that the smart terminal performs the action from the near-outward direction;

If the obtained waveform diagram has obvious peaks in the waveform diagram of the X-axis, and the waveform diagrams of the Y-axis and the z-axis do not change significantly, it is judged that the smart terminal performs the action from the far-reaching near-turnback;

If the obtained waveform diagram, the waveform diagram of the Y-axis has obvious troughs first, and there are obvious peaks afterwards, and the waveform diagrams of the X-axis and the z-axis do not change significantly, then the smart terminal is judged to flip to the left;

The gyro-based human-computer interaction detection and processing method on the smart terminal according to claim 1 or 2, wherein: the step (4) determines the action made by the smart terminal, and according to the setting The triggering of the corresponding event means:

If it is determined that the smart terminal performs the action from the near-out direction, the events triggered by the smart terminal include: sending an email, uploading a file, sending a short message, sending a message, or launching a weapon in a shooting game; The action triggered by the smart terminal includes: receiving a file, downloading a file, and receiving the message;

4. The method for detecting and processing a human-machine interaction based on a gyroscope according to claim 2, wherein the apparent trough is: in the waveform diagram, the amplitude of the curve is less than S1 and continues to exceed T seconds, there are obvious peaks: In the waveform diagram, the amplitude of the curve is greater than S2, and lasts for more than T seconds. If there is no obvious trough and no obvious peak in the waveform, it is considered that the waveform has no obvious change. The S1, S2 and T are all settable values.

The method for detecting and processing a human-machine interaction based on a gyroscope according to claim 4, wherein: S1 is -1.5, said S2 is 1.5, and said T is 0.2.

6. A human-machine interaction detection and processing method based on a linear acceleration sensor on a smart terminal, characterized in that: the method comprises the following steps:

Step (2) If the smart terminal holder acts on the intelligent terminal, the line acceleration sensor is used to respectively test the linear acceleration of the terminal device in three axes of XYZ;

Step (3), by sampling the linear acceleration, respectively, obtaining a linear acceleration curve of the three directions of the X-axis, the Y-axis, and the Z-axis;

Step (4): According to the obtained linear acceleration of the X-axis, the Y-axis, and the Z-axis, the waveform diagram of the time change curve is used to determine the action made by the smart terminal, and the corresponding event is triggered according to the setting.

7. The method of detecting and processing a human-machine interaction based on a linear acceleration sensor on a smart terminal according to claim 6, wherein: in the step (4), according to the obtained line of the X-axis, the Y-axis, and the Z-axis The waveform of the acceleration versus time curve determines the action made by the intelligent terminal. Refers to:

If the obtained waveform diagram has obvious peaks in the waveform diagram of the Z-axis, and the waveform diagrams of the Y-axis and the X-axis do not change significantly, it is judged that the smart terminal performs the action from the far-end to the near-turnback;

If the obtained waveform diagram has obvious troughs in the waveform diagram of the Y-axis, and the waveform diagrams of the X-axis and the Z-axis do not change significantly, it is judged that the smart terminal performs the action from the near-outward direction;

If the obtained waveform diagram has obvious peaks in the waveform diagram of the Y-axis, and the waveform diagrams of the X-axis and the z-axis do not change significantly, it is judged that the smart terminal performs the action from the far-end to the near-turnback.

The method for detecting and processing a human-machine interaction based on a linear acceleration sensor on a smart terminal according to claim 6 or 7, wherein: (4) determining an action performed by the intelligent terminal, and triggering according to the setting The event refers to:

9. The method according to claim 7, wherein the apparent trough is: in the waveform diagram, the amplitude of the curve is less than S1 and continues. More than T seconds, there are obvious peaks: In the waveform diagram, the amplitude of the curve is greater than S2, and lasts longer than T seconds. If there is no obvious trough and no obvious peak in the waveform, it is considered that the waveform has no obvious change. The S1, S2, and T are all settable values.

10. The human-machine interaction based on linear acceleration sensor on the intelligent terminal according to claim 9. The detection and processing method is characterized in that: S1 is -1.5, the S2 is 1.5, and the T is 0.2.

A data exchange system based on a state change of a mobile terminal, comprising: a processing module connected to each other, a detecting module and a storage module, wherein the detecting module detects state change data of the mobile terminal, and The state change data of the mobile terminal is stored in the storage module, and the detecting module reads the state change data of the mobile terminal stored in the storage module and performs processing to determine the state change type of the mobile terminal, thereby Trigger the corresponding event.

The data exchange system based on the state change of the mobile terminal according to claim 11, wherein the detecting module further comprises:

a timing module for setting a detection period; and

a state detecting module, configured to detect a state of the mobile terminal at each time point, wherein the timing module is connected to the state detecting module, and the timing module starts timing when detecting an acceleration change, and the state detecting module detects the time. The status data of the mobile terminal to which it arrives is transmitted to the storage module.

The data exchange system based on the state change of the mobile terminal according to claim 11, wherein the processing module further comprises: a state change type determining module and a switching module connected to each other, wherein the state change The type determining module reads the state data of the mobile terminal in the storage module, performs processing to determine a state change type of the mobile terminal, and then transmits the state change type data of the mobile terminal to the switching module, the switching module Processing the state change type data of the mobile terminal, obtaining a corresponding trigger event, and then acquiring the required data from the mobile terminal, and performing a corresponding operation.

The data exchange system based on the state change of the mobile terminal according to claim 12, wherein the processing module further comprises: a state change type determining module and a switching module connected to each other, wherein the state change The type determining module reads the state data of the mobile terminal in the storage module, performs processing to determine a state change type of the mobile terminal, and then transmits the state change type data of the mobile terminal to the switching module, the switching module Processing the state change type data of the mobile terminal, obtaining a corresponding trigger event, and then acquiring the required data from the mobile terminal, and performing a corresponding operation.

15. The data exchange system based on state change of a mobile terminal according to claim 13, The switching module further includes: an interpreting module connected to each other, a data exchange module and a communication module, wherein the interpreting module interprets the mobile terminal state change type data, obtaining the target object instruction data and the Target data instruction data, the interpretation module transmits the target object instruction data to the communication module, and transmits the target data to the data exchange module, the data exchange module acquires the target data, and the target data Transferred to the communication module, the communication module transmits target data to a target object.

The data exchange system based on the state change of the mobile terminal according to claim 14, wherein the switching module further comprises: an interpreting module connected to each other, a data exchange module and a communication module, wherein The interpretation module interprets the mobile terminal state change type data, obtains the target object instruction data and the target data instruction data, and the interpretation module transmits the target object instruction data to the communication module, and transmits the target data to the The data exchange module, the data exchange module acquires the target data, and transmits the target data to the communication module, and the communication module transmits the target data to the target object.

17. The data exchange system based on state change of a mobile terminal according to claim 15, wherein the communication module transmits the received data to the interpretation module of the day, and the interpretation module interprets the received The data identifies the attribute data of the data, generates call instruction data, and then transfers the data, the attribute data of the data, and the call data to the data exchange module for calling a device outside the system.

18. The data exchange system based on state change of a mobile terminal according to claim 16, wherein the communication module transmits the received data to the interpretation module of the day, and the interpretation module interprets the received The data identifies the attribute data of the data, generates call instruction data, and then transfers the data, the attribute data of the data, and the call data to the data exchange module for calling a device outside the system.

The data exchange system based on the state change of the mobile terminal according to claim 17, wherein the data exchange system based on the state change of the mobile terminal further comprises a mode selection module, the mode selection module and the processing The module is connected, and the mode selection module provides a plurality of trigger event configuration data for the processing module to read, thereby adapting to different applications.

20. The data exchange system based on a state change of a mobile terminal according to claim 18, wherein said data exchange system based on a state change of the mobile terminal further comprises a mode selection module, said mode selection module and said process Module connection, the mode selection module provides more The trigger event configuration data is read by the processing module to adapt to different applications.

The data exchange system based on the state change of the mobile terminal according to claim 19, wherein the data exchange system based on the state change of the mobile terminal further comprises an adjustment module, and the adjustment module and the detection module respectively And the processing module is connected to the processing module, wherein the adjustment module is configured for the user to adjust the preset speed value, the preset angular velocity value, the displacement threshold, and the displacement comparison value.

The data exchange system based on the state change of the mobile terminal according to claim 20, wherein the data exchange system based on the state change of the mobile terminal further comprises an adjustment module, and the adjustment module and the detection module respectively And the processing module is connected to the processing module, wherein the adjustment module is configured for the user to adjust the preset speed value, the preset angular velocity value, the displacement threshold, and the displacement comparison value.

23. A method of operating an external device by a data exchange system with a state change of a mobile terminal, comprising the steps of:

Step 8: Display data, the data is received from the data exchange module, and the external device is The data is presented by its output device.

24. The method of claim 23, wherein the step 2 further comprises the following sub-steps:

Step 2.1: determining whether the instantaneous speed value of a time point in the instantaneous speed value of each time point of the mobile terminal exceeds a preset speed value during the detection period, and if yes, determining that the state of the mobile terminal changes, if No, no longer judged;

Step 2.2: Establish a three-dimensional coordinate system with the direction of the X axis from west to east and the positive direction of the X axis to the east. The direction of the Y-axis is from south to north, and the positive direction of the Y-axis is north. The Z axis is from the center of the earth to the ground, and the positive direction of the Z axis is toward the ground. The original center of the coordinate axis is the position of the mobile terminal at the start and end time of the detection period; Step 2.3: Calculating the displacement of the mobile terminal, the displacement is The displacement component of the displacement in the X-axis, the displacement component in the Y-axis, and the displacement component in the Z-axis;

Step 2.4: determining the mobile terminal state change type data, first determining that the displacement is in the displacement component of the displacement on the X axis, the displacement component in the Y axis and the displacement component in the Z axis are the largest, and then determining the largest value a symbol relationship to determine the mobile terminal state change type data; Step 2.5: determining that the user holds the action made by the mobile terminal, determining that the user holds the mobile terminal according to determining the mobile terminal state change type data The type of action.

The method for operating an external device by a data exchange system of a mobile terminal state change according to claim 24, wherein the mobile terminal state change type data described in the step 2.4 includes the following types:

Right 甩: The right 甩 refers to the mobile terminal moving in the positive direction of the X axis;

Left 甩: the left 甩 refers to the mobile terminal moving in the negative direction of the X axis;

Deviation: the separation means that the mobile terminal moves in the positive direction of the Y axis;

Roundabout, the roundabout refers to the mobile terminal moving in the negative direction of the Y axis;

The upper jaw refers to the mobile terminal moving in the positive direction of the Z axis;

The lower jaw refers to the mobile terminal moving in the negative direction of the Z axis.

The method of operating an external device by a data exchange system of a mobile terminal state change according to claim 25, wherein the action type described in the step 2.5 includes the following types:

Right-hand action: the right-hand action means that the user moves the mobile terminal to the right of the user by the mobile terminal; Left-handed action: the left-handed action means that the mobile terminal moves the mobile terminal to the left of the user;

The detachment action: the detachment action means that the user moves the mobile terminal to the mobile terminal in a direction away from the user.

Roundabout action: The circuitous action means that the user moves the mobile terminal to the mobile terminal in the direction of approaching the user.

The action of the captain means that the user moves the mobile terminal to move the mobile terminal to the sky: the squatting action means that the user moves the mobile terminal to the ground by the mobile terminal.

The method of operating an external device by a data exchange system of a mobile terminal state change according to claim 23, wherein the step 3 and the step 4 further have a step 3A: determining a degree of displacement change, The data exchange system of the state change of the mobile terminal further has a displacement comparison value, and the displacement value is compared with the displacement comparison value. If the displacement value is smaller than the displacement comparison value, determining that the displacement change degree is a beat, if the displacement value If the displacement comparison value is greater than or equal to, the displacement change degree is determined to be 甩, so that the state change type can be further divided, so that more events can be triggered, wherein the right 甩 can be further divided into a right shot and a right 甩, left 甩It can be further divided into left and left, which can be further divided into beat and detachment, which can be further divided into beats and rounds, which can be further divided into upper shots and uppers. The squat can be further divided into a lower shot and a lower jaw.

28. The method of claim 23, wherein the step 2 further comprises the following sub-steps:

Step 2.1: determining whether an instantaneous speed value of a time point exceeds a preset angular velocity value in the instantaneous angular velocity value of each time point of the mobile terminal during the detecting period, and if yes, determining that the mobile terminal state changes, If not, no longer judged;

Step 2.2: determining the direction of the mobile terminal, determining whether the mobile terminal is held vertically or horizontally by the user, the vertical holding is that the user holds the mobile terminal in a vertical manner, and the horizontal holding is a user Holding the mobile terminal in a horizontal manner;

Step 2.3: determining whether the rotation mode of the mobile terminal is rotating clockwise or counterclockwise; Step 2.4: determining that the type of state change occurs in the mobile terminal;

Step 2.5: determining that the user holds the action made by the mobile terminal, and determining the action performed by the user by the mobile terminal according to determining the mobile terminal state change type data.

The method for operating an external device by a data exchange system of a mobile terminal state change according to claim 28, wherein the mobile terminal state change type data described in the step 2.4 includes the following types:

Vertical rotation: the vertical rotation means that the mobile terminal rotates clockwise in a vertical manner; vertical reversal: the vertical reversal means that the mobile terminal rotates counterclockwise in a vertical manner; Turning: The horizontal rotation means that the mobile terminal rotates clockwise in a horizontal direction; transverse reversal: the horizontal reversal means that the mobile terminal rotates counterclockwise in a horizontal manner.

The method of operating an external device by a data exchange system of a mobile terminal state change according to claim 28, wherein the action type described in the step 2.5 includes the following types:

Vertical rotation: the vertical rotation means that the mobile terminal is held by the user and then rotated in a clockwise direction;

Vertical reversal action: the vertical reversal means that the mobile terminal is held by the user and then rotated in a counterclockwise direction;

Transverse rotation: the horizontal rotation means that the mobile terminal is held horizontally by the user and then rotated in a clockwise direction;

Horizontal reversal action: The horizontal reversal means that the mobile terminal is held horizontally by the user and then rotated in the counterclockwise direction.

The method of operating an external device by a data exchange system of a mobile terminal state change according to claim 23, wherein the step 3 and the step 4 further have a step 3B: determining a degree of rotation, The data exchange system of the state change of the mobile terminal has an angle comparison value. If the angle value of the rotation of the mobile terminal is less than the angle comparison value, it is determined that the degree of state change of the mobile terminal is jitter, and if the value of the angle of rotation of the mobile terminal is greater than or Equal to the angle comparison value, it is determined that the degree of state change of the mobile terminal is a turn, so that the state change type can be further divided, so that more events can be triggered, wherein the vertical turn is further divided into vertical and vertical, The vertical reversal is further divided into vertical and vertical reversal, and the horizontal reversal is further divided into horizontal and horizontal reversal, and horizontal reversal is further divided into horizontal and horizontal reversal.

The data exchange system of the mobile terminal state change has a displacement threshold. When the bit shift value is less than the displacement threshold, it is determined that the mobile terminal state change type data is a round trip.

33. The method of claim 24, wherein the event described in step 2.3 is selected from the following events: sending, receiving, page turning, Upload, download, OK, play, stop, go forward, back.