CN115494971A - Electronic touch pen and input system thereof - Google Patents
Electronic touch pen and input system thereof Download PDFInfo
- Publication number
- CN115494971A CN115494971A CN202211281031.XA CN202211281031A CN115494971A CN 115494971 A CN115494971 A CN 115494971A CN 202211281031 A CN202211281031 A CN 202211281031A CN 115494971 A CN115494971 A CN 115494971A
- Authority
- CN
- China
- Prior art keywords
- module
- information
- gesture
- electronic
- pen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 claims abstract description 19
- 241000180587 Pinnidae Species 0.000 claims abstract description 17
- 238000007781 pre-processing Methods 0.000 claims description 9
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 238000001914 filtration Methods 0.000 claims description 7
- 230000003068 static effect Effects 0.000 claims description 7
- 238000004364 calculation method Methods 0.000 claims description 6
- 230000008859 change Effects 0.000 claims description 6
- 230000006698 induction Effects 0.000 claims description 5
- 238000005452 bending Methods 0.000 claims description 3
- 210000001145 finger joint Anatomy 0.000 claims description 3
- 230000003993 interaction Effects 0.000 abstract description 13
- 238000000034 method Methods 0.000 description 20
- 230000008569 process Effects 0.000 description 17
- 230000000875 corresponding effect Effects 0.000 description 15
- 230000006870 function Effects 0.000 description 10
- 230000006872 improvement Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 4
- 241001422033 Thestylus Species 0.000 description 2
- 230000001149 cognitive effect Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000012905 input function Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/04162—Control or interface arrangements specially adapted for digitisers for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses an electronic touch pen and an input system thereof, wherein an image acquisition module, a pressure sensing module, an adjusting module and a transmission module are arranged in a miscellaneous pen shell, when the electronic touch pen is used, the image acquisition module acquires gesture information to determine operation information, the adjusting module adjusts the proper length of the electronic touch pen and the angle of the image acquisition module according to the operation information and gestures, so that a user can conveniently operate the electronic touch pen, the pressure sensing module can receive the pressure information to determine touch areas and line thicknesses, the transmission module transmits the pressure information and track information formed by a pen point in the touch areas to electronic equipment and displays corresponding input information on the touch input module, space gestures and touch are combined to realize the quick input of various input types, the interaction flexibility is also improved, the problem of low touch identification accuracy caused by different hand structures is effectively solved, and the use range of the electronic touch pen and the experience degree of the user are improved.
Description
Technical Field
The invention belongs to the technical field of electronics, and particularly relates to an electronic touch pen and an input system thereof.
Background
At present, manually operated pen type interaction and multi-point touch interaction have the characteristics of intuitive and natural operation, are always considered to be promising interaction modes, and integrate information input modes such as pen pressure sensing, pen holding posture sensing and the like of an electronic pen on the basis of a traditional physical pen direct mode, so that the input bandwidth of a pen channel is widened. The fingers are directly utilized in the information input link without other additional input media, so that the user can directly obtain more tactile feedback in the interaction process, and the inherent attribute in the touch interaction brings more real experience to the user. In the daily human-computer interaction process, a user usually needs to process multiple complex work tasks and directly and repeatedly switch between different task types to meet specific operation requirements. Due to the limitation of input conditions, the operation tasks which can be realized in parallel originally are often forced to be completed in a sequential mode, so that the task completion time is prolonged, the fatigue of hands is caused, the operation performance of touch control is influenced, the problems of finger fatiguing and shielding are solved, misoperation is often caused in the process of directly clicking or selecting a small target by using fingers on touch equipment, and the experience degree of a user is reduced.
Disclosure of Invention
In view of the above, the present invention provides an electronic stylus and an input system thereof, which improve the operation flexibility and the recognition accuracy and expand the application range, so as to solve the above technical problems.
In a first aspect, the present invention provides an electronic stylus for inputting information to an electronic device via a touch input module, the electronic stylus comprising:
a pen shell;
a nib disposed at a first end of the pen housing;
the image acquisition module is arranged at the second end of the pen shell and used for acquiring a gesture image and generating operation information of the electronic touch pen according to the gesture image, wherein the operation information comprises a writing mode, a drawing mode and a control mode;
the adjusting module is connected with the image acquisition module and used for generating adjusting information according to the operation information and the gesture image, wherein the adjusting information comprises the length of the electronic touch pen and the angle of the image acquisition module;
the pressure induction module is arranged in the pen point and used for acquiring a plurality of pieces of pressure information generated when the electronic touch pen executes the operation information according to the adjustment information, wherein the plurality of pieces of pressure information are respectively in one-to-one correspondence with at least two contact areas of the electronic touch pen contacting the touch input module;
the transmission module is arranged in the pen shell, is connected with the pressure sensing module and is used for sending a plurality of pressure information to the electronic equipment, and the electronic equipment executes the track information of the operation information and generates corresponding input information according to the plurality of pressure information when the electronic stylus is contacted with the touch input module.
As a further improvement of the above technical solution, the pressure sensing module includes:
the setting unit is used for setting a first line corresponding to the pressure information when the change value of the pressure information received by the pressure sensing module is smaller than a preset pressure value when the operation information is in a writing mode; when the operation information is in a drawing mode, and when the variation value of the pressure information is greater than or equal to the preset pressure, the setting unit sets a second line corresponding to the pressure information, wherein the width of the second line is greater than that of the first line.
As a further improvement of the above technical solution, the pressure sensing module includes:
the conversion unit is connected with the setting unit and is used for converting the pressure information into a pressure value and sending the pressure value to the setting unit;
and the power supply unit is connected with the conversion unit and used for supplying power to each module in the pen shell.
As a further improvement of the above technical solution, the image acquisition module is configured to acquire a gesture image and generate operation information of the electronic stylus according to the gesture image, and includes:
acquiring the number of fingers and the position of a palm in the acquired gesture image, wherein when the palm does not appear in the gesture image, the operation information is in a writing mode; when the number of the fingers is a single finger, the operation information is in a control mode; when the number of the fingers is multiple, the operation information is a drawing mode.
As a further improvement of the above technical solution, the trajectory information includes a trajectory formed by moving or clicking a contact area of a pen tip on the touch input module, the input information includes an input type and a display color, and the input type includes at least one of text, a picture, or a page.
In a second aspect, the invention further provides an electronic touch pen input system, which comprises an electronic touch pen and an electronic device, wherein the electronic device is in wireless connection with the electronic touch pen, the electronic device comprises a gesture image preprocessing module, a touch input module and a control module, the gesture image preprocessing module receives gestures collected by an image collecting module and sent by a transmission module, the gestures are filtered to obtain gesture images, the control module generates operation information according to the gesture images, the control module sends the operation information to the touch input module to be displayed and adjusts the electronic touch pen, a pressure sensing module receives pressure information generated by contact between a pen point and the touch input module and sends the pressure information to the electronic device through the transmission module, and the control module generates corresponding input information according to the track information and the pressure information.
As a further improvement of the above technical solution, the execution process of the gesture image preprocessing module includes:
calculating the gray value of each point gray value in the neighborhood of each pixel point of the image by adopting a mean filtering algorithm, presetting an image as f (i, j), and (i, j) as the pixel points on the image, wherein the expression corresponding to the mean filtering is
Wherein M is the value range of the image pixel points covered by the calculation template, and n is the number of pixels contained in the neighborhood of the point (i, j) covered by the calculation template operator.
As a further improvement of the above technical solution, when the image acquisition module detects a gesture, a cartesian coordinate system is established, the origin of coordinates is at the center position of the control module, the x-axis and the z-axis of the coordinate system are on the horizontal plane of the touch input module, the x-axis is parallel to the long side of the touch input module, the z-axis is parallel to the short side, and the y-axis of the coordinate system is perpendicular to the plane of the touch input module and is upward in the positive direction;
each frame of image acquisition of the image acquisition module calculates and updates a data set according to current image frame data, each frame of data comprises a data list, and when the image acquisition module detects a gesture, the control module allocates a first identifier to the current gesture;
if the image acquisition module does not acquire the gesture, the control module allocates a second identifier to the current gesture image, reads the hand attribute according to the first identifier and the second identifier and determines gesture information.
As a further improvement of the technical scheme, the gesture information comprises a static gesture and a dynamic gesture, the static gesture adopts the combination of each finger joint and the bending state of the hand to realize the gesture recognition, and the dynamic gesture recognizes different gestures through the space position change condition of the whole hand.
As a further improvement of the above technical solution, reading the hand attribute according to the first identifier and the second identifier and determining the gesture information includes:
adopting a three-dimensional gesture tracking and evaluating algorithm to obtain an average Euclidean distance between the endpoint of the gesture in the gesture image and a real key point, wherein the expression of the endpoint error is
Wherein, the default single hand has 21 joint points, i is the joint label number, D is the sample number of the data set, s is the sample number, w and h are the width and height of the original image respectively, y si The true value of the tag is represented,
representing a predicted value;
true keypoint percentage PCK, i.e. true Euclidean distance error below thresholdThe percentage of the key points is expressed as
And delta is a threshold value, if the predicted value is smaller than the distance of the true value, the indication function delta is set to be 1, and if not, the indication function delta is set to be 0.
The invention provides an electronic touch pen and an input system thereof, wherein an image acquisition module, a pressure sensing module, an adjusting module and a transmission module are arranged in a miscellaneous pen shell, when the electronic touch pen is used, the image acquisition module acquires gesture information to determine operation information, the adjusting module adjusts the proper length of the electronic touch pen and the angle of the image acquisition module according to the operation information and gestures, so that a user can conveniently operate the electronic touch pen, the pressure sensing module can receive the pressure information to determine touch areas and line thicknesses, the transmission module transmits the pressure information and track information formed by a pen point in the touch areas to electronic equipment and displays corresponding input information on the touch input module, space gestures and touch are combined to realize the quick input of various input types, the interaction flexibility is also improved, the problem of low touch identification accuracy caused by different hand structures is effectively solved, and the use range of the electronic touch pen and the experience degree of the user are improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
FIG. 1 is a block diagram of an electronic stylus provided in the present invention;
FIG. 2 is a block diagram of an electronic stylus input system according to the present invention;
FIG. 3 is a block diagram of a pressure sensing module according to the present invention;
fig. 4 is a diagram illustrating a process of using the electronic stylus provided in the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.
It will be understood that when an element is referred to as being "secured to" another element, it can be directly on the other element or intervening elements may also be present. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present. In contrast, when an element is referred to as being "directly on" another element, there are no intervening elements present. The terms "vertical," "horizontal," "left," "right," and the like as used herein are for illustrative purposes only.
In the present invention, unless otherwise expressly stated or limited, the terms "mounted," "connected," "secured," and the like are to be construed broadly and can, for example, be fixedly connected, detachably connected, or integrally formed; can be mechanically or electrically connected; they may be directly connected or indirectly connected through intervening media, or may be connected through the use of two elements or the interaction of two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
Referring to fig. 1, the present invention provides an electronic stylus for inputting information to an electronic device through a touch input module, the electronic stylus comprising:
a pen shell;
a nib disposed at a first end of the pen housing;
the image acquisition module is arranged at the second end of the pen shell and used for acquiring a gesture image and generating operation information of the electronic touch pen according to the gesture image, wherein the operation information comprises a writing mode, a drawing mode and a control mode;
the adjusting module is connected with the image acquisition module and used for generating adjusting information according to the operation information and the gesture image, wherein the adjusting information comprises the length of the electronic touch pen and the angle of the image acquisition module;
the pressure induction module is arranged in the pen point and used for acquiring a plurality of pieces of pressure information generated when the electronic touch pen executes the operation information according to the adjustment information, wherein the plurality of pieces of pressure information are respectively in one-to-one correspondence with at least two contact areas of the electronic touch pen contacting the touch input module;
the transmission module is arranged in the pen shell, is connected with the pressure sensing module and is used for sending a plurality of pressure information to the electronic equipment, and the electronic equipment executes the track information of the operation information and generates corresponding input information according to the plurality of pressure information when the electronic stylus is contacted with the touch input module.
In this embodiment, the pressure sensing module includes a setting unit, a conversion unit, and a power supply unit, and when the operation information is in the writing mode and a variation value of the pressure information received by the pressure sensing module is smaller than a preset pressure value, the setting unit sets a first line corresponding to the pressure information; when the operation information is in a drawing mode and the variation value of the pressure information is greater than or equal to the preset pressure, the setting unit sets a second line corresponding to the pressure information, wherein the width of the second line is greater than that of the first line; the conversion unit is connected with the setting unit and used for converting the pressure information into a pressure value and sending the pressure value to the setting unit; and the power supply unit is connected with the conversion unit and used for supplying power to each module in the pen shell. The forced induction module can include two at least pressure fibrous bodies, and the pressure fibrous body can take place deformation according to the pressure size that receives, and the degree that the pressure fibrous body takes place deformation is corresponding with the size of pressure, and the forced induction module obtains two at least pressure information according to two at least pressure sensor. The image acquisition module can be installed at the top of the pen shell, the pressure sensing module is arranged at one end close to the pen point, and the image acquisition module can acquire user gestures so as to set an operation mode of the electronic touch pen, and can be used for writing, drawing or controlling functions such as a mouse.
Referring to fig. 2, it should be noted that the image acquisition module is a micro camera, the micro camera is arranged at the tail end of the pen shell of the pen holder in a structure embedding mode, two ends of the micro camera are connected to two sides of the pen holder through rotating shafts, the rotating shafts are connected with the transmission motor through two meshing gears, the angle of the camera is adjusted through control display of the motor, and the electronic touch pen can be properly adjusted according to the use habits or operation modes of users. The transmission module can be a WeChat controller or a wireless communication function such as Bluetooth, and can display pressure information received by the pressure sensing module and a track formed by the pen point on the touch input module, so that rapid and convenient interaction is realized. The dynamic space gesture is realized in a waving mode, the position data of the palm center is recorded every time frame data are refreshed for a fixed number of times in a preset mode, the current dynamic gesture type is determined through the change of the palm positions in two frame data, a dynamic gesture is recorded, the drawing color is changed through left-right waving of the palm, and the brush color is triggered to change every left-right dynamic gesture.
It should be understood that when a user uses the electronic stylus, the gesture setting operation information can be recognized according to the image acquisition module, so that the electronic stylus is suitable for different scenes, can write or draw, can be simply controlled, and is convenient to carry. The touch input module is a touch screen, fingers are easy to shield the cursor due to the physiological structure of the fingers, so that the relative position between the cursor and the base line cannot be observed in the drawing process, the position of the fingertip is finely adjusted, the drawing offset is slightly larger than the pen input, and the drawing time is slightly shorter than the pen input. And under the control mode, the friction between the finger and the screen causes discomfort of the finger contact surface due to long-distance continuous sliding, the active experience of operation is influenced, the electronic touch pen is suitable for accurate operation due to the combination of space gestures and touch, and the discomfort of the hand and the influence on the operation performance caused by long-distance touch sliding operation and long-time continuous space gesture operation can be avoided.
Optionally, the image capturing module is configured to capture a gesture image and generate operation information of the electronic stylus according to the gesture image, and the method includes:
acquiring the number of fingers and the position of a palm in the acquired gesture image, wherein when the palm does not appear in the gesture image, the operation information is in a writing mode; when the number of the fingers is a single finger, the operation information is in a control mode; when the number of the fingers is multiple, the operation information is a drawing mode.
In this embodiment, the trajectory information includes a trajectory formed by moving or clicking a contact area of a pen tip on the touch input module, the input information includes an input type and a display color, and the input type includes at least one of text, a picture, or a page. The electronic touch pen is single-point input, the input bandwidth is relatively high, the combination of a plurality of finger positions can express rich semantic information, the palm position can be used as a reference face meeting to determine specific gesture information, in related work of drawing or design, most of the electronic touch pen needs to use an interactive digital screen or a digital board for pen input, drawing of lines, clicking or color block selection of a brush color on the digital screen, clicking expansion and folding menus, selection of thickness of the brush and the like, and operation tasks mainly comprise drawing tasks and command operation tasks. The user needs to move the input position of the pen, and the input position is switched between the drawing area and the command operation area for multiple times, the command operation occurring in the drawing process interrupts the current drawing task, and when the drawing task with higher accuracy requirement is carried out, the drawing process of the user needs to be accurately adjusted for multiple times before returning to the drawing state after being interrupted by the command operation, so that the serious waste of time is caused, and the input efficiency is reduced. If command operations such as changing the color of strokes are required to be performed many times during the drawing process, the adjustment process before each switching back to the drawing task will be cumulatively referred to as a process causing fatigue of the upper arm and the hand, and causing psychological fatigue of the user, thereby affecting the ability of the drawing operation and the command operations.
It should be noted that, when the operation information is in a writing mode, an appropriate length is adjusted according to the structure of the hand of the user, when the operation information is in a drawing mode, the angle of the camera can be adjusted to facilitate rapid capture of gesture images, so that interface switching or color selection is realized, when the operation information is in a control mode, the length of the electronic touch pen can also be adjusted, clicking or sliding is facilitated to replace the function of a mouse, writing can replace the simple input function of a keyboard, when in actual use, the user can select a single hand to operate the electronic touch pen, and can also operate with two hands, the operation hand is distributed according to the accuracy degree of operation and the cognitive load, the cognitive load is correlated with the work memory, and the brain needs to transfer resources to perform short-time memory storage. The information processing and action control have completed the corresponding tasks. Under the touch operation without limiting the area, if the right hand is selected to combine the touch operation and the pen operation, the pen point is moved by the operation of the touch command gesture, and the user may readjust the pen holding posture for the right hand touch operation, so that the use convenience of the electronic touch pen is improved.
Referring to fig. 2, the invention further provides an electronic stylus input system, which includes an electronic stylus and an electronic device that are wirelessly connected, where the electronic device includes a gesture image preprocessing module, a touch input module, and a control module, the gesture image preprocessing module receives a gesture acquired by an image acquisition module sent by a transmission module, and performs filtering processing to obtain a gesture image, the control module generates operation information according to the gesture image, the control module sends the operation information to the touch input module to display and adjust the electronic stylus, a pressure sensing module receives pressure information generated by a pen tip contacting the touch input module and sends the pressure information to the electronic device through the transmission module, and the control module generates corresponding input information according to the trajectory information and the pressure information.
In this embodiment, the execution process of the gesture image preprocessing module includes: calculating the gray value of each point gray value in the neighborhood of each pixel point of the image by adopting an average filtering algorithmPresetting an image as f (i, j), (i, j) as pixel points on the image, and the expression corresponding to the mean filtering is
Wherein M is the value range of the image pixel points covered by the calculation template, and n is the number of pixels contained in the neighborhood of the point (i, j) covered by the calculation template operator. The using process of the electronic stylus comprises the following steps:
s1: acquiring a gesture image and generating operation information of the electronic stylus according to the gesture image, wherein the operation information comprises a writing mode, a drawing mode and a control mode;
s2: generating adjusting information according to the operation information and the gesture image, wherein the adjusting information comprises the length of the electronic touch pen and the angle of the image acquisition module;
s3: when the electronic touch pen executes the operation information according to the adjustment information, acquiring a plurality of pressure information generated when the pen point is contacted with the touch input module, wherein the plurality of pressure information are respectively in one-to-one correspondence with at least two contact areas of the electronic touch pen contacted with the touch input module;
s4: and sending a plurality of pressure information to the electronic equipment, and generating corresponding input information by the electronic equipment according to the track information of the operation information executed by the electronic stylus contacting the touch input module and the plurality of pressure information.
It should be noted that, for a user with right-handed input, the operating hand of the pen input is the right hand, and the touch and space gestures can be operated by the left hand or the right hand. The electronic touch pen is used as a main input channel, a pen holding hand is required to be guaranteed to be the right hand of the user's tube, and on the basis of realizing accurate input by using the right hand pen, mixed input is realized by matching with left hand operation touch or space gestures, and the method comprises two distribution modes: the electronic touch pen can be connected with electronic equipment through Bluetooth or other wireless modes, and is further provided with an operation key so as to better replace the function of a mouse, the operation hand can be distributed according to the moving distance of a pen point, when the electronic equipment can definitely distinguish the input behaviors of touch and the pen, the position of touch operation can not be limited, and better input can be realized by utilizing the gesture of touch. In mixed input of touch control and a pen, the input attribute of the pen is controlled by utilizing the touch control, the area of an operation space is an operation surface of an interactive digital screen, namely a two-dimensional plane with a fixed size, the current operation plane is divided, the quantity of the input operable attribute can be expanded, the electronic equipment can store the interaction result written or controlled by a user for the first time, and the interaction result can be pushed when the user inputs the next time. The user can also switch pages or quickly play the electronic equipment through the electronic touch pen, so that the application range of the electronic touch pen is expanded.
Optionally, when the image acquisition module detects a gesture, a cartesian coordinate system is established, the origin of coordinates is at the center of the control module, the x-axis and the z-axis of the coordinate system are on the horizontal plane of the touch input module, the x-axis is parallel to the long side of the touch input module, the z-axis is parallel to the short side, and the y-axis of the coordinate system is perpendicular to the plane of the touch input module and is upward in the positive direction;
each frame of image acquisition of the image acquisition module calculates and updates a data set according to current image frame data, each frame of data comprises a data list, and when the image acquisition module detects a gesture, the control module allocates a first identifier to the current gesture;
if the image acquisition module does not acquire the gesture, the control module allocates a second identifier to the current gesture image, reads the hand attribute according to the first identifier and the second identifier and determines gesture information.
In this embodiment, the gesture information includes a static gesture and a dynamic gesture, the static gesture employs a combination of each finger joint and a bending state of the hand to realize gesture recognition, and the dynamic gesture recognizes different gestures through a spatial position change condition of the whole hand. Reading the hand attributes according to the first identification and the second identification and determining gesture information, wherein the method comprises the following steps:adopting a three-dimensional gesture tracking and evaluating algorithm to obtain an average Euclidean distance between the endpoint of the gesture in the gesture image and a real key point, wherein the expression of the endpoint error is
Wherein the default single hand has 21 joint points, i is the joint label number, D is the sample number of the data set, s is the sample number, w and h are the width and height of the original image, respectively, y si The true value of the tag is represented,
representing a predicted value; the percentage of true keypoints is PCK, the percentage of true keypoints for which the Euclidean distance error is below a threshold, expressed as
And delta is a threshold value, if the predicted value is smaller than the distance of the true value, the indication function delta is set to be 1, and if not, the indication function delta is set to be 0.
In another possible embodiment, the electronic stylus further includes a microprocessor built in the stylus, a wireless module, and a storage unit, the microprocessor mainly performs clock and instruction control on the flash memory, the storage unit is used for storing all static information and dynamic process power-off files, and the wireless module is used for implementing a real-time wireless transmission function by being connected to an electronic device. The electronic stylus storage process is as follows: firstly, information of electronic equipment receives information through a data line or receives a wireless carrier signal through a wireless antenna to a wireless module to complete adjustment, then the information is transmitted to a memory card interface control chip so as to control normal reading and writing of a clock and data, and the control chip stores an information file into a storage unit of the electronic touch pen through a storage interface. The transmission process of the touch pen is as follows: inserting a touch pen to be directly connected with the electronic equipment, and transmitting information between the touch pen and the electronic equipment in a moving or copying and pasting mode; or, the touch control pen is operated on a touch control input module, namely a screen, of the electronic equipment to control the touch control pen to send or receive data, when the touch control pen completes gesture operation on the screen, the control module of the electronic equipment judges whether to send or receive an instruction, and when the touch control pen sends the instruction, the control instruction from the electronic equipment needs to be received first, and then an information document needed by a user in the touch control pen is sent to the electronic equipment; upon receipt, the user may transmit an edit completion text, picture, or application process selection to the stylus.
According to the electronic touch pen input system, the image acquisition module, the pressure sensing module, the adjusting module and the transmission module are arranged in the miscellaneous pen shell, when the electronic touch pen is used, the image acquisition module acquires gesture information to determine operation information, the adjusting module adjusts the proper length of the electronic touch pen and the angle of the image acquisition module according to the operation information and gestures, a user can conveniently operate the electronic touch pen, the pressure sensing module can receive the pressure information to determine the touch area and the line thickness, the transmission module transmits the pressure information and track information formed by a pen point in the touch area to electronic equipment and displays corresponding input information on the touch input module, space gestures and touch are combined to achieve rapid input of multiple input types, interaction flexibility is improved, the problem of low touch identification accuracy caused by different hand structures is effectively solved, and therefore the use range of the electronic touch pen and the experience degree of the user are improved.
In all examples shown and described herein, any particular value should be construed as merely exemplary, and not as a limitation, and thus other examples of example embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The above examples are merely illustrative of several embodiments of the present invention, and the description thereof is more specific and detailed, but not to be construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention.
Claims (10)
1. An electronic stylus for inputting information to an electronic device via a touch input module, the electronic stylus comprising:
a pen shell;
a nib disposed at a first end of the pen housing;
the image acquisition module is arranged at the second end of the pen shell and used for acquiring a gesture image and generating operation information of the electronic touch pen according to the gesture image, wherein the operation information comprises a writing mode, a drawing mode and a control mode;
the adjusting module is connected with the image acquisition module and used for generating adjusting information according to the operation information and the gesture image, wherein the adjusting information comprises the length of the electronic touch pen and the angle of the image acquisition module;
the pressure induction module is arranged in the pen point and used for acquiring a plurality of pieces of pressure information generated when the electronic touch pen executes the operation information according to the adjustment information, wherein the plurality of pieces of pressure information are respectively in one-to-one correspondence with at least two contact areas of the electronic touch pen contacting the touch input module;
the transmission module is arranged in the pen shell, is connected with the pressure sensing module and is used for sending a plurality of pressure information to the electronic equipment, and the electronic equipment executes the track information of the operation information and generates corresponding input information according to the plurality of pressure information when the electronic stylus is contacted with the touch input module.
2. The electronic stylus of claim 1, wherein the pressure sensing module comprises:
the setting unit is used for setting a first line corresponding to the pressure information when the change value of the pressure information received by the pressure sensing module is smaller than a preset pressure value when the operation information is in a writing mode; when the operation information is in a drawing mode, and when the variation value of the pressure information is greater than or equal to the preset pressure, the setting unit sets a second line corresponding to the pressure information, wherein the width of the second line is greater than that of the first line.
3. The electronic stylus of claim 2, wherein the pressure sensing module comprises:
the conversion unit is connected with the setting unit and is used for converting the pressure information into a pressure value and sending the pressure value to the setting unit;
and the power supply unit is connected with the conversion unit and used for supplying power to each module in the pen shell.
4. The electronic stylus of claim 1, wherein the image capture module is configured to capture a gesture image and generate operational information of the electronic stylus from the gesture image, and comprises:
acquiring the number of fingers and the position of a palm in the acquired gesture image, wherein when the palm does not appear in the gesture image, the operation information is in a writing mode; when the number of the fingers is a single finger, the operation information is in a control mode; when the number of the fingers is multiple, the operation information is a drawing mode.
5. The electronic stylus of claim 1, wherein the trace information comprises a trace of a contact area movement or a click of a pen tip on the touch input module, the input information comprises an input type and a display color, and the input type comprises at least one of text, a picture, or a page.
6. An electronic touch pen input system of an electronic touch pen according to any one of claims 1-5, comprising the electronic touch pen and an electronic device which are wirelessly connected, wherein the electronic device comprises a gesture image preprocessing module, a touch input module and a control module, the gesture image preprocessing module receives gestures collected by an image collecting module and sent by a transmission module, the gestures are filtered to obtain gesture images, the control module generates operation information according to the gesture images, the control module sends the operation information to the touch input module to be displayed and adjusts the electronic touch pen, a pressure sensing module receives pressure information generated by contact between a pen point and the touch input module and sends the pressure information to the electronic device through the transmission module, and the control module generates corresponding input information according to trajectory information and the pressure information.
7. The electronic stylus input system of claim 6, wherein the execution of the gesture image pre-processing module comprises:
calculating the gray value of each point gray value in the neighborhood of each pixel point of the image by adopting a mean filtering algorithm, presetting an image as f (i, j), and (i, j) as the pixel points on the image, wherein the expression corresponding to the mean filtering is
Wherein M is the value range of the image pixel points covered by the calculation template, and n is the number of pixels contained in the neighborhood of the point (i, j) covered by the calculation template operator.
8. The electronic stylus input system of claim 6, wherein when the image capture module detects a gesture, a cartesian coordinate system is established with an origin of coordinates at a center position of the control module, an x-axis and a z-axis of the coordinate system on a horizontal plane of the touch input module, the x-axis being parallel to a long side of the touch input module, the z-axis being parallel to a short side, the y-axis of the coordinate system being perpendicular to the plane of the touch input module and being upward in a positive direction;
each frame of image acquisition of the image acquisition module calculates and updates a data set according to current image frame data, each frame of data comprises a data list, and when the image acquisition module detects a gesture, the control module allocates a first identifier to the current gesture;
if the image acquisition module does not acquire the gesture, the control module allocates a second identifier to the current gesture image, reads the hand attribute according to the first identifier and the second identifier and determines gesture information.
9. The electronic stylus input system of claim 8, wherein the gesture information includes static gestures and dynamic gestures, the static gestures employ a combination of finger joints and bending states of the hand to achieve gesture recognition, and the dynamic gestures recognize different gestures through spatial position changes of the entire hand.
10. The electronic stylus input system of claim 8, wherein reading hand attributes and determining gesture information based on the first and second identifications comprises:
adopting a three-dimensional gesture tracking and evaluating algorithm to obtain an average Euclidean distance between the endpoint of the gesture in the gesture image and a real key point, wherein the expression of the endpoint error is
Wherein the default single hand has 21 joint points, i is the joint label number, D is the sample number of the data set, s is the sample number, w and h are the width and height of the original image, respectively, y si The true value of the tag is represented,
representing a predicted value;
the percentage of true keypoints is PCK, the percentage of true keypoints for which the Euclidean distance error is below a threshold, expressed as
And delta is a threshold value, if the predicted value is smaller than the distance of the true value, the indication function delta is set to be 1, and if not, the indication function delta is set to be 0.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211281031.XA CN115494971B (en) | 2022-10-19 | 2022-10-19 | Electronic touch pen and input system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211281031.XA CN115494971B (en) | 2022-10-19 | 2022-10-19 | Electronic touch pen and input system thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115494971A true CN115494971A (en) | 2022-12-20 |
| CN115494971B CN115494971B (en) | 2024-11-05 |
Family
ID=84474829
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211281031.XA Active CN115494971B (en) | 2022-10-19 | 2022-10-19 | Electronic touch pen and input system thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115494971B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118210390A (en) * | 2024-04-03 | 2024-06-18 | 东莞市意志强塑胶五金有限公司 | Touch monitoring method and system of capacitive stylus |
| CN118394229A (en) * | 2024-04-22 | 2024-07-26 | 深圳市左木科技有限公司 | Intelligent touch pen interaction method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105278704A (en) * | 2014-07-17 | 2016-01-27 | 致伸科技股份有限公司 | Stylus |
| CN105718079A (en) * | 2014-12-18 | 2016-06-29 | 苹果公司 | Stylus With Touch Sensor |
| KR20160148959A (en) * | 2015-06-17 | 2016-12-27 | 엘지전자 주식회사 | Mobile terminal and method for controlling the same |
| CN107533397A (en) * | 2015-04-09 | 2018-01-02 | 株式会社和冠 | Method, system, sensor controller and the active stylus of active stylus and sensor controller are used |
| CN108490735A (en) * | 2016-02-23 | 2018-09-04 | 深圳晶源信息技术有限公司 | The method, apparatus and computer-readable medium that full chip mask pattern generates |
| CN109960404A (en) * | 2019-02-15 | 2019-07-02 | 联想(北京)有限公司 | A kind of data processing method and device |
| CN213545237U (en) * | 2020-12-15 | 2021-06-25 | 维沃移动通信有限公司 | Touch control pen and electronic equipment |
-
2022
- 2022-10-19 CN CN202211281031.XA patent/CN115494971B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105278704A (en) * | 2014-07-17 | 2016-01-27 | 致伸科技股份有限公司 | Stylus |
| CN105718079A (en) * | 2014-12-18 | 2016-06-29 | 苹果公司 | Stylus With Touch Sensor |
| CN107533397A (en) * | 2015-04-09 | 2018-01-02 | 株式会社和冠 | Method, system, sensor controller and the active stylus of active stylus and sensor controller are used |
| KR20160148959A (en) * | 2015-06-17 | 2016-12-27 | 엘지전자 주식회사 | Mobile terminal and method for controlling the same |
| CN108490735A (en) * | 2016-02-23 | 2018-09-04 | 深圳晶源信息技术有限公司 | The method, apparatus and computer-readable medium that full chip mask pattern generates |
| CN109960404A (en) * | 2019-02-15 | 2019-07-02 | 联想(北京)有限公司 | A kind of data processing method and device |
| CN213545237U (en) * | 2020-12-15 | 2021-06-25 | 维沃移动通信有限公司 | Touch control pen and electronic equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118210390A (en) * | 2024-04-03 | 2024-06-18 | 东莞市意志强塑胶五金有限公司 | Touch monitoring method and system of capacitive stylus |
| CN118394229A (en) * | 2024-04-22 | 2024-07-26 | 深圳市左木科技有限公司 | Intelligent touch pen interaction method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115494971B (en) | 2024-11-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8604364B2 (en) | Sensors, algorithms and applications for a high dimensional touchpad | |
| US8577100B2 (en) | Remote input method using fingerprint recognition sensor | |
| CN115494971B (en) | Electronic touch pen and input system thereof | |
| US20060028457A1 (en) | Stylus-Based Computer Input System | |
| US20060119588A1 (en) | Apparatus and method of processing information input using a touchpad | |
| CN102253746B (en) | Information processing method and equipment for electronic equipment with touch screen | |
| KR20130088104A (en) | Mobile apparatus and method for providing touch-free interface | |
| US8884930B2 (en) | Graphical display with optical pen input | |
| US20120249417A1 (en) | Input apparatus | |
| Matulic et al. | Pensight: Enhanced interaction with a pen-top camera | |
| US20120162061A1 (en) | Activation objects for interactive systems | |
| US7460111B2 (en) | Computer input device | |
| JP2015035103A (en) | Information processing device and program | |
| CN106648152B (en) | It is a kind of to be based on rotation angle and the three-dimensional pen-based interaction interface Zoom method of distance | |
| WO2007088430A1 (en) | System, device, method and computer program product for using a mobile camera for controlling a computer | |
| CN114816135B (en) | Cross-device drawing system | |
| CN114816088A (en) | Online teaching method, electronic equipment and communication system | |
| CN210573714U (en) | Erasing device of electronic whiteboard | |
| EP1244954A1 (en) | Written command | |
| JP5256700B2 (en) | Terminal device and program thereof | |
| CN100394373C (en) | Application execution method and apparatus employing pointing device | |
| CN113010130B (en) | Remote large-screen interaction control method based on image stream | |
| JP5305256B2 (en) | Terminal device and program thereof | |
| CN108803898B (en) | Combined intelligent wireless finger input device, system and control method thereof | |
| EP2669766B1 (en) | Graphical display with optical pen input |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |