WO2012148232A2

WO2012148232A2 - Aircraft instrument display system and method thereof

Info

Publication number: WO2012148232A2
Application number: PCT/KR2012/003322
Authority: WO
Inventors: 김기일; 현세웅; 이충재
Original assignee: 경상대학교 산학협력단
Priority date: 2011-04-28
Filing date: 2012-04-27
Publication date: 2012-11-01
Also published as: KR101242432B1; KR20120122308A; WO2012148232A3

Abstract

The present invention relates to an aircraft, and more specifically, to an aircraft instrument display system which automatically recognizes the facial image of a pilot to verify the identity of the pilot, and then displays and memorizes the instrument arrangement preferred by the pilot, and a method thereof. To this end, the present invention comprises: a photographing device which recognizes the facial image of a pilot and extracts the characteristics of the image to generate a template; and a control device which receives the template to verify the identity of the pilot, and memorizes and displays the instrument arrangement preferred by the pilot.

Description

Aircraft instrument display system and method

The present invention relates to an aircraft instrument display system and a method for displaying and learning a pilot's preferred instrument array after the automatic recognition of identity of the pilot's face image, and more particularly.

In recent years, the aviation industry has been actively growing. As a result, the number of aircraft pilots is increasing. However, conventionally, when manipulating an aircraft, the instrument panel is fixed, and there is inconvenience that each pilot must adapt to the fixed instrument panel. Such inconvenience caused a large accident in case of causing a momentary mistake in a device that operates at a high speed such as an aircraft.

In other words, the left-handed pilot has a problem in that he / she may experience a disruption in response to an instantaneous emergency situation while looking at the instrument panel fixedly arranged for the right-handed.

On the other hand, there is a problem that the procedure is complicated in the case of authenticating the pilot in case the uncertified pilot controls the aircraft.

In addition, the fixed instrument panel had a problem that it takes time to cope with an emergency because it takes time to check the instrument required by the pilot.

Therefore, there is an urgent need for a means for rapidly coping with emergency situations and reducing pilot fatigue in ultrafast vehicles such as aircraft.

The present invention has been made to solve the problems of the prior art as described above, the object of the present invention, in particular, aircraft instrument display system and method for automatically authenticating the pilot to learn and load the preferred instrument arrangement of the pilot To provide.

To this end, the aircraft instrument display system according to the present invention recognizes a pilot's face image, extracts features of the image, generates a template, and receives the template to check the identity of the pilot, A controller for learning a pilot's preferred instrument arrangement and displaying the instrument's preferred instrument arrangement.

The imaging device may include an imaging unit for photographing a pilot's face, a detection unit for receiving the face image and separating the image into respective components, a correction unit for correcting the separated image of the component, and generating a template from the corrected image. And a generating unit for transmitting the generated template.

The component includes a face shape, eyes, nose and mouth.

The instrument includes an altimeter, speedometer and magnetic world.

The learning identifies the frequency and placement position at which the pilot moves, enlarges or reduces the instrument.

The control device includes a receiving unit for receiving the template, a comparison unit for extracting a matching template by comparing the template with a plurality of pre-stored templates, a display unit for displaying instrument arrangement information corresponding to the extracted template, and the instrument of the pilot. It includes a learning unit for learning the array to store the preferred instrument array information.

The apparatus may further include a storage unit including the plurality of templates and the instrument arrangement information corresponding to the plurality of templates, respectively.

The display unit includes a touch pad that recognizes the pilot's touch.

To this end, an aircraft instrument display method according to the present invention includes an imaging process of photographing a pilot's face, a detection process of receiving the face image and dividing it into respective components, a correction process of correcting an image of the separated component, and correction. A generation process of generating a template from the image, a transmission process of transmitting the generated template, a reception process of receiving the template, a process of extracting a matching template by comparing the template with a plurality of pre-stored templates, and the extracted process A display process of displaying instrument arrangement information corresponding to a template, and a learning process of storing the instrument arrangement information of the pilot by learning the instrument arrangement of the pilot.

According to various embodiments of the present disclosure, the pilot is automatically recognized and authenticated, thereby improving the security of the aircraft.

In addition, according to various embodiments of the present invention, there is also an effect of facilitating the pilot's control of the aircraft by automatically learning and displaying the pilot's preferred instrument arrangement.

According to various embodiments of the present invention, by ultimately facilitating the pilot's control of the aircraft, there is an effect that can reduce the fatigue and stress of the pilot and can be agile even in an emergency.

1 is an exemplary view for showing an aircraft instrument display system according to an embodiment of the present invention as an example.

Figure 2 is an exemplary view for showing in detail the imaging device 110 of the aircraft instrument display system 100 of Figure 1 according to an embodiment of the present invention.

Figure 3 is an exemplary view for showing in detail the control device 120 of the aircraft instrument display system 100 of Figure 1 according to an embodiment of the present invention.

4 is an exemplary screen illustrating an example of a meter pattern according to an embodiment of the present invention.

5 is a flow chart showing an aircraft instrument display method according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings will be described in detail the aircraft instrument display system and method according to an embodiment of the present invention.

The same reference numerals are used for the same members in FIGS. 1 to 4.

The basic principle of the present invention is to identify the identity of the pilot's face image to learn the instrument arrangement preferred by the pilot to display the instrument automatically.

In addition, in describing the present invention, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

Referring to FIG. 1, the aircraft instrument display system 100 according to an exemplary embodiment of the present disclosure recognizes a face image of a pilot, extracts features of the image, and generates a template, and the template. Receiving a confirmation of the identity of the pilot, learning the preferred instrument arrangement of the pilot, and includes a control device 120 for displaying the instrument arrangement preferred by the pilot.

Referring to the aircraft instrument display system according to an embodiment of the present invention configured as shown in Figure 1 in detail as follows.

First, the imaging apparatus 110 separates the recognized pilot's face image for each component, and generates a template by correcting the separated image.

The components of the facial image here include the pilot's face shape, eyes, nose and mouth.

The imaging device 110 transmits the generated template.

Then, the control device 120 receives the template and compares it with a plurality of pre-stored templates to select the template that most matches.

Here, the plurality of previously stored templates are information stored after generating a template by dividing the face images of the pilots by components.

In addition, the plurality of pre-stored templates include unique instrument array information learned and stored for each pilot.

Therefore, the control device 120 displays the instrument arrangement information according to the selected template.

The pilot can then zoom in and out or relocate the displayed instrument array to the instrument of their choice.

In other words, the relocated gauge array is updated with the gauge array information of the selected template.

The instrument arrangements thus rearranged by the pilot are learned.

Here, the display is preferably configured to include a touch pad that can recognize the pilot's touch.

The imaging device 110 and the control device 120 according to an embodiment of the present invention will be described in detail with reference to FIGS. 2 to 3.

2 is an exemplary view for showing in detail the imaging device 110 of the aircraft instrument display system 100 of FIG. 1 according to an embodiment of the present invention.

Referring to FIG. 2, the imaging apparatus 110 according to an exemplary embodiment of the present invention includes an imaging unit 111 for imaging a pilot's face, a detection unit 112 for receiving a face image, and separating the components into respective components. A correction unit 113 for correcting an image of the component, a generator 114 for generating a template from the corrected image, and a transmitter 115 for transmitting the generated template.

The operation of the imaging device 110 according to an embodiment of the present invention configured as shown in FIG. 2 will be described in detail as follows.

First, the imaging unit 111 is configured to include a lens for imaging the pilot's face.

That is, it is preferable that the imaging part 111 is a camera. Then, the detector 112 receives the face image picked up by the imaging unit 111 and separates the components into respective components.

Preferably, the components of the facial image include facial contours, eyes, nose, and mouth constituting a human face.

For example, the detector 112 separates the transmitted facial image into a facial contour, an eye, a nose, and a mouth. The correction unit 113 then corrects the components separated into facial contours, eyes, noses, and mouths.

For example, when correcting an image of a separated eye, the eye image can be positioned in the center of the screen, and the information area can be corrected in binary style by dividing the area with information as '1' and the area without information as '0'. have.

The image separated and corrected into the facial contour, eyes, nose, and mouth as described above is generated as a template by the generation unit 114.

The transmitter 115 transmits the generated template. That is, the imaging device 110 takes a pilot image and separates it for each component, and then corrects and generates and transmits a template to be compared later.

3 is an exemplary view for showing in detail the control device 120 of the aircraft instrument display system 100 of FIG. 1 according to an embodiment of the present invention.

Referring to FIG. 3, the control device 120 according to an embodiment of the present invention compares the received template with the template 121 transmitted from the transmitter 115 of FIG. 2, and compares the received template with a plurality of previously stored templates. A comparator 122 for extracting a matching template, a display unit 123 for displaying gauge array information corresponding to the extracted template, and a learner 124 for learning a pilot array of pilots and storing preferred gauge array information. It includes, and further comprises a storage unit 125 stores a plurality of templates and the resulting instrument arrangement information.

Referring to the operation of the control device 120 according to an embodiment of the present invention configured as shown in Figure 3 in detail as follows.

First, the receiver 121 captures a face image of a specific pilot in the imaging device 110, separates it for each component, and then receives a generated template.

Thereafter, the comparison unit 122 compares the received template with a plurality of templates previously stored in the storage unit 125 and extracts the most similar template.

In this case, the aircraft manager may set a threshold of the degree of correspondence between the templates.

For example, if the degree of agreement is less than 60%, the pilot is not authorized to control the instrument information is not loaded and can not control the aircraft.

In addition, the comparison unit 122 confirms the identity of the pilot, if there is a matching template in the storage unit 125, and transmits the instrument arrangement information of the pilot corresponding to the matching template.

The display unit 123 receives and displays instrument arrangement information.

Here, the template of pilots stored in the storage unit 125 includes preferred instrument arrangement information for each pilot.

Thus, if the operator is authenticated, the instrument array information is displayed.

The pilot can then view the device array information and set the preferred array without further action.

If the pilot wants to change the device arrangement information, the touch screen provided in the display unit 123 may be touched to enlarge and reduce the device and move the position.

In this case, the learning unit 124 learns the instrument arrangement information of the pilot.

In other words, the instrument array that the pilot set up can be memorized and loaded on the next flight, and the instrument can load the instrument on the next flight by calculating the arithmetic mean of the frequency of the scaled-up and shifted instruments.

4 is an exemplary screen illustrating an example of an instrument pattern according to an embodiment of the present invention.

Referring to FIG. 4, the gauge 12 in the gauge 1 of the aircraft may be moved on the screen.

For example, gauge 1 and gauge 12 may be repositioned from each other by the touch of a pilot. In addition, gauge 2 may be enlarged like gauge 6, and gauge 10 may be reduced like gauge 7.

That is, the pilot can reposition the instruments to their tastes and resize each instrument. As a result of the pilot's rearrangement and adjustment of the instrument, the instrument placed by the pilot is stored after determining that the frequent arrangement is the pilot's preferred arrangement, and when the pilot is later certified for flight, the instrument array arranged by the pilot is loaded. .

The pilot can then artificially store his or her favorite instrument array and load the instrument array that he has saved from the next flight.

5 is a flowchart showing an aircraft instrument display method according to an embodiment of the present invention.

Referring to FIG. 5, an aircraft instrument display method 500 according to an embodiment of the present invention includes an imaging process of photographing a pilot's face (S510), and a detection process of receiving the photographed face image and separating the components into respective components ( S520), a correction process of correcting the image of the separated component (S530), a generation process of generating a template from the corrected image (S540), a transmission process of transmitting the generated template (S550); Receiving process of receiving a template (S560); Comparing the received templates with a plurality of pre-stored templates and extracting a matching template (S570); A display process 580 for displaying the instrument arrangement information corresponding to the extracted template, and a learning process S590 for learning the instrument arrangement of the pilot and storing the preferred instrument arrangement information.

5 is described in detail with reference to the aircraft instrument display method 500 according to an embodiment of the present invention.

First, the pilot's face is imaged (S510).

After receiving the facial image is separated into each component (S520)

Preferably each component comprises a facial contour, eyes, nose, mouth and the like that make up the facial image.

The image of the separated components is corrected (S530).

Herein, the correction of the image is described as follows.

First, in the case of correcting an image of an eye, the eye image is positioned at the center of the screen, and then, the area with the image information is generalized as '1', and the area without the information is generalized as '0'.

In other words, it binarizes the image of the eye.

The template is generated from the corrected image (S540).

Thereafter, the generated template is transmitted (S550) and received (S560).

The received template is compared with a plurality of pre-stored templates to extract a matching template (S570).

In operation 580, the instrument array information corresponding to the extracted template is displayed.

Preferably, the display means for displaying the instrument arrangement information includes a touch screen that can recognize the touch of the pilot.

The instrument arrangement thus displayed can be enlarged, reduced and repositioned by the touch of the pilot.

Then, the pilot arrangement of the instrument to learn and store the preferred instrument arrangement information (S590).

As described above, although the present invention has been described with reference to the limited embodiments and the drawings, the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.

Claims

An imaging device for recognizing a face image of a pilot, extracting features of the face image, and generating a template; And

Receiving the template to confirm the identity of the pilot, the controller for displaying the instrument arrangement preferred by the pilot; aircraft instrument display system comprising a.
The method of claim 1, wherein the imaging device

An imaging unit for imaging the pilot's face;

A detector configured to receive the face image and separate the components into respective components;

A correction unit correcting an image of the separated component;

A generation unit generating a template from the corrected image; And

And a transmitter for transmitting the generated template.
The method of claim 1, wherein the control device

The aircraft instrument display system, characterized in that for learning the instrument arrangement preferred by the pilot according to the change history of the instrument arrangement state changed by the pilot.
The method of claim 1, wherein the meter

Displayed on the touch pad, the control unit checks at least one of the display of the instrument on the touch pad, the position change, the shape change, the color change, the frequency of use of each instrument to remind the final instrument arrangement state Aircraft instrument display system, characterized in that the pilot determines the preferred instrument arrangement.
The method of claim 1, wherein the control device

Receiving unit for receiving the template;

A storage unit including the plurality of templates and the instrument arrangement information corresponding to the plurality of templates, respectively;

Extracting and comparing a template by comparing the template and the plurality of templates stored in the storage unit;

A display unit for displaying instrument arrangement information corresponding to the extracted template; And

Learning unit for learning the instrument arrangement of the pilot to store the preferred instrument arrangement information; aircraft instrument display system comprising a.
The instrument of claim 1, wherein the instrument is

An aircraft instrument display system comprising an altimeter, speedometer, and own world.
An imaging process of imaging the pilot's face;

A detection process of receiving the face image and separating the components into respective components;

A correction process of correcting the image of the separated component;

Generating a template from the corrected image;

An extraction process of comparing the template with a plurality of pre-stored templates and extracting a matching template;

A display process of displaying instrument arrangement information corresponding to the extracted template; And

Learning process for storing the preferred instrument arrangement information by learning the instrument arrangement of the pilot; aircraft instrument display method comprising a.