GB2580861A

GB2580861A - Improving driver emergency responses in autonomous vehicles

Info

Publication number: GB2580861A
Application number: GB1816815.3A
Authority: GB
Inventors: Alexander Courtney William
Original assignee: Individual
Current assignee: Individual
Priority date: 2018-10-16
Filing date: 2018-10-16
Publication date: 2020-08-05
Also published as: GB201816815D0

Abstract

A display system comprises at least one screen 2 which displays information, entertainment or media in autonomous mode, but shows real-time driving hazards (Fig.5) as they arise and simultaneously transfers control from the artificial intelligence (AI) autonomy to a human driver for manual input when the vehicle detects safety critical driving decisions, thus improving safety of autonomous road vehicles. The display screen may overlay part of the windscreen 1, be mounted above the dashboard or suspended from the roof or upper windscreen area, may incorporate a thumbnail view, and may be coupled to a forward looking camera. The system may include a training mode, driver and airbag sensors and a speaker 11 for alerts, a keyboard 3, joystick or touch screen mounted in front of the driver on the steering wheel 5, which can remain stationary relative to the driver. The steering wheel 5 can take many forms. Information, entertainment and vehicle control can be achieved via wireless technology.

Description

Improving driver emergency responses in autonomous vehicles

Technical field

This invention relates to improvements in the safety of autonomous road vehicles. It reduces the driving hazards that can arise during the transition of vehicle control from the vehicles artificial intelligence to a human driver. According to the invention there exists a system for reducing the risks during the transfer of safety critical driving decisions from the artificial intelligence of autonomous vehicles to human drivers when the complexity of decision making becomes too difficult for the artificial intelligence to cope with, comprising at least one electronic display screen or monitor, preferably mounted above the dashboard or suspended from a support in the car roof interior or at the top of the front windscreen and coupled to a forward looking camera for collecting live image data about the road ahead and a computer keyboard preferably mounted on a platform adjacent to or in front of the spokes of the steering wheel or other steering device such as a joystick or touch screen mounted in front of the driver, with the keyboard remaining stationary relative to the driver, even if the steering wheel turns or other steering device is moved by the artificial intelligence steering system, characterised by the screen being used to display information for the passive driver in a manner similar to existing laptop or tablet computers or smartphones, but with the existing display being switched off and preferably replaced by a real time image of the road ahead when the onboard artificial intelligence system decides to hand over control to the human driver.

Brief description of the drawings

Figure 1 depicts the view of the invention seen by the driver when looking towards the front windscreen. The vehicle is being driven autonomously and text of interest to the driver is displayed on the computer screen.

Figure 2 depicts the view of the invention seen by the driver when looking towards the front windscreen. The vehicle is being driven by the driver and a life-size view of part of the road ahead is displayed on the computer screen.

Figure 3 illustrates a version of the invention where the platform is be mounted on a tube (depicted as going into the page) and running smoothly on a track concentric with the airbag cover.

Figure 4 depicts a version of the invention where the steering wheel has 24 thin radial spokes.

Figure 5 illustrates a version of the invention that includes a conventional torus shaped steering wheel but with the central steering column being eliminated. It is replaced by a steering wheel rim gripping and rotational displacement detecting system that is mounted on or close to the dashboard.

Figure 6 illustrates a version of the invention that has some features in common with that depicted in Figure 5, but with the steering wheel being replaced by a frame that does not rotate. Instead, a flexible loop of material rides on the outside rim of the frame and can be moved round the frame in a similar manner to turning a conventional steering wheel.

Figure 7 illustrates a version of the invention with a keyboard as in Figure 1, but with the monitor or display screen being parked under the vehicle interior roof when not required but sliding forward and down towards the middle of the windscreen.

Figure 8 illustrates another version of the invention where the monitor or display screen is suspended from the vehicle interior roof, but in a manner similar to existing two hinged pull down sunshades.

Disclosure of the invention

The Society for Automotive Engineers International uses a 0-5 scale of autonomy for motor ehicles. At level 0 the vehicle is completely driver controlled and at level 5 there is no driver, with artificial intelligence (Al) taking even the most critical safely decisions.

From the human driver perspective, the most challenging stage of development is level 3 where the vehicle can be driven autonomously under certain conditions, for example on uncluttered, pedestrian and cyclist free roads. But crucially at level 3, the driver is always available to take command of the decision making when the information flow into the system reaches a level of complexity that the AI cannot process it in an unambiguous manner.

The conventional automobile engineering assumption is that the biggest problem posed by level 3 autonomy is likely to be keeping the driver awake and alert so that they are ready to take control of the vehicle. The corresponding engineering solution is to provide stimuli such as warning sounds if driver monitoring electronic devices detect that the driver is falling asleep.

The present invention recognises that such 'verge of sleep' detection systetns are inadequate because they fail to address the far wider range of problems that drivers of level 3 vehicles are likely to encounter when changing from passive to active driving mode during an emergency. Several of these problems are relatively minor when considered individually, but if two or more arise at the same time during the handover to driver control, the consequences could be catastrophic.

Here is a list of the principal new driving challenges for level 3 vehicle drivers that today's law abiding drivers of less sophisticated level 0 to 2 vehicles do not face.

(i) A serious problem with level 3 autonomy is that it relaxes many drivers and lulls them into a false sense of security because the AT appears to be so clever. Relaxed, trusting drivers will tend to be incredulous and have a slow reaction time when responding to emergencies, especially if they have been preoccupied with non-driving activities in the moments preceding the emergency. This time loss will be enhanced if they are reluctant to drop an important or expensive item that they are holding when called to take control of their vehicle. In the worst case scenario, the driver is holding a rigid object, for example a tablet computer in the line of expansion of the driver's airbag when it is deployed during a crash. In this case the airbag itself becomes a hazard because it can thrust the tablet at great speed into the drivers face.

(ii) When freed from the responsibility and mental stimulation of driving, even conscientious drivers are more likely to fall asleep at the wheel. The 'waking up systems' currently being developed often fail to recognise that the driver may be technically awake, but still slow to respond during an emergency because their hands and eyes are not in a 'ready to respond' position.

(iii) Over-polite drivers using mobile phones may waste valuable critical decision making time if they feel obliged to apologise before ending an important telephone conversation in an emergency.

(iv) Older drivers commonly experience a delay in refocusing their eyes to different distances. The default position of healthy young eye lens systems is that they are effectively focussed on infinity, which is the required focus for driving. Muscles in the eye allow the eye lenses to change shape to focus on closer objects. The greatest stress is placed on the eye lens and ciliary muscles when focusing on fairly small print' size, as found in books or on small smartphone screens.

These muscle and eye lens system slows down its response time as the eye lenses age and lose elasticity. So older drivers who have spent some time reading a book or a small screen will have difficulty in quickly refocusing their eyes for safe driving work.

(v) About 30% of UK, 40% of American and 90% of Chinese drivers need to wear driving glasses because they are myopic (nearsighted). A compensating benefit of this problem is that, if they take their driving glasses off, they can see very small print clearly compared with a person with normal vision because they can hold small print material closer to their eyes. This has two consequences; they rarely need reading glasses as they get older and, compared with normal sighted people, they tend to hold small print reading material closer their eyes. In an emergency their good near sight vision may cause problems. When called upon to act urgently they may become flustered, mislaying their driving glasses or failing to put them on.

The converse is true for older drivers with normally aging eyesight who do not require driving glasses, but need reading glasses for close reading work. In an emergency, they may fail to remove their reading glasses, causing them to drive with impaired vision.

(14) The sudden head movements involved when changing from a prolonged looking down position, as commonly adopted for small screen or hook reading to the horizon looking position required for driving can cause dizziness and disorientation (benign paroxysmal positional vertigo), temporarily impairing clear thinking driving performance.

(vii) The brightness of objects viewed inside a vehicle is lower than that of a daylight lit road. The contrast is greatest if the vehicle has tinted windows and intense sunlight is being reflected from a light coloured road. To see clearly in the darker interior conditions the pupils open up. The pupils then shrink, to reduce the amount of light entering the eye when looking at a brightly lit road. But if the driver is suffering from light sensitivity (Photophobia) the pupils will be slow to respond when the driver has to adapt to bright light. As a result they will be dazzled and temporarily blinded. Photophobia is brought about by a foreign body in the eye, eye infections, hay fever and other conditions.

(viii) Stage 3 autonomous vehicle drivers are more prone to motion or travel sickness compared with fully engaged drivers of less sophisticated vehicles. Travel sickness is commonly caused by conflicting signals being sent to the brain by the eyes and the inner ears which control orientation and balance. It can also be triggered by anxiety. The driver is likely to be anxious in anticipation of being called upon to take emergency action, but is also likely to be preoccupied by looking down at a book, newspaper or electronic display screen. In these circumstances the visual information tells the brain that the body is sifting still. However, the inner ear tells the brain that the body is moving. This is because the inner ear acts in the manner of a tri-axial accelerometer, detecting angular and linear accelerations caused by the movement of the vehicle. Work on autonomous vehicle simulators suggests that the driver's lack of ability to predict the direction of vehicle movements also contributes to motion sickness.

An illustrative example of how the present in minimises these hazards will now be revealed. It is to be understood that this example in no way limits the scope of the invention.

Figure I depicts the view seen by the driver when looking towards the section of the front windscreen I facing them. Item 2 is an electronic display screen or monitor which acts in the manner of a conventional computer display screen. The screen is depicted as displaying a short section of text [he screen occupies the position shown when Al is steering the vehicle. It can be sufficiently wide to simultaneously provide laptop computer and smartphone displays. It can be folded down against the dashboard or otherwise lowered when not required. This folding or lowering process can be automated. The screen may also have a cowling that shades the display. Skilled designers will be able to design sprung flexible cowlings that shield the screen but collapse when the screen is lowered.

Viewing a computer monitor tends to be less stressful on the eye's ciliary muscles and lenses compared with viewing a small smartphone screen or reading a book because the display can be larger and the screen is usually further from the driver's eyes. So the eye lenses are less compressed and the muscles are more relaxed.

Another benefit of reading a computer screen rather than a book in weak daylight conditions, especially later in the day when the natural light colour temperature is lower (i.e., towards the red end of the spectrum) is that the light emitted from electronic display screens is blue (short wavelength) enriched compared with low colour temperature daylight. So reading a display screen allows more blue light to enter the eye than when reading a book or other document. This additional blue light helps to prevent the pineal gland from releasing melatonin. For driving purposes in dull lighting conditions this is a bonus, because the release of melatonin helps the body to prepare for sleep.

Item 3 is similar to a conventional computer keyboard. For night time travelling it may be fitted with internal illumination that lights up the keys. This is mounted on a platform 4 that is raised clear of the spokes of the steering wheel 5. A hinge 6 at the end of the platform away from the driver couples the platform to a stout support 7 firmly attached to the dashboard. Where the platform passes over the steering wheel there may he sufficient clearance for part of the driver's hands to pass under the platform when holding the steering wheel. Using known methods, the precise position of the platform may be altered to accommodate different positions of the steering wheel. In addition, the keyboard may rest in an inclined well in the platform so that it is approximately horizontal. The other end of the platform, close to the driver is supported by a plurality of legs, for example 8 and 9. The ends of these legs run freely over a shallow track in the steering wheel I0, allowing the steering wheel to turn while the legs remain stationary. Skilled engineers will be aware of the options available for ensuring this freedom of movement including the use of roller bearings and the use of low friction surface coatings. For versions of the invention where there is a permanent coupling between the steering wheel and the steering gearbox, the juxtaposition of the stationary keyboard and the steering wheel that turns on bends provides the driver with feedback on the direction of travel of the vehicle.

At the keyboard end, the platform can be extended over but clear of the steering wheel and fitted with a length of cushioning material to provide a wrist support for the driver when typing. Some drivers will find this useful, but others will dislike it, because it reduces the length of the circumference of the steering wheel that they can grip To cater for both types of driver, this platform extension can be detachable.

A loudspeaker 11 is used for sounding alerts and other audio purposes. Item 12 is a microphone. The linked personal computer system is effectively fully functional, offering all of the features and applications commonly provided by desktop, laptop and other common forms of personal computer. The computer system also allows the invention to cover the full range of telecommunication and social media features offered by smartphones, encouraging the driver to use the computer system instead of these devices.

The alternative to using a standard computer mouse is to use a trackball 13 and a plurality of buttons such as 14 that perform equivalent functions to those on a computer mouse. To accommodate the needs of left and right handed drivers, an equivalent set of buttons and trackball can be added on both sides of the keyboard.

The platform mounting may include a horizontal rail, allowing the platform to be lifted and slid to the side of the steering wheel when not required.

The top end of the platform bridge prevents the driver gripping the steering wheel at its highest point. This is a useful safety bonus, because a driver holding the wheel at this point can suffer horrific arm injuries if the airbag deploys.

When not using the keyboard, the driver's hands are likely to be resting on the steering wheel.

The invention extends to cover the inclusion of sensors that detect and take remedial action if the steering wheel airbag is covered by any item such as a laptop computer. Such remedial action includes the sounding of an alarm if the a substantial object is placed close above the driver's airbag for more than a few moments, with the vehicle being brought to a safe halt if the object is not removed.

It is to be understood that the invention extends to include electronic displays that are built into the vehicle windscreen, displays that are projected onto the windscreen and displays close to the driver's eyes in the manner of a virtual reality headset.

The screen may also provide a small or thumbnail view of the road as seen by a roof mounted camera. This improves the driver's ability to predict the vehicles movements when under Al control. For example, they can expect the vehicle to slow down if it is catching up on a vehicle in front but there is no room to overtake on the outside lane. The invention includes a setting that only switches the thumbnail image on when the vehicle accelerates, brakes or turns.

There may also be a plurality of displays. For example a pull-down sunshade that reduces light entering the front windscreen may also include a screen. Also, according to the invention a screen on a roof mounted putdown sun shade may replace the dashboard mounted monitor.

It is also to be understood that keyboard may also be in any location in close proximity to the steering wheel. So, for example, it may be mounted on a pullout tray that is accessed below the steering wheel just above the drivers lap. The keyboard may take the form of any manner known to design engineers and is not restricted to the qwerty layout. It may for example include keys incorporated into the rim of the steering wheel.

Other known computer linked devices such as a hand writing recognition tablet that clips over the keyboard and a document scanner can also be added. The common aim of including all of these devices is to maximise the probability that the driver will use the present invention in preference to alternatives such as unconnected laptop computers which are perfectly safe in a normal office setting, but reduce the alertness of drivers in level 3 autonomous vehicles as discussed earlier in this patent application. In order to reduce manufacturing costs and to improve portability and security, the personal computer features may be assessed from a coupled laptop, tablet or other form of portable computer. The coupling may be achieved using cables, Bluetooth or other forms of electronic device communication known to engineers. Likewise, smart-phone features may be accessed through the computer by adding a coupled conventional stnartphone. In order to further reduce costs the monitor may he used to display the standard information commonly displayed o electronic on screens in modern vehicles, for example route information maps. For use according to the invention, the monitor is preferably viewed above the steering wheel. When not required for this purpose and used for standard driver information displays, the monitor may be lowered, so that the driver views the screen below the upper rim of the steering wheel.

Drivers interacting with their laptops or mobile phones provide several clues that they are awake. "These clues are easier to record if they are all integrated into one system, as in the present invention. For example clues can be detected when they use the keyboard, scroll though displayed information and speak into their phones. To distinguiSh the driver's voice from that of other occupants of the vehicle, the system includes voice recognition software. This also allows the AI to detect that the driver is awake if they are singing along to the tunes of an in-vehicle music system. Accessing these information inputs through the onboard computer simplifies the task of detecting when the driver has stopped using them, suggesting that they have fallen asleep. It also simplifies the detection of eye and eyelid movements using known inventions because a driver looking in the direction of an onboard display system requires head and body movements over a smaller solid angle compared with drivers carrying out a wide range of tasks involving looking at books, magazines, phones, laptops and tablet computers. A design aim of the present invention is not only to provide an alternative to the use of existing electronic devices, but to make the new alternative more appealing. Several factors contribute to the enhanced appeal of the invention including the integration of computer and telecommunication systems, the conveniently placed keyboard and the large screen compared with smartphones. If these electronic devices are being run on battery power, then the time between charges can b eased because their display screens, microphones and loudspeakers are not being used.

According to the invention, the non-driving computer and communication services described above can only normally he accessed when the AI system is able to drive the vehicle within its limits as decided upon by the manufacturer. When the system concludes that it has reached its safe limits of operation it saves the current electronic device settings and work, sends an apology message to anyone in remote communication with the driver and immediately changes its screen display to show a view of the road ahead. Taking the decision to close down remote communications out of the hands of the driver solves a politeness and respect problem because in human perception terms, the computer 'has to take the blame' for any abrupt interruptions in communications. This perceived blame shifting could save several seconds when over-polite drivers are communicating with people they do not wish to offend. This is an important difference between the invention and existing in-car mobile phone systems which allow the driver to have hands free access to a mobile phone even when they arc driving. However, for commercial (and possibly civil liberties reasons), the driver should be able to opt out of this feature of the invention, so that they can use their hands free mobile phone system at all times, including when the driver is in driving control of the vehicle. According to the invention, a practical compromise between these two options is for mobile phone communications to be cut off for a short period of time; say 5 10 seconds, immediately the driver takes control. After this time, the driver can switch the phone system back on again. The saved date can also include live broadcasts so that the driver does not miss information of interest, for example details of road traffic conditions.

Figure 2 depicts the view seen by the driver when the Al system encounters information about an environment that is beyond its ability to process. In this illustrative example, the road is blocked by a family of deer and a pram. The Al is unable to decide whether to serve to the left and hit a moving animal or swerve to the right and hit an immobile inanimate object, the pram. This situation calls for immediate driver action, so delays of even a few seconds cannot be tolerated. It also requires the driver to have a clear view of the hazard ahead which is just as good as if the monitor was not blocking their view. The present invention allows for this.

In this example the computer system has used information about the mean solid angle subtended to the display screen by the driver's eyes, using for example sets or infra red or ultra sound position sensors I, 2 and 3 and used its camera system to display a good approximation of the view that would be seen by the driver if the display screen had been replaced by a transparent window of the same size. For example the rear end of one animal 4 is seen live through the windscreen and the front end 5 is a contiguous computer screen image. It is not necessary to turn the camera lens to achieve this contiguous image. Instead, the camera can he fitted with a wide angle lens, with the appropriate selection of part of the electronic image, depending on the position of the driver's eyes being displayed. Alternatively, when the driver takes command, the screen rapidly folds or moves down to provide an unobstructed view of the windscreen. This option is more suited to relatively benign transfers of control where there is less urgency, for example on exiting a motorway. Drivers will differ in their tolerance of the frequently of the screen rising and falling. To accommodate this, the invention hands cumin! to the driver to choose which system they use. The default setting selected by the manufacturer will be based on trials involving a wide range of drivers.

Immediately the Al system encounters a dangerous hazard, the loudspeaker also transmits a warning message or sound. The choice of message or sound can be chosen by the driver to maximise their emotional response. For example, a parent may act with greatest urgency if they are aroused by a recorded shout from one of their children. The system can include a hierarchy of warnings. For example, a planned handover to the driver as the vehicle exits a motorway could he preceded by a polite verbal reminder and a visual message on the display screen. In more critical cases, if there is a sudden and unexpected increase in the complexity of the data collected by the AI system, a loud warning shout can be used. Other means of alerting the driver may also be used, for example, sending vibrations through the seat or backrest.

In another version of the invention, the monitor drops down into a slot or trench in the dashboard when not required, with the image of the part of the road blocked by the presence of the monitor and displayed on the screen diminishing in extent accordingly.

In another version of the invention, the monitor is flexible and folds into sections or rolls up when not required.

The threshold of the hazard assessment system is variable, with the lowest threshold being well within the ability of the Al system to cope with. This allows the functioning of the system to be tested at regular intervals without exposure to high risk. In order to reassure nervous drivers, the loudspeaker may broadcast an informative message, for example, -This threshold setting is very low. You do not need to use it when travelling but using it for a few minutes occasionally will give you confidence that the Al system is working." The system can provide reminders to the driver if they have not used the training setting for some time.

The invention reduces the tendency to motion or travel sickness because when looking ahead at the display screen, the driver's peripheral vision will confirm to their brain that the vehicle is moving. This visual input will be in harmony with the messages sent to their brains by their inner ears. Depending on the specific embodiment of the invention, the invention may also reduce motion sickness because the driver can receive feedback when the vehicle changes direction if they are lightly holding the steering wheel while the AI is in driving command. (This will only be true if the steering wheel is permanently coupled to the steering gear box.) Clinical trials have shown that focusing on breathing deeply and slowly can reduce motion sickness. The invention is extended to the use of additional small loudspeakers built into the system that reproduce the sound of slow deep breathing, to stimulate the driver to breath in harmony.

The invention is also extended to include the use of aroma therapy devices that deliver aromas known to reduce travel sickness, for example mint or ginger.

The method of supporting the keyboard platform revealed above is only an illustrative example. The scope of the invention is extended to cover any form of weight support for the platform that allows it to remain stationary when the steering wheel rotates as a consequence of Al steering.

For example Figure 3 illustrates a version where the platform 1 is be mounted on a tube 2 (depicted as going into the page) and running smoothly on a track concentric with the airbag cover 3. Typically the plain of the steering wheel is at a steep angle to the horizontal so the pull of gravity on the mass of the keyboard naturally encourages the keyboard to remain stationary at the lowest possible position when the steering wheel is rotated. The power and data transfer cables 4 and 5 may be carried on stiffened bridges secured to the dashboard and platform, providing further resistance in the form of stabilisers against the rotation of the platform when the steering wheel rotates. It is not strictly necessary for the invention to include power and data transfer cables. Alternatively, the data may be transferred wirelessly using for example Bluetooth and the keyboard may be battery powered, with the battery being wirelessly recharged using an induction method or a small solar energy panel 6 mounted on the platform. In these cases, the bridges are reduced to the function of preventing the keyboard platform moving when the steering wheel turns.

The invention is extended to include the option of a controlled tuning force being applied to the platform support tube so that it rotates in the opposite sense to the steering wheel, but at the same angular speed. Such a platform remains stationary from the driver's perspective when the steering wheel rotates. The method for producing these equal in magnitude but opposite in sense rotations may be achieved by any method known to skilled engineers, including the use of cogs and motors.

It is not essential for bars, bridges or struts to be used to stabilise the keyboard platform against rotation when the steering wheel rotates.

The invention may rely purely on gravity and inertia, with the keyboard and platform being sufficiently massive that they tend to remain stationary when the steering wheel rotates.

The only essential requirement for the invention is that the keyboard can he used by the driver when the vehicle is under Al control.

According to the invention it is only necessary for the steering wheel to be linked to the steering gearbox or rack when the driver is in control. This offers the option that the steering wheel remains stationary when Al is in steering command. In one embodiment of the invention, the steering wheel sends steering information to the steering gearbox using current carrying cables, Bluetooth or other electromagnetic or ultrasonic signals. In a slightly different embodiment of the invention, the steering wheel column is connected to the road wheel steering mechanism by a clutch that only engages when the driver is obliged to take steering control. With these variations the driver will probably feel most at ease if the steering wheel and road wheels are aligned so that the spokes of a two spoke steering wheel are horizontal, or one of the spokes of a three spoke steering wheel is vertical, when the front road wheels are moving the vehicle directly ahead on a level road. Using mechanisms already known to engineers it is possible to automatically rotate the steering wheel to the required position in the moments before the driver takes command. But this orientating process takes time, which is at a premium in an emergency. According to the invention it is possible to put the drivers mind at ease about the angular position of the steering wheel spokes in an entirely different way by using either a steering wheel that has a large number of radial spokes, or has a single spoke that takes the form of a disk that is in contact with all points on the inner edge of the steering wheel rim. The disk in the single spoke version may be transparent, allowing the driver to see nstruments on the dashboard on the far side of the steering wheel.

In Figure 4 the steering wheel has 24 thin radial spokes, for example 1. In this embodiment, there are sufficient spokes that the driver's eye discerns no preferred alignment of the spokes, thus eliminating the cognitive need for an automated system for aligning the steering wheel when the steering clutch engages. Having a large number of thin spokes makes it difficult to see dashboard instruments behind the steering wheel. This problem can be overcome by mounting the instruments or a small multi-instrument equivalent digital display screen on the keyboard platform. This also frees up space inside the dashboard for the monitor to drop into, a far tidier arrangement than a fold down monitor.

For versions of the invention that include a steering wheel clutch enabling the steering wheel to remain stationary when the driver is free to use the keyboard, the keyboard platform may include a means of position locking so that the platform is not reliant solely of gravity to hold the.keyboard in place. In this ease, the invention includes a release mechanism that automatically releases the lock when the steering wheel is activated for driver control.

With a Bluetooth or otherwise linked steering wheel where the central column does not rotate, the keyboard platform can he mounted directly on to the column. The steering wheel can then be mounted on a track that runs around the column. From the driver's visual perspective, the layout can bear a close similarity to that depicted in Figure 4, but with the means of attachment of the keyboard platform, which are hidden from view, being different.

Two illustrative examples that in no way limit the scope of the invention will now be provided. These examples eliminate the need for a central steering column but still allow the driver to use the recommended two handed, push-pull method of turning the 'steering wheel'.

Figure 5 illustrates a version of the invention that includes a conventional torus shaped steering wheel 1, but with the central steering column being eliminated. It is replaced by a sliding gip clamp and a displacement detection device, both hidden inside in a box 2 that is mounted on top of a column secured to the frame of the vehicle close to the dashboard. The sliding grip allows the steering wheel to be rotated while still holding the wheel in a fixed plane relative to the driver. To achieve rigidity in all degrees of freedom, except for rotation of the wheel, a short length of shaped rail in inside the box is in contact with a complementary shaped rail around either the inner or outer circumference of the steering wheel. That is, there is a tongue and groove or male and female shaped relationship between the two rails. Displacement detectors inside the box detect tangential movements of the steering wheel and send a signal to the steering gear box, instructing the road wheels to turn in a similar manner to if a conventional steering wheel had been used. The keyboard platform 3 is secured to the box. Both the angle of tilt of the wheel and the angle of tilt of the platform can he altered by the driver.

Figure 6 illustrates a version of the invention that has some features in common with that depicted in Figure 5, but with the conventional rotating steering wheel being replaced by a fixed or non-rotating D' shaped frame I as illustrated. Instead, a flexible band or flexible closed loop of material 2, having a cross section similar to the radial cross section of conventional steering wheel hand grips is used as the hand grip. This hand grip rides in a slight depression in the outside rim of the D shaped frame, so that the driver's hand movements cause the band or loop to move through the displacement sensors in the box 3. It is the movement of this band or flexible closed loop that is detected, with a signal being generated that is used to steer the road wheels. A merit of this version of the invention is that the height of the monitor 4 can be increased.. Skilled engineers will be aware of the many forms this flexible closed loop hand grip may take. For example it may consist of many short solid cylinders all threaded together along their principal axes by a strong elastic cord or wire in the manner of a necklace and being covered by a flexible rubbery membrane to improve tactile feel. Skilled engineers will also be aware of the many methods of reducing friction as the loop is moved round the D shaped frame. For example the depression in the frame may be coated with a friction reduction polymer and roller bearings may be added at the two corners of the D shape frame According to the invention, steering information may be transmitted to the road wheel rack or gearbox by electromagnetic, ultrasonic or electric current signal. This means that the term 'steering wheel' can be used in the widest sense to cover any device that allows the driver's hand to make a circular movement and for a transducer to transmit a signal to the steering gear box that mimics the signal that would be sent if a conventional steering wheel had been used.

For versions of the invention in which the monitor is mounted so that it acts in the manner of a roof or windscreen mounted sun shade, several design options are available.

It may be swung into position in the manner of existing vehicle sun shades that are anchored to a point above the windscreen, with the monitor automatically being lowered when the vehicle is under Al control and automatically lifts when under driver control, provided that the light intensity falling on the shade is below a threshold set by the driver. The monitor screen may have a similar shape to the sun shade and may be flush with it in its parked position, moving lower down to a height, as preferred by the driver for non-driving viewing. For driving work in bright light conditions, the monitor may move up to lie neatly over the sun shade, with the camera being used to display an image of the road ahead on the monitor, but at a lower luminous intensity.

In another roof mounted monitor version of the invention, the monitor rides on a plurality of rails that allow the monitor to move lower down in front of the windscreen compared with a conventional sun shade. For all roof mounted monitor versions of the invention, a traditional conventional sun shade may be added, for example to block some of the intense sunlight entering through a side window. Figure 7 illustrates a version of the invention with a keyboard as in Figure 1, but with the monitor or display screen 1, being parked under the vehicle interior roof, above the driver's head when not required but sliding forward and down towards the middle of the windscreen as illustrated on rails 2 and 3. A conventional sunshade 4 can be slid sideways to block light entering the windscreen above the monitor. The monitor automatically moves down to the position shown when the ear is in self drive mode and, after a few seconds, automatically lifts up to its parking position under the roof when the driver is in control. The driver can opt to keep the monitor in the mid windscreen position when in control and view the road ahead through the monitor. This is a useful safety measure when driving towards the direction of a low lying bright sun because it prevents the driver being dazzled by intense direct sunlight. This safety feature will also be useful at night when driving towards vehicles with dazzling headlights. The intensity of faint parts of the image may be amplified to provide improved vision through the monitor at night.

Figure 8 illustrates another version of the invention where the monitor or display screen 1, is suspended from the vehicle interior roof, but in a manner similar to existing two hinged (2 and 3) pull down sunshades 4. The monitor has a face that is similar in shape and size to the sunshade and slides down on tracks 5 and 6 in the sunshade to the driver's preferred position.

We will now draw together the information about the invention that has been revealed in this patent application and using the same numbering sequence as used above explain how the invention solves the problems identified.

(r) Summary of the problem.

Level 3 autonomy will lull drivers into a false state of security. Their thoughts may be far removed from driving matters and they may be holding valuable objects that they are reluctant to drop to take control of the vehicle.

The solution according to the invention.

The invention physically aligns the driver's head, eyes and hands during non-driving activities to those required for driving by encouraging the driver to focus their gaze in the direction of the road ahead, free their hands from holding valuable items and instead use them to operate a computer keyboard in close proximity to the steering wheel. Also, when the Al is unable to cope with a complex problem, it promptly closes down all systems that could distract the driver from concentrating on their driving.

This frequent and prompt denial of access to non-driving activities during everyday driving educates the driver so that they are mentally prepared to act quickly in an emergency. The invention also reduces the degree of alienation between the human driver and the artificial intelligence system because they are in a partnership, sharing the same computer system for non-driving and autonomous driving activities.

Summary of the problem.

When freed from the responsibility and mental stimulation of driving, even conscientious drivers are likely to fall asleep at the wheel.

The solution according to the invention.

(a) The Al system uses voice recognition and inputs to the keyboard or trackball to detect that the driver is awake and alert. If there are no regular responses, or they are becoming sluggish, a wakeup call is sounded. Other known alerts may also be used, for example, causing the driver's seat to vibrate.

(b) The short wavelength, blue enriched computer screen light entering the driver's eyes is less likely to make the driver feel sleepy compared with the red wavelength enriched light reflected from the surface of printed documents. This difference will be greatest in late afternoons and early evenings, when natural light is red wavelength rich and the statistics show that accident rates are at their highest.

(ii) Summary of the problem.

Over-polite drivers may be reluctant to bring a mobile phone conversation to an abrupt end, to cope with an emergency.

The solution according to the invention.

The driver has no choice in the matter. The invention automatically cuts off phone conversations when the AI system has to hand over control to the driver.

(iii) Summary of the problem.

The eyes of older drivers take sonic time to refocus when changing from book or small screen reading to driving work.

The solution according to the invention.

Replace book and small screen reading with larger screen reading, where the screen is further from the driver's eyes and requires less refocusing for subsequent driving work. Also replace the small touch screen keypad on smartphones with a larger sized keyboard mounted in front of the steering wheel.

(iv) Summary of the problem

(a) Myopic drivers need to wear driving glasses, but may not need to wear reading glasses. Instead, they usually hold books or small screens close to their eyes. If they have to swap from close reading to driving work in an emergency, they may opt to drive with defective vision by leaving their driving glasses off (b) For older drivers with normally aging vision the reverse is true. In an emergency, they may not remove their reading glasses before taking command of the driving.

The solution according to the invention.

Myopic drivers can normally leave their driving glasses on for computer screen work, because the screen is further from their eyes than their preferred distance for doing close book or small screen reading work.

Older drivers who normally use reading glasses for close reading work will be able to read the display screen clearly without wearing glasses, partly because it is slightly further away than their preferred distance for reading small screens and partly because they can enlarge the font size displayed on the screen.

Both types of driver will also find it easier to use the relatively large keyboard offered by the invention, compared with a small smartphone keypad.

(v) Summary of the problem

The rapid head movements involved when promptly changing from prolonged downward looking small screen or book work to the forward looking position required for driving work can cause dizziness in drivers suffering from some health problems, slowing down their emergency response time.

The solution according to the invention.

Motivate drivers to do all their reading using a display screen which requires the head to be held in a similar position to that required for driving.

(vi) Summary of the problem

Drivers suffering from some health problems can he dazzled when shifting their gaze from looking down inside a vehicle to looking horizontally at a brightly lit road ahead. The solution according to the invention.

When looking at a dashboard mounted screen inside the vehicle the driver gaze is likely to occasionally stray to the more brightly lit external surroundings, partly accommodating their eyes to brighter conditions.

(vii) Summary of the problem

Autonomous vehicle drivers are prone to motion sickness when reading, or for some other reason spending time looking away from the road. This localised visual awareness causes conflicting signals to be sent to the brain by the eyes and the inner ear balance system. Motion sickness can also be triggered by anxiety and a lack of knowledge about vehicle movement e changes decided by the AI system.

The solution according to the invention.

When using their central vision to view the electronic display screen, the driver's peripheral vision is still able to pick up visual clues that the vehicle is moving. Consequently, the signals sent to the brain by their eyes and inner ears are in harmony. The invention also reduces anxiety because the driver's, hands and eyes are in a strategic position to take over the steering. In addition, if the steering wheel is not fitted with a clutch or Bluetooth linked steering mechanism, the driver receives tactile information about changes in the vehicles direction of travel when lightly holding the steering wheel.

The screen can also provide a small or thumbnail view of the road ahead, increasing the driver's awareness that the vehicle is moving. This image also keeps the driver informed of any changes in vehicle direction or road circumstances.

Adding the invention to driverless cars will increase manufacturing costs, but because it significantly reduces the risk of accidents it will lead to a compensating reduction in insurance costs.

The primary aim of the invention is to reduce the number of accidents caused by drivers. But many of its benefits may be enjoyed by passengers, especially those sitting in front seats. The invention is extended to include an additional dashboard or interior roof mounted monitor above the front passenger airbag and a pullout keyboard and trackball mounted below the airbag, to discourage front seat passengers from using hard electronic devices in the line of expansion of their front airbag, that could cause the hard object to he thrown into their face at high speed, if the passenger airbag deploys.

Claims

Claims I A system for reducing the risks during the transfer of safety critical driving decisions from the artificial intelligence of autonomous vehicles to human drivers when the complexity of decision making becomes too difficult for the artificial intelligence to cope with, comprising at least one electronic display screen or monitor, preferably mounted above the dashboard or suspended from a support in the car roof interior or at the top of the front windscreen and coupled to a forward looking camera for collecting live image data about the road ahead and a computer keyboard preferably mounted on a platform adjacent to or in front of the spokes of the steering wheel or other steering device such as a joystick or touch screen mounted in front of the driver, with the keyboard remaining stationary relative to the driver, even if the steering wheel turns or other steering device is moved by the artificial intelligence steering system, characterised by the screen being used to display information for the passive driver in a manner similar to existing laptop or tablet computers or smartphones, but with the existing display being switched off and preferably replaced by a real time image of the road ahead when the onboard artificial intelligence system decides to hand over control to the human driver.
2. An invention according to the first claim with parts of the keyboard platform being in physical contact with the underlying steering wheel, but with the contact points making sliding, roller bearing or other known forms of low friction contact, such that the platform can remain stationary relative to the driver, when the steering wheel turns.
3. An invention according to the first claim with the keyboard platform being connected to the dashboard or other stationary part of the interior of the vehicle by a I least one bar, bridge or strut that prevents the platform from rotating when the underlying steering wheel turns..
4. An invention according to the first claim with the display screen being sufficiently small that natural eye movements and peripheral vision allow the drivers eyes to take in information about the view through the front windscreen even when the passive driver is focusing their conscious attention on viewing the screen.
5. An invention according to the first claim with the screen also providing a small or thumbnail view of the road, to increase the driver's awareness that the vehicle is moving, with the camera providing the viewing information optionally being mounted on the roof of the vehicle, with the invention including an optional setting that only switches the thumbnail image on when the vehicle accelerates, brakes or turns..
6. An invention according to the first claim with the keyboard being placed in close proximity to the steering wheel rim so that the drivers hands only need to make small distance movements to transfer from using the keyboard to operating the steering wheel and with the drivers head only needing to make small changes in the direction of gaze because when viewing the screen the drivers eyes are already looking forward in the direction the vehicle is travelling in.
7. An invention according to the first claim with the solid angle subtended to the drivers eyes by the real time image of the road ahead on the display screen being similar to that subtended to the driver's eyes if the display screen was removed and the view seen directly through the windscreen.
8. An invention according to the first claim with the passive driver accessing a plurality of standard communication and computing devices, for example a laptop computer and smartphone, with the invention triggering an alarm if the passive driver has not verified that they are awake by regularly providing some form of device input for example scrolling though a document displayed on the screen, operating the keyboard or speaking into a microphone.
9. An invention according to the first claim including an ultras sensitive training setting where relatively trivial incidents trigger the transfer of control to the driver such that regular use of the training setting verifies that the system is working and gives the driver practice at taking emergency control, with the system providing reminders to the driver if ey have not used the training setting for some time.
10. An invention according to the first claim with data being transferred wirelessly to and from the keyboard using for example bluetooth and the keyboard being battery powered, with the battery being wirelessly recharged using all induction method or a small solar energy panel mounted on the platform.
II. An invention according to the first claim with the steering wheel being electromagnetic or ultrasonic signal or signal carrying cable connected to the road wheel steering mechanism such that the steering wheel can remain stationary when the vehicle is under artificial intelligence control.
12. An invention according to the first claim with the steering wheel column being connected to the road wheel steering mechanism by a clutch that only engages when the driver is obliged to take steering control.
13. An invention according to the first claim with the steering wheel being connected to the rest of the vehicle steering system via non-mechanical linkage means, for example Bluetooth Of a clutch which disengages when the driver is not in steering control and there being sufficient spokes in the steering wheel that the driver's eye discerns no preferred alignment of spokes associated with the alignment of the steering wheel when the vehicle is travelling in a straight line, thus eliminating the cognitive need for an automated system for aligning the steeling wheel when the steering clutch engages.
14. An invention according to the first claim with a Bluetooth or otherwise linked steering wheel where the central steering wheel column does not rotate, with the keyboard platform being mounted directly on to the central column, with the steering wheel being mounted on a track that runs around the column.
15. An invention according to the first claim with the inclusion of sensors that detect and take remedial action if the steering wheel airbag is covered by any item such as a laptop computer, with the remedial action including the sounding of an alarm if the a substantial object is placed close above the driver's airbag for more than a few moments, with the vehicle being brought to a safe halt if the object is not removed.
16. An invention according to the first claim with steering information being transmitted to the road wheel rack or gearbox by electromagnetic, ultrasonic or electric current signals, with the term 'steering wheel' can be used in the widest sense to cover any device that allows the driver's hand to make a circular movement and for a transducer to transmit a signal to the steering gear box that mimics the signal that would he sent if a conventional steering wheel had been used.
17. An invention according to the first claim with includes a conventional torus shaped steering wheel but with the central steering column being replaced by a device that holds a length of the rim so that the steering wheel is at an angle to the vertical in the manner of a conventional column mounted steering wheel, but holds it with a sliding grip that allows the steering wheel to be rotated in the manner of a conventional steering wheel and includes a device for detecting rotational displacements and uses this information to send a signal to the road wheel turning mechanism, causing the road wheels to swivel, to alter the direction of travel of the vehicle..
18 An invention according to the first claim with the conventional steering wheel being replaced by a fixed 'D' shaped frame that does not rotate, with a flexible band or flexible closed loop of material, having a cross section similar to the radial cross section of existing steering wheel hand grips being used as the hand grip, with the hand grip riding in a slight depression in the outside rim of the D shaped frame, so that the driver's hand movements cause the band or loop to move through a displacement detecting device that sends a signal to the steering gearbox causing the road wheels to swivel and alter the direction of travel of the vehicle.
19. An invention according to the first claim with the monitor being mounted on a fixture in the interior roof of the vehicle, or at the top of the windscreen such that it can be swung or lowered from its parking position into a position in front of the windscreen for the driver to view when artificial intelligence is driving the vehicle and returned to its parking position when the driver is called upon to take command.
20. An invention according to the first claim with the monitor or display screen being parked under the vehicle roof when not required but sliding forward and down towards the middle of the windscreen on rails with a conventional sun shade sliding sideways to block light enter O the windscreen above the monitor, with the monitor automatically moving down to the viewing position when the car is in self drive mode and, after a few seconds, automatically riding back up to its parking position under the roof when the driver is in control.
21. An invention according to the first claim extended to include an additional dashboard or interior roof mounted monitor above the front passenger airbag and a pullout keyboard and trackball mounted below the airbag, to provide an alternative that discourages front seat passengers from using hard electronic devices in the line of expansion of their front airbag, that could cause the hard object to be thrown into their face if the passenger airbag deploys.