Nothing Special   »   [go: up one dir, main page]

CN117037571A - AI-based artificial intelligence auxiliary communication system - Google Patents

AI-based artificial intelligence auxiliary communication system Download PDF

Info

Publication number
CN117037571A
CN117037571A CN202311092864.6A CN202311092864A CN117037571A CN 117037571 A CN117037571 A CN 117037571A CN 202311092864 A CN202311092864 A CN 202311092864A CN 117037571 A CN117037571 A CN 117037571A
Authority
CN
China
Prior art keywords
voice
information
sign language
patient
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311092864.6A
Other languages
Chinese (zh)
Inventor
丛江涛
邾明明
沈佳
胡遵平
房文强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Huasheyun Information Technology Co ltd
Original Assignee
Nanjing Huasheyun Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Huasheyun Information Technology Co ltd filed Critical Nanjing Huasheyun Information Technology Co ltd
Priority to CN202311092864.6A priority Critical patent/CN117037571A/en
Publication of CN117037571A publication Critical patent/CN117037571A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/009Teaching or communicating with deaf persons

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

The application discloses an AI-based artificial intelligence auxiliary communication system, which mainly comprises a medical staff voice acquisition module, a medical staff voice conversion module, a sign language display module, a patient sign language acquisition module, a patient sign language conversion module, a voice playing module and a central processing module, wherein the medical staff voice acquisition module is used for acquiring voice information of medical staff, the medical staff voice conversion module is used for translating the voice information of the medical staff into sign language information, the sign language display module is used for playing the sign language information in a video mode, the patient sign language acquisition module is used for acquiring sign language information of a patient, the patient sign language conversion module is used for converting the sign language information of the patient into voice information, and the voice playing module is used for playing the converted voice information in a voice mode; the communication system provided by the application can realize the communication between medical staff and a deaf-mute patient, and can give a reasonable treatment scheme at the first time, so that the illness state of the patient is not easy to delay.

Description

AI-based artificial intelligence auxiliary communication system
Technical Field
The application relates to the technical field of artificial intelligence, in particular to an AI-based artificial intelligence auxiliary communication system.
Background
Artificial intelligence (english: artificial Intelligence, abbreviated AI) is also known as smart machine, machine intelligence, meaning the intelligence exhibited by machines manufactured by humans. Artificial intelligence generally refers to the technology of presenting human intelligence through a common computer program. The word also indicates whether and how to study the implementation of such intelligent systems. The field of definition of artificial intelligence in general textbooks is "research and design of intelligent agents (intelligent agent), which refer to a system that can observe the surrounding environment and act to achieve a goal. John's Maka tin was defined in 1955 as "science and engineering for manufacturing intelligent machines". Andrias Kaplan (Andreas Kaplan) and Michael Haenlein (Michael Haenlein) define artificial intelligence as "the ability of a system to interpret external data correctly, learn from these data, and utilize this knowledge to achieve specific goals and tasks through flexible adaptation. The research of artificial intelligence is highly technical and professional, and various branch fields are deep and not communicated, so that the range of the research is extremely wide, and the core problems of AI include the capability of constructing reasoning, knowledge, planning, learning, communication, perception, object moving, using tools and controlling machinery which can be similar to or even super-tall to human beings. There are a number of tools currently in use for artificial intelligence including searching and mathematical optimization, logical deduction. Algorithms based on bionics, cognitive psychology, and probability theory and economics, etc. are also under gradual exploration. Thinking comes from the brain, while thinking control acts, which need to be realized, are the arrangement of all data collection, which is equivalent to a database, so artificial intelligence is finally evolved into a machine to replace human beings.
The doctor-patient communication is the premise of clinical diagnosis and treatment that needs disease diagnosis, namely, understanding the disease cause and development process of a patient, the medical history acquisition and physical examination are the communication and communication processes with the patient, and the quality of the process determines the reliability degree of the medical history acquisition and the credibility of the physical examination, and also determines whether the disease diagnosis is correct or not in a certain sense. The doctor-patient communication is a clinical treatment requirement, and the medical activities must be completed by both parties of the doctor-patient, but for the deaf-mute patient with language and hearing impairment, most doctors cannot know sign language when carrying out the doctor-patient communication, so that the disease cause, development process, disease symptoms and the like of the patient cannot be known, further the deaf-mute patient cannot be treated for the first time, and the illness state of the patient may be delayed, so that an AI-based artificial intelligence auxiliary communication system is needed to solve the technical problems.
Disclosure of Invention
This section is intended to outline some aspects of embodiments of the application and to briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section as well as in the description of the application and in the title of the application, which may not be used to limit the scope of the application.
The present application has been made in view of the above-mentioned problems with the conventional AI-based artificial intelligence-assisted communication system.
Therefore, the technical problem to be solved by the application is to provide an AI-based artificial intelligence auxiliary communication system, which aims to solve the problems that a doctor cannot know the disease cause, development process, disease symptoms and the like of a deaf-mute patient, and further cannot treat the deaf-mute patient for the first time, and even possibly delays the illness state of the patient.
In order to solve the technical problems, the application provides the following technical scheme: an AI-based artificial intelligence auxiliary communication system mainly comprises:
the medical staff voice acquisition module is used for acquiring voice information of medical staff and transmitting the voice information to the central processing module;
the medical staff voice conversion module is used for translating voice information of medical staff into sign language information and sending the sign language information to the central processing unit;
the sign language display module is used for playing sign language information in a video mode;
the patient sign language acquisition module is used for acquiring sign language information of a patient and transmitting the sign language information to the central processing unit;
the patient sign language conversion module is used for converting sign language information of a patient into voice information and sending the voice information to the central processing unit;
the voice playing module is used for playing the converted voice information in a voice mode;
the central processing module is connected with the medical staff voice acquisition module, the medical staff voice conversion module, the sign language display module, the patient sign language acquisition module, the patient sign language conversion module and the voice playing module.
As a preferable scheme of the AI-based artificial intelligence auxiliary communication system, the application comprises the following steps: the medical staff voice acquisition module comprises a voice input unit and a voice recognition unit, wherein the output end of the voice input unit is connected with the input end of the voice recognition unit, the output end of the voice recognition unit is connected with the input end of the central processing unit, the voice information input unit is used for acquiring voice information of medical staff, and the voice recognition unit is used for recognizing the voice information, obtaining text information and sending the text information to the central processing unit.
As a preferable scheme of the AI-based artificial intelligence auxiliary communication system, the application comprises the following steps: the sign language display module comprises a display device, wherein the display device comprises a display and a bearing frame used for supporting the display.
As a preferable scheme of the AI-based artificial intelligence auxiliary communication system, the application comprises the following steps: the bearing frame has the function of adjusting the height and the angle of the display.
As a preferable scheme of the AI-based artificial intelligence auxiliary communication system, the application comprises the following steps: the sign language acquisition module of the patient comprises a motion recognition camera, wherein the motion recognition camera is used for capturing sign language gestures of the patient and forming a sign language gesture image sequence from the acquired sign language gestures.
As a preferable scheme of the AI-based artificial intelligence auxiliary communication system, the application comprises the following steps: the voice playing module is also provided with a volume adjusting module, and comprises a voice player.
As a preferable scheme of the AI-based artificial intelligence auxiliary communication system, the application comprises the following steps: the electronic case generation module comprises a doctor information acquisition unit and a patient information acquisition unit.
As a preferable scheme of the AI-based artificial intelligence auxiliary communication system, the application comprises the following steps: the doctor information acquisition unit is used for acquiring doctor basic information and diagnosis time, wherein the doctor basic information comprises age, gender, position and main treatment subjects.
As a preferable scheme of the AI-based artificial intelligence auxiliary communication system, the application comprises the following steps: the patient information acquisition unit is used for acquiring basic patient information, disease information and a disease treatment scheme, wherein the basic patient information comprises age, gender, identity, direct relative telephone and identity card number, and the disease information comprises disease symptoms and risk grades.
The application has the beneficial effects that:
when the voice information processing device is used, voice information of medical staff is acquired through the medical staff voice acquisition module, the voice information of the medical staff is translated into sign language information through the medical staff voice conversion module, and the sign language information is played in a video mode through the sign language display module, so that problems, suggestions, replies and the like of the medical staff can be transmitted to a deaf-mute patient;
the sign language information of a patient is acquired through the patient sign language acquisition module, the sign language information of the patient is converted into voice information through the patient sign language conversion module, the voice information is sent to the central processing unit, the voice information is played through the voice playing module in a voice mode, and therefore information of disease causes, development processes, disease symptoms and the like of a deaf-mute patient can be transmitted to a doctor, the doctor can give a reasonable treatment scheme at the first time according to the information of the disease causes, development processes, the disease symptoms and the like, and then the illness state of the patient is not easy to delay.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. Wherein:
FIG. 1 is a block diagram of an AI-based artificial intelligence aided communication system of the present application.
Detailed Description
In order that the above-recited objects, features and advantages of the present application will become more readily apparent, a more particular description of the application will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application, but the present application may be practiced in other ways other than those described herein, and persons skilled in the art will readily appreciate that the present application is not limited to the specific embodiments disclosed below.
Further, reference herein to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic can be included in at least one implementation of the application. The appearances of the phrase "in one embodiment" in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments.
Further, in describing the embodiments of the present application in detail, the cross-sectional view of the device structure is not partially enlarged to a general scale for convenience of description, and the schematic is only an example, which should not limit the scope of protection of the present application. In addition, the three-dimensional dimensions of length, width and depth should be included in actual fabrication.
Example 1
Referring to fig. 1, for one embodiment of the present application, an AI-based artificial intelligence-assisted communication system is provided, which mainly includes:
the medical staff voice acquisition module is used for acquiring voice information of medical staff and transmitting the voice information to the central processing module;
the medical staff voice conversion module is used for translating voice information of medical staff into sign language information and sending the sign language information to the central processing unit;
the sign language display module is used for playing sign language information in a video mode;
the patient sign language acquisition module is used for acquiring sign language information of a patient and transmitting the sign language information to the central processing unit;
the patient sign language conversion module is used for converting sign language information of a patient into voice information and sending the voice information to the central processing unit;
the voice playing module is used for playing the converted voice information in a voice mode;
the central processing module is connected with the medical staff voice acquisition module, the medical staff voice conversion module, the sign language display module, the patient sign language acquisition module, the patient sign language conversion module and the voice playing module.
When the voice information processing device is used, voice information of medical staff is acquired through the medical staff voice acquisition module, the voice information of the medical staff is translated into sign language information through the medical staff voice conversion module, the sign language information is played in a video mode through the sign language display module, and therefore problems, suggestions, replies and the like of the medical staff can be transmitted to a deaf-mute patient;
the sign language information of a patient is acquired through the patient sign language acquisition module, the sign language information of the patient is converted into voice information through the patient sign language conversion module, the voice information is sent to the central processing unit, the voice information is played through the voice playing module in a voice mode, and therefore information of disease causes, development processes, disease symptoms and the like of a deaf-mute patient can be transmitted to a doctor, the doctor can give a reasonable treatment scheme at the first time according to the information of the disease causes, development processes, the disease symptoms and the like, and then the illness state of the patient is not easy to delay.
Specifically, the medical staff voice acquisition module comprises a voice input unit and a voice recognition unit, wherein the output end of the voice input unit is connected with the input end of the voice recognition unit, the output end of the voice recognition unit is connected with the input end of the central processing unit, the voice information input unit is used for acquiring voice information of medical staff, and the voice recognition unit is used for recognizing the voice information, obtaining text information and sending the text information to the central processing unit;
specifically, sign language display module includes display device, display device includes the display and is used for carrying out the bearing frame that supports to the display, the bearing frame has the function of carrying out altitude mixture control and angle adjustment to the display, can adjust the altitude mixture control and the angle of display according to patient's height and position, guarantees that the patient can clearly see the sign language information of broadcast on the display, and then can be with the accurate transmission of doctor's inquiry, answer etc. for the deaf-mute patient.
Specifically, the patient sign language acquisition module comprises an action recognition camera, wherein the action recognition camera is used for capturing sign language gestures of a patient and forming the acquired sign language gestures into a sign language gesture image sequence.
Specifically, still be equipped with volume adjustment module on the voice playing module, meet privacy problem, can adjust the volume to minimum, avoid hearing by outdoor personnel, the privacy is good, voice playing module includes the voice player, can pass on the response of deaf-mute patient, illness state description etc. to the doctor through the voice player.
The system specifically comprises an electronic case generation module, a data processing module and a data processing module, wherein the electronic case generation module comprises a doctor information acquisition unit and a patient information acquisition unit;
the doctor information acquisition unit is used for acquiring doctor basic information and diagnosis time, wherein the doctor basic information comprises age, gender, position and main treatment subjects;
the patient information acquisition unit is used for acquiring basic patient information, disease information and a disease treatment scheme, wherein the basic patient information comprises age, gender, identity, direct relative telephone and identity card number, and the disease information comprises disease symptoms and risk grades, so that a doctor can conveniently and rapidly know the condition of a patient in the subsequent treatment process.
In summary, when in use, the voice information of the medical staff is collected through the voice collecting module of the medical staff, the voice information of the medical staff is translated into sign language information through the voice conversion module of the medical staff, and the sign language information is played in a video mode through the sign language display module, so that the problems, suggestions, replies and the like of the medical staff can be transmitted to a deaf-mute patient; the sign language information of a patient is acquired through the patient sign language acquisition module, the sign language information of the patient is converted into voice information through the patient sign language conversion module, the voice information is sent to the central processing unit, the voice information is played through the voice playing module in a voice mode, and therefore information of disease causes, development processes, disease symptoms and the like of a deaf-mute patient can be transmitted to a doctor, the doctor can give a reasonable treatment scheme at the first time according to the information of the disease causes, development processes, the disease symptoms and the like, and then the illness state of the patient is not easy to delay, so that the deaf-mute patient can see a doctor easily.
It should be noted that the above embodiments are only for illustrating the technical solution of the present application and not for limiting the same, and although the present application has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that the technical solution of the present application may be modified or substituted without departing from the spirit and scope of the technical solution of the present application, which is intended to be covered in the scope of the claims of the present application.

Claims (9)

1. An AI-based artificial intelligence-assisted communication system, comprising:
the medical staff voice acquisition module is used for acquiring voice information of medical staff and transmitting the voice information to the central processing module;
the medical staff voice conversion module is used for translating voice information of medical staff into sign language information and sending the sign language information to the central processing unit;
the sign language display module is used for playing sign language information in a video mode;
the patient sign language acquisition module is used for acquiring sign language information of a patient and transmitting the sign language information to the central processing unit;
the patient sign language conversion module is used for converting sign language information of a patient into voice information and sending the voice information to the central processing unit;
the voice playing module is used for playing the converted voice information in a voice mode;
the central processing module is connected with the medical staff voice acquisition module, the medical staff voice conversion module, the sign language display module, the patient sign language acquisition module, the patient sign language conversion module and the voice playing module.
2. The AI-based artificial intelligence-assisted communication system of claim 1, wherein: the medical staff voice acquisition module comprises a voice input unit and a voice recognition unit, wherein the output end of the voice input unit is connected with the input end of the voice recognition unit, the output end of the voice recognition unit is connected with the input end of the central processing unit, the voice information input unit is used for acquiring voice information of medical staff, and the voice recognition unit is used for recognizing the voice information, obtaining text information and sending the text information to the central processing unit.
3. The AI-based artificial intelligence-assisted communication system of claim 1, wherein: the sign language display module comprises a display device, wherein the display device comprises a display and a bearing frame used for supporting the display.
4. The AI-based artificial intelligence auxiliary communication system of claim 3, wherein: the bearing frame has the function of adjusting the height and the angle of the display.
5. The AI-based artificial intelligence-assisted communication system of claim 1, wherein: the sign language acquisition module of the patient comprises a motion recognition camera, wherein the motion recognition camera is used for capturing sign language gestures of the patient and forming a sign language gesture image sequence from the acquired sign language gestures.
6. The AI-based artificial intelligence-assisted communication system of claim 1, wherein: the voice playing module is also provided with a volume adjusting module, and comprises a voice player.
7. The AI-based artificial intelligence-assisted communication system of claim 1, wherein: the electronic case generation module comprises a doctor information acquisition unit and a patient information acquisition unit.
8. The AI-based artificial intelligence auxiliary communication system of claim 7, wherein: the doctor information acquisition unit is used for acquiring doctor basic information and diagnosis time, wherein the doctor basic information comprises age, gender, position and main treatment subjects.
9. The AI-based artificial intelligence auxiliary communication system of claim 7, wherein: the patient information acquisition unit is used for acquiring basic patient information, disease information and a disease treatment scheme, wherein the basic patient information comprises age, gender, identity, direct relative telephone and identity card number, and the disease information comprises disease symptoms and risk grades.
CN202311092864.6A 2023-08-28 2023-08-28 AI-based artificial intelligence auxiliary communication system Pending CN117037571A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311092864.6A CN117037571A (en) 2023-08-28 2023-08-28 AI-based artificial intelligence auxiliary communication system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311092864.6A CN117037571A (en) 2023-08-28 2023-08-28 AI-based artificial intelligence auxiliary communication system

Publications (1)

Publication Number Publication Date
CN117037571A true CN117037571A (en) 2023-11-10

Family

ID=88644897

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311092864.6A Pending CN117037571A (en) 2023-08-28 2023-08-28 AI-based artificial intelligence auxiliary communication system

Country Status (1)

Country Link
CN (1) CN117037571A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117672026A (en) * 2024-01-31 2024-03-08 安徽渔之蓝教育软件技术有限公司 Educational service question-answering dialogue system with privacy protection

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117672026A (en) * 2024-01-31 2024-03-08 安徽渔之蓝教育软件技术有限公司 Educational service question-answering dialogue system with privacy protection
CN117672026B (en) * 2024-01-31 2024-04-19 安徽渔之蓝教育软件技术有限公司 Educational service question-answering dialogue system with privacy protection

Similar Documents

Publication Publication Date Title
US20230376120A1 (en) Gesture information processing method and apparatus, electronic device, and storage medium
Mehmood et al. Optimal feature selection and deep learning ensembles method for emotion recognition from human brain EEG sensors
US11659350B1 (en) Metaverse dating
DE112019000747T5 (en) AUGMENTED REALITY TEMPLATE ASSOCIATED WITH A DISEASE AND / OR TREATMENT OF A PATIENT
CN105105771B (en) The cognition index analysis method of latent energy value test
CN117037571A (en) AI-based artificial intelligence auxiliary communication system
Sonntag et al. Towards medical cyber-physical systems: Multimodal augmented reality for doctors and knowledge discovery about patients
Das et al. Home automation system combining Internet-of-Things with brain–computer interfacing
Cha et al. Deep-learning-based real-time silent speech recognition using facial electromyogram recorded around eyes for hands-free interfacing in a virtual reality environment
CN110689934A (en) Pre-inquiry system and method
EP2097852A2 (en) A system and method for diagnosis of human behavior based on external body markers
Marcos et al. Emotional AI in Healthcare: a pilot architecture proposal to merge emotion recognition tools
CN114145744A (en) Cross-device forehead electroencephalogram emotion recognition method and system
Moumgiakmas et al. Robustly effective approaches on motor imagery-based brain computer interfaces
Battina et al. Innovative study of an AI voice-based smart Device to assist deaf people in understanding and responding to their body language
Rincon et al. Intelligent wristbands for the automatic detection of emotional states for the elderly
An et al. Algorithm contest of motor imagery BCI in the world robot contest 2022: a survey
CN115640808A (en) Text labeling method and device, electronic equipment and readable storage medium
Lisetti et al. Affective computing in tele-home health: design science possibilities in recognition of adoption and diffusion issues
CN118412151B (en) Remote consultation system based on AR technology and disease position marking method
CN111897428B (en) Gesture recognition method based on moving brain-computer interface
Shi et al. Spatial information considered convolutional neural network for electroencephalogram-based motor imagery classification
Sujana et al. Practical Benefits of Using AI for More Accurate Forecasting in Mental Health Care
Valle et al. Identification of perceived sentences using deep neural networks in EEG
CN118983081A (en) Embedded clinical decision support system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination