Nothing Special   »   [go: up one dir, main page]
Next Article in Journal
Layer-Wise Compressive Training for Convolutional Neural Networks
Previous Article in Journal
Forecasting E-Commerce Products Prices by Combining an Autoregressive Integrated Moving Average (ARIMA) Model and Google Trends Data
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Future Internet
Volume 11
Issue 1
10.3390/fi11010006
futureinternet-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Framework for Improving the Engagement of Medical Practitioners in an E-Training Platform for Tuberculosis Care and Prevention

by
Syed Mustafa Ali
1,
Ana Filomena Curralo
2,
Maged N. Kamel Boulos
3 and
Sara Paiva
4,*
1
Mercy Corps, Islamabad 44000, Pakistan
2
Department, Instituto Politécnico de Viana do Castelo, 4900-367 Viana do Castelo, Portugal
3
Moray College, University of the Highlands and Islands, Elgin IV30 1JJ, UK
4
ARC4DigiT–Applied Research Center for Digital Transformation, Instituto Politécnico de Viana do Castelo, 4900-367 Viana do Castelo, Portugal
*
Author to whom correspondence should be addressed.
Future Internet 2019, 11(1), 6; https://doi.org/10.3390/fi11010006
Submission received: 26 November 2018 / Revised: 11 December 2018 / Accepted: 20 December 2018 / Published: 28 December 2018
(This article belongs to the Special Issue New Advances in E-Health)
Browse Figures
Figure 1
<p>Main conclusions gathered from a survey conducted with 27 medical practitioners.</p> "> Figure 2
<p>Use Case Diagram with main use cases of the proposed platform.</p> "> Figure 3
<p>Proposed System Architecture.</p> "> Figure 4
<p>First platform logo presented.</p> "> Figure 5
<p>Second platform logo proposed.</p> "> Figure 6
<p>Platform logo.</p> "> Figure 7
<p>Main screen of Dr. DOTS.</p> "> Figure 8
<p>Main screen of level 1—Presumptive Case Identification.</p> ">
Versions Notes

Abstract

:
We propose a new framework to improve the engagement of medical practitioners in a planned e-training platform for the successful identification and effective management of presumptive cases of tuberculosis (TB) in Pakistan. Our work is aligned with the World Health Organization’s TB-DOTS (Directly Observed Treatment Short-course) strategy for promoting the effective management of tuberculosis. We start by presenting previous work done at Mercy Corps Pakistan for training medical practitioners, then present the results of a recent survey we administered to a random sample of medical practitioners in Pakistan to learn about their requirements and readiness to embrace a new e-training platform and methodology. Informed by feedback from the survey, we formulated a detailed requirement analysis of the five key learning areas (or phases) that we believe are fundamental to the success of a TB e-training platform. Moreover, survey results revealed that an on-spot, on-demand, and competency-based learning tool can potentially improve the engagement of medical practitioners in the process. Building on the insights gained from the survey, we finally describe our initial UX (user experience) prototypes for phase 1, which corresponds to the identification of presumptive tuberculosis cases.

1. Introduction

The World Health Organization’s (WHO) recommended Directly Observed Treatment Short-courses (DOTS) strategy promotes de-centralized care and effective management of the tuberculosis (TB) control program, including training and supervision of healthcare providers [1]. Among other challenges of the healthcare systems in low and middle-income countries, poor quality, insufficient quantity, and partial distribution of the healthcare providers are significant concerns mentioned in the WHO Global Plan to Stop TB 2006–2015 [2,3]. In addition, it is usually acknowledged that building the capacity of human resource is crucial for TB control efforts [4]. Recognizing the need of human resource capacity building, the Global Fund to Fight AIDS, Tuberculosis, and Malaria provided 16 million training episodes to healthcare providers (HCPs), which is almost ten times higher the number of HCPs training episodes given in 2005 [5]. In the past, most of the TB care and prevention focus remained on the coverage of services. However, current data trends show that there is a need to think about expansion of TB care services, thereby emphasizing quality of care, both in private and public sectors [6,7]. Evidence indicated that improved training and continuous supportive supervision can improve providers’ skills for TB case management, hence resulting in better treatment adherence [8]. It is also known that quality of training is directly associated with quality of TB care and treatment outcome. Additionally, knowledge deficiency in healthcare providers can result in a delayed or missed diagnosis [9]. Hence, troubling the overall efforts of the TB control program.
Training is considered as an agent of change and lectures are the most common, simple, and low-cost method used in training programs in classroom settings [10]. However, disengagement of participants, likelihood of forgetting, and one-way communication are common issues associated with this method [11]. Therefore, importance of blended education is emphasized where two or more methods are used to impart training (e.g., multimedia course, seminar, and e-learning). Studies suggest that a combination of face-to-face training along with e-learning methods has generated better results [12]. An increasingly popular method, e-Learning, is a training method where trainer and trainee are not required to be co-located and technological capabilities (tools, technology, equipment) connect them together [13]. For these reasons, e-Learning or e-Training approaches have gained immense importance, especially when healthcare providers have limited time available, different work shifts, and high turnover rate in developing countries. Virtual reality (VR) is a methodology that has successfully been applied to the learning process and it can help to improve the traditional teaching methods. VR’s adoption in the learning process allows participants to have intuitive understanding of what they learn [14].
Three-dimensional (3D) virtual worlds and graphical environments, such as Second Life (http://secondlife.com/) and Sansar (https://www.sansar.com/), offer a number of unique edutainment affordances and opportunities (edutainment is education enhanced by entertainment and game-like elements, also known as ‘serious gaming’); for example, realistic immersion, visualization, and simulation, exploratory learning and training, networking and collaboration (in multi-player environments). Kamel Boulos et al.’s [15,16] reviews of the subject toured some of the early medical and public, environmental, and occupational health examples in Second Life and highlighted the potentials of 3D virtual worlds in medical and health education. Serious gaming engages the learner through various game elements and challenges involving positive competition with other learners (or players), such as game points, badges, achievements, and leader boards.
However, virtual environments are different from digital games and simulations [17]. The use of game elements and metaphors is currently a wide practice across several domains to improve the design of non-game elements (e.g., virtual environment) and processes, helping create outcomes that enhance user engagement [18]. This process is usually called gamification and is successfully being used to create education support and motivation promotion systems, elicitation, digital inclusion, and social platforms and health applications, among others. In the domain of medicine, digital games are presented as simulations, virtual environments, and alternate reality games [19,20]. The present state of literature, pertinent to digital games in medical education, is not conclusive in regard to definition of its constituent elements [17].
Considering the nature of the medical profession, medical practice is given a pivotal importance, hence the majority of the games-based education and training programs concentrate on the procedural skills (e.g., for surgery) to improve patient safety and to offer competency-based learning [21]. This method of learning is cost-effective in providing virtual experience to learners through a variety of clinical scenarios, hence they are able to assess themselves by negative or positive outcome of the clinical procedure [22] in a safe environment without any fear of being judged and becoming a risk to patient safety [23].
The current cumulative evidence in the research literature regarding the effectiveness of serious games in a healthcare professionals’ education is mixed. This could be partially explained by the wide variability in their design and presentation (on mobile, desktop, and dedicated game console platforms) across different studies, prompting Maheu-Cadotte et al. [24] to conduct a new systematic review to “identify, appraise, and synthesize the best available evidence regarding the effectiveness of serious games and the impact of game design on engagement and educational outcomes of healthcare professionals”. Evaluations are crucial to determine whether training programs were effective or not [25] (Habicht et al., 1999). This can be done by systematic assessment of the intended learning outcomes of training activities, and by measuring if it has resulted in improved job performance or not [26]. In one cluster randomized controlled trial, no significant improvement was observed in treatment outcome of TB patients as a result of an 18-h long participatory training program for clinic staff [27]. After the success of flight simulations, use of virtual reality was first proposed by Satava [28] in the medical field for the purpose of gaining surgical skills. Virtual reality is based on creating virtual environments that allow users to interact with a 3-dimensional computerized world. The virtual environment consists of a humanoid ‘avatar’ as well as real life objects to make it look more realistic. User can take any avatar and can interact with objects, people, and scene through joystick or mouse. The VR technology utilizes the concepts of immersion and interactivity.
The use of technological solutions to improve health care is a constant and growing reality. Management of the patient´s vital statistics, anamnesis, risk factors, and information related to the communication between the patient and the healthcare organization are the focus of a solution proposed by Conte et al. [29], with the main purpose being to present a platform to coordinate the whole clinical data and management within a common framework. Mobile apps, for their frequent use in daily lives of citizens, are also being used for e-learning and e-training purposes. An example is provided by Fonsa et al. [30] that provides medical practitioners with a mobile app to use in e-training in imaging diagnosis, allowing them to perform measurements on those images, which represent an important component of healthcare personnel training.
In this paper, we start by presenting the context of what has been the approach so far to the education of medical practitioners (MPs) in the Public Private Mix (PPM) model of the Pakistan’s National TB Control Program. Based on the learning from the previously applied methods, we designed a survey that we gave to randomly selected MPs with the purpose of evaluating their experience with previous methodology and predisposition to enroll in a new program with a new approach. Based on the obtained results, we describe the requirements and architecture for an e-training platform that will be composed of 5 phases to allow MPs to have access to all the necessary information that will support them in provision of quality TB care. The proposed solution makes use of a virtual reality environment as well as gamification concepts to improve motivation and efficiency in the learning process. This paper also presents the User Experience UX) prototype for the first phase of the entire e-training platform.

2. Methodology

2.1. Contextualization

Historically, the Public Private Mix Model (PPM) of Pakistan’s National Tuberculosis Control Program (NTP) promoted the formal engagement of private MPs to address case detection and notification issues. Later to private sector engagement, MPs were trained on TB prevention and care guidelines because it has been widely acknowledged that capacity building of the MPs or doctors is critically important for the provision of quality of care. In the present scenario, wherein case detection and notification still remain daunting challenges, ensuring the clinical effectiveness or quality of tuberculosis care is also important for achieving positive treatment outcomes. Before 2015, conventional modes of training (i.e., use of notes and reading) were utilized to train MPs both in public and private healthcare settings. It was 2015 when Mercy Corps revised the training methodology and started using notes along with PowerPoint presentations. Beginning from 2015, Mercy Corps trained more than 2000 private MPs with the use of revised training methodology. The revised training approach also included shortening of the training module and reducing total training hours, with an aim to maximize the participation of the private MPs. Training hours reduced from 36 h (6 days) to 18 h (3 days). Despite this revision, it is observed that the participation level of private practitioners remains low (average 7 h). It is believed that the low participation level of private MPs also results in poor clinical quality of care. The main observed reasons are classroom arrangement, conflict between training hours and clinic working hours, and not acknowledging the need for capacity building by private MPs. Because of these challenges, the quality of tuberculosis care has remained under discussion, and standardization in the clinical practices is yet to be achieved. In addition to diagnostic tools and a public–private partnership, improved training of practitioners is considered as a pre-requisite for improving the quality of TB care in Pakistan [31]. Hence, this situation signifies the need for the development and testing of an innovative training approach, which motivates the work described in the following sections.

2.2. Feedback and Readiness Survey

The study involved telephonic interviews with randomly selected medical practitioners from the list of enrolled general practitioners as primary, private, and for-profit service providers. The objective of study was explained, and an invitation was given for participation in telephonic interview at a time convenient for medical practitioners. A questionnaire was developed and pre-tested before its actual use. The questionnaire consisted of two sub-sections: (1) training feedback questions and (2) readiness questions. Close-ended questions regarding their training experience and proposed solution were asked and open-ended question was asked to gather their overall feedback or suggestion. In total, 41 general practitioners were contacted by trained interviewer and 27 GPs consented for participation and provided their responses against a set of pre-tested questions. They also provided their feedback on current and proposed training methodologies.

3. Findings of Feedback and Readiness Survey

The questionnaire-based survey had the participation of 27 general practitioners that completed the survey with a 66% response rate. Average age of participating MPs was 44 years with an average of 15 years of medical practice experience in a primary healthcare setting.
A great degree of variation is found in the MPs’ assessment of a facilitator’s knowledge about a subject and gave an average score of 7.4 with a range 0 to 10. Similarly, a comparable level of variation was also found in the ratings of MPs for their satisfaction with the quality of training provided to them at the time of induction (i.e., mean score was 7 and range was 3 to 10). One respondent suggested improvement in a training facilitation role and said that:
“Facilitator should engage all participants and provide training in such a way that all participants understand it easily”.
In total, 44% of the MPs (n = 12) were discouraged with the length of the course and found it increasingly difficult to participate in 6-h long daily sessions for three days. More than half (n = 16) found it practically difficult to attend three days of training. Only 6 MPs were comfortable with a classroom-based training arrangement. One of the MPs explained his experience as:
“daily requirement for participation in training should be of two hours, because it becomes increasingly difficult to participate in long training sessions and shutting down clinical practice during that time”.
Another MP referred that “Basic (induction) training should be arranged in classroom-based settings while refresher trainings can be arranged at a clinic, because in basic training more time and concentration is required which one will not be able to assign due to patient load”.
One MP provided a suggestion on changing the training approach and said that “Overall quality of training was good; however, refresher sessions should be conducted on a regular basis with use of pre- and post-test to assess change in knowledge”.
Other suggestions included a scenario-based feedback session, manifestation and management of high-risk groups, and a session on behavior change communication strategies.
All of the MPs use mobile phone or computer for gaining medical knowledge either on a daily basis (n = 20) or occasionally (n = 7). However, all the MPs agreed that technology and need-based training modules will work better for them. Almost all of the MPs (n = 24) think that training provided at their clinic is more feasible and all the MPs (n = 27) liked the idea of an in-App quiz to assess learning outcomes. Further, 26 MPs thought that learning through game will improve their engagement and they identified different learning needs, such as diagnosis for TB (n = 7), treatment protocol (n = 10), and case management (n = 10). Twenty-four of the participating MPs thought that game scores from participating MPs will have a motivational effect, however, one MP said:
“I will not be comfortable to share my scores in game as my colleagues may develop a negative perception about me, however, I also think that it can motivate you to participate if you are performing well and you know that others will see your scores”.
One MP, having 65 years of age, said:
“In this mature age, we are generally afraid of technology related things because of our age, but I think whenever I overcame this fear in the past, I received great benefit from the use of technology. So, I think a technology-based training solution is a need of time and we should eliminate our fears pertaining to technology”.
All the participating MPs expressed their interest in prototype testing and liked the idea of accrediting this training course with the Pakistan Medical and Dental Council (a regulatory authority in Pakistan). Further, 80% of the MPs think that technology-based training methodology is better than classroom-based training methodology.
Figure 1 shows the four main aspects and major conclusions we were able to obtain from the survey and that are fundamental to the rest of this work.

4. Requirement Analysis

Taking into account the past experience of classroom-based training for the MPs, standardization in the practice of TB care and prevention services is yet to be achieved, which highlights potential concern for patient safety. Developing and testing an innovative approach or tool is highly needed to improve the current performance of the TB control program. Therefore, based on the survey results we described above, we propose to develop an immersive 3-dimensional environment of a typical clinical set-up to disseminate technical knowledge in an interactive manner. A virtual clinic will include display of TB-specific medical equipment and supplies along with general equipment. Head-mounted virtual reality devices, along with joysticks will be used for this purpose. On-site, on-demand, competency-based learning (beginner and expert levels), in-app quizzes for learning assessment or certification, and course accreditation from relevant authorities are key characteristics of the proposed concept or technology. To guide the content development of an e-training module, we have identified five key learning areas which are identified below:
  • Identification of Presumptive TB Case
  • Diagnosis Process
  • Intensive Phase of Treatment
  • Continuation Phase of Treatment
  • Treatment Outcome
Figure 2 illustrates a Use Case Diagram with the main use cases for the two actors that are part of the system, the medical practitioner and platform administrator. The medical practitioner will have access to the five modules previously identified, each one representing a use case for him. The first use case, which we will focus on in detail in the rest of the paper, has other associated use cases that encompass selection of a particular case to work on, quiz mode, and training mode. The administrator has two use cases associated that allows him to manage medical practitioners and questions that can be used both for training and quiz mode.
The first learning area—and use case for the medical practitioner—corresponds to the first step in tuberculosis process of care, which is identification of a TB presumptive case. A list of simulated patients, also known as standardized patients, will allow user or trainee to select any particular case (e.g., pregnant lady, child, a regular smoker, diabetic patient, etc.). The recommended process of TB care will be shown in the virtual environment, which will be representative of the typical clinical set-up of primary and private healthcare settings, and users will be allowed to interact with it through joystick and audio-visual arrangements. A series of questions or steps will be displayed in a recommended sequence to identify a typical TB presumptive case. If the user chooses a wrong step or option, then recommended care guidelines will be displayed or narrated to facilitate the user’s learning. Clinical assessment of the presenting case will lead into referral of presumptive cases for the appropriate diagnostic test. At each step, users will be guided through the recommended process of care and common error in the clinical practice.
The diagnosis process involves implementation of recommended diagnostic algorithms. The user will have to choose the appropriate diagnostic test from a list of tests in a sequential manner. The interpretation of test results and further actions will then ensure correct and timely diagnosis, which is critically important for TB control efforts and patient safety. After the patient is diagnosed, an intensive phase of TB treatment is commenced that accounts for the measures of clinical importance, such as body weight. Correct dosage, side effect management, contact screening, and infection control measures are important aspects of the intensive phase. At the junction of initial phase and continuation phase, a laboratory test and its interpretation are important for treatment effectiveness. Once the intensive phase is completed, the continuation phase of TB treatment is started. Technically, this phase is similar to the intensive phase, with differences of treatment regimen and follow up laboratory tests. At the culmination of the continuation phase, declaring treatment outcomes becomes important because it involves consideration of various treatment-related indicators. It includes decisions regarding the termination of anti-TB drugs if treatment of a recommended period is completed. However, in the case of treatment interruptions or a non-standardized treatment regimen, a different outcome may occur, such as the patient may die or be declared as loss-to-follow-up or treatment failure.
In addition to five distinct learning areas, counselling, recording and reporting, patient safety, treatment compliance, and side effects management are important cross-cutting themes. These are important for achieving desirable treatment outcomes and for meaningful efforts towards breaking the chain of transmission, preventing relapse, and stopping the progression of disease severity.

5. Solution Proposal and Specification

In this section, we introduce the architecture proposed for this system and refer to the main actors and modules that compose the architecture. Moreover, we explain the general behavior of the platform, make some considerations regarding the user experience, present the detail of the first learning area, and end this section with a reference on how gamification elements will be incorporated as a motivational factor.

5.1. Architecture

Our proposed system architecture for developing a platform to facilitate e-training to MPs is presented in Figure 2.
As depicted in Figure 3, the system architecture encompasses MPs, patients, and a frontend application. MPs are the main actors in this system as the e-training platform is meant for their use, in order to promote their capacity to identify and treat TB cases. Patients are indirect actors of the system, as the purpose of the platform is to provide them better care when they are assisted by MPs. The frontend is the point of access MPs have to interact with the e-training solution, which can be accessed via a web browser, smartphone, or tablet. The frontend will interact via a data layer (REST web services) with a set of processes (logic layer) that support each one of the phases identified in the requirement analysis.

5.2. General Behavior

The e-training platform, named Dr. DOTS (after Directly Observed Treatment Short Courses), will require a login for each MP, which is approved by the administrator of the platform, before having access to the contents. There are two training programs: inception training and refresher training. The first time the MP uses the platform, he is automatically assigned with an inception training program that is characterized by the mandatory need of performing levels by sequence, to require that all knowledge has been learned. MPs can ask to join the refresher training after they successfully finish the inception training. The refresher training allows MPs to visualize and train specific levels and content, without having to follow any sequence. The main purpose is for MPs to train a specific content, depending on their needs.

5.3. Considerations on the User Experience

As users interact with products, systems, or services, their level of satisfaction or frustration establishes the quality of the User Experience (UX). Based on positive or negative responses and perceptions resulting from handling the product, system, or service, the UX is also determined by the number of steps and participants involved in the process. Also, understanding the UX involves understanding potential users’ priorities and needs, so they can be met through the implementation of credible solutions. This is determined through use by parameters such as functionality, performance, attributes, interactivity, and function features [32]. Hence, to accomplish a pleasurable successful experience, it is fundamental to analyze the properties and aspects that may trigger positive responses, including the actions performed by the user, the surrounding space, and the product, service, or system in question. Therefore, the UX is not about how the service or product works internally, but how it operates externally, as users interact with such a service or product. Oriented by functionality, product design must therefore encompass product performance according to user expectations, characterized by users’ perceptions, emotions, references, and behaviors throughout the various stages of use. According to Roto et al. [33], the User Experience process has properties and characteristics to follow, namely the context of use has physical aspects (surrounding environment, external noises, task to perform (purpose, time, importance of use) and socio-cultural factors (rules, beliefs, fashion, language). Users visualize the system engineering but are free to handle and control it. It is also argued by some authors that systems must allow user control in order to fit the user experience parameters. Therefore, user experience relies on the concept of usability. Usability translates the attributes defining the user friendliness of the interface. The term usability also regards methods to improve the ease-of-use during the design process [34]. Usability empowers the creation of transparent interfaces so as not to hinder the process, allowing the user to control the environment during the interaction instead of becoming an obstacle. In the present context of research, usability may be simply understood as ensuring that something will work well, as defined by Stephen Krug [35]. Usability relies on three concepts: effectiveness, efficiency, and satisfaction [36]. Effectiveness relates to objective analysis and the possible level of accuracy achieved. Efficiency is the ratio of effectiveness and the amount of allocated resources. Satisfaction is established by the comfort and product acceptability by the users. This may be determined through subjective methods or goals. Interaction is apprehended by the use of or experience with other products. Therefore, the products that are used intuitively are those with similar characteristics to those developed earlier. The relevant past experience is thus transferred among products and probably also between settings. Hence, performance is affected by the level of familiarity of the user with similar technologies [37]. This explains why good visual design is structured according to classical models and rationalization standards that have been present in societies since early stages. An important part of the user interface Graphic Design is the graphical presentation, including the layout, colors, icon design, and text fonts. Visual elements allow manipulation to achieve various emphases, modifiable by visual communication techniques, corresponding to the purpose of a message [38]. Much of the interaction objects are limited by edges (i.e., lines) which are quite significant to assure the lightness of such objects. This occurs through the simple nature of the strokes and proposed clearance between edges and texts displayed on the screen, such as names, titles, headers, and labels, among others [39]. Concerning the development of the platform logo, it was inspired by the prospective users (Medical Practitioners, MP), choosing as the main symbol the stethoscope (Figure 4). However, after the development of the first proposal, the team members decided to incorporate signs of technological aspects, suggesting the introduction of 3-D glasses and some more detail to the image of the doctor. It was also suggested the lowering of the round side of the stethoscope, to replace the ‘o’ in Dots, as shown in Figure 5.
However, the second proposal triggered some discussion regarding the color of the skin and hair of the avatar. It was decided to adopt the first solution, a color stain producing the silhouette of a human being, in this case a doctor. The final logo is presented in Figure 6, the result of this long process. Concerning color, red was the first suggestion, but due to the sharp contrast, the compromise was a punctual use of red over the dominant grey color, creating visual tuning. The typeface family chosen for this process was Helvetica Neue. It coexists harmoniously with our own logo and allows full readability of the text, complemented with the Bold and Light versions. The product development was centered on the human being, a process beginning with users and their needs instead of starting with technology. The logo targets mainly the user, his characteristics and capabilities, and targets meeting his expectations, habits, and levels of recognition. Finally, the logo definition allowed the layout definition and subsequently all other visual elements.

5.4. Detailed Analysis of Phase 1

At this point, we have defined the behavior, functionalities, and UX prototypes for phase 1 corresponding to the Identification of a Presumptive TB Case, as introduced in Section 4. Gamification strategies will be incorporated in this platform as a learning motivating factor. Leader boards, badges, scores, levels, progress bars, and rewards are some of the game elements that will be used throughout the e-training platform.
The first screen (shown in Figure 7), after the MP logs in, presents the user with the five different levels of the game, corresponding to the five key learning areas identified in the requirements. Each of the levels has an associated progress bar that shows the MP’s progress on that level. The MP can see their current registration type on the platform (inception or refresher), and according to that, they will be able to choose the specific content they want, or else they have to continue in the proposed sequence. At the top of the page, the MP can see his current classification (position and points earned) within the global leader board and the badge he has earned so far. In case of inception training, the MP can also see the percentage of completion of the entire training; in case of refresher training, the MP can see the last module taken in the e-training platform. When entering level 1, the MP is taken to a screen where he can choose the type of case he wants to practice (see Figure 8). Some examples include a pregnant lady, child, regular smoker, or diabetic patient. After choosing one presumptive case, a virtual environment is shown with a 3D image that can be explored by the MP using the keyboard or joystick.
Each presumptive case has a training and a quiz mode. In training mode, the MP can select a question and answer to it. In case he fails to answer a question correctly, the MP is presented with a detailed explanation, so he can understand what was wrong with his selection.

5.5. Points and Level Progression

This e-training platform will use a point-based scoring system that will include accumulation of points as MP makes progress through learning areas. As stated earlier, the first time the user will be auto-assigned the inception training module and the MP will have to take all courses (corresponds to five learning areas) in sequence. Difficulty level also increases with later levels; therefore, each learning area will be assigned different points based on the difficulty level. For availing on-demand learning, which is only possible after inception training is completed, MP will be identified by the system as refresher training user. Since, different points are assigned to different learning areas therefore corresponding points of on-demand training will be added to MP’s personal scoreboard and based on points earned MP will be given rank within leader board. However, positions on leader boards will be determined as a result of combined scores of quiz marks (learning assessment) and points earned (learning) after completing one or more learning areas or levels.

6. Discussion

The solution we presented represents the design of an e-training platform and presents underlying logic, which was formed on the basis of Mercy Corps’ implementation experience coupled with MP feedback. Our e-training platform offers an on-site, on-demand, technology-enabled, interactive, accredited, and competency-based learning solution. These learning strategies were used to promote meaningful engagement and to achieve learning outcomes that are reflected by active, interactive, reflective, and authentic learning [40]. Further, e-learning courses are advantageous because of the convenience and flexibility they offer to their users, hence permits them to undertake their working, personal, and family commitments [41].
In most of the technology-based educational systems, information is usually presented in a static manner, resulting in less engagement and activity [42]. Recently, personalized services have gained enormous attention because of the ability to address diverse information or learning needs of the users [43]. Considering this, our e-training platform offers competency-based learning, which takes into account learners’ goals, existing knowledge, and their experience.
Our e-training platform gives an opportunity to the medical practitioner to see how fellow practitioners are making progress with learning, and they will also have opportunity to interact with a technical person or trainer to receive further assistance on any matter of their interest. It is noted that lack of interaction with a trainer and fellow practitioners is a disadvantage of e-learning courses [41]. Additionally, without interaction, users or learners miss the opportunity to receive instant feedback [44]. However, such issues are likely to be resolved with the use of blended learning, also known as hybrid e-training, which utilizes a combination of learning methods [45], where cornerstone is a dependency, to promote a lifelong learning and knowledge society [46].
In addition to hybrid e-training, the role of the trainer should also be carefully addressed in an e-learning environment which is not significantly different from trainer’s role in the traditional environments. However, new roles and competencies are to be developed to maximize learning outcomes in new environments [47]. Therefore, our e-training platform does not eliminate the role of the trainer, and uses learning strategies (e.g., gamification, on-site, etc.) to achieve training goals. The game element is used to promote interactivity by providing system-generated instant responses and feedback. When the user is in learning mode and in assessment mode, the system will not generate prompts. However, in later stages of development and based on the actual usage data, our e-training platform will estimate the learner’s ability through item response theory [48], and based on that a personalized and adaptive post-test scenario can be presented for better learning.

7. Conclusions

This paper presents findings of a feedback and readiness survey conducted with medical practitioners along with requirement analysis and solution architecture for an e-training platform. The purpose of this work is to develop a context- and user-specific tool that will allow medical practitioners in Pakistan to improve their capability to identify tuberculosis cases and to manage cases effectively. The development of this tool is aligned with the WHO’s recommended Directly Observed Treatment Short-courses (DOTS) strategy that promotes decentralized care and effective management of the tuberculosis control program. Additionally, it is known that quality of training is directly associated with quality of tuberculosis care and treatment outcomes and that knowledge deficiency in healthcare providers can result in a delayed or missed diagnosis. With the awareness that training is considered as an agent of change, at this point it seemed clear that the training methodology in Pakistan’s National TB Control Program would have to evolve and start using emergent technologies that could make the training course more appealing to medical practitioners, and at the same time, flexible in terms of scheduling. Considering this, the solution we introduced in this paper uses virtual reality and gamification strategies. We also described in this paper the five learning areas we believe are fundamental for an effective and successful e-training platform: (1) identification of presumptive tuberculosis case, (2) diagnosis process, (3) intensive phase of treatment, (4) continuation phase of treatment, and (5) treatment outcome. We provided details on the first learning area presenting user experience considerations, and how incorporation of gamification strategies will potentially improve learning outcomes.

Author Contributions

S.M.A. and S.P. were responsible for the writing of the first draft of the paper as well as final revisions. A.F.C. was responsible for all materials and text contents related to UX prototypes. M.N.K.B. was responsible for the overall supervision of the paper and literature review section redaction.

Funding

This research received no funding.

Conflicts of Interest

Authors declare no conflict of interests.

References

  1. Enarson, D.A.; Rieder, H.L.; Arnadottir, T.; Trébucq, A. Management of Tuberculosis: A Guide for Low Income Countries, 5th ed.; International Union against Tuberculosis and Lung Disease: Paris, France, 2000. [Google Scholar]
  2. Harries, A.; Zacchariah, R.; Bergström, K.; Blanc, L.; Salaniponi, F.; Elzinga, G. Human resources for control of tuberculosis and HIV associated tuberculosis. Int. J. Tuberc. Lung Dis. 2005, 9, 128–137. [Google Scholar] [PubMed]
  3. Awofeso, N.; Schelokova, I.; Dalhatu, A. Training of front-line health workers for tuberculosis control: Lessons from Nigeria and Kyrgyzstan. Hum. Resour. Health 2008, 6, 1–9. [Google Scholar] [CrossRef] [PubMed]
  4. Bergstrom, K. Training for Better TB Control Human Resource Development for TB Control—A Strategic Approach within Country Support; World Health Organization: Geneva, Switzerland, 2002. [Google Scholar]
  5. World Health Organization. Global Tuberculosis Report; World Health Organization: Geneva, Switzerland, 2005. [Google Scholar]
  6. Scott, K.W.; Jha, A.K. Putting quality on the global health agenda. New Engl. J. Med. 2014, 371, 3–5. [Google Scholar] [CrossRef] [PubMed]
  7. Kruk, M.E.; Larson, E.; Twum-Danso, N.A. Time for a quality revolution in global health. Lancet Glob. Health 2016, 4, 594–596. [Google Scholar] [CrossRef]
  8. Mesfin, M.M.; Newell, J.N.; Walley, J.D.; Gessessew, A.; Tesfaye, T.; Lemma, F.; Madelev, R.J. Quality of tuberculosis care and its association with patient adherence to treatment in eight Ethiopian districts. Health Policy Plan. 2009, 24, 457–466. [Google Scholar] [CrossRef] [Green Version]
  9. Chiang, S.S.; Cruz, A.T.; Castillo, H.D.; Contreras, C.; Becerra, M.C.; Lecca, L. Evaluation of health-care provides’ knowledge of childhood tuberculosis in Lima, Peru. Paediatr. Int. Child Health 2015, 35, 29–35. [Google Scholar] [CrossRef]
  10. Golafrooz Shahri, H.; Khaghanizade, M. Introduction to oral presentation teaching method. Sci. J. Educ. Strat. Med Sci. 2010, 2, 161–166. [Google Scholar]
  11. Norouzi, H.M.; Mohsenizadeh, S.M.; Jafary, S.H.; Ebrahimzadeh, S. The effect of teaching using a blend of collaborative and mastery of learning models, on learning of vital signs: An experiment on nursing and operation room students of Mashhad University of Medical Sciences. Iran. J. Med Educ. 2011, 11, 544–553. [Google Scholar]
  12. Garrison, D.R.; Kanuka, H. Blended learning: Uncovering its transformative potential in higher education. Internet High. Educ. 2004, 7, 95–105. [Google Scholar] [CrossRef]
  13. Thiele, J.E. Learning patterns of online students. J. Nurs. Educ. 2003, 42, 364–366. [Google Scholar]
  14. Li, Y.; Zhang, J.; Sun, W.; Wang, J.; Gao, X. VREX: Virtual reality education expansion could help to improve the class experience (VREX platform and community for VR based education). In Proceedings of the 2017 IEEE Frontiers in Education Conference (FIE), Indianapolis, IN, USA, 18–21 October 2017. [Google Scholar] [CrossRef]
  15. Kamel Boulos, M.N.; Hetherington, L.; Wheeler, S. Second Life: An overview of the potential of 3-D virtual worlds n medical and health education. Health Inf. Libr. J. 2007, 24, 233–345. [Google Scholar] [CrossRef] [PubMed]
  16. Kamel Boulos, M.N.; Ramloll, R.; Jones, R.; Toth-Cohen, S. Web 3D for public, environmental and occupational health: Early examples from second life. Int. J. Environ. Res. Public Health 2008, 5, 290–317. [Google Scholar] [CrossRef] [PubMed]
  17. Bigdeli, S.; Kaufman, D. Digital games in medical education: Key terms, concepts, and definitions. Med. J. Islam. Repub. Iran 2017, 31, 52. [Google Scholar] [CrossRef] [PubMed]
  18. Herbert, B.; Charles, D.; Moore, A.; Ireland, N.; Charles, T. An Investigation of Gamification Typologies for Enhacing Learner Motivation. In Proceedings of the International Conference on Interactive Technologies and Games 2014, Washington, DC, USA, 16–17 October 2014. [Google Scholar]
  19. Boctor, L. Active-learning strategies: The use of a game to reinforce learning in nursing education: A case study. Nurse Educ. Pract. 2013, 13, 96–100. [Google Scholar] [CrossRef] [PubMed]
  20. Akl, E.A.; Kairouz, V.F.; Sackett, K.M.; Erdley, W.S.; Mustafa, R.A.; Fiander, M.; Gabriel, C.; Schunemann, H. Educational games for health professionals. Cochrane Database Syst. Rev. 2013, 28, 3. [Google Scholar]
  21. Yunyongying, P. Gamification: Implications for curricular design. J. Grad. Med Educ. 2014, 6, 410–412. [Google Scholar] [CrossRef] [PubMed]
  22. Hess, J.; Shrum, K. The new media and the acceleration of medical education. Horizon 2011, 19, 331–340. [Google Scholar] [CrossRef]
  23. Blakely, G.; Skirton, H.; Cooper, S.; Allum, P.; Nelmes, P. Use of educational games in the health professions: A mixed-method study of educator’s perspective in the UK. Nurs. Health Sci. 2010, 12, 27–32. [Google Scholar] [CrossRef]
  24. Maheu-Cadotte, M.A.; Cossette, S.; Dubé, V.; Fontaine, G.; Mailhot, T.; Lavoie, P.; Cournoyer, A.; Balli, F.; Mathieu-Dupuis, G. Effectiveness of serious games and impact of design elements on engagement and educational outcomes in healthcare professionals and students: A systematic review and meta-analysis protocol. BMJ Open 2018, 8, e019871. [Google Scholar] [CrossRef]
  25. Habicht, J.; Victora, C.; Vaughan, J. Evaluation designs for adequacy, plausibility and probability of public health programme performance and impact. Int. J. Epidemiol. 1999, 28, 10–18. [Google Scholar] [CrossRef] [Green Version]
  26. Kraiger, K.; Ford, J.K.; Salas, E. Application of cognitive, skill-based, and affective theories of learning outcoes to new methods of training evaluation. J. Appl. Psychol. 1993, 78, 311–328. [Google Scholar] [CrossRef]
  27. Lewin, S.; Dick, J.; Zwarenstein, M.; Lombard, C.J. Staff training and ambulatory tuberculosis treatment outcomes:a cluster randomized controlled trial in South Africa. Bull. World Health Organ. 2005, 83, 250–259. [Google Scholar] [PubMed]
  28. Satava, R.M. Virtual reality surgical simulator: The first steps. Surg. Endosc. 1993, 7, 203–205. [Google Scholar] [CrossRef] [PubMed]
  29. Conte, R.; Sansone, F.; Grande, A.; Tonacci, A.; Napoli, F.; Pala, A.P.; Raciti, M.; Landi, P. Development of an integrated ICT system for data production, standardization and elaboration in health & care. In Proceedings of the 2017 E-Health and Bioengineering Conference (EHB), Sinaia, Romania, 22–24 June 2017; pp. 321–324. [Google Scholar]
  30. Fonsa, E.; Sansone, F.; Grande, A.; Tonacci, A.; Napoli, F.; Pala, A.P.; Guarino, R.; Landi, P.; Raciti, M.; Conte, R. A novel approach for performing measurements in diagnostic images on a mobile-based App for the training of professionals. In Proceedings of the 2017 IEEE 7th International Conference on Consumer Electronics—Berlin (ICCE-Berlin), Berlin, German, 3–6 September 2017; pp. 260–262. [Google Scholar]
  31. Braham, C.A.; White, P.J.; Arinaminpathy, N. Management of tuberculosis by healthcare practitioners in Pakistan: A systematic review. PLoS ONE 2018, 13, e0199413. [Google Scholar] [CrossRef] [PubMed]
  32. Curralo, A.F.; Paiva, S. UX Design and Incluso App Development. In Proceedings of the 9th International Conference Design Beyond Borders and Rhizomes—Sense and Sensibility, Lisboa, Portugal, 24–27 October 2017. [Google Scholar]
  33. Roto, V.; Law, E.; Vermeeren, A.; Hoonhout, J. User Experience White Paper. Bringing Clarity to the concept of user experience. University of Helsinki. Available online: http://www.allaboutux.org/files/UX-WhitePaper.pdf (accessed on 1 April 2018).
  34. Nielsen, J. Usability 101: Introduction to Usability. Available online: http://www.nngroup.com/articles/usability-101-introduction-tousability/ (accessed on 30 April 2018).
  35. Krug, S. Don’t Make Me Think! A Common-Sense Approach to Web Usability, 2nd ed.; New Riders: Barkeley, CA, USA, 2006. [Google Scholar]
  36. International Organization for Standardization. Ergonomic Requirements for Office Work with Visual Display Terminals(VDTs)—Part 11: Guidance on Usability; International Organization for Standardization: Geneva, Switzerland, 1998. [Google Scholar]
  37. Blackler, A.; Popovic, V.; Mahar, D. Intuitive Interaction Applied to Interface Design. In Proceedings of the International Design Congress—IASDR 2005, Douliou, Taiwan, 1–4 November 2005; Available online: http://eprints.qut.edu.au/archive/00003638 (accessed on 22 May 2018).
  38. Dodis, D. La Sintaxis de La Imagem; Gustavo Gili: Barcelona, Spain, 1997. [Google Scholar]
  39. Cybis, W. Abordagem Ergonômica para IHC. In Apostila LabIUtil; Universidade Federal de Santa Catarina: Florianópolis, Brazil, 1997. [Google Scholar]
  40. Din, R.; Nordin, M.S.; Abu Kassim, N.L.; Tunku Ahmad, T.B.; Jusoff, K.; Johar, N.A.; Kamarul Zaman, M.F.; Zakaria, M.S.; Ahmad, M.; Abdul Karim, A.; et al. Development and validation of meaningful hybrid e-training model for computer education. Int. J. Comput. Sci. 2010, 1, 179–184. [Google Scholar]
  41. Pena-Sanchez, R. Efficiency of training courses. Compet. Forum 2012, 10, 66–73. [Google Scholar]
  42. Hwang, W.Y.; Wang, C.Y.; Sharples, M. A study of multimedia annotation of Web-based materials. Comput. Educ. 2007, 48, 680–699. [Google Scholar] [CrossRef]
  43. Xu, D.; Wang, H. Intelligent agent supported personalization for virtual learning environments. Decis. Support Syst. 2006, 42, 825–843. [Google Scholar] [CrossRef] [Green Version]
  44. Chen, C.M.; Lee, H.M.; Chen, Y.H. Personalized e-learning system using Item Response Theory. Comput. Educ. 2005, 44, 237–255. [Google Scholar] [CrossRef]
  45. Din, R.; Norman, H.; Karim, A.; Shah, P.; Rahmat, F.R.; Kamarulzaman, F. Hybrid e-training assessment tool for higher education. WSEAS Trans. Adv. Eng. Educ. 2012, 2, 52–61. [Google Scholar]
  46. Din, R.; Zakaria, M.S.; Nordin, M.S.; Kamarul Zaman, M.F.; Abu Kassim, N.L.; Tunku Ahmad, T.B.; Mastor, K.A.; Abdul Karim, A.; Embi, M.A. A meaningful hybrid e-training measure for technology in education. Asian J. Teach. Learn. High. Educ. 2011, 3, 71–82. [Google Scholar]
  47. Aragon, S.R.; Johnson, S.D. Emerging roles and competencies for training in e-learning environments. Adv. Dev. Hum. Resour. 2002, 4, 424–439. [Google Scholar] [CrossRef]
  48. Baylari, A.; Montazer Gh, A. Design a personalized e-learning system based on item response theory and artificial neural network approach. Expert Syst. Appl. 2009, 36, 8013–8021. [Google Scholar] [CrossRef]
Futureinternet 11 00006 g001 550
Figure 1. Main conclusions gathered from a survey conducted with 27 medical practitioners.
Figure 1. Main conclusions gathered from a survey conducted with 27 medical practitioners.
Futureinternet 11 00006 g001
Futureinternet 11 00006 g002 550
Figure 2. Use Case Diagram with main use cases of the proposed platform.
Figure 2. Use Case Diagram with main use cases of the proposed platform.
Futureinternet 11 00006 g002
Futureinternet 11 00006 g003 550
Figure 3. Proposed System Architecture.
Figure 3. Proposed System Architecture.
Futureinternet 11 00006 g003
Futureinternet 11 00006 g004 550
Figure 4. First platform logo presented.
Figure 4. First platform logo presented.
Futureinternet 11 00006 g004
Futureinternet 11 00006 g005 550
Figure 5. Second platform logo proposed.
Figure 5. Second platform logo proposed.
Futureinternet 11 00006 g005
Futureinternet 11 00006 g006 550
Figure 6. Platform logo.
Figure 6. Platform logo.
Futureinternet 11 00006 g006
Futureinternet 11 00006 g007 550
Figure 7. Main screen of Dr. DOTS.
Figure 7. Main screen of Dr. DOTS.
Futureinternet 11 00006 g007
Futureinternet 11 00006 g008 550
Figure 8. Main screen of level 1—Presumptive Case Identification.
Figure 8. Main screen of level 1—Presumptive Case Identification.
Futureinternet 11 00006 g008

Share and Cite

MDPI and ACS Style

Ali, S.M.; Curralo, A.F.; Boulos, M.N.K.; Paiva, S. A Framework for Improving the Engagement of Medical Practitioners in an E-Training Platform for Tuberculosis Care and Prevention. Future Internet 2019, 11, 6. https://doi.org/10.3390/fi11010006

AMA Style

Ali SM, Curralo AF, Boulos MNK, Paiva S. A Framework for Improving the Engagement of Medical Practitioners in an E-Training Platform for Tuberculosis Care and Prevention. Future Internet. 2019; 11(1):6. https://doi.org/10.3390/fi11010006

Chicago/Turabian Style

Ali, Syed Mustafa, Ana Filomena Curralo, Maged N. Kamel Boulos, and Sara Paiva. 2019. "A Framework for Improving the Engagement of Medical Practitioners in an E-Training Platform for Tuberculosis Care and Prevention" Future Internet 11, no. 1: 6. https://doi.org/10.3390/fi11010006

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop