This paper evaluates the effectiveness of simulation in critical care nursing among students in a public university.
A single quasi-experimental design was used to evaluate the effectiveness of simulation compared to videos and High Fidelity Simulation (HFS). A convenience sample of 100 students in the critical care nursing course was selected in the year 2015-2016. Standardized simulation instruments were used to measure the knowledge, performance, self-satisfaction and self-confidence, educational practices and simulation design among students. ANOVA and t-test was used to analyze the findings.
'Active learning', 'Diverse ways of learning' and 'High expectations' were significantly higher for satisfaction and confidence among students in learning using simulation compared to videos'. Support', 'Problem solving' and 'Fidelity was significantly higher with Satisfaction and Importance among students using simulation compared to videos.
Knowledge, performance, self-satisfaction and confidence improved among critical nursing students exposed to high fidelity simulation.
Nursing, Education, Satisfaction, Self-confidence, Simulation
'Active learning', 'Diverse ways of learning' and 'High expectations' were significantly higher for Self-satisfaction and Self-confidence among students using simulation.
'Support', 'Problem solving' and 'Fidelity' (realism) was significantly higher with Satisfaction and Importance in the simulation among nursing students.
Knowledge, performance, self-satisfaction and self-confidence improved among critical care nursing students exposed to simulation.
Novice nursing students are trained to develop skills for delivering safe patient-centered holistic care in the undergraduate nursing. Entry of novice students in the higher levels of the undergraduate curriculum entails their adult clinical experience in the intensive care, high acuity, post-anesthetic and emergency settings. This clinical practice exposes the students to a variety of clinical conditions with unpredictable socio-cultural and psychosocial background [1]. With growing patient acuity and the complexity of care, higher standards of nursing and competencies are set for new graduates in the clinical settings. Nurse educators endeavor to promote students' critical thinking skills and confidence and are confronted with interactive technology for improving student centered learning [2,3].
Simulations technology constructs real critical care scenarios for improving active participation, clinical reasoning, judgment, and acute decision making skills [4]. It provides hands-on practice and experiences in life-saving measures, resuscitation, cardiac arrest, casualty, disaster and emergency management to enhance understanding and learning. Simulation technology in teaching and science encourages interaction between students' feelings and activities and the development of competencies. Example engagement in role play in a simulated scenario in the midst of peers is based on prior knowledge and practices. It can boost students' skills to critically analyze actions and improve decision-making skills [5,6].
Simulated patient care skills can be designed in a structured laboratory for nursing care to improve clinical reasoning [7] and learning outcomes [8]. Use of High Fidelity Simulation (HFS) facilitates transition of critical thinking skills and performance among Arab students into real critical care settings in the Middle Eastern countries. This will advance critical thinking and decision-making skills in a safe and supportive environment [9] and initiate development of core competencies [10]. Registered nurses are role-models for the final year students as they facilitate orientation and teaching-learning in the clinical units [11]. Hence the use of simulation affects student learning outcomes (cognitive, psychomotor, and behavioral) in critical settings is an important aspect of the critical care nursing curriculum in undergraduate unwring program in the Sultanate of Oman.
Over the past decade, nursing schools have gained momentum in the Middle Eastern countries to meet the changing societal needs, population demands and community needs. Nursing schools have raised the bar of standards of nursing practice by preparing baccalaureate nurses with efficient critical skills for safe practice in the critical settings in the Sultanate of Oman. There has been a need for increasing experiential practice in the critical care units in Oman to update to the clinical expectations and preparing the students to take on the role and responsibilities of Registered Nurses (RNs) in the acute and critical care settings. This application and clinical judgement is necessary for student nurses using high fidelity simulation [12]. Students have high expectations using advanced technology and information technology for learning in Oman [1,3].
Use of HFS will bridge the gap between theory and practice through simulation for escalating active-learning [13]. HFS may increase active engagement through observation, role-play and debriefing as a tool in the educational practices and simulation design [14]. Use of HFS boosts active interaction between students and faculty, exchange of knowledge and performance, cooperation, giving feedback, accentuating time on task, collaborating high expectations, valuing diverse talents and ways of learning [15]. As nurse educators and clinical teachers the curriculum requirements and outcomes emphasize preparation of safe student nurses. There are socio-economic, cultural and gender differences among student nurses and their expectations of the clinical learning environment.
Nursing students have recognized that simulated learning improves problem solving abilities, and psychomotor skills [16], knowledge and situation awareness [17]. Past experiences have demonstrated that students' value simulation in a safe controlled environment compared to direct critical care settings in Oman. Little is known about outcomes of simulation learning among Middle Eastern nursing students' to achieve clinical outcomes in the curriculum. There is a need for collaborative simulation practices for transfer of competencies in a safe effective nursing care in critical care settings in Oman. This study evaluates the effectiveness of HFS compared to videos for improving knowledge, performance, satisfaction and confidence among Omani critical care nursing students. This study will be useful to develop further interventional strategies and simulation designs for nursing students in the critical care nursing curriculum.
To evaluate the effectiveness of simulation in among students in the critical care nursing course in the undergraduate nursing program at Oman.
A one-time post-test intervention design was used to examine the effectiveness of simulation using videos and high fidelity simulation in the critical care nursing among Omani students.
One of the schools of nursing in a public university was selected to conduct this study in the accredited Simulation Laboratory (SL) using pre-programmed manikins and advanced technology. The SL has Noelle and Laerdal SimMan 3 Generation human patient simulators. The SL had three main units: simulation, control and observation. The simulation unit consisted of the HFS computerized mannequin with computerized screens and remote mobile camera equipped in a life-like critical nursing unit (e.g. hemodynamic monitoring, lifesaving equipment, resuscitation carts). Microphone, recorder, pre-programmed computerized operator devices in the Control unit. The observation unit has a live-telecast LCD screen displaying the simulation unit. A hundred (100) students registered in the critical care nursing course in the pre-licensure BSc Nursing program in the each academic year 2015-2016. English is the medium of instruction, assessment, examination and communication in the course, program and college. The course clinical team teaching-learning included specific videos and the High Fidelity Simulation (HFS) for the students in the critical care nursing course.
The required sample size for values of δ in effect size of 0.4 for powers of 80% at 2-sided 5% alpha is 100 to find the mean difference between the two interventions [18]. A convenience sample of 100 nursing students registered in the critical care nursing course was used in the study. 100 students who volunteered in this study were exposed to both the videos and HFS in the critical care course in an interval of 8 weeks in the course. These students were tested twice after the videos and the HFS interventions.
Inclusion criteria was students confirmed enrollment in the critical care nursing course in the BSc nursing program and provided voluntary participation. Students registered in other clinical courses, with an 'academic withdraw status' or did not volunteer were excluded from the study.
A review of simulation instruments in the public domain illustrated that the National League for Nursing and Laerdal Medical study instruments and simulated scenarios were suitable for the study [19]. Permission was obtained to use the English standardized questionnaires in the study.
Education Practices Questionnaire (EPQ) (student version), a 16-item tool using a 5-point Likert scale processes four educational practices: Active learning, collaboration, high expectations, and diverse ways of knowing in the instructor-developed simulation, and the importance of each practice to the learner. A total score is gained by summing all items, for a total of 80 points each for educational practices and importance subscales. Content validity was established by three nurse educators in simulation. Cronbach's alpha was 0.92 and 0.91 respectively [20]. In our study the internal reliability assessed by Cronbach's alpha was 0.89 and 0.86 for educational practices and importance subscales.
Simulation Design Scale (SDS) is a 20-item tool with a 5-point Likert scale intended to appraise five design features of instructor-developed simulations. It provides agreement and importance of scenario design: Objectives and information, student support, problem solving, and guided reflection/debriefing/feedback and fidelity. The instrument has two parts: Presence of specific features in the simulation and its importance to the learner. A total score is attained by summing all items, with a possible score of 100 points each on the simulation design and importance subscale. Content validity was established by three nurse educators in simulation. Cronbach's alpha for the overall scale is 0.94 [21]. Internal reliability obtained by Cronbach's alpha was 0.87 and 0.85 for agreement and importance subscales in our study.
Student Satisfaction and Self Confidence in Learning (SSSCL) is a 13-item questionnaire that uses a 5-point Likert scale to measure each item. The instrument measures satisfaction and self-confidence in attaining the instruction for the simulation. Five items are summed for a total score on the satisfaction with current learning scale, with 25 points. A total score is acquired for the self-confidence in learning scale, for a total possible score of 40 points. Cronbach's alpha for satisfaction is 0.94 and self-confidence is 0.87 [22]. Internal reliability measured by Cronbach's alpha was 0.88 and 0.87 for satisfaction and confidence subscales.
Knowledge and performance scenario questionnaire was programmed in the simulated mannequins based on the applied concepts of Myocardial infarction and Cardiac arrest (20 items), Trauma and Shock (20 items) and Diabetes ketoacidosis and Hyperglycemia (20 items) scenarios [23]. It included multiple choice questions with 10 items on knowledge and 10 items on performance with 5 alternative closed responses for each item in each of the three simulation critical care scenarios. There was a total of 60 items with one correct answer for each item got 1 score and the wrong answer gave 0 score. Content validity was established by three nurse educators. Internal reliability got by Cronbach's alpha was 0.81 and 0.82 for knowledge and performance in our study.
Demographic characteristics included age, gender, credits completed, Grade Point Average (GPA) and previous HFS experience.
Critical care nursing course has been designed with face-to-face videos and simulation scenarios based on the course requirements, objectives and outcomes developed by the course clinical team. There were no lectures or discussions delivered on these three selected critical care simulated scenarios before the main intervention. 100 students were provided the same interventions including the videos and the HFS. The clinical team monitored the intervention delivery, instrumentation, participant's involvement, ethics and the teaching protocol for both the interventions.
The clinical team delivered three programmed and standardized scenarios on Myocardial infarction and Cardiac arrest, Trauma and Shock and Diabetes ketoacidosis and Hyperglycemia using videos. The students were exposed to the videos on the selected three scenarios on the first week of the semester in a single classroom setting. Reading materials based on the selected scenarios were offered in the Moodle e-learning system to students before the videos were demonstrated. E-learning pre-reading materials helped the students to participate in the learning. Each video scenario was exhibited for 30 minutes and the total time for the three scenarios was 90 minutes. The pre-test and post-test knowledge and performance scenario questionnaire was done before and after the videos immediately. 100 students who viewed the videos participated in the study.
The Noelle and Laerdal SimMan 3 Generation human patient simulators were pre-programmed to the student's competency levels. The course clinical team developed three dynamic simulations scenarios like Myocardial infarction and Cardiac arrest, Trauma and Shock and Diabetes ketoacidosis and Hyperglycemia to capture the study aim. This included acute and deteriorating patient conditions and evolving symptoms, triggers and cues which responded to the actions of students. The lab technicians managed the simulators and implemented changes in the different parameters in the 15 minutes simulation outline and controlled the patients' voice. These changes were dependent on the students be various in the scenarios. Simulation scenario scripts were role-played by standardized performers (actors) as physician, paramedical and family members trained by the course team. Focused reading resources were offered in the e-learning platform based on students' competence and course needs. The validity of the simulated intervention protocol was agreed by two nurse educators experienced in simulation. A trained faculty observed the students' actions. The integrity and fidelity of the intervention was monitored by trained simulated faculty across the two consecutive semesters in the critical care nursing course.
Hundred students experienced the HFS structured simulation scenario in the 8th week of the semester. Students were provided time to be familiar with the simulator and environment and were not aware of the scenarios. They were coached to collaborate as a nursing team, to think aloud and act on the scenario. Student groups were provided detailed study information and instruction kits, intervention and ethical protocols, data collection instruments and informed consent. The students ensured concealment of the simulation scenarios and signed the declaration of confidentiality. Small groups of five student's role played as primary and secondary nurses, physicians, interprofessional collaborative practice in the three simulation scenarios until the selected 50 students completed all the three scenarios.
Pre-briefing was conducted before the real simulated scenario. Each real-time simulation scenario was run for 15 minutes for each of the 10 groups. Simulations were video-taped with informed consent and used for guided reflection. Debriefing was conducted at the end of each scenario with the same group on the same day facilitated by the course team for 20-minutes. It included discussion of outcomes, interventions, priority, decision-making, clinical practice. Observers were random students given specific tasks to focus (e.g. assessment, intervention, collaboration, communication, psychosocial) during the simulated scenario. The simulation lasted for one week. Baseline data consisted of demographic characteristics taken from all the students on day 1 before starting the intervention in the allotted 8th week. Education Practices Questionnaire (EPQ), Simulation Design Scale (SDS) and the Student Satisfaction and Self Confidence in Learning (SSSCL), Pre-test and post-test knowledge and performance scenario questionnaires were administered before and after each simulation scenario.
University Review Board and College Ethics Committee approval were obtained for the study. Administrative approval was pursued from the Deanship of Student Affairs, Dean and Assistant Deans. Ethical principles and protocols were conformed to the Declaration of Helsinki [24]. Principal investigator and co-investigators maintained credibility, consistency and fidelity of the intervention, data collection, data entry, data cleaning and ethical protocols in the pilot and main study. Informed written and verbal consent was acquired from the students who participated in the study after providing study information and clarifying study details. All the students volunteered to participate in the study in the experimental and the control group. Ethical and research protocols was safeguarded in the study. Participation was voluntary and freedom to withdraw at any time was fortified without affecting student learning. There were no potential risks identified in the study. Students were provided privacy for data collection and feedback as needed. Confidentiality and anonymity was maintained in the study.
Double data checking was done and password-protected and secured. Data was analyzed using the SPSS 21 software. ANOVA and t-test was used in the study. There were no missing data.
One-third of the students have completed 101 credits (35%) in the BSN program (Table 1). Few students (21%) had been exposed exposure to HFS in the previous courses (> 5 times).
Table 1: Demographic characteristics among Omani nursing students N = 100. View Table 1
Mean overall satisfaction (77.6 ± 4.9) and self-confidence (87.6 ± 4.0) and respective subscales were higher among students exposed to the HFS compared to the videos (Table 2). Active learning, diverse ways of learning and high expectations were significantly higher with self-satisfaction and self-confidence in the use of HFS among students compared to videos.
Table 2: Comparison between learning via simulation and videos among students in critical care nursing N = 100. View Table 2
Satisfaction in current learning (P < 0.03) was significantly higher among students in the HFS compared to the videos.
Mean overall satisfaction (88.6 ± 4.2) and importance (78.6 ± 4.2) was higher among students in the HFS group. Support, Problem solving and Fidelity (realism) was significantly higher with satisfaction and importance in the HFS compared to the videos among nursing students.
Mean post-test scenario scores was higher in the students exposed to HFS for Myocardial infarction and cardiac arrest (15.9 ± 1.7), Shock and trauma (16 ± 1.2) and DKA and hyperglycaemia (17.1 ± 1.3) compared to the videos (Table 3). Mean post-test scores of the three simulation scenarios were significantly higher with the use of HFS compared to the videos among the students.
Table 3: Differences in post-test knowledge and performance scores among students using simulation and videos N = 100. View Table 3
Our study confirmed 'Overall Self-satisfaction' and 'Self-confidence' in the 'Educational practices' and higher subscale scores among students exposed to the HFS compared to the videos independent of the roles during simulation and observation. The self-confidence scores were proportionally higher than the satisfaction scores. Educational practices subscales were 'Active learning', 'Diverse ways of learning' and 'High expectations', which were significantly higher for Self-satisfaction and Self-confidence in the use of HFS. Interactive simulation in a safe environment [25] and yield differences in simulation compared to traditional learning [26]. Simulation improves clinical judgement [27,28] while nurse educators facilitate engagement in discussions for active learning in Oman [3]. This indicated positive satisfaction with the simulation lab learning environment and learning through observation, experiences and practice. It direct to the diverse learning styles, experiences and expectations among students in using simulated pedagogy. This shows that students were able to apply knowledge, practical skills and display competencies.
'Satisfaction' and 'Confidence' was demonstrated higher especially with Satisfaction in current learning was among students using HFS compared to the videos in our study. Improvements in simulation were seen compared to lectures and MCQ in critical care [29] and higher satisfaction scores [30]. Simulation improved self-confidence [31,32], while Omani students prefer behavioural competencies and hands-on practices [33].
'Overall Satisfaction and Importance' in the Simulation design was displayed higher among students in the HFS group among students as role players and observers in our study. They study illustrates 'Support', 'Problem solving' and 'Fidelity' (realism) was significantly higher in this study with Satisfaction and Importance in the HFS compared to the videos among nursing students. Feedback from simulation improved reflective learning and critical thinking [34] and performance in the premises of learning among Omani students [14,35]. Thus students displayed guided reflection and discussion of actions as they learn through peers.
In our study Post-test knowledge and performance scores explained significantly higher in the students exposed to HFS in the three scenarios. The post-test scores increased across the scenarios from Myocardial infarction and cardiac arrest, Shock and trauma to the DKA and hyperglycaemia compared to the videos. Higher performance among intensive care nurses in simulated emergency scenarios [36] and increased critical thinking, clinical judgement, skill acquisition, clinical reasoning [37-39]. Simulation translated application in knowledge [40,41] with use of clinical scenarios [42]. Increased post-test simulated scores on assessment and learning complex patient scenarios [43] and increased behaviors scores [44] improved in simulated teaching. Hence knowledge scores improved with higher satisfaction with current learning and self-confidence [45,46]. This shows that knowledge is related to performance in the scenarios for applied learning and is closely linked to each other.
Higher age, GPA, credits and prior exposure to HFS among students had higher knowledge and performance. Cohort performance had improvements with simulated practices [47] and higher GPA increased competencies [48]. Higher age, GPA and number of clinical courses were significant with satisfaction with clinical learning environments in Oman [35].
There was only one group of students and no control group to assess the effectiveness of students' transfer of skills into clinical practice. The study could not compare the demographic differences between the students in the two interventions.
This study demonstrates improved knowledge and performance among critical care nursing students with use of high fidelity simulation compared to videos. Students perceived higher satisfaction and self-confidence in the safe controlled environment. This is the first study in Oman to confirm that students' learn in complex simulated environments and integrated into nursing course. 'Active learning', 'Diverse ways of learning' and 'High expectations' subscales had significantly higher mean scores among students. It illustrated 'Support', 'Problem solving' and 'Fidelity' (realism) was significantly higher in this study with Satisfaction and Importance in the HFS compared to the videos among critical care nursing students. Students valued satisfaction with current learning and confidence with exposure to the HFS. Use of HFS provides incomparable practice in safe environment to improve knowledge and performance in nurturing critical care nursing concepts and nursing care. Use of HFS technology was valued by critical care nursing students as the simulation was proven effective and beneficial to learning, acquisition of critical skills in a non-risk and safe lab environment. Use of HFS improved self-satisfaction and self-confidence in the as an effective tool for educational practices and simulation design. Students' role play adds to the satisfaction and confidence in various learning situations to develop competencies and improve the abilities to contribute to knowledge and performance.