Journal of the College of Physicians and Surgeons Pakistan
ISSN: 1022-386X (PRINT)
ISSN: 1681-7168 (ONLINE)
Affiliations
doi: 10.29271/jcpsp.2021.06.710ABSTRACT
Objective: To identify the insights of dentistry students towards a new 3/1 problem-based learning (PBL) and team-based learning (TBL) blended package approach.
Study Design: Mixed method triangulation design, using validating quantitative data model.
Place and Duration of Study: College of Dentistry, Qassim University, KSA, from March to July 2020.
Methodology: Modified TBL within an existing PBL hybrid curriculum, by strategically designing three modified PBL sessions followed by one modified TBL session was evaluated. There were 241 students enrolled over five academic years of session 2019-2020, and all were included in the study. Feedback of the students regarding novel approach was collected at the culmination of the academic year through an e-questionnaire, utilising closed- and open-ended questions. Descriptive statistics and thematic analysis were used to analyse data.
Results: In total, 124 (51.5%) students filled a questionnaire regarding use of PBL and TBL in the new blended approach. The median perception score of TBL was 3.9 (3.2-4.3) and PBL was 3.9 (3.3-4.3). Thematic analysis of the qualitative data supported the quantitative results. Students reported positive aspects of TBL experience as more engaging format, collaborative learning, teamwork, and group competition. They stated that PBL has improved their research, presentation, and clinical reasoning skills.
Conclusion: Students valued the novel PBL-TBL package as an optimum learning approach. They predominantly voted in favour of TBL. Students further identified the sequence and format of the current approach conducive to learning, feedback and assessment.
Key Words: Hybrid curriculum, Team-based learning, Problem-based learning, Blended learning, Innovative instructional strategy.
INTRODUCTION
Active learning has become a buzzword for medical educators since the advent of problem-based learning (PBL), almost half a century ago to the more recently evolved team-based learning (TBL).1 The co-existence of PBL and TBL in medical education confirms the fact that both fit well within current instructional design principles.2 Therefore, medical schools all over the world have been compelled to recognise and adopt these major breakthroughs in curriculum reform.
PBL is one of the most substantial innovations in the history of education,3 pioneered by Barrows and Tamblyn at the McMaster University’s medical school programme in Hamilton in the 1960s.4
It augments student-centered approach, upholds lifelong self-directed learning, confirms constructive approach and compliments integrated learning by identifying curriculum core. 5,6 TBL, on the other hand, is a highly structured collaborative learning strategy that retains the educational powers of PBL in a more resource-friendly way. TBL was devised by Larry Michaelson, at the University of Oklahoma Business School in the late 1970s .7 Later, the concept was popularised and came to the attention of medical education in the late 1990s when Boyd Richards and colleagues began piloting it at Baylor School of Medicine. It inculcates individual accountability, high-level student engagement and group cohesiveness.8
Medical educators have been inspired to adopt innovative instructional strategies. Medical schools all over the world regularly modify their curricula to prepare their graduates for the changing world of the health professions.2 Regardless of the flag under which the curriculum sails, important is to discover variety of approaches which, when blended, lead to authentic learning by achieving particular curricular outcomes.9
This study reported a five-year experience of implementing a blended PBL and TBL. The authors tried to meticulously combine the best of both worlds to maximise their joint educational powers, and named it a package approach.
The objective of present study was to explore the insights of students regarding PBL and TBL as a novel package approach. Since the team of researchers is the member of dental education unit, consequently the results of this study might be used to modify the design of blended approach depending upon which learning strategy is perceived more positive.
METHODOLOGY
The study was conducted at College of Dentistry, Qassim University from March to July 2020. Ethical approval (ST/6070/2020) was obtained from the Institutional Ethical Review Committee. This cross-sectional study used mixed method triangulation design using validating quantitative data model where quantitative and qualitative data were collected simultaneously. Non-probability convenience sampling technique was used to include undergraduate dental students as study participants. Before commencing the study, all the students were informed about the background and purpose of the research. Subsequently, an online e-questionnaire was sent through an electronic mail to 241 dental students, at the end of the academic year. All the students who filled e-forms were included; and who did not fill, were excluded from the study.
Qassim College of Dentistry is implementing a hybrid PBL curriculum (H-PBL), for the past 10 years. The curriculum is recognised by the Saudi Commission for Health Specialities, accredited by the National Commission for Academic Accreditation and Assessment, and supported by a growing body of literature in the field of dental education.10 Seventy percent of the curricular component was traditional lectures reinforced by 30% PBL, until this approach (H-PBL) was further modified five years back, with the inclusion of 10% TBL as 3/1 PBL-TBL package, making conventional and interactive teaching modalities more balanced. Orientation of faculty and students with TBL process is done by a set of workshops by Dental Education Unit at the start of each academic year. There are three PBLs, followed by one TBL session for each theme of the block, at all academic levels, from first to fourth year. We have separate male and female campuses with the maximum number of 25 students in each class. Our student teams consist of 6 to 8 students for TBL and 8 to 10 students for PBL.
Each PBL is traditionally conducted in two tutors-led sessions per week. In between sessions, students work on their objectives individually as well as in groups, using an online discussion board under supervision of respective tutors. The discussion board is also used to provide peer and tutor feedback. During the second PBL session, students present their objectives in the form of PowerPoint presentations, and tutors assess them formatively against a criterion-referenced checklist. The concept to develop English communication skills through PBL strategy is contextual; as in Saudi Arabia, most of the high school teaching is provided in Arabic. Therefore, the shift to an English-based learning environment may be difficult for some students .11
The TBL follows an established sequence of activities as recommended by the AMEE guide No. 65,12 with slight modification. In addition to reference sent to students according to theme of the week, the authors also use TBL to assess learning objectives derived in the last three PBL sessions. TBL process consists of 20 minutes MCQ-based, individual readiness assurance e-test (I-RAT) at the start of session, followed by same test in groups as group readiness assurance test (G-RAT) for further 20 minutes. Results are displayed promptly after completion of both tests and immediate feedback or clarification of any concept is given by the content expert. Subsequently, it is followed by 60 minutes application exercise.
The whole conduction and assessment system of PBL and TBL is electronic. The online assessment form with standardised rubric criterion for content and context is submitted by relevant tutors on completion of both sessions. There are 60 points for each PBL, 30 for both sessions (15 each) and 30 for discussion board (structured feedback). Total weightage of all the PBLs in each block is 10 points. There are 5 points for TBL in one block. All TBL sessions are facilitated by trained dental education unit members.
The validated questionnaire, developed by Burgess and colleagues,13 was utilised in the study with permission. The five-point Likert scale was used for 12 closed ended questions, where five was “strongly agree” and one was “strongly disagree”. Five open-ended questions were also used to ascertain their views about useful and difficult features of both active learning strategies to package approach.
Data was analysed using SPSS version 23 (IBM Corp, 32 Armonk, N.Y., USA). Descriptive statistics were recorded as median (IQR) along with percentages and frequencies. The association between the categorical variables was determined by using Chi-square test. The level of significance was set at below 0.05 (p-value<0.05). Thereafter, for evaluating the significance among study variables, inferential statistics were used (Kruskal-Wallis test and Mann-Whitney U- test).
Validation of quantitative data through cross verification was planned to provide clearer understanding of the problem and to increase confidence in the results. Categorisation of the qualitative data into themes was carried out by conducting the content thematic analysis using inductive coding. Quantification of data set within different themes was done for measuring the thematic prevalence.
RESULTS
Out of 241 students, 124 (51.5%) responded to the survey questionnaires. The lowest response rate 20 out of 49 (40.8%) was noted for the final year students; and highest 20 out of 36(55.6%) for the first-year students. The female to male ratio of the respondents was 1.14:1. The median perception score of the students for PBL was slightly higher than TBL. (Table I).
Table I: Students’ perception about problem-based learning and team-based learning.
Items |
Median (IQR) perception score |
p-value |
||||
PBL |
TBL |
PBL |
TBL |
|||
Gender2 |
Academic Year3 |
Gender2 |
Academic Year3 |
|||
1-All team members made an effort to participate in the discussion |
4 (3.25-5.0) |
4(3.0-5.0) |
0.52 |
0.41 |
*0.03 |
0.69 |
2-Team members encouraged one another to express their opinions |
4 (3.0-5.0) |
4(3.0-5.0) |
0.41 |
0.48 |
0.88 |
0.82 |
3-Different points of view were respected by team members |
4 (4.0-5.0) |
4(4.0-5.0) |
0.68 |
0.74 |
0.72 |
0.78 |
4-Team actively elicited multiple points of view before deciding on final answer |
4(3.0-5.0) |
4(3.25-5.0) |
0.37 |
0.80 |
0.11 |
0.61 |
5-All team members consistently paid attention while conducting group discussions |
4 (3.0-5.0) |
4(3.0-5.0) |
0.25 |
0.59 |
0.36 |
0.99 |
6-Team members used feedback about individual or team performance to help the team to be more effective |
4(3.0-4.0) |
4(3.0-4.0) |
0.58 |
0.36 |
0.33 |
0.33 |
7-Students did read the readings prior to sessions |
4(3.0-4.0) |
4(3.0-4.0) |
0.18 |
0.63 |
0.46 |
0.81 |
8-Completion of prescribed out of class preparation helped in my learning |
4(3.0-4.0) |
4(3.0-4.0) |
0.16 |
0.23 |
*0.04 |
0.44 |
9-The number of group members enhanced my experience of group learning |
4 (3.0-4.75) |
4(3.0-5.0) |
0.66 |
0.08 |
0.08 |
0.35 |
10-I received the useful and timely feedback from the tutor |
4 (3.0-5.0) |
4(3.0-4.0) |
0.31 |
0.46 |
0.33 |
0.22 |
11-The tutor helped to focus discussion and learning |
4(3.0-5.0) |
4(3.0-4.75) |
0.85 |
0.59 |
0.22 |
0.42 |
12-Problem solving allowed me to develop my clinical reasoning skills |
4(3.0-4.0) |
4(3.0-4.0) |
0.57 |
*<0.001 |
0.57 |
*<0.001 |
*Statistically Significant derived from 2Chi-square test and 3Kruskal-Wallis test. |
Description |
N (%) |
Median PBL score (IQR) |
Mean Rank |
p-value |
Median TBL Score (IQR) |
Mean Rank |
p-value |
Gender** |
|||||||
Male |
58(46.8) |
3.87(3.08-4.18) |
58.03 |
0.19 |
3.71(3.00-4.11) |
53.62 |
0.01 |
Female |
66(53.2) |
4.00(3.46-4.50) |
66.42 |
4.00 (3.36-4.38) |
70.30 |
||
Academic Year* |
|||||||
First Year |
20(16.1) |
4.00(3.10-4.48) |
67.18 |
0.46 |
3.93(3.09-4.45) |
62.93 |
0.50 |
Second Year |
33(26.6) |
3.91(3.29-4.12) |
61.74 |
4.00(3.25-4.14) |
63.73 |
||
Third Year |
26(21.0) |
3.58(2.90 -4.27) |
54.73 |
3.46(2.98-4.25) |
52.19 |
||
Fourth Year |
25(20.2) |
4.00(3.38-4.62) |
71.78 |
3.93(3.25-4.50) |
70.18 |
||
Fifth Year |
20(16.1) |
3.83(3.25-4.06) |
57.58 |
3.86(3.52-4.23) |
63.85 |
||
*Kruskal-Wallis test (p <0.05), **Mann-Whitney U-test (p <0.05). |
The highest perception score for both PBL and TBL was noted for the item “Different point of views were respected by the team members”; whereas, the lowest perception score was noted for the item “Team members used feedback about individual or team performance to help the team to be more effective’’ (Table I).
The gender-based item-wise analysis of the PBL questionnaire was found to be insignificant, conversely, for TBL, items stating “All team members made an effort to participate in the discussion” and “Completion of prescribed out of class preparation helped in my learning”, showed statistically significant differences (p-value<0.05) (Table I). Furthermore, the comparison of the PBL and TBL perception scores of male and female students suggested higher female scores, with the TBL score being significantly higher (p <0.05, Table II). The item-based year-wise analysis highlighted the significant difference in the perception of item “Problem solving allowed me to develop my clinical reasoning skills ’’for both PBL and TBL (p-value<0.05, Table I). Moreover, fourth-year was found to have the highest perception scores, whereas third year scored lowest for both strategies.
Qualitative data were segregated to gender and question-wise to start with thematic analysis. Initial open coding was done followed by development of hierarchical coding frame regarding perceived useful and difficult features of PBL and TBL package approach. Themes were generated by making axial coding connections, and mapping to the conceptual framework. Emergent prevalent themes along with selective responses to open-ended questions are illustrated (Table III).
DISCUSSION
Generally, learning experience of students regarding the innovative approach was positive for both TBL and PBL. These results are in line with many studies which have compared the efficacy of team-based and problem based learning in blended modules and reported that students favoured both strategies over other learning methods.14,15
Table III: Students’ views regarding best and challenging features of PBL and TBL.
Emergent theme PBL |
Model student’s comments |
Similar responses |
Best features of PBL in perspective of package approach |
||
Research skills |
I like discovering new information, because when you search about the information by yourself it's hard to forget. It has helped me in how to find the most trusted resources and also the skill to search for information from the correct and scientific sources |
37/124 |
Presentation skills |
Makes me a good presenter by facing the audience and being able to talk in public. It helps in self-development by increasing our confidence when we learn skill of giving presentations |
33/124 |
Self-directed learning skills |
It taught me depending on myself for learning and gain opportunity to collect information individually Self-dependence to solve a problem increases our horizons to the highest potential |
24/124 |
Clinical reasoning skills |
Teaches us how to analyse and solve the clinical problem by critical thinking in many directions. Group working improves our critical thinking in solving the problem. |
19/124 |
Challenging features of PBL in perspective of package approach |
||
Waste of time |
It takes lot of time to upload my topic and reply to my group members whole week along, Continuous along the week and It consume so much time and effort We can have more TBL in place of PBL as it has only one session |
43/124 |
Larger groups |
Larger group size as compared to TBL hinders our learning The high number of students in each group, is difficult to manage discussion |
23/124 |
Lack of structured feedback |
Tutors do not give immediate feedback as in TBL. I want to have feedback so that I come to know my shortcoming and I want to improve myself and not loose grades |
16/124 |
Best features of TBL in perspective of package approach |
||
Teamwork skills |
It teaches me how to deal especially in team working while cooperation and respecting each other’s opinion. It makes us learn how to respect each other while there are differences in opinion. |
40/124 |
Group discussion and competition |
Discussions before solving questions allow us to share as much of the previous information as possible Competitiveness between the groups motivates us to participate and discuss. Competition gives us reason to be better |
36/124 |
Interesting format of learning |
It is interesting way to learn. Never ever forget the information learned in so interesting way, very engaging Preparing our PBL objectives for IRAT is useful for our final exams. While preparing objectives, we actually prepare for block assessments |
22/124 |
Challenging features of TBL in perspective of package approach |
||
IRAT |
IRAT is difficult sometimes and stressful if there is exam close to week. They should replace it with GRAT, because IRAT is not team based IRAT questions of TBL are difficult and not team based. |
36/124 |
Interdependency in achieving grades |
It totally depends on who is in the group some students just staying without doing anything Some students relay on others and do not work hard for team the grade for the session does not represent the effort made by individual student |
19/124 |
The highest perception scores were noted related to item, stating “Different points of view were respected by team members”. Many studies have been done around the globe, to identify the effects of team on students’ satisfaction and performance.16 Results of most of these studies have shown that students were highly satisfied and appreciated the team-based active learning environment.17,18 Notably, 75% of students agreed that in TBL “Team actively elicited multiple points of view before coming to final answer” compared to 67% in PBL. It is well documented fact that the structure of TBL has elements beneficial to prepare students to work in teams that is essential, particularly within progressively intricate healthcare systems.19
Perception scores of female students were higher for both PBL and TBL. Although gender differences in medical education have been reported previously, 20 there is little evidence in the context of small group learning. Few studies have shown more attention and information sharing in female compared with male tutorial groups.21 Results of this study are comparable to the previous research outcome that women tend to support each other by harmonising their interactions; whereas, men more often struggle as individuals to attain and uphold supremacy.22 These results are also consistent with the established theories of women’s developmental psychology.23 In this study, it is interesting to examine that male students are tutored by males; and female students by females. This gender dichotomy is a pre-dominant phenomenon due to separate male and female campuses across the Kingdom.
Thematic content analysis of open-ended data supported this statistical analysis and provided a useful framework of emergent themes to understand students’ perspectives in depth. Students were generally inclined towards TBL, due to its interesting collaborative approach, group competition and peer feedback. Students found instant feedback from a content expert helpful for their learning. Several studies have indicated prompt feedback to be more effective than delayed.24
During this study, we came up with two noteworthy indications: first, students stated a desire for removing I-RAT and making TBL process completely team based and, secondly, they appreciated reflection through G-RAT activity. Although contemplative practices were exercised during PBL sessions, the structured testing procedures in TBL promoted greater level of reflection. The act of reflection is a vital metacognitive skill and there is some evidence that TBL offers several opportunities for informal reflection and improves early cognitive skills.25 Moreover, students admitted that the assessment of PBL objectives in IRAT is a good idea to help them prepare for main block assessments. Finally, they appreciated the innovative use of PBL, to enhance personal development through structured presentation skills session. Some of them considered the number of PBL sessions more and suggested replacing with TBL sessions. Overall, the findings of the study support the use of TBL in the modified Package approach.
Admittedly, this study suffers from some limitations. First, it was a single institute study and findings may not be generalised to other institutes. Second, lower than expected response rate due to COVID-19 pandemic, which has affected every aspect of life, making students busy in making personal arrangements towards online education. Third, probably students found the blended approach unique, which may have rendered their responses optimistic. However, given the depth of responses, and the scale of the study, across all academic levels, the authors feel the inferences and commendations are accurate. Although this study established the effectiveness of TBL, more research is recommended to ponder the in-depth association among how and why particular aspects of TBL are effective the way they are.
CONCLUSION
Students perceived their learning experience in TBL more beneficial as compared to PBL, in blended package approach. They found the novel strategy to be rewarding and enjoyable. The findings of this study suggest a planned and wide scale implementation of hybrid approach, utilising the philosophies of both TBL and PBL to benefit students. Further studies are required to support the blended approach.
ETHICAL APPROVAL:
Dental Ethics Committee, Qassim University, has approved the research proposal before initiation of the research work.
CONFLICT OF INTEREST:
The authors declared no conflict of interest.
AUTHORS’ CONTRIBUTION:
SN: Designed study, collected data and contributed to manuscript writing.
MQJ: Collected and analysed data and partially contributed towards article writing.
RB: Contributed to study design and partial manuscript writing.
All the authors read and approved the final manuscript.
REFERENCES