<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.3 20210610//EN" "JATS-archivearticle1-3.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:ali="http://www.niso.org/schemas/ali/1.0/" article-type="research-article" dtd-version="1.3" xml:lang="en">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">JPSIM</journal-id>
      <journal-title-group>
        <journal-title>Journal of Pakistan Society of Internal Medicine</journal-title>
        <abbrev-title>J Pak Soc Intern Med</abbrev-title>
      </journal-title-group>
      <issn publication-format="print">2709-8729</issn>
      <issn publication-format="electronic">2710-0804</issn>
      <publisher>
        <publisher-name>Pakistan Society of Internal Medicine</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.70302/jpsim.v2i2.2129</article-id>
      <article-id pub-id-type="publisher-id">jpsim.v2i2.2129</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Original Research</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Training Future Doctors on Screen a Hit or a Miss During Covid</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author" corresp="yes">
          <name>
            <surname>Qaisar</surname>
            <given-names>Wafa</given-names>
          </name>
          <email>wafa.waisar04@gmail.com</email>
          <xref ref-type="aff" rid="aff1"/>
          <xref ref-type="corresp" rid="cor1">*</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Latif</surname>
            <given-names>Shahzad</given-names>
          </name>
          <xref ref-type="aff" rid="aff1"/>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Waseem</surname>
            <given-names>Tariq</given-names>
          </name>
          <xref ref-type="aff" rid="aff1"/>
        </contrib>
      </contrib-group>
      <aff id="aff1">
        <institution>Department of Medicine, Akhtar Saeed Medical and Dental College, Lahore.</institution>
      </aff>
      <author-notes>
        <corresp id="cor1">*Correspondence: Wafa Qaisar (wafa.waisar04@gmail.com)</corresp>
      </author-notes>
      <pub-date date-type="pub" publication-format="electronic" iso-8601-date="2021-06-17">
        <day>17</day>
        <month>06</month>
        <year>2021</year>
      </pub-date>
      <pub-date date-type="collection" publication-format="electronic">
        <year>2021</year>
      </pub-date>
      <volume>2</volume>
      <issue>2</issue>
      <fpage>119</fpage>
      <lpage>122</lpage>
      <history>
        <date date-type="received" iso-8601-date="2021-01-05">
          <day>05</day>
          <month>01</month>
          <year>2021</year>
        </date>
        <date date-type="accepted" iso-8601-date="2021-04-25">
          <day>25</day>
          <month>04</month>
          <year>2021</year>
        </date>
      </history>
      <permissions>
        <copyright-statement>Copyright © 2021 The Author(s)</copyright-statement>
        <copyright-year>2021</copyright-year>
        <copyright-holder>The Author(s)</copyright-holder>
        <ali:free_to_read xmlns:ali="http://www.niso.org/schemas/ali/1.0/"/>
        <license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
          <ali:license_ref xmlns:ali="http://www.niso.org/schemas/ali/1.0/">https://creativecommons.org/licenses/by/4.0/</ali:license_ref>
          <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
        </license>
      </permissions>
      <self-uri xlink:href="https://psimj.com/article/jpsim.v2i2.2129" content-type="text/html"/>
      <self-uri xlink:href="https://psimj.com/article/jpsim.v2i2.2129.pdf" content-type="application/pdf"/>
      <abstract>
        <sec>
          <title>Objective</title>
          <p>Research was conducted amongst undergraduate medical students to compare how their scores and</p>
          <p>performance differed when assessed online with various tools like Socrative and Zoom and at the bedside in real time.</p>
        </sec>
        <sec>
          <title>Methodology</title>
          <p>Data was collected from exam records of 48 students retrospectively and results were compiled.</p>
        </sec>
        <sec>
          <title>Results</title>
          <p>It was observed that 62.5% students scored above 70% in the socrative scoring and a gradual decrease was</p>
          <p>observed in as 39.6% scored above 70% by zoom scoring while only 2.1% in real time scoring system.</p>
        </sec>
        <sec>
          <title>Conclusion</title>
          <p>We concluded that bedside teaching and clerkship is a significant contributor to student performance. Elearning, while has revolutionized teaching in covid times, needs to be modified in ways to accommodate this aspect.</p>
        </sec>
      </abstract>
      <kwd-group xml:lang="en" kwd-group-type="author-keywords">
        <title>Keywords</title>
        <kwd>E learning</kwd>
        <kwd>Clinical skills</kwd>
        <kwd>medical education.</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec>
      <title>Introduction</title>
      <p>As the world goes through the second summer in the pandemic, it is vital to discuss how learning and teaching patterns have undergone a massive change over the last 15 months or so since the global COVID- 19 crisis began.1 Education is undergoing a historic moment2 where teaching has moved from classrooms and lecture theatres to the computer screens of the students at their homes. In the case of undergraduate medical education, a very important aspect of training especially in their final year MBBS as they embark upon their medical journey and officially become doctors, ready to practice, is Bedside Teaching that involves demonstration of real-life cases and patients’ profiles.3</p>
      <p>The main purpose of the medical curriculum is to ensure that students acquire knowledge, clinical skills and the correct attitudes for their practical role in the community.4 They also need to develop interpersonal skills to be able to gather from and transfer information to their patients while working as a part of a medical team.5 As the first wave of COVID 19 hit in March 2020 in Pakistan, all educational institutes were closed down according to the Governments’ Directive and teaching was shifted to e-learning including social media platforms like Facebook and YouTube Live lectures and other modalities like Zoom meetings and Google classrooms which was a completely new experience for both the faculty members as well as the medical students.6</p>
      <p>Alongside imparting knowledge during these online classes, we had to come up with methods to assess their learning by conducting regular daily tests, end of rotation clinical tests that would usually be done on the bedside in real life situations and during a very brief period when classes were allowed physically on campus with strict SOPs, students were assessed in conventional ways.7</p>
      <p>During the teaching sessions, students were tested on Socrative cloud-based student response system that allowed creation of simple quizzes that they were able to take quickly on laptops.8 While Socrative remained a tool for formative assessment, monthly quizzes on Zoom Meeting were also carried out where questions were shared live by the examiner and students asked to answer in the premeditated time frame as a means of summative assessment.9</p>
      <p><bold>Rationale: </bold>The purpose of this study was to compare the student scores on all of these various testing platforms and the difference in overall performance.</p>
    </sec>
    <sec>
      <title>METHODOLOGY</title>
      <p>The study was conducted over a span of 8months, from April ’20 to November’20 at Akhtar Saeed Medical and Dental College, Bahria town, Lahore (ASMDC).</p>
      <p>We compared 48 students of final year MBBS who were taught by 3 different consultants in the department of medicine, ASMDC, mostly on the platform of online classes via e-learning and for a short time during real time classes conducted within the hospital premises. They were examined with all 3 modalities of assessment including Socrative quizzes, Zoom interactive quiz sessions and bedside tests. The competencies assessed included Laboratory Data interpretation including blood biochemistries, blood gas analysis, etcetera. Understanding of investigations like ECG, X ray and CT scans was also assessed. Clinical skills, student confidence and communication abilities were assessed by the examiners during the bedside tests.</p>
      <p>During evaluation, it was ensured that Examiners’ bias was overcome by randomly allotting students to the three examiners during their zoom and bedside tests. Socrative was a computer-based quiz with no live interaction with any examiner.</p>
    </sec>
    <sec>
      <title>Results</title>
      <p>A total of 48 students were analysed in this study showing highest mean grading socrative score as 68.67 ±18.23 followed by zoom score as 59.44±19.06 with real time as 53.48±16.57 as shown in Table 1.</p>
    </sec>
    <sec>
      <title>Table 1: Mean Grading Scores by category</title>
      <table-wrap id="tbl1">
        <label>Table 1</label>
        <table>
          <tbody>
            <tr>
              <td>Category</td>
              <td>Mean</td>
              <td>Standard Deviation</td>
            </tr>
            <tr>
              <td>Socrative %</td>
              <td>68.67</td>
              <td>18.23</td>
            </tr>
            <tr>
              <td>Zoom %</td>
              <td>59.44</td>
              <td>19.06</td>
            </tr>
            <tr>
              <td>Real Time %</td>
              <td>53.48</td>
              <td>16.57</td>
            </tr>
          </tbody>
        </table>
      </table-wrap>
      <p>Paired sample test was used to observe the difference among groups and a significant difference was observed (p-vale &lt;0.05) among all groups where scores in socrative grading remained highest and significantly high (p-vale &lt;0.05) in socrative grading as compared to zoom and real time grading scores. Zoom grading scores also remained significantly high (p-vale &lt;0.05) as compared real time scores as shown in Table 2.</p>
    </sec>
    <sec>
      <title>Table 2: Comparison of Grading Categories using Paired Sample Test</title>
      <table-wrap id="tbl2">
        <label>Table 2</label>
        <table>
          <tbody>
            <tr>
              <td>Paired Samples Test</td>
            </tr>
            <tr>
              <td>Pair Description</td>
              <td>Paired Differences</td>
              <td>t</td>
              <td>df</td>
              <td>p-value
Sig. (2-tailed)</td>
            </tr>
            <tr>
              <td></td>
              <td>Mean</td>
              <td>Std. Deviation</td>
              <td>Std. Error Mean</td>
              <td>95% Confidence Interval of the Difference</td>
              <td></td>
              <td></td>
              <td></td>
            </tr>
            <tr>
              <td></td>
              <td></td>
              <td></td>
              <td></td>
              <td>Lower</td>
              <td>Upper</td>
              <td></td>
              <td></td>
              <td></td>
            </tr>
            <tr>
              <td>Socrative % - Zoom %</td>
              <td>9.22917</td>
              <td>17.39802</td>
              <td>2.51119</td>
              <td>4.17731</td>
              <td>14.28102</td>
              <td>3.675</td>
              <td>47</td>
              <td>.001</td>
            </tr>
            <tr>
              <td>Socrative % - Real Time %</td>
              <td>15.18750</td>
              <td>20.88026</td>
              <td>3.01381</td>
              <td>9.12450</td>
              <td>21.25050</td>
              <td>5.039</td>
              <td>47</td>
              <td>.000</td>
            </tr>
            <tr>
              <td>Zoom % - Real Time %</td>
              <td>5.95833</td>
              <td>19.79250</td>
              <td>2.85680</td>
              <td>.21119</td>
              <td>11.70548</td>
              <td>2.086</td>
              <td>47</td>
              <td>.042</td>
            </tr>
          </tbody>
        </table>
      </table-wrap>
      <p>Pearson correlation was also done to observe the difference of scores with each other among all grading systems and a significant difference (p-vale &lt;0.05) was observed in 2-tailed correlation as shown in Table 3.</p>
    </sec>
    <sec>
      <title>Table 3: Pearson Correlation of Scoring Systems with each other</title>
      <table-wrap id="tbl3">
        <label>Table 3</label>
        <table>
          <tbody>
            <tr>
              <td>Correlations</td>
            </tr>
            <tr>
              <td></td>
              <td>Socrative Grading</td>
              <td>Zoom Grading</td>
              <td>Real Time Grading</td>
            </tr>
            <tr>
              <td>Socrative Grading</td>
              <td>Pearson Correlation</td>
              <td>1</td>
              <td>.493**</td>
              <td>.404**</td>
            </tr>
            <tr>
              <td></td>
              <td>Sig. (2-tailed)</td>
              <td></td>
              <td>.000</td>
              <td>.004</td>
            </tr>
            <tr>
              <td></td>
              <td>N</td>
              <td>48</td>
              <td>48</td>
              <td>48</td>
            </tr>
            <tr>
              <td>Zoom Grading</td>
              <td>Pearson Correlation</td>
              <td>.493**</td>
              <td>1</td>
              <td>.357*</td>
            </tr>
            <tr>
              <td></td>
              <td>Sig. (2-tailed)</td>
              <td>.000</td>
              <td></td>
              <td>.013</td>
            </tr>
            <tr>
              <td></td>
              <td>N</td>
              <td>48</td>
              <td>48</td>
              <td>48</td>
            </tr>
            <tr>
              <td>Real Time Grading</td>
              <td>Pearson Correlation</td>
              <td>.404**</td>
              <td>.357*</td>
              <td>1</td>
            </tr>
            <tr>
              <td></td>
              <td>Sig. (2-tailed)</td>
              <td>.004</td>
              <td>.013</td>
              <td></td>
            </tr>
            <tr>
              <td></td>
              <td>N</td>
              <td>48</td>
              <td>48</td>
              <td>48</td>
            </tr>
            <tr>
              <td>**. Correlation is significant at the 0.01 level (2-tailed).</td>
            </tr>
            <tr>
              <td>*. Correlation is significant at the 0.05 level (2-tailed).</td>
            </tr>
          </tbody>
        </table>
      </table-wrap>
      <p>A grading system was defined as A (≥70% scores), B (51%-69% scores) and C (≤50% scores) and it was observed that 62.5% students remained in A grade by socrative scoring and a gradual decrese was observed in as 39.6% in A grade by zoom scoring while only 2.1% in real time scoring system and vice versa in B and C grades as shown in Figure 1.</p>
    </sec>
    <sec>
      <title>Figure 1: Comparison of Grades in Scoring Systems</title>
    </sec>
    <sec>
      <title>DISCUSSION</title>
      <p>Clinical skills assessment includes the student’s interaction with real life patients who have abnormal physical findings, that need to be identified by the candidate as well as interpreted in the light of his /her medical knowledge to reach a probable diagnosis and formulate a management plan.10,11 The entire interaction with the patient relies on the student ability to effectively communicate with his/her patient.12 This is an extremely vital competency tool that is assessed for all medical students especially in their final year of undergraduate training before they emerge as doctors and start practicing and serving to their profession.13,14 The limitation of both Socrative and Zoom assessments was the fact that these modalities were unable to evaluate the students in this regard. When students were tested at the patient’s bedside in real time, the examiners were able to judge their clinical and communication skills as well as their patient interaction. The results then reflected that the online mode of teaching as well as evaluating the students showed a significant difference in the student performance, which was the weakest in the real time group. A very important aspect of examiner bias15 also needs to be factored in that when the examiners got a chance to physically observe the students on the bedside, the results differed. This was augmented by the nervousness and the anxiety that students experienced while facing the examiner.16 Students have seemed to perform the best when there was no or some interaction with the examiner as in the Socrative and Zoom tests but both only focusing on testing theoretical knowledge while when they were tested on their patient interaction skills, their scores significantly dropped.</p>
      <p>Limitation of both Online tests was poor connectivity and technical difficulties that the students faced that prevented them from effectively participating in their assessments.17</p>
      <p>Several studies have been conducted in the past year or so evaluating the impact of E-learning methods and use of various teaching tools to improve delivery of undergraduate medical education with an aim to make up for the compromised bedside learning. 18,19</p>
    </sec>
    <sec>
      <title>CONCLUSION</title>
      <p>Online teaching gained popularity in a short span of time, and provided an initial insight into new and innovative ways of teaching for medical education20, undergraduate training may perhaps be incomplete without exposing these students to real life situations for them to be able to really learn the art of medicine, which starts with a good interview21 from the patient about his illness and then correlation of his physical findings and his investigations.22Implementation of Clerkship in the covid-19 era may be a challenge but remains a vital component of the medical education and training. Therefore, methods must be devised to include bedside teachings during the penultimate years of medical training.23</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <title>References</title>
      <ref id="ref1">
        <label>1</label>
        <mixed-citation>Mukhtar K, Javed K, Arooj M, Sethi A. Advantages, Limitations and Recommendations for online learning during COVID-19 pandemic era. Pakistan journal of medical sciences. 2020 May;36(COVID19-S4):S27.</mixed-citation>
      </ref>
      <ref id="ref2">
        <label>2</label>
        <mixed-citation>Schneider SL, Council ML. Distance learning in the era of COVID-19. Archives of dermatological research. 2020 May 8:1-2.</mixed-citation>
      </ref>
      <ref id="ref3">
        <label>3</label>
        <mixed-citation>Fazio SB, Ledford CH, Aronowitz PB, Chheda SG, Choe JH, Call SA, Gitlin SD, Muntz M, Nixon LJ, Pereira AG, Ragsdale JW. Competency-based medical education in the internal medicine clerkship: a report from the alliance for academic internal medicine undergraduate medical education task force. Academic Medicine. 2018 Mar 1;93(3):421-7.</mixed-citation>
      </ref>
      <ref id="ref4">
        <label>4</label>
        <mixed-citation>Al-Elq AH. Medicine and clinical skills laboratories. Journal of family &amp; community medicine.</mixed-citation>
      </ref>
      <ref id="ref5">
        <label>5</label>
        <mixed-citation>Rider EA, Hinrichs MM, Lown BA. A model for communication skills assessment across the undergraduate curriculum. Medical teacher. 2006 Jan 1;28(5):e127-34.</mixed-citation>
      </ref>
      <ref id="ref6">
        <label>6</label>
        <mixed-citation>Farooq F, Rathore FA, Mansoor SN. Challenges of online medical education in Pakistan during COVID-19 pandemic. J Coll Physicians Surg Pak. 2020 Jun 1;30(6):67-9.</mixed-citation>
      </ref>
      <ref id="ref7">
        <label>7</label>
        <mixed-citation>Eurboonyanun C, Wittayapairoch J, Aphinives P, Petrusa E, Gee DW, Phitayakorn R. Adaptation to open-book online examination during the Covid-19 pandemic. Journal of Surgical Education. 2021 May 1;78(3):737-9.</mixed-citation>
      </ref>
      <ref id="ref8">
        <label>8</label>
        <mixed-citation>Batool H, Mumtaz A, Ali S, Chughtai AS. Positive trend shifting to Online Assessments: A Review of using Socrative in Medical College, its Advantages and Challenges faced. Journal of Medical Education. 2018 Jan 1;17(3):160-7.</mixed-citation>
      </ref>
      <ref id="ref9">
        <label>9</label>
        <mixed-citation>Boston C. The concept of formative assessment. Practical Assessment, Research, and Evaluation. 2002;8(1):9.</mixed-citation>
      </ref>
      <ref id="ref10">
        <label>10</label>
        <mixed-citation>Haring CM, Cools BM, van der Meer JW, Postma CT. Student performance of the general physical examination in internal medicine: an observational study. BMC Medical education. 2014 Dec;14(1):1-6.</mixed-citation>
      </ref>
      <ref id="ref11">
        <label>11</label>
        <mixed-citation>Oyedokun A, Adeloye D, Balogun O. Clinical history-taking and physical examination in medical practice in Africa: still relevant?. Croatian medical journal. 2016 Dec;57(6):605.</mixed-citation>
      </ref>
      <ref id="ref12">
        <label>12</label>
        <mixed-citation>Modi JN, Chhatwal J, Gupta P, Singh T. Teaching and assessing communication skills in medical undergraduate training. Indian pediatrics. 2016 53(6):497-504.Jun;</mixed-citation>
      </ref>
      <ref id="ref13">
        <label>13</label>
        <mixed-citation>Humphris GM, Kaney S. Assessing the development of communication skills in undergraduate medical students. Medical education. 2001 Mar;35(3):225-31.</mixed-citation>
      </ref>
      <ref id="ref14">
        <label>14</label>
        <mixed-citation>Windish DM, Price EG, Clever SL, Magaziner JL, Thomas PA. Teaching medical students the important connection between communication and clinical reasoning. Journal of General Internal Medicine. 2005 Dec;20(12):1108-13.</mixed-citation>
      </ref>
      <ref id="ref15">
        <label>15</label>
        <mixed-citation>Schleicher I, Leitner K, Juenger J, Moeltner A, Ruesseler M, Bender B, Sterz J, Schuettler KF, Koenig S, Kreuder JG. Examiner effect on the objective structured clinical exam–a study at five medical schools. BMC medical education. 2017 Dec;17(1):1-7.</mixed-citation>
      </ref>
      <ref id="ref16">
        <label>16</label>
        <mixed-citation>Arndt CB, Guly UM, McManus IC. Preclinical anxiety: the stress associated with a viva voce examination. Medical education. 1986 Jul;20(4):274-80.</mixed-citation>
      </ref>
      <ref id="ref17">
        <label>17</label>
        <mixed-citation>Bączek M, Zagańczyk-Bączek M, Szpringer M, Jaroszyński A, Wożakowska-Kapłon B. Students’ perception of online learning during the COVID-19 pandemic: a survey study of Polish medical students. Medicine. 2021 Feb 19;100(7).</mixed-citation>
      </ref>
      <ref id="ref18">
        <label>18</label>
        <mixed-citation>Rahm AK, Töllner M, Hubert MO, Klein K, Wehling C, Sauer T, Hennemann HM, Hein S, Kender Z, Günther J, Wagenlechner P. Effects of realistic e-learning cases on students’ learning motivation during COVID-19. PloS one. 2021 Apr 21;16(4):e0249425.</mixed-citation>
      </ref>
      <ref id="ref19">
        <label>19</label>
        <mixed-citation>Rose S. Medical student education in the time of COVID-19. Jama. 2020 Jun 2;323(21):2131-2.</mixed-citation>
      </ref>
      <ref id="ref20">
        <label>20</label>
        <mixed-citation>Sandhu P, de Wolf M. The impact of COVID-19 on the undergraduate medical curriculum. Medical Education Online. 2020 Jan 1;25(1):1764740.</mixed-citation>
      </ref>
      <ref id="ref21">
        <label>21</label>
        <mixed-citation>Peterson MC, Holbrook JH, Von Hales D, Smith NL, Staker LV. Contributions of the history, physical examination, and laboratory investigation in making medical diagnoses. Western Journal of Medicine. 1992 Feb;156(2):163.</mixed-citation>
      </ref>
      <ref id="ref22">
        <label>22</label>
        <mixed-citation>Asif T, Mohiuddin A, Hasan B, Pauly RR. Importance of thorough physical examination: a lost art. Cureus. 2017 May;9(5).</mixed-citation>
      </ref>
      <ref id="ref23">
        <label>23</label>
        <mixed-citation>Ferrel MN, Ryan JJ. The impact of COVID-19 on medical education. Cureus. 2020 Mar;12(3).</mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>
