Get Permission Rasool and Galzie: Perception of new medical graduates on e-assessments conducted through Microsoft Team’s portal during the covid pandemic


Introduction

Assessments are designed to provide students with relevant feedback early in the learning process to support the achievement of learning outcomes. Usually done as formative or summative assessments both having “higher-stakes” to grade students at the end of a study period, by providing feedback to students on their performance.4 In class, paper-based assessments have limitations, as they don’t provide individual feedback. Paper-based assessment is time-consuming and may not be feasible for large classes as well.5 Online e-assessment is a modern tool, is a time-effective alternative and providing the educators timely feedback to large groups of students without creating workload on the institutional resources. It is also advantageous for students by providing more flexibility in terms of transferring skills and knowledge, as it is neither time-bound nor space-bound, in or out of the classroom, with a feedback by providing links to learning resources, it motivates further study.6, 5 Early adopters include the University of Cambridge Local Examinations Syndicate; conducted its first major test around November 2000. The letter “e” is “electronic,” which will ultimately affect in future all educational activities whether online or offline via a network using computers or any other device.7 Advantages being an independent exploration of a complex phenomenon, easy access, and relatively low cost of production. Disadvantages like limited physical interaction, limited fidelity quoted in the previous study.8 The modern global village provides web facilities i.e, ILIAS, which is open-source software that is published under the General Public License and is free of charge for various institutions and organizations worldwide. Assessing tools in computer-based training usually comes in the form of multiple-choice questions, drag-and-drop, radio button, simulation, or other interactive means. The grades are easily recorded via online software, providing immediate end-user feedback and completion status.9, 10, 11 The main barriers of e-assessment are the requirement for a change, poorly designed packages, inadequate technology, lack of skills, need for a component of face-to-face teaching, time factor, computer anxiety. There is a range of solutions to overcome these barriers i.e, standardization, strategies, funding, integration of e-learning into the curriculum, blended teaching, user-friendly packages, access to technology, skills training, support.12 A comparison between traditional teacher-led lectures and e learning reveals equal effectiveness complementing each other and described as a blended learning strategy. Medical education should have the backing of e-learning i.e, digital libraries; have access to e-learning material and provision for peer review of resources. That provides research opportunities but also documents scholarship. This scenario will bring a revolution in education as individualized performance (adaptive learning), interaction with other learners (collaborative learning) and transformation role of educators and academicians.13 Advantages of e-assessment include quick updating of content and knowledge, fast accessibility, personalized instruction, accountability, standardization of content;14, 15, 16 and interaction of large groups at different locations in the world at the same time.17 Therefore, the objective of the study was to assess medical students' opinions regarding e learning and to look into the perception of the advantages and disadvantages of the e-assessment in 1st-year medical students.

Method and Materials

Online registration

The 100 students of 1st MBBS were given extensive training on how to register for the e-assessment through an orientation program conducted by Microsoft teams IT department.

Course registration

Later on, intensive training was given to all students through a second orientation program on how to register with their email addresses and passwords for each student from the IT section, through which they were registered for the subject of physiology. Through e-learning during the pandemic, various sections of the subject were taught online live through the same portal whose strength had been updated by Microsoft IT team. Now it accommodate upto 259 students. Thirty MCQ and SEQ from various sections of human physiology taught live on line were preloaded through the Microsoft team’s portal, and the students used their devices to answer the questions within the stipulated time. Since this is the first instance, when online e-assessment in the subject of physiology was conducted by government medical college Baramulla, a questionnaire prepared for the survey before and after the completion was carried out on the student's perception of the advantages and disadvantages of the e-learning program.

Test date

On the intended day of the e-assessment, the students kept their laptops and mobile phones connected to the Microsoft team application. They navigated into the Educational portal to open the quiz form by a link provided by the IT administrator to access the 30 multiple choice questions and click on the diagram to choose an answer, also with an option for suggestions and comments based on the latest competency based physiology curriculum which were uploaded by the faculty of physiology. The E- assessment was set to start at 11am a pre-determined time was set for the test to begin and end. The reliability /credibility of the assessment process is being continuously upgraded worldwide including Microsoft Online as only one response could be submit per student also the time to answer was factor that limited any chance of forgery.

Assignment

The marks generated automatically at the end of the test for the students to view their responses. Consent was taken from the students, and they were explained briefly about the questionnaire and the study.

Ethical issues

Cleared from students ethical committee

Results

Immediately after completing the quizzes, a post-intervention survey was carried, as the students received automated and personalized, real-time feedback.

Figure 1
https://typeset-prod-media-server.s3.amazonaws.com/article_uploads/5ea16228-3bbb-42e3-9401-04675d06a916/image/68f2dd00-60e5-4bb2-9fa3-ba71028e7078-uimage.png

Table 1
Questions about the use of e-learning in assessment
Pre-Intervention Post-Intervention Level of significance
Mean ± SD Mean ± SD T value P
1. Which one of the tool is good for assessment in guiding student to better learning? Formal 48.4% Summative 8.4% Both 43.2% Formal 68.4% Summative 5% For formal p was < 0.05 significant
2. Do students need orientation for such programs? Yes 76.8% No 4.03% Maybe 18.9% Yes 95.3 % No 4.8 % For yes p was < 0.05 significant
3. Is it better to do at official places like college or can be done at home also? Home 30.5% College30.5% Not sure 38.9% Home= 17.5 % College= 82.5 % For college p was < 0.05 significant
4. Did you want immediate feedback, which will not be possible in the conventional exams? Yes=78.9% No=21.1% Yes=90 % No=5% For yes p was < 0.05 significant
5. Where you excited when you came to know about the event? Yes 63.2 % No 33.7% Yes 64.9 % No 15.1% Non significant
6. Will online test prevents you from copying? Yes 11.6 % No 20.7% Maybe 48.2% Yes 53.6 % No 46.0% For yes p was < 0.05 significant
7. Will this improve your computer skills? Yes 53.7 % No 18.9 % Maybe 27.4 % Yes 69.8 % No 29.9 % For yes p was < 0.05 significant
8. Do you support the move? Yes 81.1 % Maybe 15.8 % Yes=88.4% No=9.3% Non significant
9. Did the message make you to study more? Yes 60 % No 12 % Maybe 26.3 % Yes 82.6 % No 17.9 % For yes p was < 0.05 significant
10. Are you serious to have them on regular basis? Yes 69.5 % Maybe 22.3 % Yes 82.6 % No 11.9 % For yes p was < 0.05 significant
11. Being a professional college, would you agree to have classes on online? Yes 50.5 % No 16.8 % Maybe 29.5 % Yes 86 % No 14 % For yes p was < 0.05 significant
Table 2

Qualitative analysis using Likert’s scale the individual student’s perception

Questions about the use of e-learning in assessment Post-Intervention
Mean ± SD
1.Was it easy to access to this event? Min=4.7% Max=84.2%
2. Is comfort level high in e-learning sessions? Min=12% Max=25%
3. Will it be helpful to click on the diagrams, during online test in future, which would have not been possible in other conventional exams? Strongly=30.2% Neutral=50%
1. What should be the time limit for such events? 2min=43.2% 1.5 max =20%
2. How many extra hours did you put for the event in hours? 2 hr.=1% 6 hrs. =10%
3. How much time are you spending on physiology only in hours? 2hrs 20% 6hr.=2%

There was a significant difference in the post-test score when compared to the pre-test score, as shown in the Table 1 before an e-assessment of the actual subject of physiology, hence quantitative evidence showed that learning has occurred.

Discussion

In the changing digital age, medical education increasing claims on educators and academicians of having less available time for teaching than before.13 New technologies, such as the web, digital video, sound, animations, and interactivity, are providing tools that can make assessment design and implementation more efficient, timely, and sophisticated. Academic dishonest-marking is one way that many assessments and awarding bodies, such as Cambridge International Examinations, are utilizing innovations in technology to expedite the marking of examinations. Evidence indicates that formative online quizzes can help students perform better on course assessments (Dobson 2008; Kibble 2007; Velan et al. 2008). Wilson et al. (2011)18, 19 they noticed that students who participated in the formative quiz received a final grade that was 10% greater than those who did not attempt after excluding already higher achievers, as this methodology helps to gain skills in the mechanics of online learning. To have review Moodle.org (201420 has provided a guide using Moodle quizzes designed using the different modes to have deeper learning, i.e, understanding the application and also the responses are marked automatically (e.g. multiple choice, true/false, short answer, numerical, graphs visual) which were not possible with traditional assessments, though options of manually marking (e.g. paragraph style questions) can also be done. Informative assessment, often defined as 'assessment for learning', digital tools are increasingly being adopted worldwide in higher education institutions to measure students skills and knowledge, which makes it easier to provide tailored feedback, interventions or action plans to improve learning outcome goals of the institutions by allowing the teachers deep insight. Academic dishonesty commonly known as cheating occurs in all levels of educational institutions. In traditional classrooms, students cheat in various forms i.e, hidden prepared notes not permitted to be used or looking at another student's paper during an exam, copying homework from one another, or copying from a book, article or media without properly citing the source. Individuals can be dishonest due to lack of time management skills, a pursuit for better grades, cultural behavior or a misunderstanding of plagiarism are among the concerns that need to resolved to accomplish this transition. Most students will not complete assignments unless there is an assessment (i.e. motivation). It is the instructor’s role to catalyze student motivation. Online classroom environments are no exception to the possibility of academic dishonesty. Proper assignments types, meetings, and projects can prevent academic dishonesty in the online classroom

Score. Scholars commonly find many negative impacts of traditional paper-and-pencil assessment methods in research, examination-oriented instruction and the inability to assess high-order cognitive abilities and affective attributes are some examples.21, 22 However, the online assessment may also allow the possibilities for cheating, such as hacking. Seventy-five percent of the students in our study could access the examination and do it in the stipulated time. Those who had problems in connectivity were given extra time being their first experience. Once the exam was complete, the students were able to see the correct answers and get their scores immediately. This caused great excitement in the students as they could correct their mistakes and learn from the errors they had committed. E learning is now being routinely used in physiology and done by anatomy and biochemistry. To enhance the utility, this study has led to curriculum changes and 5% on internal assessment should be given to the online assessments to motivate the students and to develop interest.

This type of survey allows facilitators to collect data and feedback on any type of situation where the course or experience needs justification or improvement further to identify gaps in student learning.

Conclusion

The use of the computer-based formative test with automated feedback improved the performance of the students and can be explored as an optional addition to the curriculum of pre-clinical integrated medical program to improve higher academic ability. Since e learning is not well established in India, we hope to create awareness and change the outlook of medical students about online learning and assessment programs. This can lead to the development of an innovative curriculum. Higher education in India is undergoing rapid progress, and can provide e-learning to the undergraduate curriculum.

Source of Funding

None.

Conflict of Interest

None.

References

1 

N Entwistle Styles of learning and teaching (2nd ed.)WylieChichester1987

2 

F Marton R Saljo On qualitative differences in learning. I-outcome and processBr J Educ Psychol19764614110007-0998Wiley

3 

D I Newble K Jaeger The effect of assessments and examinations on the learning of medical studentsMed Educ1983173165710308-0110, 1365-2923Wiley

4 

Mary Peat Sue Franklin Has student learning been improved by the use of online and offline formative assessment opportunities?Aust J Educ Tech 200319187991449-3098, 1449-5554Australasian Society for Computers in Learning in Tertiary Education

5 

Gary M. Velan Rakesh K. Kumar Mark Dziegielewski Denis Wakefield Web-based self-assessments in pathology with Questionmark PerceptionPathol200234328240031-3025Elsevier BV

6 

I Rolfe J McPherson Formative assessment: how am I doing?Lancet1995345895383790140-6736Elsevier BV

7 

Jorge G. Ruiz Michael J. Mintzer Rosanne M. Leipzig The Impact of E-Learning in Medical EducationAcad Med2006813207121040-2446Ovid Technologies (Wolters Kluwer Health)

8 

I Masiello R Ramberg K Lonka Learning in a web-based system in medical educationMed Teach2005275613

9 

N Anderson Applicant and recruiter reactions to new technology in selection: A critical review and agenda for future researchInt J Sel Assess20031112136

10 

D Tavangarian M Leypold K Nölting M Röser Is e-Learning the Solution for Individual LearningJ e-Learning2004

11 

I E Allen J Seaman Sizing the Opportunity: The Quality and Extent of Online Education in the United StatesWellesley, MA2003

12 

Sue Childs Elizabeth Blenkinsopp Amanda Hall Graham Walton Effective e-learning for health professionals and students-barriers and their solutions. A systematic review of the literature-findings from the HeXL projectHealth Info Libr J200522s220321471-1834, 1471-1842Wiley

13 

Philip O Ozuah Undergraduate medical education: Thoughts on future challengesBMC Med Educ2002218101472-6920Springer Science and Business Media LLC

14 

M Rosenberg E-Learning: Strategies for Delivering Knowledge in the Digital AgeMcGraw-HillNew York2001

15 

T Wentling C Waight J Gallaher La Fleur J Wang C Kanfer A E-Learning A Review of Literature2000Urbana-Champaignhttps://learning.ncsa.uiuc.edu/papers/elearnlit.pdf*#

16 

T F Moberg M E Whitcomb Educational technology to facilitate medical students' learning: Background paper 2 of the medical school objectives projectAcad Med199974114650

17 

Jeremy PT Ward Jill Gordon Michael J Field Harold P Lehmann Communication and information technology in medical educationLancet2001357925879260140-6736Elsevier BV

18 

J Dobson The use of formative online quizzes to enhance class preparation and scores on summative examsAdv Physiol Educ200832297302

19 

Kathi Wilson Cleo Boyd Liwen Chen Sarosh Jamal Improving student performance in a first-year geography course: Examining the importance of computer-assisted formative assessmentComputers Educ2011572149315000360-1315Elsevier BV

21 

R Glaser E Silver Assessment, testing, and instruction: Retrospect and prospectRev Res Educ199420393419

22 

J L Herman What research tells us about good assessmentEduc Leadersh199249748



jats-html.xsl


This is an Open Access (OA) journal, and articles are distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 License, which allows others to remix, tweak, and build upon the work non-commercially, as long as appropriate credit is given and the new creations are licensed under the identical terms.

  • Article highlights
  • Article tables
  • Article images

View Article

PDF File   Full Text Article


Copyright permission

Get article permission for commercial use

Downlaod

PDF File   XML File   ePub File


Digital Object Identifier (DOI)

Article DOI

https://doi.org/10.18231/j.ijcap.2020.032


Article Metrics






Article Access statistics

Viewed: 1544

PDF Downloaded: 830