Introduction
Education is not merely imparting knowledge to the students according to the social constructivist theory. Learning is a continuous process and it is heavily influenced by sociocultural stimuli, previous knowledge, emotional beliefs, values, and attitudes.1 Technology plays a positive role in student learning. While e-assessment are often wont to broadly ask any practice where technology is employed to reinforce or support assessment and feedback activities.2 When students are actively involved in the process of learning and are surrounded by a supportive learning environment, they gain the motivation that is essential to succeed. Moving to online education reduces human interaction which could hinder the transition to incorporate technology in education.3 Online tests are used regularly used within the learning management system (LMS) either as aptitude or as essay type in recent years to medical students to make them aware of online learning and assessment in our institution. During Covid-19 lockdown online learning and assessment was done extensively. So, the purpose of the study is to know the student’s perception regarding the changes in learning and assessment tools. If their opinion was not taken into serious consideration, measures taken to solve problems become unsatisfactory solutions.
Materials and Methods
Study subjects of this project were undergraduate 1st Year Medical students of Tertiary level teaching Medical Institute, India are recruited by volunteer recruitment process. It was a cross sectional type of study done for the duration 1month from the date of Institute Human Ethical committee approval of the Institute. All 1st year MBBS students age 18 and above with a minimum of 3 online exams were attended by them at the end of their course were included for the study. The online Google form survey questionnaire was distributed to all 1st year medical students and the data was obtained. Whoever responded to the questionnaire within the duration of study project was taken as a study sample.
Cross sectional survey using Google form with a set of standard questionnaires, for 1st year undergraduate medical students were done to assess their perception and personal details. The purpose of this study was explained in detailed to the study participants in the beginning of the questionnaire. A set of valid questionnaires used earlier by Baleni., 2015 was used in this survey tool 4 with modifications and the newly added questions were validated by face validation, peers & subject expert validation. The survey questions were grouped under two categories 1) Demographic details and 2) Perception of students on the advantages and disadvantages of online assessment compared to traditional method. Anonymity of the students and the confidentiality of the results was strictly maintained. The results were assessed based on 5-point Likert scale scoring using the descriptive and inferential statistics. All data were entered into an online Google Form Questionnaire sheet and then into Excel spreadsheet (MS Excel 2011).
Results
At the end of one-month period 115 students gave consent and responded to both open & close ended questions.
Age
Out of 115 students 110 students responded. The age variations among them are starting from 18 years to 22 years. (Figure 1)
Gender
Out of 115 students, 114 students responded to this question, out of which 68 students are female and 46 students are male. (Figure 2)
Computer literacy
Out of 115 responses, 49.6% students felt confident in handling the newer technology during their first online assessment and the 48.2% students wanted online trial test before the main test for comfortability to face the online assessment but 14.9% students felt that online trial test will not make any difference in imparting knowledge in a newer technology. (Table 1)
Close ended questionnaire scoring by Likert scale
Total no. of questions in this category is 27.
Likert scale ranging from strongly agrees (SA), Agree (A), Not Sure (NS), and Disagree (DA) to Strongly Disagree (SDA).
Attributes of good assessment
It was assessed by Q.No -1, 2, 3 & 4 and the results were analyzed (Table 2).
Table 2
Attributes of online assessment
Advantages of online assessment
Perception of students on the advantages of online assessment were analyzed by 14 questions (Q.No- 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 20, 21 & 24) in (Table 3).
Table 3
Advantages of online assessment
Disadvantages of online assessment
It was assessed by Q.No – 5, 16, 18, 19, 22, 23 & 26 in (Table 4)
Table 4
Disadvantages of online assessment
Discussion
COVID-19 pandemic situation has made many educational institutions to close all over the world. The spread of this virus has tested the preparedness of all health science universities to deal with a crisis, which required advanced technology in ICT to enable learning and assessment effectively through online. Many institutions have become interested in developing and delivering best course content by online T-L method and also to assess the students for the same by effective online assessment tools.5
Among the 115 students’ responses, in our study we found that age distribution varied from 18 years of age to 22 years but majority of the students i.e., nearly 88 students aged 19 and above (Figure 1). Female students have responded more i.e., about 60% of the responses are from female students and 40% from male students (Figure 2).
Competency and experience of students in online test
Nearly 50% of the students felt competent to handle newer technology, but they need to undergo online trial test 1 or 2 times before feeling comfortable to implement online test.
(Table 1) from these results we understood that the students had already experience in handling online test. This is because in our university we had a working Learning Management system (Ganesha Canvas) where as a part of Competency Based Medical Education (CBME) students were exposed to online MCQ’s and assignment during their Self-Directed Learning (SDL) time. According to Boitshwarelo et al.,6 online tests were used extensively within LMS in both online and mixed mode delivery worldwide in many higher educations. Even though 50% of students felt competent in handling online assessment in first time itself, the other 50% agreed to have online trial test which would make them comfortable and easier to handle it. This was in align with Alruwais et al.,7 stated in her study that student’s poor knowledge in handling the ICT is one of the challenges in online assessment and recommended to improve the technical infrastructure and train the students to handle the newer technology.6
Attributes of assessment
Question no 1, 2, 3 & 4 checks the attributes of good assessment. In question no: 1 on accessibility of online test there was mixed reaction out of 115 responses only 25.7% agreed and only 7% strongly agreed upon it. This was not in align with a study done in south Africa by Baleni Z4 where in his university 70% of the students were strongly agreeing to the accessibility of online test compared to traditional method.8 Accuracy of paper checking and showing favoritism by the faculty was asked in question 2 & 4, where nearly 50% of the students remained neutral and around 30% of students agreed on it. Our results were not in align with the study done by Ridgway et al.,9 where 100% of the students agreed on the accuracy of online test grading. On the reliability of using technology in assessment around 45% of the students agreed and around 35% -40% were neutral and less than 20% disagreed. Many studies supported our statement that newer technology cannot be reliable due to internet connection problem and other glitches in technical area.10
Advantages of online assessment over traditional method
Question no: 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 20, 21 & 24 were grouped together to know the student’s perception on the advantages of online assessment.
In the study done by Alruwais et al.,7 stated that students prefer E-assessment, because they can have more control and also easy to use if they are trained in it. It also provides immediate feedback which motivates the students to learn it better. Prompt and comprehensive feedback along with multiple attempts can help students in improvising their learning.4 In our study also we found that majority of the students were positively agreeing to the advantages of the online test in form of timely feedback, multiple attempts and revisiting the study material before each attempt and preparing for the test seriously due to constructive & immediate feedback which was not happening in paper-based exam and it also added value to SDL because they take their ownership in learning.
Disadvantages of online assessment over traditional method
Question no: 5, 16, 18, 19, 22, 23 & 26 were grouped under this category.
Regarding the disadvantages of online test many studies stated that attending online test would be stressful even though it is paper free because of non-reliability of technology to upload or submit the answers on time even with timer on. Moreover, lack of personal interaction with faculty leads to poor performance in the examination.3 In our study also we found that majority of the students agreed to the disadvantages mentioned above and 50% of the students agreed that they were constantly motivated to learn throughout the course is because of conventional assessment method only. The major drawback of online assessment is cheating/ plagiarism which was mentioned in many studies3, 4, 11 and even 60% of our students agreed it openly with 30% remained neutral and only 10% disagreed to the statement. Out of 115 responses there was 1/3rd responses for agreement, 1/3rd for neutral and 1/3rd for disagreement for the comfortability of using online test and only 25% of faculty prefer to choose online assessment over conventional method. This may be due to fact that it is always difficult to give up the old habits and to accept newer habits or methods. The study done in Arab University also found the same findings.3
Conclusion
So from our study we found that it was difficult to switch from conventional to online method in the form of learning or assessment even though the advantages of online methods overweigh the traditional method. But they show their willingness to adapt to blended learning method which gives us a positive hope that over a period of time with regular training in ICT for students as well as educating them about the importance of digitalization in education can change their mindset to accept the 21st century outcome-based education.
Article DOI
