X

Get awesome marketing content related to Hiring & L&D in your inbox each week

Stay up-to-date with the latest marketing, sales, and service tips and news
Computer-Based-Exams

Talent Assessment | 6 Min Read

Computer-Based Exams: The Future of the Education Sector

Introduction

The steep rise in COVID-19 cases is a global challenge for industries and sectors and education is no exception. Institutions that believed the disruption to mitigate soon are now rightfully concerned about students’ distress, delay in examinations, results and academic sessions. They are taking several approaches to bring continuity to their curricula and academic sessions. While some have canceled their remaining exams, a majority of universities are contemplating shifting to computer-based testing

computer_based_test

Often, institutes don’t see the bigger picture, factoring in minor challenges that accompany online examinations. Though the adoption of online examination may have been gradual, the ongoing global disruption must expedite the process of embracing technology by doing away with unfounded concerns about online exams. 

Many universities in India have already undertaken the transition. Given the social, financial and geographical diversity among students at Mumbai University and its affiliated colleges, University officials are considering a combination of options, including online and physical exams, for college and varsity exams that have not occurred due to lockdown.

An official statement by Nagpur University reads:

“We are contemplating holding (a) 30% objective, 70% descriptive question paper. (A) Thought is also being given to the possibility of holding examinations online.”

In a meeting held between Vice-Chancellors (VC) of different varsities and Delhi Chief Minister (CM) and his deputy, VCs apprised the CM of their decision to conduct the remaining exams online. The Delhi Technological University (DTU) has also decided to conduct all its end-term examinations for theory subjects in the online mode. The exams would be conducted through an Artificial Intelligence(AI)-enabled platform with online invigilation, thus maintaining its integrity.  

There has been a discernible rise in computer-based testing, indicating that institutions are likely to continue with the online mode of exams even after the end of the COVID-induced lockdown, which underlines the advantages associated with online examinations.

What is a Computer-Based Examination System

Computer testing refers to the role of computers in delivering the assessments as an alternative to pen and paper. Such a test can be conducted online through the use of the internet or a computer-aided facility. It is a time-efficient and effective means of hosting large-scale online examinations concurrently. It enables educational institutions to evaluate students’ performance in a short time irrespective of students’ geographical location. Features such as online invigilation, randomization of questions, managing a large number of students and test completion upon the expiration of the stipulated time, lend uniqueness to computer-based exams. 

Assessments have been in use for the selection process for a very long time. Traditional approach based tests were widely used before the digital era. With internet technology seeping into different aspects of life and computing gadgets becoming an imperative necessity, can online assessments be far behind! The computer-based test has some potential benefits when compared with traditional assessment methods. Computer testing finds its use in various sectors such as education, government and corporate sector. All the stakeholders involved in the web-based exam format such as the assessors, participants, proctors, administrators, selectors, etc. get benefitted from this medium.

The need for conducting computer-based examinations has rightly increased, given the current situation. There are serious concerns about educational continuity, with universities and schools being shut indefinitely, causing a delay in examination results and the consequent onset of the next academic year. The ubiquitousness of several computer-based examination systems must encourage institutions to shift to online examinations. Computer-based exams (CEB) provide auto-grading and section-wise feedback. They provide easy-to-use and reliable assessment results using cutting-edge technological innovation. For instance, videos or slideshows to assess medical students during surgery or virtual simulations to assess social skills have revolutionized the way exams are being conducted. Besides, the corporate sector also emphasized using computer-based tests to identify the best candidate for available job roles. It simplifies the first level of screening when there aren’t enough applicants. The online CBT exam also comes in handy for shortlisting candidates with adequate skills and talent, thus selecting the right candidates for a face-to-face interview.

Application of Computer Testing:

Web-based exams can be utilized for any exam or during a mass hiring process that has assessment tests as one of an integral part of the screening /elimination process. Computer testing is also used by the management to assist employees in their career advancement. By understanding the strengths and weaknesses of candidates, the learning and development team can devise adequate training programs for workforce development. A well-informed workforce keeps the business sustainable and competitive.

 The Adoption of Computer-Based Exams

There has been a gradual adoption of computer-based exams, with the last two decades witnessing the most profound shift.  This is because computer-based tests continue to offer numerous benefits compared to pen-and-paper tests. Some of the advantages include:

  •       Increased delivery
  •       Administration and scoring efficiency
  •       Improved test security
  •       Consistency and reliability
  •       Faster response rate

-(Riku, Laurif and Ari, 2001)

The advancement in educational technology delivered ample opportunities to measure complex reasoning, which could not be gauged via traditional exams (Bodmann and Robinson, 2004)2. Furthermore, computer-based assessments established a link between observation and interpretation. These enabled institutions to analyze a student’s performance based on actionable items to measure the aptitude to make a fair comparison. (Pellegrino, Chudowsky and Glaser, 2001).

Students’ Experience

Numerous researches conducted over the last two decades indicate students’ responses to the computer-based examination system. The consensus reflects positive feedback.

  •  The National University of Singapore had introduced CBT back in 2004. Lim et al., in 2006, conducted an online survey to understand how the final year MBBS students adapted to the new system. Out of 213 students, 80% preferred CBT, 9.6% liked the traditional method. Meanwhile, 10.5% were not sure.
  •  Ayo et al., 2007 proposed a model for online examination in Nigeria to curb the irregularities of its entrance exam conducting body. The model was already tested in Covenant University. Out of the 1023 students, most first-time online test-takers found the test to be easy. 24% of the students who found it challenging, adjusted with time.
  • Karadeniz researched in 2009 to study the influence of paper, web and mobile-based assessments on the success of students. The paper revealed that students had a positive outlook toward web and mobile-based assessments due to its ease of use, and comprehensive and instant feedback. Paper-based tests emerged to be the least favorite.

Teachers’ Experience

A majority of researchers have greatly emphasized the impact of the ed-tech revolution on students and educational institutions. Teachers, however, have remained largely at the periphery of decision making. A study was undertaken in Pakistan to understand the teachers’ opinions on computer-based vs. paper-based exams. The study revealed the following:

  • The Higher Education Commission, Pakistan, should plan to train university teachers for conducting computer-based examinations to enable them to evaluate large groups of students in a shorter time frame.
  • Computer-based exams save time. 
  • Computer-based tests facilitate students to develop their understanding, thus improving their grade-point average (GPA).

Types of Computer-Based Tests

CBT allows institutions to conduct large-scale online examinations without compromising the credibility of the results. A stellar online examination platform can feature various test types, such as:

types_of_computer_based_test

Advantages of Computer-Based Testing

Computer-based tests have various advantages over traditional examination methods. From conducting exams to delivering reports, computer-based exams have made the examination smoother. CBTs offer multiple benefits to online learners, instructors and e-learning programs in terms of administering, grading and scaling-up process, which explains why it’s crucial in today’s times. Listed below are some benefits of computer testing:

  • Administration of Multiple Assessments

Learners can partake in several assessments throughout the e-learning program. The data collected from these evaluations can be correlated with specific standards (can be regional or national) for evaluating learners based on these standards. Data gathered over the period will be useful for program instructors to identify key focus areas for improvement. Such data is also exportable from various learning management systems into a database where data analysis for evaluation and research purposes takes place.  

  • Dynamic and Personalized tests

Computer-based tests are easy to be personalized to students. The difficulty level of each question can be changed based on the learner’s prior responses. The web-based exam can be taken a notch up by using video applications that enable the instructor to reach out to individual learners and offer them oral assessments. Students can also use apps that allow them to share their questions, opinions, etc.

  • Instant Grading

Multiple choice or True/False questions form the core of select-response tests. Such assessments can be graded immediately, not only enabling candidates to analyze their performance but also allowing instructors to change their approach based on the data garnered from computer testing. Instant grading will enable instructors to focus on those points, which are crucial for learning. Online assessment, depending on its functionality, can prove useful in terms of shedding some light on potential areas of improvement for students.

  • Extensions for Open-ended Assessments 

For most instructors, grading open-ended assessments (projects/ portfolios that use rubrics ) is a time-consuming activity. Online rubric extensions, such as Google Sheets add-ons, enable automated scoring rubrics that provide insightful feedback to both teachers and students.

  • Vertically Aligned or Horizontally Aligned Tests

Vertically aligned tests are used to assess the same knowledge at varying levels of difficulty. Horizontally aligned tests are useful for comparing learners against each other (used mainly in filtering out candidates for scholarships), teaching roles and more. Computer testing provides raw test scores that learners eventually receive either in the form of a percentile score or a letter grade.

  • Uncovers new aspects of thinking

Gamification can reveal underlying aspects of a student’s problem-solving skills and help instructors in measuring their higher-order thinking skills. By having students play computer-based tests that focus on digital learning games and evaluating their rationale behind making game-based decisions, online program instructors can personalize and tailor future learning experiences to each student.

  • Helpful for candidates with special needs

Computer testing is useful for candidates with special needs for the features it offers, such as text-to-voice and voice-to-text applications, screen reader, magnification, Braille keyboard and similar tools. Using these tools, candidates can take up assessments more conveniently than ever before.\

  • Analytics 

LMSs generate lots of back-end data, such as duration of the task, number of log-ins, and number of posts that can be correlated with an individual’s performance-based data to keep a tab on his/her progress in an online course. Moreover, student-centric analytics can provide learners with in-depth insights into their performance and notify them about reminders such as assignment due dates, and early warnings ( if their performance is weak). Such actionable insights can enable students to focus on areas that need improvement before the final test. Instructors can utilize analytics to measure the effectiveness of course resources, track student engagement, and the percentage of items correctly answered by the students. This way, insights can be utilized for introducing new interventions.

  • Integrity:

There are various security features inherent in the computer-based testing to ensure that test integrity is maintained.

Anywhere, Anytime

Unlike the traditional examination system, there is no need for students to commute to physical test centers when appearing for an online exam. CBT has enabled students to select an exam slot as per their convenience. Especially now, when social distancing and restricted traveling are globally accepted norms, conducting online exams from any corner of the world has given hope to universities.

Saves Time and Resources

The time consumed in creating question papers, registration, arranging supplies and evaluation can be avoided with online exams as it automates the entire process. Additionally, there is significantly lower consumption of resources, such as stationery, invigilators, or transport facilities.

Scalable

Since the computer-based examination system offers a robust platform, it can support a large number of exams. A stellar computer-based exam software can support over 1,00,000 proctored tests and can be further scaled without spending significantly.

Autograding

This eliminates the scope of human error and the hassle of allotting evaluation duties to teachers. Multiple-choice questions can be auto-graded easily. This facilitates institutions to churn out real-time reports. There is also a considerable saving in terms of the time spent in evaluating a large number of answer sheets.

Click Here to Know More

How Does a Computer-Based Assessment Software Work

how_does_a_computer_based_assessment_software_work_computer_based_test

Conducting online examinations is not as tedious as it seems. Computer-based assessment software is user-friendly and can be easily configured.

Step 1: Set-Up the Exam

The first step to organizing a computer-based assessment is uploading questions. Good online examination software allows you to upload 17 types of questions. The integration of the learning management system (LMS) and the examination platform occurs here.

Step 2: Invite Test-Takers

Exam authorities upload bulk student data, thus saving on significant time spent in gathering and updating candidates’ details. Invitation e-mails are sent to students, post which they can select a suitable exam slot.

Step 3: Authorize and Proctor Tests

ID-based authentication, AI-based live proctoring, screen recording and browsing tolerance are some features that eliminate impersonation and malpractices, thus making the results as credible as traditional pen-and-paper tests.

Step 4: Real-Time Results

A computer-based assessment software provides real-time results that can be customized and shared in PDF or HTML format.

Step 5: Group-Level Analytics

In addition to individual reports, thorough data analysis provides useful group-level insights that can be used in the future.

Click Here to Know How to Conduct Computer-based Exams Seamlessly

maintain_the_integrity_of_computer_based_exam

Candidate Authentication

Before the exam, candidates need to show an id proof, click a live picture on the webcam and submit their admit card. This is followed by providing a one-time password received by students via e-mail. The three-step authentication negates any possibilities of impersonation.

Navigation Control

A world-class computer-based assessment software creates a highly secure environment for test-takers by disabling background apps, browsers, or screen sharing. The candidates are barred from browsing outside the exam window and are warned if the system catches such an activity.

Online Proctoring

Online proctoring ensures that candidates adopt no unfair means to clear an exam. There are three kinds of proctoring:

Auto Proctoring:

AI-based examination platforms monitor the candidate’s live feed and auto-flags a variety of cases that endanger the sanctity of exams.

Live Proctoring:

A human proctor monitors the live feed, communicates with the students for any queries, and can pause or resume a test in real-time.

Recording:

The unlimited video recording storage allows recording of a proctored session for reviewing later. Navigation to a specified time in the recording is also possible.

Business Impact

How Mercer | Mettl empowered IIM Bangalore to conduct secure online proctored exams

About the Institution

Founded in 1973, the Indian Institute of Management Bangalore (IIMB) is an acclaimed public business school (B-school). The institute offers a comprehensive range of post-graduate, doctoral and executive programs. In addition to its notable academic courses, the institute facilitates research, provides consulting services, conducts seminars, educational conferences, and publishes insightful journals.

Requirements

  • Robust platform

    IIMB needed a dynamic end-to-end examination platform that was easily accessible and location-agnostic for learners and examiners. The B-school wanted a platform that would support multiple question types and exam formats without any operational hassles.
  • Preserve the academic integrity

    Since the exams were online and attempted remotely by candidates, the B-school’s requirement was a robust anti-cheating setup, with an online invigilation mechanism to ensure candidates attempting the test couldn’t resort to any illicit means.

Solution

After careful consideration, IIMB was recommended a suite of Mercer | Mettl’s futuristic online technologies:

  •       Online Examination Platform
  •       Mettl’s Proctoring as a Service (MPaaS)

Both these value propositions were synergized with IIMB’s existing requirement and its future need to enable blended learning.

Impact

  • The institute witnessed a drastic reduction in instances of cheating after shifting to Mercer | Mettl’s examination tools.
  • With Mercer | Mettl’s automated result feature, the results were generated almost instantaneously.
  • The institute was able to offer credible certificates to deserving students after evaluating the actual performance.

How to Attempt Computer-Based Tests?

Students new to computer testing may experience few difficulties in taking computer-based tests. If you are not familiar with web-based exams, you should understand the necessary steps before entering the CBT exam.

Listed below are the steps for attempting computer testing:

  • Click on the “exam’’ icon to start your assessment.
  • After clicking it, a test window will open. The opening page will ask you to enter such details as a username and passcode for the exam. The exam board has already given you this information. Fill up every required space with the information that you are asked about. Click on the tab ‘’NEXT’’ to proceed further with the exam.
  • The next page will be opened. This page will include instructions such as test duration, types of questions and things to remember before attempting the questions.
  • You’ll find a call-to-action button that says “START EXAM”. Clicking on it will open a new page that includes initial questions of your test. As you move up through the pages, you will notice questions in proper sequence.
  • At the top of the test window, there will be a timer bar indicating the remaining time for the exam.
  • Each question will require respondents to choose one option from multiple choices, or there will be an ample space for writing explanatory answers, in case of subjective questions.
  • There is a ‘’SUBMIT’’ button at the end of each question. After answering the questions, click on this button to submit your responses. If you don’t submit your responses, you won’t be given marks for these answers.
  • You can use the NEXT PAGE” and “PREVIOUS PAGE” arrows for moving to the next and previous pages. There can also be a straight bar that lists all the page numbers for you to access a specific page by clicking it.
  • It depends on the test creator, whether there will be one question per page or more. The point is you shouldn’t invest the time you have on a question you don’t know the answer to, just leave that and get on to the next one. You must first attempt all the easier questions and address the complex problems at the end of the test if time allows.
  • It may be the case that you have reached the last page of the online test but skipped a few questions. The asterisk (*), a star-shaped symbol, denotes the number of questions that have not been attempted on some pages. You can go back to those pages to try these questions.
  • At the bottom of the last page of the exam, there will be a “FINISH” button. Click on the tab to finish the assessment after completing all the questions. In some exams, results come out as soon as you hit the finish button. But in some cases, your scores may also be sent via email or postal address.

How Mercer | Mettl Can Help?

reinvent_examination_in_the_digital_age_computer_based_test

key_business_benefits_of_using_our_examination_technology_computer_based_test

References

Originally published August 13 2020, Updated August 13 2020

Megha Singh

Written by

A writer at heart, Megha has been in the content industry for 4 years. Starting her career from print, her journey spans across IT, legal and consulting industries. She has been associated with Mercer | Mettl as Assistant Manager, Content Marketing for 2 years.

Would you like to comment?

X

Please write a comment before submitting

X

Thanks for submitting the comment. We’ll post the comment once its verified.

Related posts

Get awesome marketing content related to Hiring & L&D in your inbox each week

Stay up-to-date with the latest marketing, sales, and service tips and news