Mettl’s assessments have been the biggest filter in our recruitment process. Their platform has helped us reach out to a higher volume our applicant numbers. Mettl constantly keeps innovating on their products and tries to introduce a new aspect to everything.
What started as an experiment has grown into a go-to solution, helping countless academicians and students tide over the educational continuity challenges concerning examinations. From doing away with the setting up of physical exam centers to give exams remotely and expediting the evaluation process irrespective of the scale, online proctoring has empowered the education community to surmount every obstacle in these uniquely challenging circumstances of a global health emergency.
In its varied manifestations, proctoring has been the best alternative for universities, colleges and other centers of learning the world over. In fact, proctoring has now become the foremost consideration for a variety of exams. The scope of proctoring is evolving rapidly, with a radically developing technology.
Until now, online proctoring required a trustworthy invigilator known as a ‘proctor’ to monitor students remotely using a computer. The prerequisite to such a proctoring was switching on the audio and video on the test-takers’ computers. A real-time video of the students would stream on the proctor’s system, from start to finish, to ensure compliance with the exam guidelines.
Mostly, the proctors hired for invigilation are not faculty members, but trained professionals adept at remote proctoring nuances, thereby assuaging concerns with strict scrutiny. They offered notable supervision and control over cheating.
There are several ways a proctor gathers information, monitoring the
Thus, a human proctor does everything to lend credibility and integrity to the examination process and preserve the educational organization’s reputation.
Eminent online proctoring service providers offer a competitive advantage to universities and educational centers, globally, by enabling ‘auto proctoring’ in exams.
Auto proctoring meaning AI-enabled automated proctoring that helps conduct online examinations without human intervention. It is an advanced form of proctoring that ensures minimal chances of error and 95 percent accuracy in predicting distractions or other suspicious activities.
A proficient auto proctoring system considers human proctor’s observations using an algorithm. It can replicate the way humans process information and make the right decisions. Hence, auto proctoring enhance human abilities, not just replaces them.
An auto proctored online test is an incredibly flexible and convenient option for students and a highly scalable approach for institutes. From ensuring the test-taker’s authenticity, identifying other faces in a testing environment, to restricting any form of on-screen cheating, auto proctoring is an additional set of eyes during an examination process that flags untoward instances. It also records the proceedings, adding it to the exam administrator’s results for a later review and assessment. Such levels of reliability lend incredible ease and integrity to the process of auto-proctoring online exams.
Auto proctored test meaning an auto proctoring mechanism guided by AI to prevent, detect and gather evidence of any untoward activity during an online auto-proctored test.
Here’s how an automated proctoring system operates:
After mining and analyzing hoards of data on patterns and trends in test-takers’ behavior, an AI algorithm is trained by experts to assist in proctoring. The AI empowers the system with predefined parameters to gauge candidates’ behavior and movements. The AI’s advanced algorithms enable it to predict, flag and register even the minutest of discrepancies and suspicion.
This AI algorithm is then created into logic or reasoning and embedded into the system. Hence, when auto proctoring is initiated, the AI imbibes the information it sees for processing and assessment, just like a human proctor. This logic is customizable. After understanding the learning and measurable outcomes for respective exams, blueprints are created with logic for the algorithm to catch various discrepancies.
The system must receive the following, to ensure a seamless auto proctoring experience:
Mercer | Mettl has a proprietary algorithm, the ‘Credibility Index,’ which is an excellent predictor providing administrators with the most relevant results. Credibility Index auto-generates a report that highlights the applicants’ integrity scores for a proctored session.
With valuations showcased as high, medium and low, examiners can swiftly identify and filter out candidates who may have resorted to cheating.
The Credibility Index takes inputs from Mercer | Mettl’s proctoring flags and the test-finish status.
These flags and conditions are:
It indicates the number of times students attempt cheating, using on-screen aids such as opening unauthorized websites, accessing blacklisted software/third-party applications, enabling browsers and cheating tools.
The analysis is based on the insights mentioned-above, guaranteeing the authenticity and validating the online proctoring process.
Three types of online auto proctoring eliminate cheating:
Each of these auto proctoring types allows the examiner or the administrator to validate whether the test-taker has taken the exam fairly. Similarly, the stored data ensures transparency for the test-taker, enabling them to refute false claims to preserve their credibility.
Online video proctoring meaning the test-taker’s entire proctoring session is recorded automatically by the system. This continual video streaming is then played by the exam administrator at their convenience to check for suspicious activities during the online exam. The examiner analyses the flags raised by the AI during the session and their understanding of the test-takers’ actions to eliminate malpractice instances. A discernible advantage of a video proctoring exam is that it does not require strict scheduling since the test-takers can take the exam at their chosen time. Video proctoring is similar to a webcam proctored test. A video proctoring system is adequate for low-stakes exams.
Audio proctoring software scans the test-takers’ physical environment for additional sounds or noises using the microphone to ensure a cheating-free exam. It is useful in ascertaining the differences between sounds that can and must not be in a testing environment. For example, Mercer | Mettl’s audio proctoring software is robust enough to alienate sounds for students taking an exam in a cyber cafe. This proctoring accurately identifies details such as low sound levels, whispers, mumbling and other such discrepancies to ensure a safe examination environment.
Image proctoring is a type of auto proctoring that captures the test-takers’ photos in real-time when they appear for the test. A robust proctoring service provider will provide random snapshots/live images of the test-takers’ screens and presence in front of the camera at regular intervals, preferably every ten seconds. These images taken through their system’s webcams are time-stamped and stored on the cloud for review. Image proctoring is relatively cost-effective as compared to video streaming quality but is equally reliable.
Apart from lending fairness and feasibility to the invigilation process, auto proctored tests simplify the entire examination process for both educators and students. They make auto proctored cheating difficult, also streamlining the examination infrastructure in several ways. Here’s how:
By handling hundreds of data points and a vast number of students at any given time, auto proctoring can meet the requirements of any medium-stakes large-scale examination. From stringent monitoring, real-time tracking, to ease of exam evaluation, auto proctoring offers unmatched efficiencies. Auto proctoring enables instant report generation that is ready-to-use for further action. Subsequently, auto proctoring’s quality assurance and improved accuracy, without compromising the score or integrity, significantly reduce the burden on assessors.
To err is human. But for a machine? According to an individual innovation report, “Artificial intelligence has a margin of error of 3 percent; humans, 5 percent,” but a machine’s ability to solve problems and maximize efficiencies is beyond human capacity. Auto proctoring cannot replace humans. The AI makes its work more coherently by sharing accurate predictions, measurable performance and data-backed insights. It doesn’t get tired or make careless mistakes while delivering on the massive responsibilities it entails. Hence, it is morally trained to perform transparently and validate its detections, reducing the margin for errors.
AI embedded auto proctoring test provides examiners with an exceptional advantage like no other- a limited navigation control feature to prevent on-screen cheating. Students’ test screens get locked once they begin their online proctored exam. This lockdown mode prevents them from opening new browser tabs/incognito tabs/windows. It blocks functions such as copying/pasting, restricts keys such as Alt+Tab/ Cmd+Tab/ 3-finger swipe. Auto proctoring also prevents access to secondary devices, such as cables, hard drives or external devices such as the USB or internet dongle, during the exam. If students have already synced any such device before the test or attempt to sync them during the test, the AI will either not commence the test or immediately terminate it and log out the student. The disabled external ports also prevent bypassing or illegal booting.
Using the world’s most popular learning management systems (LMSs), such as Moodle, Blackboard or Canvas or a personal legacy LMS? Auto proctoring can be easily configured with any platform or system. The proctoring feature can be initiated by installing a proctoring extension on your browser, allowing the examiners to schedule an auto proctoring mode without compromising the quality or functionality. No human presence is involved in supervision.
Auto proctoring can be easily customized to meet various online testing needs. Depending on the exam levels’ authenticity, custom settings are enabled at the examiners’ request. At a fundamental level, for exams such as a test quiz or a subject test, one can record the exam screen in real-time via a webcam while the AI measures students’ actions. The test environment will be different if you take it a notch higher, say for an online certification examination. The examiner can ask the proctoring service provider to add more logic for stricter cheating detection.
AI-enabled proctoring eliminates the resource-intensive task of setting up physical exam centers, exponentially reducing the expenses incurred in setting up exam-related infrastructure. Auto proctoring does away with the need for human intervention, saving the cost of hiring proctors.
Mercer | Mettl’s next-generation auto proctoring technologies lend fairness, ethics and progressiveness to a myriad of online exams by negating the possibility of malpractices. It is transforming the operation of an examination system, from automating work, to increasing scale, effectiveness and accuracy in measuring exams and assessments. Mercer | Mettl’s auto proctoring technology is robust enough to simultaneously support multiple exam-takers, across various locations globally, with bandwidth as low as 512kbps. Its ability to create the technology that mimics human abilities and improves their understanding transcends any other service provider on the market.
Considering different user requirements, Mercer | Mettl provides examiners with a dedicated admin dashboard for detailed analytics, including event logs and recording details for their auto proctoring requirements. Here are some other notable features that set Mercer | Mettl’s next-generation auto proctoring technology apart:
Mercer | Mettl’s auto proctoring algorithm is trained with more than 2.8 million online proctored exams and assessments. It detects up to 18 dynamic digressions with over 95 percent accuracy. Its intelligent algorithm is configured to flag various suspicious cases, such as the non-visibility of face/ presence, detection of mobile phone, presence of an additional person, a distracted eye movement, and much more, to eliminate the most glaring vulnerabilities with a dynamic set of anti-cheating features.
Mercer | Mettl has conducted 150,000 assessments in a day – 70 percent of them proctored remotely using an AI-based algorithm. The robust technology has a proven track record of delivering results at all levels. Most recently, it accomplished a noteworthy feat of conducting over one lakh proctored assessments in a day, along with hosting multiple universities and students simultaneously. Its impressive load testing data further showcases its volume proficiency. In a 60-minute time slot, the company successfully hosted a pool of 1000 candidates joining simultaneously, every minute of the hour.
Digitally-savvy individuals are relatively particular about customer service and expect immediate resolution of concerns. This is why Mercer | Mettl’s prompt customer service personnel enable every client to extract maximum value.
Its world-class, 24/7 customer relations support piques clients’ interest as it efficiently responds to queries and details the product offerings. Its troubleshooting skills concerning a user or a technical bug is impressive, enhancing the overall user experience. The team’s uninterrupted and prompt high-quality assistance is renowned across time zones.
Academic integrity during any level of assessment is Mercer | Mettl’s utmost priority. This is validated by its prestigious educational partnerships with renowned institutes across the globe. The likes of Cambridge Assessment, Christ University Bangalore, IIM Bangalore, The Washington Center (The USA), Jordan Hospital (The Middle East), EBZ Business School, Germany have leveraged auto proctoring to maintain their academic schedules.
Data breach, security hazards and privacy risks are global concerns. Such issues prompt a sharper focus on regulations such as Europe’s General Data Protection Regulation (GDPR) and ISO certification to strengthen data privacy. The auto proctoring system follows a stringent security protocol to safeguard both test-takers’ and clients’ data. It is hosted on Amazon Web Services (AWS), a highly secure cloud platform for storage and computation. It uses HTTPS (256 bit SSL encryption) for secure data transmission while ensuring the safety and encryption of all data available with it. From enabling multi-factor authentication to ensuring that the right person is logging onto the correct account, to laying clear guidelines on who can view and access the various system resources, Mercer | Mettl is exceptionally particular about security.
Mercer | Mettl’s online proctoring services are efficient, time-saving and tailor-made, based on clients’ budgetary allocation. An auto-proctored online test system is readily accessible and affordable for all high, medium, and low-stakes exams. However, customer satisfaction always takes precedence. Therefore, one of Mercer | Mettl’s best practices involves offering a free product trial to determine its effectiveness and usability before employing its online proctoring software.
Below are the answers to some frequently asked queries by institutes and universities concerning auto proctored meaning, auto proctored cheating, auto proctored hack and auto proctoring tools.
An online auto proctoring test is where the AI is used to automate the manual task of proctoring. For instance, Mercer | Mettl’s online proctoring services are sophisticatedly class apart.
It is almost impossible to cheat in an online proctored exam because of its powerful anti-cheating features offered by proctoring service providers such as Mercer | Mettl.
Originally published October 22 2020, Updated December 21 2020
Shirisha has been helping countless brands gain traction with her content. Her deep understanding of the education sector and sound knowledge of technical skills have helped her structure the most creative solutions for key stakeholders. Shirisha has also ghosted pieces for several industry honcho’s successfully published both online and offline. When she's not keeping up with the world, you're sure to find her catching up on bollywood stories or gramming for fun.
Online remote proctoring is the technology through which exams are conducted online in a cheating-free manner, using high-speed internet and a computer with a webcam. Online remote proctoring uses video streaming and AI or human proctors to invigilate large-scale exams securely.