Proctor Instructor Guide

Post-Exam Proctoring Guide

This guide describes how to proctor a recorded exam session with Proctor by Constructor.

What is Post-Exam Proctoring?

Post-exam proctoring is the process of reviewing recorded exam sessions to ensure that test takers did not misbehave. Unlike live proctoring, post-exam proctoring involves invigilating one examinee at a time.

Here's how post-exam proctoring works:

  1. An examinee takes a test while their screen, webcam, and microphone are being recorded.
  2. Constructor Proctor AI analyzes the examinee's behavior and generates alerts that are saved in the session log.
  3. After the exam concludes, a recording of the session, along with the event log, is stored in the archive.
  4. The proctor accesses the recorded session from the archive.
  5. The proctor reviews the event log to examine alerts detected by AI during the session.
  6. If the proctor identifies an exam rule violation that AI did not detect, they manually add it to the event log.
  7. If the exam was taken fairly, the status is set to 'Approved.' If the examinee misbehaved, the proctor sets the session status to 'Declined.'

Let's examine the post-exam proctoring process step by step.

Preparation

Sign In and Open Archive

  1. Open Google Chrome or Microsoft Edge and go to the proctoring dashboard URL.
  2. Sign in with your proctor credentials:
  3. Click Menu > Archive:
    • In the archive, you will see all recorded exam sessions:

Search, Filters, Basic Session Information

  • To find all sessions from a particular test-taker, enter their name or email address in the “Find in archive” field:
  • To filter out recordings that you don’t want to see in the list, use Filters:
    By applying a filter, you can show only recordings that were made in a certain time period, recordings that haven’t been reviewed yet, etc.
  • Each recording on the list is displayed with a number of indicators showing you some basic information about it:
IndicatorExplanation
AI-calculated cheating scoreProctor AI aggregates all generated alerts during a session to calculate a percentage-based probability of cheating for a specific student. A higher score indicates a greater likelihood that the student was cheating.
Session IDThis is a unique numeric identifier for each session. Enter it in the search field to locate a session in the archive.
Proctoring statusCan be “Unknown”, “Approved”, or “Declined”. This status represents the final outcome of a review conducted by a proctor, indicating whether the exam was taken fairly or not.
Video availabilityIndicates whether video recordings (webcam, screen sharing) from the session are fully processed and available for viewing.
Server-side AI review statusThis shows whether the session was reviewed by the server-side AI, a more advanced version of the AI that operates in the examinee's browser during the exam. This AI can detect two additional types of violations: the presence of a smartphone and headphones/earphones in the webcam view.
  • If you hover the cursor over one of the indicators, you will see a tooltip that explains the current state of the selected indicator:

Review Process

  • When you decided which session to proctor, click on its thumbnail or session ID:
  • You will land on the post-exam proctoring interface:

It allows you to identify the examinee, watch their webcam and screen-sharing videos in sync, review AI-detected alerts, manually add warnings, mark violations, and set the review status to either “Approved” or “Declined”.

Identification & Exam Rules

  • Examinees are typically required to take photos of their ID and face before their exam starts, which helps you verify the identity of the person in the session. For instance, you can click on the ID photo and compare the name on the document with the username on the platform, located just above the photo:
  • If the names do not match, scroll down the page, select the appropriate option, set the review status to “Declined,” and then click Send:
  • Review the exam rules to understand which actions were permitted 1 and which were prohibited 2 during the exam:
  • Hovering your cursor over any of these rules will display a tooltip explaining the rule:

Review AI-Detected Alerts

The most efficient way to begin proctoring a session is to first review the alerts detected by Proctor AI during the exam. This approach allows you to focus on specific moments of interest, potentially indicating misbehavior, saving you the time of watching the entire session. Here’s how you do that:

  • Enable AI alerts display:
  • These alerts will be displayed in the session’s event log with this icon:
  • To rewind the recording to 5 seconds before the event that triggered the AI alert, click on the starting timestamp:
    Then, you can watch the session recording from that moment and verify whether the AI Proctor’s suspicions are valid.
  • If you see that the AI-detected alert is valid, confirm it by clicking the corresponding button:
  • You can view a list of all alerts detectable by AI and control which ones appear in the event log. By default, all alerts are displayed. However, if you select at least one, only the checked alert types will be shown:

Watch the Recording

Each exam session features two synchronized videos: one from the webcam and one screen recording. This setup allows you to simultaneously observe the examinee and their monitor's display at any point during the exam.

  • Click play to watch the videos:
    You can also start playback by left-clicking on either video or by pressing the spacebar.
  • To navigate through the video, move the playhead:
  • To increase playback speed, use the 1x-10x slider:
  • To zoom in on a video, right-click on it:
    Right-click on the video again to minimize it.

Add Alerts Manually

While watching the video, if you spot a moment where the examinee misbehaved, you can pause the video and manually add an alert. Here’s how to do it:

  1. Click Add warning:
  2. Select the corresponding alert type from the list:
  3. To see all manually added alerts or AI ones you confirmed, enable “Confirmed by Proctor”:

Finish Review

After watching the entire session and adding warnings for all instances of misbehavior, you are ready to submit the proctoring review. This review will determine whether the student's exam score is trustworthy.

  1. Scroll the page down to see Status detection in post proctoring:
  2. If you believe the examinee failed proctoring, check all the reasons why their session should not be accepted. For instance, select "Prohibited Sites" if the examinee searched for exam answers on the web. If you don't find a suitable violation type for the session you're reviewing, type in your explanation in the "Other" field.:

Set final status

  • If the examinee was not misbehaving and you wish to approve their results, select the corresponding status and click Send:
  • If the examinee committed a serious violation of the exam rules, such as attempting to copy exam questions, set their status to Declined.

Open the Next Session

Setting the status concludes the post-exam proctoring process, and you can now return to the Archive to open a new session for proctoring.