Valuation of answer papers

Answer scripts are valued blind by dummy number, on paper or on the screen from scans. One, two or more evaluators never see each other's marks. When marks differ too much a further evaluator or the chief examiner decides, and every mark stays on record for revaluation.
PLANSFrom Growth

Why it matters

In many colleges, bundles of scripts travel from the strong room to staff rooms. The evaluator knows whose script it is, and one mark goes in unchecked. When two evaluators disagree, the final mark depends on who adds it up. SmartMy College hides each student's name behind a six-digit dummy number. Every script goes to one, two or more evaluators who never see each other's marks. A script beyond your limit goes to a further evaluator or the chief examiner, and the final mark follows the rule you wrote down. Scripts can be scanned and valued on the screen, where a bundle is taken only when every page was opened. Every mark of every round is kept, so a revaluation starts from the record.

The problem it solves

  • Scripts travel between the strong room and staff rooms in bundles, and get lost or valued at home.
  • Two evaluators' marks differ, and the rule for the final mark is not written down.
  • An evaluator skips a page, and nobody knows until the student asks for a copy.
  • When a student asks for revaluation there is no record of how the first mark was reached.

How it works

  1. The controller of examinations picks a valuation scheme on the course or exam type, such as two evaluators with a third beyond 15 %. A paper without a scheme is marked the usual way.
  2. After the exam, press Give Dummy Numbers on the paper's Valuation tab. Print the stickers to cover the register number, and the key for the exam cell's safe.
  3. On paper: press Make Bundles, name the evaluator and a due date on each bundle of 30, and Hand Out. On screen: press Upload Scanned Scripts first; a bundle is handed out only when every script has a scan.
  4. Each evaluator opens My Bundles and sees dummy numbers only. They give a mark per script, or per question where the paper came from the question bank. On screen, marks, ticks and remarks go on the page.
  5. Submit Bundle is refused while a script has no mark, or on screen while a page was never opened.
  6. When every round is in, the final mark follows the scheme. A script beyond the limit goes to a further evaluator or the chief examiner. The paper's marks are then written, and results follow.

Everything it does

The valuation scheme

  • Evaluators: 2 to start with; 1, 2, 3 or more, none seeing the others' marks
  • Scripts per Bundle: 30
  • Deviation Limit: 15 % of the maximum, or a number of marks; 0 means no limit
  • Beyond the Limit: one more evaluator (the default) or the chief examiner, whose mark is final
  • Final Mark: average of all (the default), highest, lowest, average of the closest two, the last given, the median, or highest and lowest dropped
  • Final Mark after a Further Round: average of the closest two to start with
  • Rounding: up to the next whole mark (the default), to the nearest, or none
  • Not the Students' Own Teacher: a bundle is refused to a faculty member who teaches the course to a student in it
  • Three schemes come ready; none is set until you choose

Dummy numbers and bundles

  • A random six-digit dummy number per script, unique in the exam; absent, exempted and not-eligible students get none
  • Stickers with the dummy number and its barcode, and a confidential key of register number, name and dummy number
  • A malpractice script is held back until the exam cell releases or cancels it
  • Scripts are mixed again for every round; nobody gets a script they already marked
  • Who wrote a script, every round's marks and the final mark are readable only by the exam cell

Marking on the screen

  • Scans uploaded in bulk: a PDF or pictures per script named by the dummy number, or a ZIP. Or long scans split at every page with a dummy number sticker
  • Scans kept in the account's media storage, never as a public link
  • The page beside the marks: zoom, marks and remarks placed on the page, and tick and cross stamps. Also a pen in red, green or blue, and Strike Through for an unanswered page
  • Front Pages Hidden (0 to start with) keeps the first pages from everyone who values; More Pages Hidden per script
  • Time on screen per page and script; Scripts per Evaluator per Day (0: no limit)
  • Keep the Scans (months): 0 (kept); never deleted while a request about the paper is open

Checks by the chief examiner

  • Check (% of a Bundle): a share of each submitted bundle marked again by the bundle's Checked By; 0 to start with
  • Check Tolerance: 5 marks; one script beyond it sends the whole bundle back to the evaluator
  • On screen, the checker reads every page without seeing the evaluator's marks

Records and revaluation

  • Every mark entered or changed is kept: who, when, old and new
  • A submitted bundle is reopened only by the exam cell, with a reason
  • Revaluation is a round of its own by someone who never marked the script. On Revaluation: the revised mark replaces (the default), the higher stands, or it changes only beyond 15 %
  • The student's copy: with the marks on it (Copy with the Marks on) or the bare scan, read or downloaded on the portal

Evaluators from outside, reports and pay

  • External Evaluators: a login that sees only its own bundles by dummy number and closes when the last one is submitted
  • Deviation List, Valuation by Evaluator, Marks on the Pages, Pages Read
  • Valuation Rates per script and per further round; totals per evaluator as a report, nothing paid from here

Who uses it

Controller of examinations (exam cell)Picks the scheme, gives dummy numbers, uploads scans, hands out bundles, releases held scripts and reopens bundles.
Faculty (evaluator)Values the scripts of their bundles by dummy number, on paper or on the screen.
Chief examinerChecks a share of each bundle, or gives the final mark where the scheme says so.
External examinerValues bundles from a login that sees nothing else.
StudentsAsk for a copy of the valued script and read it on the portal.

Where you use it

  • Web: Examination > Valuation (My Bundles, Bundles to Check, Bundles, Answer Scripts, External Evaluators), the paper's Valuation tab, Configuration > Valuation Schemes and Valuation Rates
  • Marking on screen in a browser, on a computer or a tablet
  • Student portal: the copy of the valued script, once a request is completed
  • Not in the Campus app: valuation is done on the web
  • Not a scanner: scan with the college's own scanner or copier

What you control

Settings

  • Valuation scheme on the course, else on the exam type
  • Evaluators 2; Scripts per Bundle 30; Deviation Limit 15 %; Beyond the Limit: one more evaluator
  • Final Mark: average of all; after a further round: average of the closest two; Rounding: up
  • Check 0 %; Check Tolerance 5 marks
  • Marking: on paper (the default) or on screen; Front Pages Hidden 0; Copy with the Marks on; Keep the Scans 0 (kept)
  • On Revaluation: the revised mark replaces

Approvals

  • Revaluation request: decided by the exam cell before the revaluation round starts; more levels if you add them

Notifications

  • Revaluation Completed: to the student and parents when a request, a copy included, is completed. It goes at once, in the app inbox and by the first channel that reaches them (app push, WhatsApp, SMS or email)
  • No notice goes to evaluators about bundles: they see them under My Bundles

Questions

Do we need double valuation for every course?

No. A paper takes a scheme only where you pick one on the course or the exam type. CIAs can stay with the faculty typing marks, while semester exams use one or two blind evaluators.

Can an evaluator find out whose script it is?

Not from the system. Evaluators see dummy numbers only; the key is readable by the exam cell alone. The sticker covers the register number, and on screen the front pages can be hidden.

What happens when two evaluators differ by a lot?

If the gap is beyond the deviation limit, 15 % of the maximum to start with, the script goes further. Your scheme sends it to another evaluator or the chief examiner. The Deviation List shows every such script.

Do we need a special scanner for on-screen marking?

No. Any scanner or copier that makes PDF or JPG files will do. Name each file by the dummy number, or scan many scripts at once and let the sticker's barcode split them.

Can faculty from another college value our scripts?

Yes. Add them as External Evaluators and create their login. They see only their bundles, by dummy number, and the login closes after the last bundle.

Related features

See your own semester run in it.

Tell us how many students you have, which programmes you run, how you hold examinations and how electives are chosen today. We will show you SmartMy College set up that way.