Skip to main content
Reviewing & Validating

Editing tests

Inspect and edit grader tests, observed expected output, comparisons, and points. Reapprove and rerun validation after changes.

Written By Alan Gandy

Last updated About 2 hours ago

The Tests tab on Review & Edit controls what the grader checks. Generated tests are a starting point; instructors should inspect each one before approval.

Check each test

Review its name, input, expected result, comparison method, and points. Choose exact output matching when formatting is part of the requirement, contains matching for a meaningful substring, or a regular expression when valid outputs vary. Keep the total score aligned with your course grading plan.

CodeTeach must derive expected results by running the working solution on each input. If a test disagrees with the intended requirement, determine whether the solution is wrong, the test input is wrong, or the comparison is too strict. Do not simply make an incorrect solution pass.

Edit and revalidate

Add missing happy-path, boundary, and error cases. Edit or remove invalid cases. Regenerating tests can replace manual changes, so review the resulting set carefully. Any test edit invalidates prior approval and quality validation; review the complete package, approve the instructions, and rerun the check before Deploy.

During Deploy, CodeTeach builds the GitHub Actions grading files from this approved test set and validates them again. Learn how validation works.