Editing tests
Inspect and edit grader tests, observed expected output, comparisons, and points. Reapprove and rerun validation after changes.
Written By Alan Gandy
Last updated About 2 hours ago
The Tests tab on Review & Edit controls what the grader checks. Generated tests are a starting point; instructors should inspect each one before approval.
Check each test
Review its name, input, expected result, comparison method, and points. Choose exact output matching when formatting is part of the requirement, contains matching for a meaningful substring, or a regular expression when valid outputs vary. Keep the total score aligned with your course grading plan.
CodeTeach must derive expected results by running the working solution on each input. If a test disagrees with the intended requirement, determine whether the solution is wrong, the test input is wrong, or the comparison is too strict. Do not simply make an incorrect solution pass.
Edit and revalidate
Add missing happy-path, boundary, and error cases. Edit or remove invalid cases. Regenerating tests can replace manual changes, so review the resulting set carefully. Any test edit invalidates prior approval and quality validation; review the complete package, approve the instructions, and rerun the check before Deploy.
During Deploy, CodeTeach builds the GitHub Actions grading files from this approved test set and validates them again. Learn how validation works.
More in Reviewing & Validating
How generation and quality validation workWhen validation fails — fixing itStill need help? Ask the team