An Online Programming Judge System - ประวัติรุ่นแก้ไข

Jittat: /* Grade Script */

2008-03-26T03:18:25Z

Grade Script

2008-03-26T03:17:20Z

Grade Script

2008-03-26T03:02:22Z

Check Script

2008-03-09T16:28:06Z

Run Script

2008-03-09T15:10:10Z

Overall process

2008-03-09T15:07:49Z

The Scripts

2007-10-11T14:09:32Z

Grade Script

2007-10-11T09:08:39Z

Compile Script

2007-10-11T08:34:47Z

Run Script

2007-10-11T07:16:22Z

Run Script

@@ แถว 127: / แถว 127: @@
 * <tt>result</tt>: Must have the following format.
   <the total points earned by the solution program for the problem>
-* <tt>comment</tt>: Any message the grade script wants to output. Useful for messages like "You suck!" or "Kanat would have done it 10 times faster than you did!".  Currently the default grade script summarizes all the comments from the check script, by concatenating all shorten messages under this mapping: <tt>Correct</tt> -> "<tt>P</tt>", <tt>Incorrect</tt> -> "<tt>-</tt>", <tt>Time out</tt> -> "<tt>T</tt>". The check script can explicitly specify the message for each test case by printing <tt>Comment:</tt>''<tt>your-comment</tt>'' on the first line.
+* <tt>comment</tt>: Any message the grade script wants to output. Useful for messages like "You suck!" or "Kanat would have done it 10 times faster than you did!".  Currently the default grade script summarizes all the comments from the check script, by concatenating all shorten messages under this mapping: <tt>Correct</tt> -> "<tt>P</tt>", <tt>Incorrect</tt> -> "<tt>-</tt>", <tt>Time out</tt> -> "<tt>T</tt>", and <tt>x</tt> for any other error messages. The check script can explicitly specify the message for each test case by printing <tt>Comment:</tt>''<tt>your-comment</tt>'' on the first line.
 * For each test run, the grade script should produce two files
 :* <tt>result-#</tt>, where # is the number of the run: Must have the following format:

@@ แถว 127: / แถว 127: @@
 * <tt>result</tt>: Must have the following format.
   <the total points earned by the solution program for the problem>
-* <tt>comment</tt>: Any message the grade script wants to output. Useful for messages like "You suck!" or "Kanat would have done it 10 times faster than you did!"
+* <tt>comment</tt>: Any message the grade script wants to output. Useful for messages like "You suck!" or "Kanat would have done it 10 times faster than you did!".  Currently the default grade script summarizes all the comments from the check script, by concatenating all shorten messages under this mapping: <tt>Correct</tt> -> "<tt>P</tt>", <tt>Incorrect</tt> -> "<tt>-</tt>", <tt>Time out</tt> -> "<tt>T</tt>". The check script can explicitly specify the message for each test case by printing <tt>Comment:</tt>''<tt>your-comment</tt>'' on the first line.
 * For each test run, the grade script should produce two files
 :* <tt>result-#</tt>, where # is the number of the run: Must have the following format:

@@ แถว 95: / แถว 95: @@
 After the check script finishes running, it will write the file <tt>check.result</tt> to the current directory. The file has the following format:
-* The first line contains a message from the check script. Most of the time, the message is simply <tt>Correct</tt> or <tt>Incorrect</tt>.
+* The first line contains a message from the check script. Most of the time, the message is simply <tt>Correct</tt>,  <tt>Incorrect</tt>, or <tt>Time limit exceeded</tt>.
 * The second line contains the score the program gets.
 For examples,

@@ แถว 66: / แถว 66: @@
   <the status of the testing, such as "Correct" or "Incorrect">
   <the point gained through this test data>
-  <the time used by the solution program in milliseconds, as outputted by /usr/bin/time>
+  <the time used by the solution program in milliseconds, as outputted by /usr/bin/time under format %Er%Uu%Ss>
 For examples,
   Correct
-:00.00
+:00.00r0.00u0.00s
 or
   Time limit exceeded
-:05.00
+:05.00r4.00u0.50s
 * <tt>comment</tt>: Any diagnostic messages the script wishes to output. Useful for comparing differences between the correct output and the submitted program's output.

@@ แถว 30: / แถว 30: @@
 * Reads <tt>test_cases/all_tests.cfg</tt>
 * For each test case:
-** Calls <tt>run</tt> script, which will
+** Calls <tt>run</tt> script, which
-*** Executes the compiled code
+*** Executes the compiled code (using box)
-*** Calls <tt>check</tt> script.
+*** Checks the output, usually by calling the <tt>check</tt> script.
 * After all test cases are run and checked (by the check script called by the run script), it calls the <tt>grade</tt> script.

@@ แถว 25: / แถว 25: @@
 == The Scripts ==
 === Running the Scripts ===
 It is guaranteed that when the above 4 scripts are being run, the environment variable PROBLEM_HOME will be set to the problem's directory.
@@ แถว 69: / แถว 79: @@
 === Check Script ===
-The check script is optional. It receives three inputs: (1) the language the user's program was written in, (2) the test case number, and (3) the output file the user program produced. (Note that the output file can be just a dump of the program's output to the standard output.) The check script can be invoked as follows:
+The check script is usually called by the <tt>run</tt> script.  If the <tt>run</tt> script checks the output itself, the check script is not needed.
   $PROBLEM_HOME/script/check <language> <test-number> [<output-file>]
 <tt><output-file></tt> is optional. If it is not specified, then it is assumed to be <tt>output.txt</tt>. The followings are some examples of valid invocations of the check script.

@@ แถว 110: / แถว 110: @@
 After the script runs, it should leave the following files in the current directory.
 * <tt>result</tt>: Must have the following format.
-  point <the total points earned by the solution program for the problem>
+  <the total points earned by the solution program for the problem>
 * <tt>comment</tt>: Any message the grade script wants to output. Useful for messages like "You suck!" or "Kanat would have done it 10 times faster than you did!"
 * For each test run, the grade script should produce two files
 :* <tt>result-#</tt>, where # is the number of the run: Must have the following format:
-  point <the points earned by the program for this test run>
+  <the points earned by the program for this test run>
 :* <tt>comment-#</tt>. where # is the number of the run: Any message the grade script wants to output. Useful for messages like "Can't finish this test run? What a n00b."

@@ แถว 39: / แถว 39: @@
 Before the script runs, the current directory will have the file <tt><input-file></tt>, the source submitted by the user. If <tt><input-file></tt> is not specified, it is assumed to be "<tt>source</tt>".
-After the compile script finishes running, it must create the file <tt><compile-result></tt> in the current directory. The file is empty if the compilation is successful, and contains the compiler's error message otherwise. If <tt>compile_result</tt> is not specified, it is assumed to be "<tt>compile_result</tt>".
+After the compile script finishes running, it must create the file <tt><compile-result></tt> in the current directory. The file is empty if the compilation is successful, and contains the compiler's error message otherwise. If <tt>compile_result</tt> is not specified, it is assumed to be "<tt>compiler_message</tt>".
 If the compilation is successful, the result of the compilation should be contained in the file <tt><output-file></tt>, which, again, should reside the current directory. If <tt><output-file></tt> is not specified, it is assumed to be "<tt>a.out</tt>".