docs: re-organize sections
This commit is contained in:
parent
753c2d482e
commit
279dce65d1
149
README.md
149
README.md
|
@ -90,7 +90,79 @@ These steps are executed in runner-images. We use `sudo -u tt` to elevate the pe
|
||||||
3. With `joint-teapot joj3-failed-table`, it will update the failed table file in grading repo.
|
3. With `joint-teapot joj3-failed-table`, it will update the failed table file in grading repo.
|
||||||
4. With `joint-teapot joj3-create-result-issue`, it create an issue in the submitter's repo to show the results.
|
4. With `joint-teapot joj3-create-result-issue`, it create an issue in the submitter's repo to show the results.
|
||||||
|
|
||||||
## Models
|
## Components
|
||||||
|
|
||||||
|
### Binaries (under `/cmd` and `/pkg`)
|
||||||
|
|
||||||
|
#### JOJ3
|
||||||
|
|
||||||
|
JOJ3 itself. Parsers and executors are compiled into the JOJ3 binary.
|
||||||
|
|
||||||
|
#### Sample
|
||||||
|
|
||||||
|
Just a sample on how to write an executable that can be called by the executor.
|
||||||
|
|
||||||
|
#### HealthCheck
|
||||||
|
|
||||||
|
The repohealth check will return a json list to for check result. The structure follows the score-comment pattern.
|
||||||
|
|
||||||
|
HealthCheck currently includes, `reposize`, `forbidden file`, `Metafile existence`, `non-ascii character` in file and message, `release tag`, and `ci files invariance` check.
|
||||||
|
|
||||||
|
The workflow is `joj3` pass cli args to healthcheck binary. See `./cmd/healthcheck/main.go` to view all flags.
|
||||||
|
|
||||||
|
### Executors (under `/internal/executors`)
|
||||||
|
|
||||||
|
#### Dummy
|
||||||
|
|
||||||
|
Do not execute any command. Just return empty `ExecutorResult` slice.
|
||||||
|
|
||||||
|
#### Sandbox
|
||||||
|
|
||||||
|
Run the commands in `go-judge` and output the `ExecutorResult` slice. Note: we communicate with `go-judge` using gRPC, which means `go-judge` can run anywhere as the gRPC connection can be established. In deployment, `go-judge` runs in the host machine of the Gitea runner.
|
||||||
|
|
||||||
|
### Parsers (under `/internal/parsers`)
|
||||||
|
|
||||||
|
#### Clang Tidy
|
||||||
|
|
||||||
|
Parser for `clang-tidy`, check `/examples/clangtidy` on how to call `clang-tidy` with proper parameters.
|
||||||
|
|
||||||
|
#### Cppcheck
|
||||||
|
|
||||||
|
Parser for `cppcheck`, check `/examples/cppcheck` on how to call `cppcheck` with proper parameters.
|
||||||
|
|
||||||
|
#### Cpplint
|
||||||
|
|
||||||
|
Parser for `cpplint`, check `/examples/cpplint` on how to call `cpplint` with proper parameters.
|
||||||
|
|
||||||
|
#### Diff
|
||||||
|
|
||||||
|
Compare the specified output of `ExecutorResult` with the content of the answer file. If they are the same, then score will be given. Just like a normal online judge system.
|
||||||
|
|
||||||
|
#### Dummy
|
||||||
|
|
||||||
|
Does not parse the output of `ExecutorResult`. It just output what is set inside the configuration file as score and comment. Currently it is used to output metadata for `joint-teapot`.
|
||||||
|
|
||||||
|
In `joint-teapot`, it will take the content before `-` of the comment of the first stage with name `metadata` as the exercise name and record in the scoreboard. (e.g. If the comment is `p2-s2-0xdeadbeef`, then the exercise name is `p2`.)
|
||||||
|
|
||||||
|
The comment in `metadata` can also be used to skip teapot commands. With `skip-teapot` in the comment, teapot will not run. And with `skip-scoreboard`, `skip-failed-table`, and `skip-result-issue`, only the corresponding step will be skipped, while the others will be executed. (e.g. If the comment is `p2-s2-0xdeadbeef-skip-scoreboard-skip-result-issue`, then only failed table step in teapot will run.)
|
||||||
|
|
||||||
|
#### Healthcheck
|
||||||
|
|
||||||
|
Parser for the `healthcheck` binary mentioned before.
|
||||||
|
|
||||||
|
#### Keyword
|
||||||
|
|
||||||
|
Match the given keyword from the specified output of `ExecutorResult`. For each match, a deduction of score is given. Can be useful if we do not have a specific parser for a code quality tool. Check `/examples/keyword`.
|
||||||
|
|
||||||
|
#### Result Status
|
||||||
|
|
||||||
|
Only check if all the status of the executor is `StatusAccepted`. Can be used to check whether the command run in the executor exit normally.
|
||||||
|
|
||||||
|
#### Sample
|
||||||
|
|
||||||
|
Parser for the `sample` binary mentioned before. Only used as a sample.
|
||||||
|
|
||||||
|
## Models (for developers only)
|
||||||
|
|
||||||
The program parses the configuration file to run multiple stages.
|
The program parses the configuration file to run multiple stages.
|
||||||
|
|
||||||
|
@ -116,78 +188,3 @@ Check the `Result` at <https://github.com/criyle/go-judge#rest-api-interface>.
|
||||||
|
|
||||||
- `Score int`: score of the stage.
|
- `Score int`: score of the stage.
|
||||||
- `Comment string`: comment on the stage.
|
- `Comment string`: comment on the stage.
|
||||||
|
|
||||||
## Binaries (under `/cmd` and `/pkg`)
|
|
||||||
|
|
||||||
### JOJ3
|
|
||||||
|
|
||||||
JOJ3 itself.
|
|
||||||
|
|
||||||
#### CLI arguments
|
|
||||||
|
|
||||||
1. `-meta-conf` to specify the meta configuration file path. JOJ3 will try to match the commit message by the `regex`, once matched, the configuration file in the `filename` will be load and run the whole process.
|
|
||||||
2. `-msg` to specify message to trigger the running. If empty, JOJ3 will use git commit message on HEAD.
|
|
||||||
|
|
||||||
### Sample
|
|
||||||
|
|
||||||
Just a sample on how to write an executable that can be called by the executor.
|
|
||||||
|
|
||||||
### HealthCheck
|
|
||||||
|
|
||||||
The repohealth check will return a json list to for check result. The structure follows the score-comment pattern.
|
|
||||||
|
|
||||||
HealthCheck currently includes, `reposize`, `forbidden file`, `Metafile existence`, `non-ascii character` in file and message, `release tag`, and `ci files invariance` check.
|
|
||||||
|
|
||||||
The workflow is `joj3` pass cli args to healthcheck binary. See `./cmd/healthcheck/main.go` to view all flags.
|
|
||||||
|
|
||||||
## Executors (under `/internal/executors`)
|
|
||||||
|
|
||||||
### Dummy
|
|
||||||
|
|
||||||
Do not execute any command. Just return empty `ExecutorResult` slice.
|
|
||||||
|
|
||||||
### Sandbox
|
|
||||||
|
|
||||||
Run the commands in `go-judge` and output the `ExecutorResult` slice. Note: we communicate with `go-judge` using gRPC, which means `go-judge` can run anywhere as the gRPC connection can be established. In deployment, `go-judge` runs in the host machine of the Gitea runner.
|
|
||||||
|
|
||||||
## Parsers (under `/internal/parsers`)
|
|
||||||
|
|
||||||
### Clang Tidy
|
|
||||||
|
|
||||||
Parser for `clang-tidy`, check `/examples/clangtidy` on how to call `clang-tidy` with proper parameters.
|
|
||||||
|
|
||||||
### Cppcheck
|
|
||||||
|
|
||||||
Parser for `cppcheck`, check `/examples/cppcheck` on how to call `cppcheck` with proper parameters.
|
|
||||||
|
|
||||||
### Cpplint
|
|
||||||
|
|
||||||
Parser for `cpplint`, check `/examples/cpplint` on how to call `cpplint` with proper parameters.
|
|
||||||
|
|
||||||
### Diff
|
|
||||||
|
|
||||||
Compare the specified output of `ExecutorResult` with the content of the answer file. If they are the same, then score will be given. Just like a normal online judge system.
|
|
||||||
|
|
||||||
### Dummy
|
|
||||||
|
|
||||||
Does not parse the output of `ExecutorResult`. It just output what is set inside the configuration file as score and comment. Currently it is used to output metadata for `joint-teapot`.
|
|
||||||
|
|
||||||
In `joint-teapot`, it will take the content before `-` of the comment of the first stage with name `metadata` as the exercise name and record in the scoreboard. (e.g. If the comment is `p2-s2-0xdeadbeef`, then the exercise name is `p2`.)
|
|
||||||
|
|
||||||
The comment in `metadata` can also be used to skip teapot commands. With `skip-teapot` in the comment, teapot will not run. And with `skip-scoreboard`, `skip-failed-table`, and `skip-result-issue`, only the corresponding step will be skipped, while the others will be executed. (e.g. If the comment is `p2-s2-0xdeadbeef-skip-scoreboard-skip-result-issue`, then only failed table step in teapot will run.)
|
|
||||||
|
|
||||||
### Healthcheck
|
|
||||||
|
|
||||||
Parser for the `healthcheck` binary mentioned before.
|
|
||||||
|
|
||||||
### Keyword
|
|
||||||
|
|
||||||
Match the given keyword from the specified output of `ExecutorResult`. For each match, a deduction of score is given. Can be useful if we do not have a specific parser for a code quality tool. Check `/examples/keyword`.
|
|
||||||
|
|
||||||
### Result Status
|
|
||||||
|
|
||||||
Only check if all the status of the executor is `StatusAccepted`. Can be used to check whether the command run in the executor exit normally.
|
|
||||||
|
|
||||||
### Sample
|
|
||||||
|
|
||||||
Parser for the `sample` binary mentioned before. Only used as a sample.
|
|
||||||
|
|
Loading…
Reference in New Issue
Block a user