When selecting a Task from the Submission Management card on the Participants Dashboard, please note that Tasks are grouped by Entities which have previously registered to them (Team in this example).
If you are part of a single Team you should see only one Teamname above the Tasklist. Otherwise there will be more options to select tasks from.
Select a respective Task for your Team to get to the Submission Management page.
In order to make a submission you will need to create at least one System, unless a System has already been created. Number of allowed system as well as System parameters might vary accoring to the rules of the Evaluation plan.
Create new Systembutton on the top right and you will be redirected to the New System page.
On the submission management page you will notice a matrix-like structue with rows representing Sytems and columns representing Evaluation Phases. Each row X column intersection can host a Submission (or a set thereof).
A Submission represents your system output in form of a file or URL considered to be scored, validated or evaluated. One or multiple Scoring Runs are created per Submission automatically.
To create a new submission:
Uploadbutton in the appropriate System X Phase slot to load the New Submission page.
Browsebutton to upload a File
Submitbutton your file will be uploaded and you will be redirected to the Submission Management page. A green/red top bar will report if the file-upload was sucessful.
View Submissionbutton. The number behind the submission represents a unique submission-id which you can use if you want to refer to a specific submission.
To access scoring run results, click on the
Scoring Run Status button.
The content of the button represents the
scoring run status and will change over time
Submitted, to custom
messages indicating various steps of the
backend scoring pipeline, to
Done/Successful or in most cases
a label representing the scoring run
results, f.e. a
Metric score. The
content varies for each Evaluation phase
Clicking on the button will load the Scoring Run Report page. The content of the page varies throught Evaluations:
The page might be empty in case no results are being shared
Or contain a single metric score:
Or a more complex report