Run_ID for the run.
1 or 2 or 3 or 4 or 5.
Judgment pool priority:
1=highest;
5=lowest.
Automatic or Human.
Automatic:
If indexing based on any combination of
1. ASRTEXT2003A;
2. ASRTEXT2004A;
3. ASRTEXT2006A;
4. ASRTEXT2006B;
5. AUTOKEYWORD2004A1;
6. AUTOKEYWORD2004A2;
including the optional use of synonyms and/or broader
terms for one or both of the AUTOKEYWORD fields.
Human: otherwise.
Manual or Automatic.
Manual:
If any human intervention was involved, including
1. any changes to the system implementation after reading the
evaluation topics;
2. any manual editing of the contents of
the topic fields that are used; and
3. any adjustments made to system output based on human
examination of the system results; and
4. bug fixes to the system after examining the topics
result in manual runs.
Automatic: otherwise.
EN (for English) or CS (for Czech) or
FR (for French) or DE (for German) or ES (for Spanish).
Query language used.
Query fields used.
Document fields indexed.
Yes or No
Yes: Synonyms used for MANUALKEYWORD field.
No: otherwise.
Yes or No
Yes: Synonyms used for AUTOKEYWORD2004A1 field.
No: otherwise.
Yes or No
Yes: Synonyms used for AUTOKEYWORD2004A2 field.
No: otherwise.
Number of broader term levels? (zero if not used)
...
More runs here...
...