Can a participants results remain anonymous?
No. All similarity matrices and performance scores submitted to NIST become the property of NIST. NIST does not conduct anonymous challenge problems and evaluations. NIST will, at its discretion, report attributed performance. If initial reports do not contain labeled or completely labeled results, this does not imply a participant’s performance will not be labeled in future reports. • Why is there no score normalization option for the 1-Many Matching task? (Score normalization can improve identification performance provided the score for every pair of gallery signatures is available, in addition to the scores between the query signature and all gallery signatures.) A: In similarity score normalization, the input is a set of similarity scores s(G,q) between a Gallery G a query q. The output is a new set of similarity scores s’(G,q). The new set of similarity scores is function of only the original set of similarity scores s(G,q). In the 1-many matching task, the input is a gallery G an
No. All similarity matrices and performance scores submitted to NIST become the property of NIST. NIST does not conduct anonymous challenge problems and evaluations. NIST will, at its discretion, report attributed performance. If initial reports do not contain labeled or completely labeled results, this does not imply a participant’s performance will not be labeled in future reports.