OVERALL ACC: 459 / 752 = 0.6103723404255319 -------------------------------------------------------------------------------- DISPATCHER PERFORMANCE (ANSWER MODE TOP-1): GRND/PRED SS MS YN ARI CNT CMP CS DD KS Single-Span-Extraction 492 4 0 0 0 0 0 0 0 Multi-Spans-Extraction 0 72 0 0 0 0 0 0 0 YesNo 0 0 71 0 0 0 0 0 0 Arithmetic-Operations 0 0 0 6 0 0 0 0 0 Counting 0 0 0 0 11 0 0 0 0 Comparing-Members 0 0 0 0 0 6 0 0 0 CommonSense 0 0 0 0 0 0 0 0 0 Date-Duration 1 0 0 0 0 0 0 25 0 Kinship 1 2 0 0 0 0 0 0 61 -------------------------------------------------------------------------------- DISPATCHER PERFORMANCE (ANSWER TYPE): GRND/PRED PER D-D LOC ORG NUM YN KIN EVT OBJ MISC Person 78 0 0 0 1 0 0 0 0 0 Date-Duration 0 110 0 0 0 0 0 0 0 0 Location 0 0 110 0 0 0 0 0 0 0 Organization 0 0 0 80 0 0 0 0 0 1 Num-Measure 0 0 0 0 66 0 0 0 0 0 YesNo 0 0 0 0 0 71 0 0 0 0 Kinship 0 0 0 0 0 0 63 1 1 1 Event 1 0 0 0 0 0 0 12 0 1 Object 0 0 0 0 0 0 0 0 138 2 Misc 0 0 0 0 0 0 0 0 0 15 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED): ACC score MEAN SCORE STD-VAR Single-Span-Extraction 0.6431 0.8920 0.1818 Single-Span-Multi-Hop-Extraction 0.6734 0.8979 0.1714 Multi-Spans-Extraction 0.0000 0.0000 0.0000 YesNo 0.5352 0.9402 0.1089 Arithmetic-Operations 0.3333 0.7443 0.2885 Counting 0.0000 0.0000 0.0000 Date-Duration 0.2692 0.8558 0.2561 Kinship 0.9194 1.0000 0.0000 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED): ACC SCORE MEAN SCORE STD-VAR Single-Span-Extraction 0.0482 0.7605 0.2285 Single-Span-Multi-Hop-Extraction 0.0241 0.8158 0.2127 Multi-Spans-Extraction 0.0158 0.0000 0.0000 YesNo 0.0000 0.9914 0.0147 Arithmetic-Operations 0.0091 0.4262 0.3168 Counting 0.0833 0.0000 0.0000 Date-Duration 0.6064 0.8128 0.2643 Kinship 0.0000 1.0000 0.0000 --------------------------------------------------------------------------------