OVERALL ACC: 107 / 217 = 0.4930875576036866 -------------------------------------------------------------------------------- DISPATCHER PERFORMANCE (ANSWER MODE TOP-1): GRND/PRED SS MS YN ARI CNT CMP CS DD KS Single-Span-Extraction 148 0 0 0 0 0 0 0 0 Multi-Spans-Extraction 0 19 0 0 0 0 0 0 0 YesNo 0 0 26 0 0 0 0 0 0 Arithmetic-Operations 0 0 0 1 0 0 0 0 0 Counting 0 0 0 0 2 0 0 0 0 Comparing-Members 0 0 0 0 0 3 0 0 0 CommonSense 0 0 0 0 0 0 0 0 0 Date-Duration 0 0 0 0 0 0 0 12 0 Kinship 1 0 0 0 0 0 0 0 5 -------------------------------------------------------------------------------- DISPATCHER PERFORMANCE (ANSWER TYPE): GRND/PRED PER D-D LOC ORG NUM YN KIN EVT OBJ MISC Person 20 0 0 0 0 0 0 0 0 0 Date-Duration 0 47 0 0 0 0 0 0 0 0 Location 0 0 23 0 0 0 0 0 0 0 Organization 0 0 0 14 0 0 0 0 0 0 Num-Measure 0 0 0 0 19 0 0 0 0 0 YesNo 0 0 0 0 0 26 0 0 0 0 Kinship 0 0 0 0 0 0 10 1 0 0 Event 0 0 0 0 0 0 0 2 0 1 Object 0 0 0 0 0 0 0 0 52 0 Misc 0 0 0 0 0 0 0 0 0 2 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED): ACC score MEAN SCORE STD-VAR Single-Span-Extraction 0.5608 0.8822 0.1836 Single-Span-Multi-Hop-Extraction 0.5878 0.8588 0.2183 Multi-Spans-Extraction 0.0526 0.0000 0.0000 YesNo 0.4231 0.9201 0.1519 Arithmetic-Operations 0.0000 0.9946 0.0000 Counting 0.0000 0.0000 0.0000 Date-Duration 0.0833 0.6025 0.3222 Kinship 0.8000 1.0000 0.0000 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED): ACC SCORE MEAN SCORE STD-VAR Single-Span-Extraction 0.0000 0.7412 0.2754 Single-Span-Multi-Hop-Extraction 0.0000 0.8509 0.1986 Multi-Spans-Extraction 0.0208 0.0000 0.0000 YesNo 0.0000 0.9958 0.0007 Arithmetic-Operations 0.0227 0.3860 0.3329 Counting 0.0909 0.0000 0.0000 Date-Duration 0.6027 0.8438 0.2437 Kinship 0.0000 1.0000 0.0000 --------------------------------------------------------------------------------