OVERALL ACC: (BEFORE OUTPUT FORMATTER) 485 / 752 = 0.6449468085106383 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 488 / 752 = 0.648936170212766 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED): ACC SCORE MEAN SCORE STD-VAR Single-Span-Extraction 0.6351 0.9097 0.1597 Single-Span-Multi-Hop-Extraction 0.6734 0.8979 0.1714 Multi-Spans-Extraction 0.0000 1.0000 0.0000 YesNo 0.9014 0.9737 0.0488 Arithmetic-Operations 0.3333 0.7443 0.2885 Counting 0.0000 0.0000 0.0000 Date-Duration 0.2692 0.8558 0.2561 Kinship 0.9194 0.9839 0.1260 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED): ACC SCORE MEAN SCORE STD-VAR Single-Span-Extraction 0.0602 0.7649 0.2458 Single-Span-Multi-Hop-Extraction 0.0241 0.8158 0.2127 Multi-Spans-Extraction 0.0000 1.0000 0.0000 YesNo 0.0000 0.9765 0.0829 Arithmetic-Operations 0.0091 0.4262 0.3168 Counting 0.0833 0.0000 0.0000 Date-Duration 0.6064 0.8128 0.2643 Kinship 0.0000 0.1667 0.3727 --------------------------------------------------------------------------------