OVERALL ACC: (BEFORE OUTPUT FORMATTER) 14 / 50 = 0.28 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 15 / 50 = 0.3 -------------------------------------------------------------------------------- AGGREGATOR PERFORMANCE: EASY: 14 / 14 = 1.0 HARD: 0 / 9 = 0.0 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 16 / 31 = 0.5161 Single-Span-Multi-Hop-Extraction 11 / 31 = 0.3548 Multi-Spans-Extraction 0 / 13 = 0.0000 YesNo 0 / 0 = NaN Arithmetic-Operations 0 / 1 = 0.0000 Counting 0 / 1 = 0.0000 Date-Duration 0 / 1 = 0.0000 Kinship 1 / 3 = 0.3333 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 0 / 19 = 0.0000 Single-Span-Multi-Hop-Extraction 0 / 19 = 0.0000 Multi-Spans-Extraction 6 / 37 = 0.1622 YesNo 0 / 50 = 0.0000 Arithmetic-Operations 0 / 49 = 0.0000 Counting 0 / 49 = 0.0000 Date-Duration 10 / 49 = 0.2041 Kinship 0 / 47 = 0.0000 --------------------------------------------------------------------------------