OVERALL ACC: (BEFORE OUTPUT FORMATTER) 16 / 50 = 0.32 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 17 / 50 = 0.34 -------------------------------------------------------------------------------- AGGREGATOR PERFORMANCE: EASY: 16 / 16 = 1.0 HARD: 0 / 12 = 0.0 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 16 / 31 = 0.5161 Single-Span-Multi-Hop-Extraction 15 / 31 = 0.4839 Multi-Spans-Extraction 0 / 13 = 0.0000 YesNo 0 / 0 = NaN Arithmetic-Operations 0 / 1 = 0.0000 Counting 0 / 1 = 0.0000 Date-Duration 1 / 1 = 1.0000 Kinship 1 / 3 = 0.3333 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 0 / 19 = 0.0000 Single-Span-Multi-Hop-Extraction 0 / 19 = 0.0000 Multi-Spans-Extraction 12 / 37 = 0.3243 YesNo 0 / 50 = 0.0000 Arithmetic-Operations 0 / 49 = 0.0000 Counting 0 / 49 = 0.0000 Date-Duration 10 / 49 = 0.2041 Kinship 0 / 47 = 0.0000 --------------------------------------------------------------------------------