OVERALL ACC: (BEFORE OUTPUT FORMATTER) 22 / 50 = 0.44 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 21 / 50 = 0.42 -------------------------------------------------------------------------------- AGGREGATOR PERFORMANCE: EASY: 22 / 22 = 1.0 HARD: 0 / 18 = 0.0 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 9 / 30 = 0.3000 Single-Span-Multi-Hop-Extraction 16 / 30 = 0.5333 Multi-Spans-Extraction 0 / 2 = 0.0000 YesNo 8 / 15 = 0.5333 Arithmetic-Operations 0 / 1 = 0.0000 Counting 0 / 0 = NaN Date-Duration 0 / 1 = 0.0000 Kinship 0 / 0 = NaN Wiki-Json-Inference 1 / 1 = 1.0000 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED ACCORDING TO THE DISPATCHER): ACC Single-Span-Extraction 0 / 20 = 0.0000 Single-Span-Multi-Hop-Extraction 0 / 20 = 0.0000 Multi-Spans-Extraction 1 / 48 = 0.0208 YesNo 0 / 35 = 0.0000 Arithmetic-Operations 10 / 49 = 0.2041 Counting 0 / 50 = 0.0000 Date-Duration 11 / 49 = 0.2245 Kinship 0 / 50 = 0.0000 Wiki-Json-Inference 0 / 0 = NaN --------------------------------------------------------------------------------