OVERALL ACC: (BEFORE OUTPUT FORMATTER) 114 / 208 = 0.5480769230769231 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 112 / 208 = 0.5384615384615384 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED): ACC SCORE MEAN SCORE STD-VAR Single-Span-Extraction 0.4662 0.9042 0.1618 Single-Span-Multi-Hop-Extraction 0.6241 0.9087 0.1663 Multi-Spans-Extraction 0.0000 1.0000 0.0000 YesNo 0.9000 0.9884 0.0275 Arithmetic-Operations 1.0000 1.0000 0.0000 Counting 0.0000 0.0000 0.0000 Date-Duration 0.2500 0.7655 0.3243 Kinship 0.9231 1.0000 0.0000 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED): ACC SCORE MEAN SCORE STD-VAR Single-Span-Extraction 0.0000 0.8495 0.1923 Single-Span-Multi-Hop-Extraction 0.0000 0.7900 0.2285 Multi-Spans-Extraction 0.0000 1.0000 0.0000 YesNo 0.0000 0.9920 0.0074 Arithmetic-Operations 0.0556 0.5073 0.3127 Counting 0.0556 0.0000 0.0000 Date-Duration 0.5669 0.8241 0.2460 Kinship 0.0000 0.6154 0.4865 --------------------------------------------------------------------------------