OVERALL ACC: (BEFORE OUTPUT FORMATTER) 122 / 217 = 0.5622119815668203 -------------------------------------------------------------------------------- OVERALL ACC: (AFTER OUTPUT FORMATTER) 120 / 217 = 0.5529953917050692 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED): ACC SCORE MEAN SCORE STD-VAR Single-Span-Extraction 0.5338 0.8931 0.1691 Single-Span-Multi-Hop-Extraction 0.5878 0.8588 0.2183 Multi-Spans-Extraction 0.0526 1.0000 0.0000 YesNo 0.9615 0.9958 0.0021 Arithmetic-Operations 0.0000 0.9946 0.0000 Counting 0.0000 0.0000 0.0000 Date-Duration 0.0833 0.6025 0.3222 Kinship 0.8000 1.0000 0.0000 -------------------------------------------------------------------------------- ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED): ACC SCORE MEAN SCORE STD-VAR Single-Span-Extraction 0.0000 0.8283 0.1986 Single-Span-Multi-Hop-Extraction 0.0000 0.8509 0.1986 Multi-Spans-Extraction 0.0000 1.0000 0.0000 YesNo 0.0000 0.9644 0.0528 Arithmetic-Operations 0.0227 0.3860 0.3329 Counting 0.0909 0.0000 0.0000 Date-Duration 0.6027 0.8438 0.2437 Kinship 0.0000 0.2500 0.4330 --------------------------------------------------------------------------------