OVERALL ACC: (BEFORE OUTPUT FORMATTER)
	24 / 46 = 0.5217391304347826
--------------------------------------------------------------------------------
OVERALL ACC: (AFTER OUTPUT FORMATTER)
	24 / 46 = 0.5217391304347826
Formatter Errors:
	[]
--------------------------------------------------------------------------------
AGGREGATOR PERFORMANCE:
	EASY: 24 / 25 = 0.96
	HARD: 0 / 3 = 0.0
--------------------------------------------------------------------------------
DISPATCHER AMODE TOP-3 PERFORMANCE: (COVERAGE)
	46 / 46 = 1.0
	ERRORS: []
--------------------------------------------------------------------------------
DISPATCHER ATYPE-3 PERFORMANCE: (COVERAGE)
	46 / 46 = 1.0
	ERRORS: []
--------------------------------------------------------------------------------
ANSWER MODULE STATS (WHEN CORRECTLY ACTIVATED ACCORDING TO THE DISPATCHER):
                                 ACC
Single-Span-Extraction           15 / 19 = 0.7895
Single-Span-Multi-Hop-Extraction 15 / 19 = 0.7895
Multi-Spans-Extraction           1 / 11 = 0.0909
YesNo                            0 / 0 = NaN
Arithmetic-Operations            2 / 5 = 0.4000
Counting                         0 / 0 = NaN
Date-Duration                    4 / 8 = 0.5000
Kinship                          0 / 3 = 0.0000
Wiki-Json-Inference              0 / 0 = NaN
Summarize                        0 / 0 = NaN
--------------------------------------------------------------------------------
ANSWER MODULE STATS (WHEN WRONGLY ACTIVATED ACCORDING TO THE DISPATCHER):
                                ACC
Single-Span-Extraction           5 / 27 = 0.1852
Single-Span-Multi-Hop-Extraction 5 / 27 = 0.1852
Multi-Spans-Extraction           3 / 35 = 0.0857
YesNo                            0 / 46 = 0.0000
Arithmetic-Operations            2 / 41 = 0.0488
Counting                         0 / 0 = NaN
Date-Duration                    0 / 38 = 0.0000
Kinship                          1 / 43 = 0.0233
Wiki-Json-Inference              0 / 0 = NaN
Summarize                        0 / 46 = 0.0000
--------------------------------------------------------------------------------
ANSWER MODULE ERRORS (WHEN CORRECTLY ACTIVATED):
Single-Span-Extraction:
['D031Q01', 'D033Q02', 'D033Q04', 'D049Q07']

Single-Span-Multi-Hop-Extraction:
['D031Q01', 'D033Q04', 'D048Q05', 'D248Q07']

Multi-Spans-Extraction:
['D013Q02', 'D015Q04', 'D046Q01', 'D062Q04', 'D082Q03', 'D087Q03', 'D092Q01', 'D120Q02', 'D138Q02', 'D215Q07']

YesNo:
[]

Arithmetic-Operations:
['D069Q13', 'D083Q05', 'D309Q02']

Counting:
[]

Date-Duration:
['D069Q05', 'D076Q01', 'D082Q07', 'D108Q01']

Kinship:
['D036Q15', 'D036Q18', 'D037Q05']

Wiki-Json-Inference:
[]

Summarize:
[]

--------------------------------------------------------------------------------