<html><body><div id="zimbraEditorContainer" style="font-family: arial, helvetica, sans-serif; font-size: 12pt; color: #000000" class="5"><style type="text/css" scoped="">
<!--table
{mso-displayed-decimal-separator:"\.";
mso-displayed-thousand-separator:"\,";}
@page
{margin:.75in .7in .75in .7in;
mso-header-margin:.3in;
mso-footer-margin:.3in;}
.zimbra1
{color:black;
font-size:9.0pt;
font-weight:400;
font-style:normal;
text-decoration:none;
font-family:新細明體, serif;
mso-font-charset:136;}
tr
{mso-height-source:auto;
mso-ruby-visibility:none;}
col
{mso-width-source:auto;
mso-ruby-visibility:none;}
br
{mso-data-placement:same-cell;}
td
{padding-top:1px;
padding-right:1px;
padding-left:1px;
mso-ignore:padding;
color:black;
font-size:11.0pt;
font-weight:400;
font-style:normal;
text-decoration:none;
font-family:新細明體, serif;
mso-font-charset:136;
mso-number-format:General;
text-align:general;
vertical-align:bottom;
border:none;
mso-background-source:auto;
mso-pattern:auto;
mso-protection:locked visible;
white-space:nowrap;
mso-rotate:0;}
.zimbra2
{text-align:left;
vertical-align:top;}
.zimbra3
{text-align:left;
vertical-align:top;
white-space:normal;}
.zimbra4
{mso-number-format:"m\0022月\0022d\0022日\0022";
text-align:left;
vertical-align:top;}
.zimbra5
{text-align:left;
vertical-align:top;
background:#FFD966;
mso-pattern:black none;}
ruby
{ruby-align:left;}
rt
{color:black;
font-size:9.0pt;
font-weight:400;
font-style:normal;
text-decoration:none;
font-family:新細明體, serif;
mso-font-charset:136;
mso-char-type:none;
display:none;}
-->
</style><div><style></style><style></style><style></style><style></style></div><div></div><div> <!--StartFragment--><div style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;">Dear all,</div><br style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;"><div style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;"><span style="color: #000000; font-family: arial, sans-serif; font-size: 16px; font-style: normal; font-weight: 400; letter-spacing: normal; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: #ffffff; float: none;" data-mce-style="color: #000000; font-family: arial, sans-serif; font-size: 16px; font-style: normal; font-weight: 400; letter-spacing: normal; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: #ffffff; float: none;">Enclosed please find the current performance of the FGC QA system with the last models</span></div><div style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;"><span style="color: #000000; font-family: arial, sans-serif; font-size: 16px; font-style: normal; font-weight: 400; letter-spacing: normal; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: #ffffff; float: none;" data-mce-style="color: #000000; font-family: arial, sans-serif; font-size: 16px; font-style: normal; font-weight: 400; letter-spacing: normal; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: #ffffff; float: none;"><div style="font-family: arial, helvetica, sans-serif;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;">dispatcher: model_dir3/epoch_18</div><div style="font-family: arial, helvetica, sans-serif;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;">single-span-extraction: ENSEMBLEModule12 models (ner)</div><div style="font-family: arial, helvetica, sans-serif;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;">multi-spans-extraction: MSPE_v18_branchy27</div><div style="font-family: arial, helvetica, sans-serif;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;">date_duration_module_4</div><div style="font-family: arial, helvetica, sans-serif;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;">arithmetic_module_4</div></span></div><div style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;"><span style="color: #000000; font-family: arial, sans-serif; font-size: 16px; font-style: normal; font-weight: 400; letter-spacing: normal; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: #ffffff; float: none;" data-mce-style="color: #000000; font-family: arial, sans-serif; font-size: 16px; font-style: normal; font-weight: 400; letter-spacing: normal; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: #ffffff; float: none;"><br data-mce-bogus="1"></span></div><div style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;"><span style="color: #000000; font-family: arial, sans-serif; font-size: 16px; font-style: normal; font-weight: 400; letter-spacing: normal; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: #ffffff; float: none;" data-mce-style="color: #000000; font-family: arial, sans-serif; font-size: 16px; font-style: normal; font-weight: 400; letter-spacing: normal; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; background-color: #ffffff; float: none;"><br></span></div><div style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;"><div>Train: 0.833, Dev: 0.757, Test:0.725</div></div><!--EndFragment--><div style="clear: both;" data-mce-style="clear: both;"><br data-mce-bogus="1"></div></div><div> <table border="1" cellpadding="0" cellspacing="0" width="954" style="border-collapse: collapse; width: 875px;" data-mce-style="border-collapse: collapse; width: 716pt;"><!--StartFragment--> <colgroup><col width="64" style="width: 48pt;" data-mce-style="width: 48pt;"> <col width="180" style="mso-width-source: userset; mso-width-alt: 6582; width: 135pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 6582; width: 135pt;"> <col width="82" style="mso-width-source: userset; mso-width-alt: 2998; width: 62pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 2998; width: 62pt;"> <col width="77" style="mso-width-source: userset; mso-width-alt: 2816; width: 58pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 2816; width: 58pt;"> <col width="79" style="mso-width-source: userset; mso-width-alt: 2889; width: 59pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 2889; width: 59pt;"> <col width="91" style="mso-width-source: userset; mso-width-alt: 3328; width: 68pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 3328; width: 68pt;"> <col width="96" style="mso-width-source: userset; mso-width-alt: 3510; width: 72pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 3510; width: 72pt;"> <col width="93" style="mso-width-source: userset; mso-width-alt: 3401; width: 70pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 3401; width: 70pt;"> <col width="64" span="3" style="width: 48pt;" data-mce-style="width: 48pt;"> </colgroup><tbody><tr height="22" style="height: 16.5pt;" data-mce-style="height: 16.5pt;"><td height="22" class="zimbra4" width="64" style="height: 16.5pt; width: 65px;"></td><td class="zimbra3" width="180" style="width: 178px;"></td><td align="left" width="82" style="width: 83px;">Single-Span</td><td align="left" width="77" style="width: 76px;">Liao's ensemble </td><td align="left" width="91" style="width: 91px;">Multi-Span</td><td align="left" width="96" style="width: 97px;">Date-Duration</td><td class="zimbra2" width="93" style="width: 93px;">Arithmetic</td><td align="left" width="64" style="width: 64px;">Train</td><td align="left" width="64" style="width: 64px;">Dev</td><td align="left" width="64" style="width: 64px;">Test</td></tr><tr height="63" style="height: 47.25pt;" data-mce-style="height: 47.25pt;"><td height="63" class="zimbra4" style="height: 47.25pt; width: 65px;">4月2日</td><td class="zimbra3" width="180" style="width: 178px;">ENSEMBLEModule: 12 models (new)</td><td class="zimbra3" width="82" style="width: 83px;">train: 0.890<br>dev: 0.801<br>test: 0.750</td><td class="zimbra3" width="77" style="width: 76px;">train: 0.899<br>dev: 0.699<br>test: 0.741</td><td class="zimbra3" width="91" style="width: 91px;">train: 0.493<br>dev: 0.476<br>test: 0.350</td><td class="zimbra3" width="96" style="width: 97px;">train: 0.589<br>dev: 0.720<br>test: 0.581</td><td class="zimbra2" style="width: 93px;"></td><td class="zimbra2" style="width: 64px;">0.786</td><td class="zimbra2" style="width: 64px;">0.709</td><td class="zimbra2" style="width: 64px;">0.658</td></tr><tr height="84" style="height: 63.0pt;" data-mce-style="height: 63.0pt;"><td height="84" class="zimbra4" style="height: 63pt; width: 65px;">4月3日</td><td class="zimbra3" width="180" style="width: 178px;">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</td><td class="zimbra3" width="82" style="width: 83px;">train: 0.890<br>dev: 0.801<br>test: 0.750</td><td class="zimbra3" width="77" style="width: 76px;">train: 0.899<br>dev: 0.699<br>test: 0.741</td><td class="zimbra3" width="91" style="width: 91px;">train: 0.548<br>dev: 0.667<br>test: 0.450</td><td class="zimbra3" width="96" style="width: 97px;">train: 0.589<br>dev: 0.720<br>test: 0.581</td><td class="zimbra2" style="width: 93px;"></td><td class="zimbra2" style="width: 64px;">0.791</td><td class="zimbra2" style="width: 64px;">0.725</td><td class="zimbra2" style="width: 64px;">0.668</td></tr><tr height="84" style="height: 63.0pt;" data-mce-style="height: 63.0pt;"><td height="84" class="zimbra4" style="height: 63pt; width: 65px;">4月4日</td><td class="zimbra3" width="180" style="width: 178px;">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</td><td class="zimbra3" width="82" style="width: 83px;">train: 0.888<br>dev: 0.801<br>test: 0.759</td><td class="zimbra3" width="77" style="width: 76px;">train: 0.897<br>dev: 0.699<br>test: 0.750</td><td class="zimbra3" width="91" style="width: 91px;">train: 0.548<br>dev: 0.667<br>test: 0.450</td><td class="zimbra3" width="96" style="width: 97px;">train: 0.753<br>dev: 0.720<br>test: 0.774</td><td class="zimbra2" style="width: 93px;"></td><td class="zimbra2" style="width: 64px;">0.817</td><td class="zimbra2" style="width: 64px;">0.737</td><td class="zimbra2" style="width: 64px;">0.705</td></tr><tr height="105" style="height: 78.75pt;" data-mce-style="height: 78.75pt;"><td height="105" class="zimbra4" style="height: 78.75pt; width: 65px;">4月5日</td><td class="zimbra3" width="180" style="width: 178px;">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>arithmetic_module_4<br>date_duration_module_4</td><td class="zimbra3" width="82" style="width: 83px;">train: 0.892<br>dev: 0.808<br>test: 0.768</td><td class="zimbra3" width="77" style="width: 76px;">train: 0.897<br>dev: 0.699<br>test: 0.750</td><td class="zimbra3" width="91" style="width: 91px;">train: 0.548<br>dev: 0.619<br>test: 0.450</td><td class="zimbra3" width="96" style="width: 97px;">train: 0.760<br>dev: 0.774<br>test: 0.774</td><td class="zimbra3" width="93" style="width: 93px;">train: 0.375<br>dev: 0.444<br>test: 0.000</td><td class="zimbra2" style="width: 64px;">0.829</td><td class="zimbra2" style="width: 64px;">0.741</td><td class="zimbra2" style="width: 64px;">0.71</td></tr><tr height="147" style="height: 110.25pt;" data-mce-style="height: 110.25pt;"><td height="147" class="zimbra4" style="height: 110.25pt; width: 65px;">4月5日</td><td class="zimbra3" width="180" style="width: 178px;">dispatcher: model_dir3/epoch_18<br>ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4<br>arithmetic_module_4</td><td class="zimbra3" width="82" style="width: 83px;">train: 0.878<br>dev: 0.803<br>test: 0.794</td><td class="zimbra3" width="77" style="width: 76px;">train: 0.905<br>dev: 0.764<br>test: 0.794</td><td class="zimbra3" width="91" style="width: 91px;">train: 0.518<br>dev: 0.667<br>test: 0.478</td><td class="zimbra3" width="96" style="width: 97px;">train: 0.746<br>dev: 0.826<br>test: 0.833</td><td class="zimbra3" width="93" style="width: 93px;">train: 0.629<br>dev: 0.600<br>test: 0.688</td><td class="zimbra2" style="width: 64px;">0.816</td><td class="zimbra2" style="width: 64px;">0.745</td><td class="zimbra2" style="width: 64px;">0.715</td></tr><tr height="147" style="height: 110.25pt;" data-mce-style="height: 110.25pt;"><td height="147" class="zimbra4" style="height: 110.25pt; width: 65px;">4月7日</td><td class="zimbra3" width="180" style="width: 178px;">dispatcher: model_dir3/epoch_18<br>ENSEMBLEModule: 12 models (ner)<br>MSPE_v18_branchy27<br>date_duration_module_4<br>arithmetic_module_4</td><td class="zimbra3" width="82" style="width: 83px;">train: 0.912<br>dev: 0.819<br>test: 0.825</td><td class="zimbra3" width="77" style="width: 76px;">train: 0.933<br>dev: 0.787<br>test: 0.814</td><td class="zimbra3" width="91" style="width: 91px;">train: 0.518<br>dev: 0.667<br>test: 0.478</td><td class="zimbra3" width="96" style="width: 97px;">train: 0.739<br>dev: 0.826<br>test: 0.833</td><td class="zimbra3" width="93" style="width: 93px;">train: 0.629<br>dev: 0.650<br>test: 0.688</td><td class="zimbra5" style="width: 64px;">0.833</td><td class="zimbra5" style="width: 64px;">0.757</td><td class="zimbra5" style="width: 64px;">0.725</td></tr></tbody></table><div style="clear: both;" data-mce-style="clear: both;"><br></div><br></div><hr id="zwchr" data-marker="__DIVIDER__"><div data-marker="__HEADERS__"><b>From: </b>"范正忠" <jjfan@iis.sinica.edu.tw><br><b>To: </b>"kysu" <kysu@iis.sinica.edu.tw><br><b>Cc: </b>"Most-ai Contest" <Most-ai-contest@iis.sinica.edu.tw><br><b>Sent: </b>Sunday, April 5, 2020 5:14:00 PM<br><b>Subject: </b>Re: [Most-ai-contest] The performance of the last version FGC QA system (4/5)<br></div><div><br></div><div data-marker="__QUOTED_TEXT__"><div style="font-family:'arial' , 'helvetica' , sans-serif;font-size:12pt;color:#000000"><div></div><div>Dear all,</div><br><div><span style="color:#000000;font-family:'arial' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:#ffffff;display:!important;float:none">Enclosed please find the current performance of the FGC QA system.</span></div><div><span style="color:#000000;font-family:'arial' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:#ffffff;display:!important;float:none"><br></span></div><div><div>Train: 0.816, Dev: 0.745, Test:0.715</div><br><div><div> <table border="1" cellpadding="0" cellspacing="0" width="954" style="border-collapse:collapse;width:716pt"><colgroup><col width="64" style="width:48pt"><col width="180" style="width:135pt"><col width="82" style="width:62pt"><col width="77" style="width:58pt"><col width="79" style="width:59pt"><col width="91" style="width:68pt"><col width="96" style="width:72pt"><col width="93" style="width:70pt"><col width="64" span="3" style="width:48pt"></colgroup><tbody><tr style="height:15.75pt"><td height="21" class="zimbra9" width="64" style="height:15.75pt;width:48pt"></td><td class="zimbra8" width="180" style="width:135pt"></td><td align="left" width="82" style="width:62pt">Single-Span</td><td align="left" width="77" style="width:58pt">Kuo</td><td align="left" width="79" style="width:59pt">Simonc</td><td align="left" width="91" style="width:68pt">Multi-Span</td><td align="left" width="96" style="width:72pt">Date-Duration</td><td class="zimbra7" width="93" style="width:70pt">Arithmetic</td><td align="left" width="64" style="width:48pt">Train</td><td align="left" width="64" style="width:48pt">Dev</td><td align="left" width="64" style="width:48pt">Test</td></tr><tr style="height:47.25pt"><td height="63" class="zimbra9" style="height:47.25pt">4月2日</td><td class="zimbra8" width="180" style="width:135pt">ENSEMBLEModule: 12 models (new) + single_span_multi_hop_v2_1</td><td class="zimbra8" width="82" style="width:62pt">train: 0.842<br>dev: 0.712<br>test: 0.741</td><td class="zimbra8" width="77" style="width:58pt">train: 0.899<br>dev: 0.699<br>test: 0.741</td><td class="zimbra8" width="79" style="width:59pt">train: 0.771<br>dev: 0.635<br>test: 0.705</td><td class="zimbra7"></td><td class="zimbra7"></td><td class="zimbra7"></td><td class="zimbra7">0.757</td><td class="zimbra7">0.652</td><td class="zimbra7">0.653</td></tr><tr style="height:47.25pt"><td height="63" class="zimbra9" style="height:47.25pt">4月2日</td><td class="zimbra8" width="180" style="width:135pt">ENSEMBLEModule: 12 models (new)</td><td class="zimbra8" width="82" style="width:62pt">train: 0.890<br>dev: 0.801<br>test: 0.750</td><td class="zimbra8" width="77" style="width:58pt">train: 0.899<br>dev: 0.699<br>test: 0.741</td><td class="zimbra8" width="79" style="width:59pt"></td><td class="zimbra8" width="91" style="width:68pt">train: 0.493<br>dev: 0.476<br>test: 0.350</td><td class="zimbra8" width="96" style="width:72pt">train: 0.589<br>dev: 0.720<br>test: 0.581</td><td class="zimbra7"></td><td class="zimbra7">0.786</td><td class="zimbra7">0.709</td><td class="zimbra7">0.658</td></tr><tr style="height:63pt"><td height="84" class="zimbra9" style="height:63pt">4月3日</td><td class="zimbra8" width="180" style="width:135pt">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</td><td class="zimbra8" width="82" style="width:62pt">train: 0.890<br>dev: 0.801<br>test: 0.750</td><td class="zimbra8" width="77" style="width:58pt">train: 0.899<br>dev: 0.699<br>test: 0.741</td><td class="zimbra7"></td><td class="zimbra8" width="91" style="width:68pt">train: 0.548<br>dev: 0.667<br>test: 0.450</td><td class="zimbra8" width="96" style="width:72pt">train: 0.589<br>dev: 0.720<br>test: 0.581</td><td class="zimbra7"></td><td class="zimbra7">0.791</td><td class="zimbra7">0.725</td><td class="zimbra7">0.668</td></tr><tr style="height:63pt"><td height="84" class="zimbra9" style="height:63pt">4月4日</td><td class="zimbra8" width="180" style="width:135pt">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</td><td class="zimbra8" width="82" style="width:62pt">train: 0.888<br>dev: 0.801<br>test: 0.759</td><td class="zimbra8" width="77" style="width:58pt">train: 0.897<br>dev: 0.699<br>test: 0.750</td><td class="zimbra7"></td><td class="zimbra8" width="91" style="width:68pt">train: 0.548<br>dev: 0.667<br>test: 0.450</td><td class="zimbra8" width="96" style="width:72pt">train: 0.753<br>dev: 0.720<br>test: 0.774</td><td class="zimbra7"></td><td class="zimbra7">0.817</td><td class="zimbra7">0.737</td><td class="zimbra7">0.705</td></tr><tr style="height:78.75pt"><td height="105" class="zimbra9" style="height:78.75pt">4月5日</td><td class="zimbra8" width="180" style="width:135pt">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>arithmetic_module_4<br>date_duration_module_4</td><td class="zimbra8" width="82" style="width:62pt">train: 0.892<br>dev: 0.808<br>test: 0.768</td><td class="zimbra8" width="77" style="width:58pt">train: 0.897<br>dev: 0.699<br>test: 0.750</td><td class="zimbra7"></td><td class="zimbra8" width="91" style="width:68pt">train: 0.548<br>dev: 0.619<br>test: 0.450</td><td class="zimbra8" width="96" style="width:72pt">train: 0.760<br>dev: 0.774<br>test: 0.774</td><td class="zimbra8" width="93" style="width:70pt">train: 0.375<br>dev: 0.444<br>test: 0.000</td><td class="zimbra7">0.829</td><td class="zimbra7">0.741</td><td class="zimbra7">0.71</td></tr><tr style="height:110.25pt"><td height="147" class="zimbra9" style="height:110.25pt">4月5日</td><td class="zimbra8" width="180" style="width:135pt">dispatcher: model_dir3/epoch_18<br>ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4<br>arithmetic_module_4</td><td class="zimbra8" width="82" style="width:62pt">train: 0.878<br>dev: 0.803<br>test: 0.794</td><td class="zimbra8" width="77" style="width:58pt">train: 0.905<br>dev: 0.764<br>test: 0.794</td><td class="zimbra7"></td><td class="zimbra8" width="91" style="width:68pt">train: 0.518<br>dev: 0.667<br>test: 0.478</td><td class="zimbra8" width="96" style="width:72pt">train: 0.746<br>dev: 0.826<br>test: 0.833</td><td class="zimbra8" width="93" style="width:70pt">train: 0.629<br>dev: 0.600<br>test: 0.688</td><td class="zimbra7">0.816</td><td class="zimbra7">0.745</td><td class="zimbra7">0.715</td></tr></tbody></table><br><br></div></div><div>jjfan</div></div><br><hr id="zwchr"><div><b>From: </b>"范正忠" <jjfan@iis.sinica.edu.tw><br><b>To: </b>"kysu" <kysu@iis.sinica.edu.tw><br><b>Cc: </b>"Most-ai Contest" <Most-ai-contest@iis.sinica.edu.tw><br><b>Sent: </b>Saturday, April 4, 2020 3:19:02 PM<br><b>Subject: </b>Re: [Most-ai-contest] The performance of the last version FGC QA system (4/4)<br></div><br><div><div style="font-family:'arial' , 'helvetica' , sans-serif;font-size:12pt;color:#000000"><div>Resend the output json file.</div><br><hr id="zwchr"><div><b>From: </b>"范正忠" <jjfan@iis.sinica.edu.tw><br><b>To: </b>"kysu" <kysu@iis.sinica.edu.tw><br><b>Cc: </b>"Most-ai Contest" <Most-ai-contest@iis.sinica.edu.tw><br><b>Sent: </b>Saturday, April 4, 2020 10:57:15 AM<br><b>Subject: </b>Re: [Most-ai-contest] The performance of the last version FGC QA system (4/4)<br></div><br><div><div style="font-family:'arial' , 'helvetica' , sans-serif;font-size:12pt;color:#000000"><div>Sorry! Correction of the performance of single-span-ensemble module </div><br><div><table border="1" cellpadding="0" cellspacing="0" width="925" style="border-collapse:collapse;width:694pt"><colgroup><col width="64" style="width:48pt"><col width="180" style="width:135pt"><col width="82" style="width:62pt"><col width="77" style="width:58pt"><col width="79" style="width:59pt"><col width="91" style="width:68pt"><col width="96" style="width:72pt"><col width="64" span="4" style="width:48pt"></colgroup><tbody><tr style="height:15.75pt"><td height="21" class="zimbra4" width="64" style="height:15.75pt;width:64px"></td><td class="zimbra3" width="180" style="width:181px"></td><td align="left" width="82" style="width:83px">Single-Span</td><td align="left" width="77" style="width:76px">Kuo</td><td align="left" width="79" style="width:78px">Simonc</td><td align="left" width="91" style="width:91px">Multi-Span</td><td align="left" width="96" style="width:97px">Date-Duration</td><td class="zimbra2" width="64" style="width:62px"></td><td align="left" width="64" style="width:64px">Train</td><td align="left" width="64" style="width:64px">Dev</td><td align="left" width="64" style="width:64px">Test</td></tr><tr style="height:47.25pt"><td height="63" class="zimbra4" style="height:47.25pt;width:64px">4月2日</td><td class="zimbra3" width="180" style="width:181px">ENSEMBLEModule: 12 models (new) + single_span_multi_hop_v2_1</td><td class="zimbra3" width="82" style="width:83px">train: 0.842<br>dev: 0.712<br>test: 0.741</td><td class="zimbra3" width="77" style="width:76px">train: 0.899<br>dev: 0.699<br>test: 0.741</td><td class="zimbra3" width="79" style="width:78px">train: 0.771<br>dev: 0.635<br>test: 0.705</td><td class="zimbra2" style="width:91px"></td><td class="zimbra2" style="width:97px"></td><td class="zimbra2" style="width:62px"></td><td class="zimbra2" style="width:64px">0.757</td><td class="zimbra2" style="width:64px">0.652</td><td class="zimbra2" style="width:64px">0.653</td></tr><tr style="height:47.25pt"><td height="63" class="zimbra5" style="height:47.25pt;width:64px">4月2日</td><td class="zimbra6" width="180" style="width:181px">ENSEMBLEModule: 12 models (new)</td><td class="zimbra6" width="82" style="width:83px">train: 0.890<br>dev: 0.801<br>test: 0.750</td><td class="zimbra6" width="77" style="width:76px">train: 0.899<br>dev: 0.699<br>test: 0.741</td><td class="zimbra6" width="79" style="width:78px"> </td><td class="zimbra3" width="91" style="width:91px">train: 0.493<br>dev: 0.476<br>test: 0.350</td><td class="zimbra3" width="96" style="width:97px">train: 0.589<br>dev: 0.720<br>test: 0.581</td><td class="zimbra2" style="width:62px"></td><td class="zimbra7" style="width:64px">0.786</td><td class="zimbra7" style="width:64px">0.709</td><td class="zimbra7" style="width:64px">0.658</td></tr><tr style="height:47.25pt"><td height="63" class="zimbra4" style="height:47.25pt;width:64px">4月2日</td><td class="zimbra3" width="180" style="width:181px">single_span_multi_hop_v2_1</td><td class="zimbra3" width="82" style="width:83px">train: 0.775<br>dev: 0.692<br>test: 0.714</td><td class="zimbra3" width="77" style="width:76px"></td><td class="zimbra3" width="79" style="width:78px">train: 0.771<br>dev: 0.635<br>test: 0.705</td><td class="zimbra2" style="width:91px"></td><td class="zimbra2" style="width:97px"></td><td class="zimbra2" style="width:62px"></td><td class="zimbra2" style="width:64px">0.714</td><td class="zimbra2" style="width:64px">0.64</td><td class="zimbra2" style="width:64px">0.637</td></tr><tr style="height:63pt"><td height="84" class="zimbra4" style="height:63pt;width:64px">4月3日</td><td class="zimbra3" width="180" style="width:181px">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</td><td class="zimbra3" width="82" style="width:83px">train: 0.890<br>dev: 0.801<br>test: 0.750</td><td class="zimbra3" width="77" style="width:76px">train: 0.899<br>dev: 0.699<br>test: 0.741</td><td class="zimbra2" style="width:78px"></td><td class="zimbra3" width="91" style="width:91px">train: 0.548<br>dev: 0.667<br>test: 0.450</td><td class="zimbra3" width="96" style="width:97px">train: 0.589<br>dev: 0.720<br>test: 0.581</td><td class="zimbra2" style="width:62px"></td><td class="zimbra2" style="width:64px">0.791</td><td class="zimbra2" style="width:64px">0.725</td><td class="zimbra2" style="width:64px">0.668</td></tr><tr style="height:63pt"><td height="84" class="zimbra4" style="height:63pt;width:64px">4月4日</td><td class="zimbra3" width="180" style="width:181px">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</td><td class="zimbra3" width="82" style="width:83px">train: 0.888<br>dev: 0.801<br>test: 0.759</td><td class="zimbra3" width="77" style="width:76px"><div><span style="background-color:rgb( 255 , 255 , 153 )">train: 0.897</span><br><span style="background-color:rgb( 255 , 255 , 153 )">dev: 0.699</span><br><span style="background-color:rgb( 255 , 255 , 153 )">test: 0.750</span></div><div><span style="background-color:rgb( 255 , 255 , 153 )"><span style="background-color:rgb( 255 , 255 , 153 )"> <span style="text-decoration:line-through"><span style="color:rgb( 0 , 0 , 0 );font-family:, serif;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:nowrap;word-spacing:0px;text-decoration:line-through;font-size:14.6667px;background-color:rgb( 255 , 255 , 255 );float:none;display:!important">train: 0.949</span></span><br style="color:rgb( 0 , 0 , 0 );font-family:, serif;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:nowrap;word-spacing:0px;font-size:14.6667px;background-color:rgb( 255 , 255 , 255 )"><span style="text-decoration:line-through"><span style="color:rgb( 0 , 0 , 0 );font-family:, serif;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:nowrap;word-spacing:0px;text-decoration:line-through;font-size:14.6667px;background-color:rgb( 255 , 255 , 255 );float:none;display:!important">dev: 0.837</span></span><br style="color:rgb( 0 , 0 , 0 );font-family:, serif;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:nowrap;word-spacing:0px;font-size:14.6667px;background-color:rgb( 255 , 255 , 255 )"><span style="text-decoration:line-through"><span style="color:rgb( 0 , 0 , 0 );font-family:, serif;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:nowrap;word-spacing:0px;text-decoration:line-through;font-size:14.6667px;background-color:rgb( 255 , 255 , 255 );float:none;display:!important">test: 0.876</span></span></span></span><br></div></td><td class="zimbra2" style="width:78px"><br><br></td><td class="zimbra3" width="91" style="width:91px">train: 0.548<br>dev: 0.667<br>test: 0.450</td><td class="zimbra3" width="96" style="width:97px">train: 0.753<br>dev: 0.720<br>test: 0.774</td><td class="zimbra2" style="width:62px"></td><td class="zimbra2" style="width:64px">0.817</td><td class="zimbra2" style="width:64px">0.737</td><td class="zimbra2" style="width:64px">0.705</td></tr></tbody></table><br><br></div><br><br><hr id="zwchr"><div><b>From: </b>"kysu" <kysu@iis.sinica.edu.tw><br><b>To: </b>"范正忠" <jjfan@iis.sinica.edu.tw>, "Simonc" <simonc@iis.sinica.edu.tw><br><b>Cc: </b>"Most-ai Contest" <Most-ai-contest@iis.sinica.edu.tw><br><b>Sent: </b>Saturday, April 4, 2020 10:48:57 AM<br><b>Subject: </b>RE: [Most-ai-contest] The performance of the last version FGC QA system (4/4)<br></div><br><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d">Thanks. Glad to know that we have got a new record high performance! Let’s keep pushing the performance.</span></p><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d"> </span></p><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d">KY</span></p><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d"> </span></p><div><div style="border:none;border-top:solid #e1e1e1 1pt;padding:3pt 0cm 0cm 0cm"><p class="MsoNormal"><b><span lang="EN-US" style="font-size:11pt;font-family:'calibri' , sans-serif">From:</span></b><span lang="EN-US" style="font-size:11pt;font-family:'calibri' , sans-serif"> most-ai-contest-bounces@iis.sinica.edu.tw [mailto:most-ai-contest-bounces@iis.sinica.edu.tw] <b>On Behalf Of </b></span><span style="font-size:11pt">范正忠</span><span lang="EN-US" style="font-size:11pt;font-family:'calibri' , sans-serif"><br><b>Sent:</b> Saturday, April 4, 2020 10:24 AM<br><b>To:</b> Simonc <simonc@iis.sinica.edu.tw><br><b>Cc:</b> Most-ai Contest <Most-ai-contest@iis.sinica.edu.tw><br><b>Subject:</b> Re: [Most-ai-contest] The performance of the last version FGC QA system (4/4)</span></p></div></div><p class="MsoNormal"><span lang="EN-US"> </span></p><div><div><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all,</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Enclosed please find the current performance of the FGC QA system.</span></p></div></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div></div><div><table class="MsoNormalTable" border="1" cellspacing="0" cellpadding="0" width="1292" style="width:694pt;border-collapse:collapse"><tbody><tr style="height:15px"><td nowrap="nowrap" valign="top" style="width:57px;border:none;padding:0.75pt 0.75pt 0cm;height:15px"></td><td valign="top" style="width:190px;border:none;padding:0.75pt 0.75pt 0cm;height:15px"></td><td nowrap="nowrap" valign="bottom" style="width:78px;border:none;padding:0.75pt 0.75pt 0cm;height:15px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Single-Span</span></p></td><td nowrap="nowrap" valign="bottom" style="width:73px;border:none;padding:0.75pt 0.75pt 0cm;height:15px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Kuo</span></p></td><td nowrap="nowrap" valign="bottom" style="width:75px;border:none;padding:0.75pt 0.75pt 0cm;height:15px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Simonc</span></p></td><td nowrap="nowrap" valign="bottom" style="width:87px;border:none;padding:0.75pt 0.75pt 0cm;height:15px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Multi-Span</span></p></td><td nowrap="nowrap" valign="bottom" style="width:93px;border:none;padding:0.75pt 0.75pt 0cm;height:15px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Date-Duration</span></p></td><td nowrap="nowrap" valign="top" style="width:62px;border:none;padding:0.75pt 0.75pt 0cm;height:15px"></td><td nowrap="nowrap" valign="bottom" style="width:62px;border:none;padding:0.75pt 0.75pt 0cm;height:15px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Train</span></p></td><td nowrap="nowrap" valign="bottom" style="width:62px;border:none;padding:0.75pt 0.75pt 0cm;height:15px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Dev</span></p></td><td nowrap="nowrap" valign="bottom" style="width:62px;border:none;padding:0.75pt 0.75pt 0cm;height:15px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Test</span></p></td></tr><tr style="height:47px"><td nowrap="nowrap" valign="top" style="border:none;background:rgb( 248 , 203 , 173 );padding:0.75pt 0.75pt 0cm;height:47px;width:57px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">2</span>日<span lang="EN-US"></span></span></p></td><td valign="top" style="width:190px;border:none;background:rgb( 248 , 203 , 173 );padding:0.75pt 0.75pt 0cm;height:47px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)</span></p></td><td valign="top" style="width:78px;border:none;background:rgb( 248 , 203 , 173 );padding:0.75pt 0.75pt 0cm;height:47px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.890<br>dev: 0.801<br>test: 0.750</span></p></td><td valign="top" style="width:73px;border:none;background:rgb( 248 , 203 , 173 );padding:0.75pt 0.75pt 0cm;height:47px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.899<br>dev: 0.699<br>test: 0.741</span></p></td><td valign="top" style="width:75px;border:none;background:rgb( 248 , 203 , 173 );padding:0.75pt 0.75pt 0cm;height:47px"><p class="MsoNormal"><span style="font-size:11pt;color:black"> <span lang="EN-US"></span></span></p></td><td valign="top" style="width:87px;border:none;padding:0.75pt 0.75pt 0cm;height:47px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.493<br>dev: 0.476<br>test: 0.350</span></p></td><td valign="top" style="width:93px;border:none;padding:0.75pt 0.75pt 0cm;height:47px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.589<br>dev: 0.720<br>test: 0.581</span></p></td><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:47px;width:62px"></td><td nowrap="nowrap" valign="top" style="border:none;background:rgb( 248 , 203 , 173 );padding:0.75pt 0.75pt 0cm;height:47px;width:62px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.786</span></p></td><td nowrap="nowrap" valign="top" style="border:none;background:rgb( 248 , 203 , 173 );padding:0.75pt 0.75pt 0cm;height:47px;width:62px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.709</span></p></td><td nowrap="nowrap" valign="top" style="border:none;background:rgb( 248 , 203 , 173 );padding:0.75pt 0.75pt 0cm;height:47px;width:62px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.658</span></p></td></tr><tr style="height:63px"><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:63px;width:57px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">3</span>日<span lang="EN-US"></span></span></p></td><td valign="top" style="width:190px;border:none;padding:0.75pt 0.75pt 0cm;height:63px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span></p></td><td valign="top" style="width:78px;border:none;padding:0.75pt 0.75pt 0cm;height:63px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.890<br>dev: 0.801<br>test: 0.750</span></p></td><td valign="top" style="width:73px;border:none;padding:0.75pt 0.75pt 0cm;height:63px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.899<br>dev: 0.699<br>test: 0.741</span></p></td><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:63px;width:75px"></td><td valign="top" style="width:87px;border:none;padding:0.75pt 0.75pt 0cm;height:63px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.548<br>dev: 0.667<br>test: 0.450</span></p></td><td valign="top" style="width:93px;border:none;padding:0.75pt 0.75pt 0cm;height:63px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.589<br>dev: 0.720<br>test: 0.581</span></p></td><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:63px;width:62px"></td><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:63px;width:62px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.791</span></p></td><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:63px;width:62px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.725</span></p></td><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:63px;width:62px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.668</span></p></td></tr><tr style="height:63px"><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:63px;width:57px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">4</span>日<span lang="EN-US"></span></span></p></td><td valign="top" style="width:190px;border:none;padding:0.75pt 0.75pt 0cm;height:63px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span></p></td><td valign="top" style="width:78px;border:none;padding:0.75pt 0.75pt 0cm;height:63px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.888<br>dev: 0.801<br>test: 0.759</span></p></td><td valign="top" style="width:73px;border:none;padding:0.75pt 0.75pt 0cm;height:63px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.949<br>dev: 0.837<br>test: 0.876</span></p></td><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:63px;width:75px"></td><td valign="top" style="width:87px;border:none;padding:0.75pt 0.75pt 0cm;height:63px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.548<br>dev: 0.667<br>test: 0.450</span></p></td><td valign="top" style="width:93px;border:none;padding:0.75pt 0.75pt 0cm;height:63px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:red">train: 0.753</span><span lang="EN-US" style="font-size:11pt;color:black"><br></span><span lang="EN-US" style="font-size:11pt;color:red">dev: 0.720</span><span lang="EN-US" style="font-size:11pt;color:black"><br></span><span lang="EN-US" style="font-size:11pt;color:red">test: 0.774</span><span lang="EN-US" style="font-size:11pt;color:black"></span></p></td><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:63px;width:62px"></td><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:63px;width:62px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.817</span></p></td><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:63px;width:62px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.737</span></p></td><td nowrap="nowrap" valign="top" style="border:none;padding:0.75pt 0.75pt 0cm;height:63px;width:62px"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.705</span></p></td></tr></tbody></table><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Please check the detail in Performance.txt file and Date-Duration performance is similar to </span><span style="color:black;background:white">郭家銍</span><span lang="EN-US" style="font-family:'helvetica' , sans-serif;color:black;background:white"> report.</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'helvetica' , sans-serif;color:black;background:white"><br><br></span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'helvetica' , sans-serif;color:black;background:white">Best,</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'helvetica' , sans-serif;color:black;background:white">jjfan</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div align="center" style="text-align:center"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><hr size="3" width="100%" align="center" id="zwchr"></span></div><div><p class="MsoNormal"><b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">From: </span></b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"</span><span style="color:black">范正忠</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">" <<a href="mailto:jjfan@iis.sinica.edu.tw" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">jjfan@iis.sinica.edu.tw</a>><br><b>To: </b>"Simonc" <<a href="mailto:simonc@iis.sinica.edu.tw" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">simonc@iis.sinica.edu.tw</a>><br><b>Cc: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Friday, April 3, 2020 4:45:39 PM<br><b>Subject: </b>[Most-ai-contest] The performance of the last version FGC QA system</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all,</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Enclosed please find the current performance of the FGC QA system.</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><table class="MsoNormalTable" border="1" cellspacing="0" cellpadding="0" width="1290" style="width:693pt;border-collapse:collapse"><tbody><tr style="height:15.75pt"><td width="96" nowrap="nowrap" valign="top" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"></td><td width="261" valign="top" style="width:140.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"></td><td width="120" nowrap="nowrap" valign="bottom" style="width:64.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Single-Span</span></p></td><td width="113" nowrap="nowrap" valign="bottom" style="width:60.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Kuo</span></p></td><td width="133" nowrap="nowrap" valign="bottom" style="width:71.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Multi-Span</span></p></td><td width="141" nowrap="nowrap" valign="bottom" style="width:75.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Date-Duration</span></p></td><td width="138" nowrap="nowrap" valign="top" style="width:74.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"></td><td width="95" nowrap="nowrap" valign="bottom" style="width:51pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Train</span></p></td><td width="96" nowrap="nowrap" valign="bottom" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Dev</span></p></td><td width="96" nowrap="nowrap" valign="bottom" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Test</span></p></td></tr><tr style="height:47.25pt"><td width="96" nowrap="nowrap" valign="bottom" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;color:black">4</span><span style="font-size:9pt;color:black">月<span lang="EN-US">2</span>日<span lang="EN-US"></span></span></p></td><td width="261" nowrap="nowrap" valign="top" style="width:140.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)</span></p></td><td width="120" nowrap="nowrap" valign="top" style="width:64.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.890<br>dev: 0.801<br>test: 0.750</span></p></td><td width="113" nowrap="nowrap" valign="top" style="width:60.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.899<br>dev: 0.699<br>test: 0.741</span></p></td><td width="133" valign="top" style="width:71.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.493<br>dev: 0.476<br>test: 0.350</span></p></td><td width="141" valign="top" style="width:75.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.589<br>dev: 0.720<br>test: 0.581</span></p></td><td width="138" nowrap="nowrap" valign="top" style="width:74.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="95" valign="top" style="width:51pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.786</span></p></td><td width="96" valign="top" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.709</span></p></td><td width="96" valign="top" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.658</span></p></td></tr><tr style="height:63pt"><td width="96" nowrap="nowrap" valign="top" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">3</span>日<span lang="EN-US"></span></span></p></td><td width="261" valign="top" style="width:140.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span></p></td><td width="120" valign="top" style="width:64.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.890<br>dev: 0.801<br>test: 0.750</span></p></td><td width="113" valign="top" style="width:60.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.899<br>dev: 0.699<br>test: 0.741</span></p></td><td width="133" valign="top" style="width:71.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.548<br>dev: 0.667<br>test: 0.450</span></p></td><td width="141" valign="top" style="width:75.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.589<br>dev: 0.720<br>test: 0.581</span></p></td><td width="138" nowrap="nowrap" valign="top" style="width:74.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"></td><td width="95" nowrap="nowrap" valign="top" style="width:51pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.791</span></p></td><td width="96" nowrap="nowrap" valign="top" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.725</span></p></td><td width="96" nowrap="nowrap" valign="top" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.668</span></p></td></tr></tbody></table><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Please </span><span style="font-size:10.5pt;color:black;background:white">郭家銍</span><span lang="EN-US" style="font-size:10.5pt;font-family:'helvetica' , sans-serif;color:black;background:white"> help to check Date-Duration ver.4. </span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:'helvetica' , sans-serif;color:black;background:white"><br><br></span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:'helvetica' , sans-serif;color:black;background:white">Best,</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:'helvetica' , sans-serif;color:black;background:white">jjfan</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div align="center" style="text-align:center"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><hr size="3" width="100%" align="center" id="zwchr"></span></div><div><p class="MsoNormal"><b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">From: </span></b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"</span><span style="color:black">范正忠</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">" <<a href="mailto:jjfan@iis.sinica.edu.tw" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">jjfan@iis.sinica.edu.tw</a>><br><b>To: </b>"Simonc" <<a href="mailto:simonc@iis.sinica.edu.tw" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">simonc@iis.sinica.edu.tw</a>><br><b>Cc: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Thursday, April 2, 2020 3:56:36 PM<br><b>Subject: </b>Re: [Most-ai-contest] Updated Performance Data with Gold Answer Inclusion Rate</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all,</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Enclosed please find the performance of the last code:</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">ENSEMBLEModule: 12 models (new), single_span_multi_hop_v2_1</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Multi-Spans: MSPE_v18_branchy20</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">date_duration_module_3</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">arithmetic_module_3</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">kinship_module6</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Overall:</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">train -> total: 882, correct: 668, accuracy: 0.757</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">dev -> total: 247, correct: 161, accuracy: 0.652</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">test -> total: 193, correct: 126, accuracy: 0.653</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Single-Span:</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">train -> portion:0.619, count:546, errors: 86, accuracy: 0.842</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> ensemble only -> portion:0.619, count:546, errors: 37, accuracy: </span><strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:red">0.932</span></strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> multi-hop only -> portion:0.619, count:546, errors: 76, accuracy: 0.861</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">dev -> portion:0.632, count:156, errors: 45, accuracy: 0.712</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> <span style="background:white">ensemble only -> portion:0.632, count:156, errors: 37, accuracy: </span></span><strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:red;background:white">0.763</span></strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white"> multi-hop only -> portion:0.632, count:156, errors: 43, accuracy: 0.724</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">test -> portion:0.580, count:112, errors: 29, accuracy: 0.741</span></p></div></div></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> <span style="background:white">ensemble only -> portion:0.580, count:112, errors: 23, accuracy: </span></span><strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:red;background:white">0.795</span></strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white"> multi-hop only -> portion:0.580, count:112, errors: 26, accuracy: 0.768</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white"><br><br></span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white">Multi-Spans:</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white">train -> portion:0.083, count:73, errors: 37, accuracy: 0.493</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white">dev -> portion:0.085, count:21, errors: 11, accuracy: 0.476</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white">test -> portion:0.104, count:20, errors: 13, accuracy: 0.350</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">jjfan</span></p></div><div align="center" style="text-align:center"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><hr size="3" width="100%" align="center" id="zwchr"></span></div><div><p class="MsoNormal"><b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">From: </span></b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"Simonc" <<a href="mailto:simonc@iis.sinica.edu.tw" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">simonc@iis.sinica.edu.tw</a>><br><b>To: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Tuesday, March 31, 2020 6:00:52 PM<br><b>Subject: </b>[Most-ai-contest] Updated Performance Data with Gold Answer Inclusion Rate</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all,</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">The attached file contains the performance data from our results in 3/27.</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">This time, the gold answer inclusion rate is also included. (That is, counting the cases where the correct answer is included in the answer candidates.)</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Regards,</span></p></div><div><p class="MsoNormal"><span style="color:black">張光瑜</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><br>_______________________________________________<br>Most-ai-contest mailing list<br><a href="mailto:Most-ai-contest@iis.sinica.edu.tw" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a><br><a href="https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</a></span></p></div></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><br>_______________________________________________<br>Most-ai-contest mailing list<br><a href="mailto:Most-ai-contest@iis.sinica.edu.tw" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a><br><a href="https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</a></span></p></div></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><br>_______________________________________________<br>Most-ai-contest mailing list<br><a href="mailto:Most-ai-contest@iis.sinica.edu.tw" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a><br><a href="https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest" rel="nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer%20nofollow%20noopener%20noreferrer nofollow noopener noreferrer" target="_blank">https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</a></span></p></div></div></div><br></div></div><br>_______________________________________________<br>Most-ai-contest mailing list<br>Most-ai-contest@iis.sinica.edu.tw<br>https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest<br></div></div><br>_______________________________________________<br>Most-ai-contest mailing list<br>Most-ai-contest@iis.sinica.edu.tw<br>https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest<br></div></div><br>_______________________________________________<br>Most-ai-contest mailing list<br>Most-ai-contest@iis.sinica.edu.tw<br>https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest<br></div></div></body></html>