<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div dir="ltr">Dear Dr. Fan,</div><div dir="ltr"><br></div><div dir="ltr">Thanks for the quick reply!</div><div dir="ltr"><br></div><div dir="ltr"><br></div><div dir="ltr">Best, Menphis.</div><div dir="ltr"><br><blockquote type="cite">范正忠 <jjfan@iis.sinica.edu.tw> 於 2020年4月4日 10:24 寫道:<br><br></blockquote></div><blockquote type="cite"><div dir="ltr"><div id="zimbraEditorContainer" style="font-family: arial, helvetica, sans-serif; font-size: 12pt; color: #000000" class="15"><div></div><div></div><div><style></style></div><div></div><div> <!--StartFragment--><div style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;">Dear all,</div><br style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;"><div style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;" data-mce-style="color: #000000; font-family: arial, helvetica, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial;">Enclosed please find the current performance of the FGC QA system.</div><!--EndFragment--> </div><div><br data-mce-bogus="1"></div><div> <div style="clear: both;" data-mce-style="clear: both;"><br></div></div><div> <table border="1" cellpadding="0" cellspacing="0" width="925" style="border-collapse: collapse; width: 694pt;" data-mce-style="border-collapse: collapse; width: 694pt;"><!--StartFragment--> <colgroup><col width="64" style="width: 48pt;" data-mce-style="width: 48pt;"> <col width="180" style="mso-width-source: userset; mso-width-alt: 6582; width: 135pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 6582; width: 135pt;"> <col width="82" style="mso-width-source: userset; mso-width-alt: 2998; width: 62pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 2998; width: 62pt;"> <col width="77" style="mso-width-source: userset; mso-width-alt: 2816; width: 58pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 2816; width: 58pt;"> <col width="79" style="mso-width-source: userset; mso-width-alt: 2889; width: 59pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 2889; width: 59pt;"> <col width="91" style="mso-width-source: userset; mso-width-alt: 3328; width: 68pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 3328; width: 68pt;"> <col width="96" style="mso-width-source: userset; mso-width-alt: 3510; width: 72pt;" data-mce-style="mso-width-source: userset; mso-width-alt: 3510; width: 72pt;"> <col width="64" span="4" style="width: 48pt;" data-mce-style="width: 48pt;"> </colgroup><tbody><tr height="21" style="height: 15.75pt;" data-mce-style="height: 15.75pt;"><td height="21" class="zimbra12" width="64" style="height: 15.75pt; width: 48pt;"></td><td class="zimbra11" width="180" style="width: 135pt;"></td><td align="left" width="82" style="width: 62pt;">Single-Span</td><td align="left" width="77" style="width: 58pt;">Kuo</td><td align="left" width="79" style="width: 59pt;">Simonc</td><td align="left" width="91" style="width: 68pt;">Multi-Span</td><td align="left" width="96" style="width: 72pt;">Date-Duration</td><td class="zimbra10" width="64" style="width: 48pt;"></td><td align="left" width="64" style="width: 48pt;">Train</td><td align="left" width="64" style="width: 48pt;">Dev</td><td align="left" width="64" style="width: 48pt;">Test</td></tr><tr height="63" style="height: 47.25pt;" data-mce-style="height: 47.25pt;"><td height="63" class="zimbra13" style="height: 47.25pt;">4月2日</td><td class="zimbra14" width="180" style="width: 135pt;">ENSEMBLEModule: 12 models (new)</td><td class="zimbra14" width="82" style="width: 62pt;">train: 0.890<br>dev: 0.801<br>test: 0.750</td><td class="zimbra14" width="77" style="width: 58pt;">train: 0.899<br>dev: 0.699<br>test: 0.741</td><td class="zimbra14" width="79" style="width: 59pt;"> </td><td class="zimbra11" width="91" style="width: 68pt;">train: 0.493<br>dev: 0.476<br>test: 0.350</td><td class="zimbra11" width="96" style="width: 72pt;">train: 0.589<br>dev: 0.720<br>test: 0.581</td><td class="zimbra10"></td><td class="zimbra15">0.786</td><td class="zimbra15">0.709</td><td class="zimbra15">0.658</td></tr><tr height="84" style="height: 63.0pt;" data-mce-style="height: 63.0pt;"><td height="84" class="zimbra12" style="height: 63.0pt;">4月3日</td><td class="zimbra11" width="180" style="width: 135pt;">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</td><td class="zimbra11" width="82" style="width: 62pt;">train: 0.890<br>dev: 0.801<br>test: 0.750</td><td class="zimbra11" width="77" style="width: 58pt;">train: 0.899<br>dev: 0.699<br>test: 0.741</td><td class="zimbra10"></td><td class="zimbra11" width="91" style="width: 68pt;">train: 0.548<br>dev: 0.667<br>test: 0.450</td><td class="zimbra11" width="96" style="width: 72pt;">train: 0.589<br>dev: 0.720<br>test: 0.581</td><td class="zimbra10"></td><td class="zimbra10">0.791</td><td class="zimbra10">0.725</td><td class="zimbra10">0.668</td></tr><tr height="84" style="height: 63.0pt;" data-mce-style="height: 63.0pt;"><td height="84" class="zimbra12" style="height: 63.0pt;">4月4日</td><td class="zimbra11" width="180" style="width: 135pt;">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</td><td class="zimbra11" width="82" style="width: 62pt;">train: 0.888<br>dev: 0.801<br>test: 0.759</td><td class="zimbra11" width="77" style="width: 58pt;">train: 0.949<br>dev: 0.837<br>test: 0.876</td><td class="zimbra10"></td><td class="zimbra11" width="91" style="width: 68pt;">train: 0.548<br>dev: 0.667<br>test: 0.450</td><td class="zimbra11" width="96" style="width: 72pt;" data-mce-style="width: 72pt;"><span style="color: rgb(255, 0, 0);" data-mce-style="color: #ff0000;">train: 0.753</span><br><span style="color: rgb(255, 0, 0);" data-mce-style="color: #ff0000;">dev: 0.720</span><br><span style="color: rgb(255, 0, 0);" data-mce-style="color: #ff0000;">test: 0.774</span></td><td class="zimbra10"></td><td class="zimbra10">0.817</td><td class="zimbra10">0.737</td><td class="zimbra10">0.705</td></tr></tbody></table><div style="clear: both;" data-mce-style="clear: both;"><br></div><div style="clear: both;" data-mce-style="clear: both;">Please check the detail in Performance.txt file and Date-Duration performance is similar to  <!--StartFragment--><span style="color: rgb(0, 0, 0); font-family: "helvetica neue", helvetica, arial, "liberation sans", sans-serif; font-size: 12pt; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); text-decoration-style: initial; text-decoration-color: initial; float: none; display: inline !important;" data-mce-style="color: #000000; font-family: 'helvetica neue', helvetica, arial, 'liberation sans', sans-serif; font-size: 12pt; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; float: none; display: inline !important;">郭家銍 report.</span></div><div style="clear: both;" data-mce-style="clear: both;"><span style="color: rgb(0, 0, 0); font-family: "helvetica neue", helvetica, arial, "liberation sans", sans-serif; font-size: 12pt; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); text-decoration-style: initial; text-decoration-color: initial; float: none; display: inline !important;" data-mce-style="color: #000000; font-family: 'helvetica neue', helvetica, arial, 'liberation sans', sans-serif; font-size: 12pt; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; float: none; display: inline !important;"><br data-mce-bogus="1"></span></div><div style="clear: both;" data-mce-style="clear: both;"><span style="color: rgb(0, 0, 0); font-family: "helvetica neue", helvetica, arial, "liberation sans", sans-serif; font-size: 12pt; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); text-decoration-style: initial; text-decoration-color: initial; float: none; display: inline !important;" data-mce-style="color: #000000; font-family: 'helvetica neue', helvetica, arial, 'liberation sans', sans-serif; font-size: 12pt; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; float: none; display: inline !important;">Best,</span></div><div style="clear: both;" data-mce-style="clear: both;"><span style="color: rgb(0, 0, 0); font-family: "helvetica neue", helvetica, arial, "liberation sans", sans-serif; font-size: 12pt; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); text-decoration-style: initial; text-decoration-color: initial; float: none; display: inline !important;" data-mce-style="color: #000000; font-family: 'helvetica neue', helvetica, arial, 'liberation sans', sans-serif; font-size: 12pt; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; float: none; display: inline !important;">jjfan</span></div><br></div><div><br data-mce-bogus="1"></div><hr id="zwchr" data-marker="__DIVIDER__"><div data-marker="__HEADERS__"><b>From: </b>"范正忠" <jjfan@iis.sinica.edu.tw><br><b>To: </b>"Simonc" <simonc@iis.sinica.edu.tw><br><b>Cc: </b>"Most-ai Contest" <Most-ai-contest@iis.sinica.edu.tw><br><b>Sent: </b>Friday, April 3, 2020 4:45:39 PM<br><b>Subject: </b>[Most-ai-contest] The performance of the last version FGC QA system<br></div><div><br></div><div data-marker="__QUOTED_TEXT__"><div style="font-family:'arial' , 'helvetica' , sans-serif;font-size:12pt;color:#000000"><div></div><div>Dear all,</div><br><div>Enclosed please find the current performance of the FGC QA system.</div><br><div> <table border="1" cellpadding="0" cellspacing="0" width="925" style="border-collapse:collapse;width:924px"><colgroup><col width="64" style="width:48pt"><col width="180" style="width:135pt"><col width="82" style="width:62pt"><col width="77" style="width:58pt"><col width="79" style="width:59pt"><col width="91" style="width:68pt"><col width="96" style="width:72pt"><col width="64" span="4" style="width:48pt"></colgroup><tbody><tr style="height:15.75pt"><td height="21" class="zimbra4" width="64" style="height:15.75pt;width:69px"></td><td class="zimbra3" width="180" style="width:187px"></td><td align="left" width="82" style="width:86px">Single-Span</td><td align="left" width="77" style="width:81px">Kuo</td><td align="left" width="91" style="width:95px">Multi-Span</td><td align="left" width="96" style="width:101px">Date-Duration</td><td class="zimbra2" width="64" style="width:99px"></td><td align="left" width="64" style="width:68px">Train</td><td align="left" width="64" style="width:69px">Dev</td><td align="left" width="64" style="width:69px">Test</td></tr><tr style="height:47.25pt"><td height="63" class="zimbra5" style="height:47.25pt;width:69px">4月2日</td><td class="zimbra6" width="180" style="width:187px">ENSEMBLEModule: 12 models (new)</td><td class="zimbra6" width="82" style="width:86px">train: 0.890<br>dev: 0.801<br>test: 0.750</td><td class="zimbra6" width="77" style="width:81px">train: 0.899<br>dev: 0.699<br>test: 0.741</td><td class="zimbra3" width="91" style="width:95px">train: 0.493<br>dev: 0.476<br>test: 0.350</td><td class="zimbra3" width="96" style="width:101px">train: 0.589<br>dev: 0.720<br>test: 0.581</td><td class="zimbra2" style="width:99px"></td><td class="zimbra7" style="width:68px">0.786</td><td class="zimbra7" style="width:69px">0.709</td><td class="zimbra7" style="width:69px">0.658</td></tr><tr style="height:63pt"><td height="84" class="zimbra4" style="height:63pt;width:69px">4月3日</td><td class="zimbra3" width="180" style="width:187px">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</td><td class="zimbra3" width="82" style="width:86px">train: 0.890<br>dev: 0.801<br>test: 0.750</td><td class="zimbra3" width="77" style="width:81px">train: 0.899<br>dev: 0.699<br>test: 0.741</td><td class="zimbra3" width="91" style="width:95px">train: 0.548<br>dev: 0.667<br>test: 0.450</td><td class="zimbra3" width="96" style="width:101px">train: 0.589<br>dev: 0.720<br>test: 0.581</td><td class="zimbra2" style="width:99px"></td><td class="zimbra2" style="width:68px">0.791</td><td class="zimbra2" style="width:69px">0.725</td><td class="zimbra2" style="width:69px">0.668</td></tr></tbody></table><br><div>Please  <span style="color:#000000;font-family:'helvetica neue' , 'helvetica' , 'arial' , 'liberation sans' , sans-serif;font-size:14.16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:#ffffff;display:!important;float:none">郭家銍 help to check Date-Duration ver.4. </span></div><div><span style="color:#000000;font-family:'helvetica neue' , 'helvetica' , 'arial' , 'liberation sans' , sans-serif;font-size:14.16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:#ffffff;display:!important;float:none"><br></span></div><div><span style="color:#000000;font-family:'helvetica neue' , 'helvetica' , 'arial' , 'liberation sans' , sans-serif;font-size:14.16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:#ffffff;display:!important;float:none">Best,</span></div><div><span style="color:#000000;font-family:'helvetica neue' , 'helvetica' , 'arial' , 'liberation sans' , sans-serif;font-size:14.16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:#ffffff;display:!important;float:none">jjfan</span></div><br></div><br><hr id="zwchr"><div><b>From: </b>"范正忠" <jjfan@iis.sinica.edu.tw><br><b>To: </b>"Simonc" <simonc@iis.sinica.edu.tw><br><b>Cc: </b>"Most-ai Contest" <Most-ai-contest@iis.sinica.edu.tw><br><b>Sent: </b>Thursday, April 2, 2020 3:56:36 PM<br><b>Subject: </b>Re: [Most-ai-contest] Updated Performance Data with Gold        Answer        Inclusion Rate<br></div><br><div><div style="font-family:'arial' , 'helvetica' , sans-serif;font-size:12pt;color:#000000"><div>Dear all,</div><br><div>Enclosed please find the performance of the last code:</div><br><div><div>ENSEMBLEModule: 12 models (new), single_span_multi_hop_v2_1</div><div>Multi-Spans: MSPE_v18_branchy20</div><div>date_duration_module_3</div><div>arithmetic_module_3</div><div>kinship_module6</div><br><div>Overall:</div><div>train -> total: 882, correct: 668, accuracy: 0.757<br></div><div>dev -> total: 247, correct: 161, accuracy: 0.652</div><div>test -> total: 193, correct: 126, accuracy: 0.653</div><br><div>Single-Span:</div><div>train -> portion:0.619, count:546, errors: 86, accuracy: 0.842</div><div>    ensemble only -> portion:0.619, count:546, errors: 37, accuracy: <span style="color:rgb( 255 , 0 , 0 )"><strong>0.932</strong></span></div><div>    multi-hop only -> portion:0.619, count:546, errors: 76, accuracy: 0.861</div><br><div>dev -> portion:0.632, count:156, errors: 45, accuracy: 0.712</div><div>     <span style="color:#000000;font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:#ffffff;display:!important;float:none">ensemble only -> portion:0.632, count:156, errors: 37, accuracy: <span style="color:rgb( 255 , 0 , 0 )"><strong>0.763</strong></span></span><div> <span style="color:#000000;font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:#ffffff;display:!important;float:none">     multi-hop only -> portion:0.632, count:156, errors: 43, accuracy: 0.724</span><br><div>test -> portion:0.580, count:112, errors: 29, accuracy: 0.741</div></div></div><div>     <span style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 );float:none;display:!important">ensemble only -> portion:0.580, count:112, errors: 23, accuracy: </span><span style="font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 );float:none;display:!important;color:rgb( 255 , 0 , 0 )"><strong>0.795</strong></span><div style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 )"><span style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 );float:none;display:!important">     multi-hop only -> portion:0.580, count:112, errors: 26, accuracy: 0.768</span></div><div style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 )"><span style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 );float:none;display:!important"><br></span></div><div style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 )"><span style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 );float:none;display:!important">Multi-Spans:</span></div><div style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 )"><span style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 );float:none;display:!important">train -> portion:0.083, count:73, errors: 37, accuracy: 0.493</span></div><div style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 )"><span style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 );float:none;display:!important">dev -> portion:0.085, count:21, errors: 11, accuracy: 0.476</span></div><div style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 )"><span style="color:rgb( 0 , 0 , 0 );font-family:'arial' , 'helvetica' , sans-serif;font-size:16px;font-style:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb( 255 , 255 , 255 );float:none;display:!important">test -> portion:0.104, count:20, errors: 13, accuracy: 0.350</span></div><br></div></div><div>jjfan</div><hr id="zwchr"><div><b>From: </b>"Simonc" <simonc@iis.sinica.edu.tw><br><b>To: </b>"Most-ai Contest" <Most-ai-contest@iis.sinica.edu.tw><br><b>Sent: </b>Tuesday, March 31, 2020 6:00:52 PM<br><b>Subject: </b>[Most-ai-contest] Updated Performance Data with Gold Answer        Inclusion Rate<br></div><br><div><div style="font-family:'arial' , 'helvetica' , sans-serif;font-size:12pt;color:#000000"><div>Dear all,</div><br><div>The attached file contains the performance data from our results in 3/27.</div><div>This time, the gold answer inclusion rate is also included. (That is, counting the cases where the correct answer is included in the answer candidates.)</div><br><div>Regards,</div><div>張光瑜</div></div><br>_______________________________________________<br>Most-ai-contest mailing list<br>Most-ai-contest@iis.sinica.edu.tw<br>https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest<br></div></div><br>_______________________________________________<br>Most-ai-contest mailing list<br>Most-ai-contest@iis.sinica.edu.tw<br>https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest<br></div></div><br>_______________________________________________<br>Most-ai-contest mailing list<br>Most-ai-contest@iis.sinica.edu.tw<br>https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest<br></div></div><div><Performance.txt></div><div><4.4-1.7z></div><span>_______________________________________________</span><br><span>Most-ai-contest mailing list</span><br><span>Most-ai-contest@iis.sinica.edu.tw</span><br><span>https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</span><br></div></blockquote></body></html>