<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div dir="ltr">Dear Dr. Fan,</div><div dir="ltr"><br></div><div dir="ltr">意思是如果我們只用single span的module來做所有題目</div><div dir="ltr">可以獲得test set=0.759 的成績，也會是目前最好的結果囉？</div><div dir="ltr"><br></div><div dir="ltr"><br></div><div dir="ltr">謝謝</div><div dir="ltr">Best, Menphis.</div><div dir="ltr"><br></div><div dir="ltr"><br><blockquote type="cite">范正忠 <jjfan@iis.sinica.edu.tw> 於 2020年4月4日 11:25 寫道：<br><br></blockquote></div><blockquote type="cite"><div dir="ltr"><div style="font-family: arial, helvetica, sans-serif; font-size: 12pt; color: #000000"><div><style></style></div><div></div><div> <!--StartFragment--><span lang="EN-US" style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;" data-mce-style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;">“</span><span lang="EN-US" style="color: black; font-family: arial, helvetica, sans-serif; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-size: 11pt;" data-mce-style="color: black; font-family: arial, helvetica, sans-serif; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-size: 11pt;">Single-Span</span><span lang="EN-US" style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;" data-mce-style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;">” = > the performance of 'single-span-extraction' answer mode, no matter which answer module gets the highest score.</span><!--EndFragment--></div><div><span lang="EN-US" style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;" data-mce-style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;"><br data-mce-bogus="1"></span></div><div><span lang="EN-US" style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;" data-mce-style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;"> <!--StartFragment-->“<span lang="EN-US" style="color: black; font-family: arial, helvetica, sans-serif; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-size: 11pt;" data-mce-style="color: black; font-family: arial, helvetica, sans-serif; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-size: 11pt;">Kuo</span>”<!--EndFragment--> => the performance of 'single-span ensemble' answer module by Kuo & Liao</span></div><div><span lang="EN-US" style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;" data-mce-style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;"><br data-mce-bogus="1"></span></div><div><span lang="EN-US" style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;" data-mce-style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;"><span lang="EN-US" style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;" data-mce-style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;"> <!--StartFragment-->“<span lang="EN-US" style="color: black; font-family: arial, helvetica, sans-serif; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-size: 11pt;" data-mce-style="color: black; font-family: arial, helvetica, sans-serif; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-size: 11pt;">Simonc</span>”<span> => not activated, since <!--StartFragment--><span style="color: #1f497d; font-family: calibri, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; display: inline !important; float: none;" data-mce-style="color: #1f497d; font-family: calibri, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; display: inline !important; float: none;">“</span><span lang="EN-US" data-mce-style="color: black; font-family: arial, helvetica, sans-serif; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-size: 11pt;" style="font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); text-decoration-style: initial; text-decoration-color: initial; color: black; font-family: arial, helvetica, sans-serif; font-size: 11pt;">Simonc</span><span style="color: #1f497d; font-family: calibri, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; display: inline !important; float: none;" data-mce-style="color: #1f497d; font-family: calibri, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; display: inline !important; float: none;">” performance is less than "Kuo". It means that for 'single-span-extraction' answer mode the system only activates "Kuo" answer module at the current test</span><!--EndFragment--></span></span></span><div style="clear: both;" data-mce-style="clear: both;"><br></div><span lang="EN-US" style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;" data-mce-style="font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: #ffffff; text-decoration-style: initial; text-decoration-color: initial; font-family: calibri, sans-serif; color: #1f497d;"><span></span><!--EndFragment--></span></div><div>jjfan</div><hr id="zwchr" data-marker="__DIVIDER__"><div data-marker="__HEADERS__"><b>From: </b>"kysu" <kysu@iis.sinica.edu.tw><br><b>To: </b>"范正忠" <jjfan@iis.sinica.edu.tw><br><b>Cc: </b>"Simonc" <simonc@iis.sinica.edu.tw>, "Most-ai Contest" <Most-ai-contest@iis.sinica.edu.tw>, "kysu" <kysu@iis.sinica.edu.tw><br><b>Sent: </b>Saturday, April 4, 2020 11:16:35 AM<br><b>Subject: </b>RE: [Most-ai-contest] The performance of the last version FGC QA system (4/4)<br></div><div><br></div><div data-marker="__QUOTED_TEXT__"><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d">What is the difference between the third column “</span><span lang="EN-US" style="font-size:11pt;color:black">Single-Span</span><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d">” and the fourth column “</span><span lang="EN-US" style="font-size:11pt;color:black">Kuo</span><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d">”? Please fill in the column of “</span><span lang="EN-US" style="font-size:11pt;color:black">Simonc</span><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d">” next time for comparison. Thanks.</span></p><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d"> </span></p><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d">KY</span></p><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d"> </span></p><div><div style="border:none;border-top:solid #e1e1e1 1pt;padding:3pt 0cm 0cm 0cm"><p class="MsoNormal"><b><span lang="EN-US" style="font-size:11pt;font-family:'calibri' , sans-serif">From:</span></b><span lang="EN-US" style="font-size:11pt;font-family:'calibri' , sans-serif"> </span><span style="font-size:11pt">范正忠</span><span lang="EN-US" style="font-size:11pt;font-family:'calibri' , sans-serif"> [mailto:jjfan@iis.sinica.edu.tw] <br><b>Sent:</b> Saturday, April 4, 2020 10:57 AM<br><b>To:</b> kysu <kysu@iis.sinica.edu.tw><br><b>Cc:</b> Simonc <simonc@iis.sinica.edu.tw>; Most-ai Contest <Most-ai-contest@iis.sinica.edu.tw><br><b>Subject:</b> Re: [Most-ai-contest] The performance of the last version FGC QA system (4/4)</span></p></div></div><p class="MsoNormal"><span lang="EN-US"> </span></p><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Sorry! Correction of the performance of single-span-ensemble module </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><table class="MsoNormalTable" border="1" cellspacing="0" cellpadding="0" width="1292" style="width:694pt;border-collapse:collapse"><tbody><tr style="height:15.75pt"><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"></td><td width="253" valign="top" style="width:135.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"></td><td width="116" nowrap="nowrap" valign="bottom" style="width:62.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Single-Span</span></p></td><td width="106" nowrap="nowrap" valign="bottom" style="width:57pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Kuo</span></p></td><td width="109" nowrap="nowrap" valign="bottom" style="width:58.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Simonc</span></p></td><td width="127" nowrap="nowrap" valign="bottom" style="width:68.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Multi-Span</span></p></td><td width="135" nowrap="nowrap" valign="bottom" style="width:72.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Date-Duration</span></p></td><td width="87" nowrap="nowrap" valign="top" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"></td><td width="89" nowrap="nowrap" valign="bottom" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Train</span></p></td><td width="89" nowrap="nowrap" valign="bottom" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Dev</span></p></td><td width="89" nowrap="nowrap" valign="bottom" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Test</span></p></td></tr><tr style="height:47.25pt"><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">2</span>日<span lang="EN-US"></span></span></p></td><td width="253" valign="top" style="width:135.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new) + single_span_multi_hop_v2_1</span></p></td><td width="116" valign="top" style="width:62.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.842<br>dev: 0.712<br>test: 0.741</span></p></td><td width="106" valign="top" style="width:57pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.899<br>dev: 0.699<br>test: 0.741</span></p></td><td width="109" valign="top" style="width:58.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.771<br>dev: 0.635<br>test: 0.705</span></p></td><td width="127" nowrap="nowrap" valign="top" style="width:68.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="135" nowrap="nowrap" valign="top" style="width:72.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="87" nowrap="nowrap" valign="top" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.757</span></p></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.652</span></p></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.653</span></p></td></tr><tr style="height:47.25pt"><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">2</span>日<span lang="EN-US"></span></span></p></td><td width="253" valign="top" style="width:135.75pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)</span></p></td><td width="116" valign="top" style="width:62.25pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.890<br>dev: 0.801<br>test: 0.750</span></p></td><td width="106" valign="top" style="width:57pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.899<br>dev: 0.699<br>test: 0.741</span></p></td><td width="109" valign="top" style="width:58.5pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span style="font-size:11pt;color:black"> <span lang="EN-US"></span></span></p></td><td width="127" valign="top" style="width:68.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.493<br>dev: 0.476<br>test: 0.350</span></p></td><td width="135" valign="top" style="width:72.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.589<br>dev: 0.720<br>test: 0.581</span></p></td><td width="87" nowrap="nowrap" valign="top" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.786</span></p></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.709</span></p></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.658</span></p></td></tr><tr style="height:47.25pt"><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">2</span>日<span lang="EN-US"></span></span></p></td><td width="253" valign="top" style="width:135.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">single_span_multi_hop_v2_1</span></p></td><td width="116" valign="top" style="width:62.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.775<br>dev: 0.692<br>test: 0.714</span></p></td><td width="106" valign="top" style="width:57pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="109" valign="top" style="width:58.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.771<br>dev: 0.635<br>test: 0.705</span></p></td><td width="127" nowrap="nowrap" valign="top" style="width:68.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="135" nowrap="nowrap" valign="top" style="width:72.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="87" nowrap="nowrap" valign="top" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.714</span></p></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.64</span></p></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.637</span></p></td></tr><tr style="height:63pt"><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">3</span>日<span lang="EN-US"></span></span></p></td><td width="253" valign="top" style="width:135.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span></p></td><td width="116" valign="top" style="width:62.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.890<br>dev: 0.801<br>test: 0.750</span></p></td><td width="106" valign="top" style="width:57pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.899<br>dev: 0.699<br>test: 0.741</span></p></td><td width="109" nowrap="nowrap" valign="top" style="width:58.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"></td><td width="127" valign="top" style="width:68.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.548<br>dev: 0.667<br>test: 0.450</span></p></td><td width="135" valign="top" style="width:72.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.589<br>dev: 0.720<br>test: 0.581</span></p></td><td width="87" nowrap="nowrap" valign="top" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.791</span></p></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.725</span></p></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.668</span></p></td></tr><tr style="height:63pt"><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">4</span>日<span lang="EN-US"></span></span></p></td><td width="253" valign="top" style="width:135.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span></p></td><td width="116" valign="top" style="width:62.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.888<br>dev: 0.801<br>test: 0.759</span></p></td><td width="106" valign="top" style="width:57pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><div><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black;background:#ffff99">train: 0.897</span><span lang="EN-US" style="font-size:11pt;color:black"><br><span style="background:#ffff99">dev: 0.699</span><br><span style="background:#ffff99">test: 0.750</span></span></p></div><div><p class="MsoNormal"><s><span lang="EN-US" style="font-size:11pt;color:black;background:white">train: 0.949</span></s><span lang="EN-US" style="font-size:11pt;color:black;background:#ffff99"><br></span><s><span lang="EN-US" style="font-size:11pt;color:black;background:white">dev: 0.837</span></s><span lang="EN-US" style="font-size:11pt;color:black;background:#ffff99"><br></span><s><span lang="EN-US" style="font-size:11pt;color:black;background:white">test: 0.876</span></s><span lang="EN-US" style="font-size:11pt;color:black"></span></p></div></td></tr><tr><td width="109" nowrap="nowrap" valign="top" style="width:58.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black"><br><br></span></p></td></tr></tbody></table><table><tbody><tr><td width="127" valign="top" style="width:68.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.548<br>dev: 0.667<br>test: 0.450</span></p></td><td width="135" valign="top" style="width:72.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.753<br>dev: 0.720<br>test: 0.774</span></p></td><td width="87" nowrap="nowrap" valign="top" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.817</span></p></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.737</span></p></td><td width="89" nowrap="nowrap" valign="top" style="width:48pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.705</span></p></td></tr></tbody></table><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div align="center" style="text-align:center"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><hr size="3" width="100%" align="center" id="zwchr"></span></div><div><p class="MsoNormal"><b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">From: </span></b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"kysu" <<a href="mailto:kysu@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">kysu@iis.sinica.edu.tw</a>><br><b>To: </b>"</span><span style="color:black">范正忠</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">" <<a href="mailto:jjfan@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">jjfan@iis.sinica.edu.tw</a>>, "Simonc" <<a href="mailto:simonc@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">simonc@iis.sinica.edu.tw</a>><br><b>Cc: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Saturday, April 4, 2020 10:48:57 AM<br><b>Subject: </b>RE: [Most-ai-contest] The performance of the last version FGC QA system (4/4)</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d">Thanks. Glad to know that we have got a new record high performance! Let’s keep pushing the performance.</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d"> </span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d">KY</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d"> </span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p><div><div style="border:none;border-top:solid #e1e1e1 1pt;padding:3pt 0cm 0cm 0cm"><p class="MsoNormal"><b><span lang="EN-US" style="font-size:11pt;font-family:'calibri' , sans-serif;color:black">From:</span></b><span lang="EN-US" style="font-size:11pt;font-family:'calibri' , sans-serif;color:black"> <a href="mailto:most-ai-contest-bounces@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">most-ai-contest-bounces@iis.sinica.edu.tw</a> [<a href="mailto:most-ai-contest-bounces@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">mailto:most-ai-contest-bounces@iis.sinica.edu.tw</a>] <b>On Behalf Of </b></span><span style="font-size:11pt;color:black">范正忠</span><span lang="EN-US" style="font-size:11pt;font-family:'calibri' , sans-serif;color:black"><br><b>Sent:</b> Saturday, April 4, 2020 10:24 AM<br><b>To:</b> Simonc <<a href="mailto:simonc@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">simonc@iis.sinica.edu.tw</a>><br><b>Cc:</b> Most-ai Contest <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Subject:</b> Re: [Most-ai-contest] The performance of the last version FGC QA system (4/4)</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><div><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all,</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Enclosed please find the current performance of the FGC QA system.</span></p></div></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div></div><div><table class="MsoNormalTable" border="1" cellspacing="0" cellpadding="0" width="1292" style="width:694pt;border-collapse:collapse"><tbody><tr style="height:11.25pt"><td width="80" nowrap="nowrap" valign="bottom" style="width:42.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:11.25pt"></td><td width="265" nowrap="nowrap" valign="bottom" style="width:142.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:11.25pt"></td><td width="109" nowrap="nowrap" valign="bottom" style="width:58.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:11.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Single-Span</span></p></td><td width="102" nowrap="nowrap" valign="bottom" style="width:54.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:11.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Kuo</span></p></td><td width="105" nowrap="nowrap" valign="bottom" style="width:56.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:11.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Simonc</span></p></td><td width="121" nowrap="nowrap" valign="bottom" style="width:65.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:11.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Multi-Span</span></p></td><td width="130" nowrap="nowrap" valign="bottom" style="width:69.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:11.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Date-Duration</span></p></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:11.25pt"></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:11.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Train</span></p></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:11.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Dev</span></p></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:11.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Test</span></p></td></tr><tr style="height:35.25pt"><td width="80" nowrap="nowrap" valign="bottom" style="width:42.75pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:35.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">2</span>日<span lang="EN-US"></span></span></p></td><td width="265" nowrap="nowrap" valign="bottom" style="width:142.5pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:35.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)</span></p></td><td width="109" nowrap="nowrap" valign="bottom" style="width:58.5pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:35.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.890<br>dev: 0.801<br>test: 0.750</span></p></td><td width="102" nowrap="nowrap" valign="bottom" style="width:54.75pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:35.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.899<br>dev: 0.699<br>test: 0.741</span></p></td><td width="105" nowrap="nowrap" valign="bottom" style="width:56.25pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:35.25pt"><p class="MsoNormal"><span style="font-size:11pt;color:black"> <span lang="EN-US"></span></span></p></td><td width="121" nowrap="nowrap" valign="bottom" style="width:65.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:35.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.493<br>dev: 0.476<br>test: 0.350</span></p></td><td width="130" nowrap="nowrap" valign="bottom" style="width:69.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:35.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.589<br>dev: 0.720<br>test: 0.581</span></p></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:35.25pt"></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:35.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.786</span></p></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:35.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.709</span></p></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;background:#f8cbad;padding:0.75pt 0.75pt 0cm 0.75pt;height:35.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.658</span></p></td></tr><tr style="height:47.25pt"><td width="80" nowrap="nowrap" valign="bottom" style="width:42.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">3</span>日<span lang="EN-US"></span></span></p></td><td width="265" nowrap="nowrap" valign="bottom" style="width:142.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span></p></td><td width="109" nowrap="nowrap" valign="bottom" style="width:58.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.890<br>dev: 0.801<br>test: 0.750</span></p></td><td width="102" nowrap="nowrap" valign="bottom" style="width:54.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.899<br>dev: 0.699<br>test: 0.741</span></p></td><td width="105" nowrap="nowrap" valign="bottom" style="width:56.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="121" nowrap="nowrap" valign="bottom" style="width:65.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.548<br>dev: 0.667<br>test: 0.450</span></p></td><td width="130" nowrap="nowrap" valign="bottom" style="width:69.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.589<br>dev: 0.720<br>test: 0.581</span></p></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.791</span></p></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.725</span></p></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.668</span></p></td></tr><tr style="height:47.25pt"><td width="80" nowrap="nowrap" valign="bottom" style="width:42.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">4</span>日<span lang="EN-US"></span></span></p></td><td width="265" nowrap="nowrap" valign="bottom" style="width:142.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span></p></td><td width="109" nowrap="nowrap" valign="bottom" style="width:58.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.888<br>dev: 0.801<br>test: 0.759</span></p></td><td width="102" nowrap="nowrap" valign="bottom" style="width:54.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.949<br>dev: 0.837<br>test: 0.876</span></p></td><td width="105" nowrap="nowrap" valign="bottom" style="width:56.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="121" nowrap="nowrap" valign="bottom" style="width:65.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.548<br>dev: 0.667<br>test: 0.450</span></p></td><td width="130" nowrap="nowrap" valign="bottom" style="width:69.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:red">train: 0.753</span><span lang="EN-US" style="font-size:11pt;color:black"><br></span><span lang="EN-US" style="font-size:11pt;color:red">dev: 0.720</span><span lang="EN-US" style="font-size:11pt;color:black"><br></span><span lang="EN-US" style="font-size:11pt;color:red">test: 0.774</span><span lang="EN-US" style="font-size:11pt;color:black"></span></p></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.817</span></p></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.737</span></p></td><td width="87" nowrap="nowrap" valign="bottom" style="width:46.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.705</span></p></td></tr></tbody></table><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Please check the detail in Performance.txt file and Date-Duration performance is similar to </span><span style="color:black;background:white">郭家銍</span><span lang="EN-US" style="font-family:'helvetica' , sans-serif;color:black;background:white"> report.</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal" style="margin-bottom:12pt"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'helvetica' , sans-serif;color:black;background:white">Best,</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'helvetica' , sans-serif;color:black;background:white">jjfan</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div align="center" style="text-align:center"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><hr size="3" width="100%" align="center"></span></div><div><p class="MsoNormal"><b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">From: </span></b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"</span><span style="color:black">范正忠</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">" <<a href="mailto:jjfan@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">jjfan@iis.sinica.edu.tw</a>><br><b>To: </b>"Simonc" <<a href="mailto:simonc@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">simonc@iis.sinica.edu.tw</a>><br><b>Cc: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Friday, April 3, 2020 4:45:39 PM<br><b>Subject: </b>[Most-ai-contest] The performance of the last version FGC QA system</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all,</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Enclosed please find the current performance of the FGC QA system.</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><table class="MsoNormalTable" border="1" cellspacing="0" cellpadding="0" width="1290" style="width:693pt;border-collapse:collapse"><tbody><tr style="height:15.75pt"><td width="96" nowrap="nowrap" valign="bottom" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"></td><td width="261" nowrap="nowrap" valign="bottom" style="width:140.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"></td><td width="120" nowrap="nowrap" valign="bottom" style="width:64.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Single-Span</span></p></td><td width="113" nowrap="nowrap" valign="bottom" style="width:60.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Kuo</span></p></td><td width="133" nowrap="nowrap" valign="bottom" style="width:71.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Multi-Span</span></p></td><td width="141" nowrap="nowrap" valign="bottom" style="width:75.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Date-Duration</span></p></td><td width="138" nowrap="nowrap" valign="bottom" style="width:74.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"></td><td width="95" nowrap="nowrap" valign="bottom" style="width:51pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Train</span></p></td><td width="96" nowrap="nowrap" valign="bottom" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Dev</span></p></td><td width="96" nowrap="nowrap" valign="bottom" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:15.75pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">Test</span></p></td></tr><tr style="height:47.25pt"><td width="96" nowrap="nowrap" valign="bottom" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;color:black">4</span><span style="font-size:9pt;color:black">月<span lang="EN-US">2</span>日</span><span lang="EN-US" style="font-size:11pt;color:black"></span></p></td><td width="261" nowrap="nowrap" valign="bottom" style="width:140.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)</span></p></td><td width="120" nowrap="nowrap" valign="bottom" style="width:64.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.890<br>dev: 0.801<br>test: 0.750</span></p></td><td width="113" nowrap="nowrap" valign="bottom" style="width:60.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.899<br>dev: 0.699<br>test: 0.741</span></p></td><td width="133" nowrap="nowrap" valign="bottom" style="width:71.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.493<br>dev: 0.476<br>test: 0.350</span></p></td><td width="141" nowrap="nowrap" valign="bottom" style="width:75.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.589<br>dev: 0.720<br>test: 0.581</span></p></td><td width="138" nowrap="nowrap" valign="bottom" style="width:74.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"></td><td width="95" nowrap="nowrap" valign="bottom" style="width:51pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.786</span></p></td><td width="96" nowrap="nowrap" valign="bottom" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.709</span></p></td><td width="96" nowrap="nowrap" valign="bottom" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:47.25pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.658</span></p></td></tr><tr style="height:63pt"><td width="96" nowrap="nowrap" valign="bottom" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">4</span><span style="font-size:11pt;color:black">月<span lang="EN-US">3</span>日<span lang="EN-US"></span></span></p></td><td width="261" nowrap="nowrap" valign="bottom" style="width:140.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span></p></td><td width="120" nowrap="nowrap" valign="bottom" style="width:64.5pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.890<br>dev: 0.801<br>test: 0.750</span></p></td><td width="113" nowrap="nowrap" valign="bottom" style="width:60.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.899<br>dev: 0.699<br>test: 0.741</span></p></td><td width="133" nowrap="nowrap" valign="bottom" style="width:71.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.548<br>dev: 0.667<br>test: 0.450</span></p></td><td width="141" nowrap="nowrap" valign="bottom" style="width:75.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">train: 0.589<br>dev: 0.720<br>test: 0.581</span></p></td><td width="138" nowrap="nowrap" valign="bottom" style="width:74.25pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"></td><td width="95" nowrap="nowrap" valign="bottom" style="width:51pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.791</span></p></td><td width="96" nowrap="nowrap" valign="bottom" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.725</span></p></td><td width="96" nowrap="nowrap" valign="bottom" style="width:51.75pt;border:none;padding:0.75pt 0.75pt 0cm 0.75pt;height:63pt"><p class="MsoNormal"><span lang="EN-US" style="font-size:11pt;color:black">0.668</span></p></td></tr></tbody></table><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Please </span><span style="font-size:10.5pt;color:black;background:white">郭家銍</span><span lang="EN-US" style="font-size:10.5pt;font-family:'helvetica' , sans-serif;color:black;background:white"> help to check Date-Duration ver.4. </span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal" style="margin-bottom:12pt"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:'helvetica' , sans-serif;color:black;background:white">Best,</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-size:10.5pt;font-family:'helvetica' , sans-serif;color:black;background:white">jjfan</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div align="center" style="text-align:center"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><hr size="3" width="100%" align="center"></span></div><div><p class="MsoNormal"><b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">From: </span></b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"</span><span style="color:black">范正忠</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">" <<a href="mailto:jjfan@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">jjfan@iis.sinica.edu.tw</a>><br><b>To: </b>"Simonc" <<a href="mailto:simonc@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">simonc@iis.sinica.edu.tw</a>><br><b>Cc: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Thursday, April 2, 2020 3:56:36 PM<br><b>Subject: </b>Re: [Most-ai-contest] Updated Performance Data with Gold Answer Inclusion Rate</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all,</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Enclosed please find the performance of the last code:</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">ENSEMBLEModule: 12 models (new), single_span_multi_hop_v2_1</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Multi-Spans: MSPE_v18_branchy20</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">date_duration_module_3</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">arithmetic_module_3</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">kinship_module6</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Overall:</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">train -> total: 882, correct: 668, accuracy: 0.757</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">dev -> total: 247, correct: 161, accuracy: 0.652</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">test -> total: 193, correct: 126, accuracy: 0.653</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Single-Span:</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">train -> portion:0.619, count:546, errors: 86, accuracy: 0.842</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> ensemble only -> portion:0.619, count:546, errors: 37, accuracy: </span><strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:red">0.932</span></strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> multi-hop only -> portion:0.619, count:546, errors: 76, accuracy: 0.861</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">dev -> portion:0.632, count:156, errors: 45, accuracy: 0.712</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> <span style="background:white">ensemble only -> portion:0.632, count:156, errors: 37, accuracy: </span></span><strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:red;background:white">0.763</span></strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white"> multi-hop only -> portion:0.632, count:156, errors: 43, accuracy: 0.724</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">test -> portion:0.580, count:112, errors: 29, accuracy: 0.741</span></p></div></div></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> <span style="background:white">ensemble only -> portion:0.580, count:112, errors: 23, accuracy: </span></span><strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:red;background:white">0.795</span></strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white"> multi-hop only -> portion:0.580, count:112, errors: 26, accuracy: 0.768</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal" style="margin-bottom:12pt;background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white">Multi-Spans:</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white">train -> portion:0.083, count:73, errors: 37, accuracy: 0.493</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white">dev -> portion:0.085, count:21, errors: 11, accuracy: 0.476</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><div><p class="MsoNormal" style="background:white"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black;background:white">test -> portion:0.104, count:20, errors: 13, accuracy: 0.350</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">jjfan</span></p></div><div align="center" style="text-align:center"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><hr size="3" width="100%" align="center"></span></div><div><p class="MsoNormal"><b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">From: </span></b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"Simonc" <<a href="mailto:simonc@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">simonc@iis.sinica.edu.tw</a>><br><b>To: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Tuesday, March 31, 2020 6:00:52 PM<br><b>Subject: </b>[Most-ai-contest] Updated Performance Data with Gold Answer Inclusion Rate</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all,</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">The attached file contains the performance data from our results in 3/27.</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">This time, the gold answer inclusion rate is also included. (That is, counting the cases where the correct answer is included in the answer candidates.)</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Regards,</span></p></div><div><p class="MsoNormal"><span style="color:black">張光瑜</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><br>_______________________________________________<br>Most-ai-contest mailing list<br><a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a><br><a href="https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest" target="_blank" rel="nofollow noopener noreferrer">https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</a></span></p></div></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><br>_______________________________________________<br>Most-ai-contest mailing list<br><a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a><br><a href="https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest" target="_blank" rel="nofollow noopener noreferrer">https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</a></span></p></div></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><br>_______________________________________________<br>Most-ai-contest mailing list<br><a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a><br><a href="https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest" target="_blank" rel="nofollow noopener noreferrer">https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</a></span></p></div></div></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div></div></div></div><br></div></div><span>_______________________________________________</span><br><span>Most-ai-contest mailing list</span><br><span>Most-ai-contest@iis.sinica.edu.tw</span><br><span>https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</span><br></div></blockquote></body></html>