<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:新細明體;
panose-1:2 2 5 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"\@新細明體";
panose-1:2 1 6 1 0 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"新細明體",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"新細明體",serif;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=ZH-TW link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D;background:white'>“</span><span lang=EN-US style='font-size:11.0pt;font-family:"Arial",sans-serif;color:black;background:white'>Simonc</span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D;background:white'>” => not activated, since “</span><span lang=EN-US style='font-size:11.0pt;font-family:"Arial",sans-serif;color:black;background:white'>Simonc</span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D;background:white'>” performance is less than "Kuo". It means that for 'single-span-extraction' answer mode the system only activates "Kuo" answer module at the current test</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>Do you mean that you only activate the top-2 two answer-generating-modules currently (off-line decided) when the answer-mode is “Single-Span-Extraction”? The Dispatcher only assign probability to each answer-mode, not each answer-generating-module. Does it imply that you manually off-line selected which answer-generating-modules should be activated?<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>KY<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'>From:</span></b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'> </span><span style='font-size:11.0pt'>范正忠</span><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'> [mailto:jjfan@iis.sinica.edu.tw] <br><b>Sent:</b> Saturday, April 4, 2020 11:25 AM<br><b>To:</b> kysu <kysu@iis.sinica.edu.tw><br><b>Cc:</b> Simonc <simonc@iis.sinica.edu.tw>; Most-ai Contest <Most-ai-contest@iis.sinica.edu.tw><br><b>Subject:</b> Re: [Most-ai-contest] The performance of the last version FGC QA system (4/4)<o:p></o:p></span></p></div></div><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D;background:white'>“</span><span lang=EN-US style='font-size:11.0pt;font-family:"Arial",sans-serif;color:black;background:white'>Single-Span</span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D;background:white'>” = > the performance of 'single-span-extraction' answer mode, no matter which answer module gets the highest score.</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D;background:white'><br><br></span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D;background:white'>“</span><span lang=EN-US style='font-size:11.0pt;font-family:"Arial",sans-serif;color:black;background:white'>Kuo</span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D;background:white'>” => the performance of 'single-span ensemble' answer module by Kuo & Liao</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D;background:white'><br><br></span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D;background:white'>“</span><span lang=EN-US style='font-size:11.0pt;font-family:"Arial",sans-serif;color:black;background:white'>Simonc</span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D;background:white'>” => not activated, since “</span><span lang=EN-US style='font-size:11.0pt;font-family:"Arial",sans-serif;color:black;background:white'>Simonc</span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D;background:white'>” performance is less than "Kuo". It means that for 'single-span-extraction' answer mode the system only activates "Kuo" answer module at the current test</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>jjfan<o:p></o:p></span></p></div><div class=MsoNormal align=center style='text-align:center'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><hr size=3 width="100%" align=center id=zwchr></span></div><div><p class=MsoNormal><b><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>From: </span></b><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>"kysu" <<a href="mailto:kysu@iis.sinica.edu.tw">kysu@iis.sinica.edu.tw</a>><br><b>To: </b>"</span><span style='color:black'>范正忠</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>" <<a href="mailto:jjfan@iis.sinica.edu.tw">jjfan@iis.sinica.edu.tw</a>><br><b>Cc: </b>"Simonc" <<a href="mailto:simonc@iis.sinica.edu.tw">simonc@iis.sinica.edu.tw</a>>, "Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw">Most-ai-contest@iis.sinica.edu.tw</a>>, "kysu" <<a href="mailto:kysu@iis.sinica.edu.tw">kysu@iis.sinica.edu.tw</a>><br><b>Sent: </b>Saturday, April 4, 2020 11:16:35 AM<br><b>Subject: </b>RE: [Most-ai-contest] The performance of the last version FGC QA system (4/4)<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>What is the difference between the third column “</span><span lang=EN-US style='font-size:11.0pt;font-family:"Arial",sans-serif;color:black'>Single-Span</span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>” and the fourth column “</span><span lang=EN-US style='font-size:11.0pt;font-family:"Arial",sans-serif;color:black'>Kuo</span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”? Please fill in the column of “</span><span lang=EN-US style='font-size:11.0pt;font-family:"Arial",sans-serif;color:black'>Simonc</span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>” next time for comparison. Thanks.</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'> </span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>KY</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'> </span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:black'>From:</span></b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:black'> </span><span style='font-size:11.0pt;color:black'>范正忠</span><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:black'> [<a href="mailto:jjfan@iis.sinica.edu.tw">mailto:jjfan@iis.sinica.edu.tw</a>] <br><b>Sent:</b> Saturday, April 4, 2020 10:57 AM<br><b>To:</b> kysu <<a href="mailto:kysu@iis.sinica.edu.tw">kysu@iis.sinica.edu.tw</a>><br><b>Cc:</b> Simonc <<a href="mailto:simonc@iis.sinica.edu.tw">simonc@iis.sinica.edu.tw</a>>; Most-ai Contest <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Subject:</b> Re: [Most-ai-contest] The performance of the last version FGC QA system (4/4)</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Sorry! Correction of the performance of single-span-ensemble module <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div><table class=MsoNormalTable border=1 cellspacing=0 cellpadding=0 width=1292 style='width:694.0pt;border-collapse:collapse'><tr style='height:15.75pt'><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'></td><td width=253 valign=top style='width:135.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'></td><td width=116 nowrap valign=bottom style='width:62.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Single-Span</span><span lang=EN-US><o:p></o:p></span></p></td><td width=106 nowrap valign=bottom style='width:57.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Kuo</span><span lang=EN-US><o:p></o:p></span></p></td><td width=109 nowrap valign=bottom style='width:58.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Simonc</span><span lang=EN-US><o:p></o:p></span></p></td><td width=127 nowrap valign=bottom style='width:68.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Multi-Span</span><span lang=EN-US><o:p></o:p></span></p></td><td width=135 nowrap valign=bottom style='width:72.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Date-Duration</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=top style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'></td><td width=89 nowrap valign=bottom style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Train</span><span lang=EN-US><o:p></o:p></span></p></td><td width=89 nowrap valign=bottom style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Dev</span><span lang=EN-US><o:p></o:p></span></p></td><td width=89 nowrap valign=bottom style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Test</span><span lang=EN-US><o:p></o:p></span></p></td></tr><tr style='height:47.25pt'><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>4</span><span style='font-size:11.0pt;color:black'>月<span lang=EN-US>2</span>日</span><span lang=EN-US><o:p></o:p></span></p></td><td width=253 valign=top style='width:135.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>ENSEMBLEModule: 12 models (new) + single_span_multi_hop_v2_1</span><span lang=EN-US><o:p></o:p></span></p></td><td width=116 valign=top style='width:62.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.842<br>dev: 0.712<br>test: 0.741</span><span lang=EN-US><o:p></o:p></span></p></td><td width=106 valign=top style='width:57.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.899<br>dev: 0.699<br>test: 0.741</span><span lang=EN-US><o:p></o:p></span></p></td><td width=109 valign=top style='width:58.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.771<br>dev: 0.635<br>test: 0.705</span><span lang=EN-US><o:p></o:p></span></p></td><td width=127 nowrap valign=top style='width:68.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=135 nowrap valign=top style='width:72.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=87 nowrap valign=top style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.757</span><span lang=EN-US><o:p></o:p></span></p></td><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.652</span><span lang=EN-US><o:p></o:p></span></p></td><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.653</span><span lang=EN-US><o:p></o:p></span></p></td></tr><tr style='height:47.25pt'><td width=89 nowrap valign=top style='width:48.0pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>4</span><span style='font-size:11.0pt;color:black'>月<span lang=EN-US>2</span>日</span><span lang=EN-US><o:p></o:p></span></p></td><td width=253 valign=top style='width:135.75pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>ENSEMBLEModule: 12 models (new)</span><span lang=EN-US><o:p></o:p></span></p></td><td width=116 valign=top style='width:62.25pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.890<br>dev: 0.801<br>test: 0.750</span><span lang=EN-US><o:p></o:p></span></p></td><td width=106 valign=top style='width:57.0pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.899<br>dev: 0.699<br>test: 0.741</span><span lang=EN-US><o:p></o:p></span></p></td><td width=109 valign=top style='width:58.5pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:black'> </span><span lang=EN-US><o:p></o:p></span></p></td><td width=127 valign=top style='width:68.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.493<br>dev: 0.476<br>test: 0.350</span><span lang=EN-US><o:p></o:p></span></p></td><td width=135 valign=top style='width:72.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.589<br>dev: 0.720<br>test: 0.581</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=top style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=89 nowrap valign=top style='width:48.0pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.786</span><span lang=EN-US><o:p></o:p></span></p></td><td width=89 nowrap valign=top style='width:48.0pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.709</span><span lang=EN-US><o:p></o:p></span></p></td><td width=89 nowrap valign=top style='width:48.0pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.658</span><span lang=EN-US><o:p></o:p></span></p></td></tr><tr style='height:47.25pt'><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>4</span><span style='font-size:11.0pt;color:black'>月<span lang=EN-US>2</span>日</span><span lang=EN-US><o:p></o:p></span></p></td><td width=253 valign=top style='width:135.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>single_span_multi_hop_v2_1</span><span lang=EN-US><o:p></o:p></span></p></td><td width=116 valign=top style='width:62.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.775<br>dev: 0.692<br>test: 0.714</span><span lang=EN-US><o:p></o:p></span></p></td><td width=106 valign=top style='width:57.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=109 valign=top style='width:58.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.771<br>dev: 0.635<br>test: 0.705</span><span lang=EN-US><o:p></o:p></span></p></td><td width=127 nowrap valign=top style='width:68.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=135 nowrap valign=top style='width:72.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=87 nowrap valign=top style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.714</span><span lang=EN-US><o:p></o:p></span></p></td><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.64</span><span lang=EN-US><o:p></o:p></span></p></td><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.637</span><span lang=EN-US><o:p></o:p></span></p></td></tr><tr style='height:63.0pt'><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>4</span><span style='font-size:11.0pt;color:black'>月<span lang=EN-US>3</span>日</span><span lang=EN-US><o:p></o:p></span></p></td><td width=253 valign=top style='width:135.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span><span lang=EN-US><o:p></o:p></span></p></td><td width=116 valign=top style='width:62.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.890<br>dev: 0.801<br>test: 0.750</span><span lang=EN-US><o:p></o:p></span></p></td><td width=106 valign=top style='width:57.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.899<br>dev: 0.699<br>test: 0.741</span><span lang=EN-US><o:p></o:p></span></p></td><td width=109 nowrap valign=top style='width:58.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'></td><td width=127 valign=top style='width:68.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.548<br>dev: 0.667<br>test: 0.450</span><span lang=EN-US><o:p></o:p></span></p></td><td width=135 valign=top style='width:72.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.589<br>dev: 0.720<br>test: 0.581</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=top style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'></td><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.791</span><span lang=EN-US><o:p></o:p></span></p></td><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.725</span><span lang=EN-US><o:p></o:p></span></p></td><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.668</span><span lang=EN-US><o:p></o:p></span></p></td></tr><tr style='height:63.0pt'><td width=89 nowrap valign=top style='width:48.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>4</span><span style='font-size:11.0pt;color:black'>月<span lang=EN-US>4</span>日</span><span lang=EN-US><o:p></o:p></span></p></td><td width=253 valign=top style='width:135.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span><span lang=EN-US><o:p></o:p></span></p></td><td width=116 valign=top style='width:62.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.888<br>dev: 0.801<br>test: 0.759</span><span lang=EN-US><o:p></o:p></span></p></td><td width=106 valign=top style='width:57.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black;background:#FFFF99'>train: 0.897</span><span lang=EN-US style='font-size:11.0pt;color:black'><br><span style='background:#FFFF99'>dev: 0.699</span><br><span style='background:#FFFF99'>test: 0.750</span></span><span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><s><span lang=EN-US style='font-size:11.0pt;color:black;background:white'>train: 0.949</span></s><span lang=EN-US style='font-size:11.0pt;color:black;background:#FFFF99'><br></span><s><span lang=EN-US style='font-size:11.0pt;color:black;background:white'>dev: 0.837</span></s><span lang=EN-US style='font-size:11.0pt;color:black;background:#FFFF99'><br></span><s><span lang=EN-US style='font-size:11.0pt;color:black;background:white'>test: 0.876</span></s><span lang=EN-US><o:p></o:p></span></p></div></td><td style='border:none;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;border-right:inset 1.0pt;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td></tr><tr style='height:63.0pt'><td width=109 nowrap valign=top style='width:58.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'></td><td style='border:none;border-bottom:inset 1.0pt;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;border-bottom:inset 1.0pt;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;border-bottom:inset 1.0pt;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;border-bottom:inset 1.0pt;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;border-bottom:inset 1.0pt;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;border-bottom:inset 1.0pt;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;border-bottom:inset 1.0pt;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;border-bottom:inset 1.0pt;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border:none;border-bottom:inset 1.0pt;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td><td style='border-top:none;border-left:none;border-bottom:inset 1.0pt;border-right:inset 1.0pt;padding:0cm 0cm 0cm 0cm;height:63.0pt'></td></tr></table><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;display:none'><o:p> </o:p></span></p><table class=MsoNormalTable border=0 cellspacing=3 cellpadding=0><tr style='height:63.0pt'><td width=127 valign=top style='width:68.25pt;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.548<br>dev: 0.667<br>test: 0.450</span><span lang=EN-US><o:p></o:p></span></p></td><td width=135 valign=top style='width:72.75pt;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.753<br>dev: 0.720<br>test: 0.774</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=top style='width:46.5pt;padding:.75pt .75pt 0cm .75pt;height:63.0pt'></td><td width=89 nowrap valign=top style='width:48.0pt;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.817</span><span lang=EN-US><o:p></o:p></span></p></td><td width=89 nowrap valign=top style='width:48.0pt;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.737</span><span lang=EN-US><o:p></o:p></span></p></td><td width=89 nowrap valign=top style='width:48.0pt;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.705</span><span lang=EN-US><o:p></o:p></span></p></td></tr></table><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div class=MsoNormal align=center style='text-align:center'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><hr size=3 width="100%" align=center></span></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>From: </span></b><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>"kysu" <<a href="mailto:kysu@iis.sinica.edu.tw" target="_blank">kysu@iis.sinica.edu.tw</a>><br><b>To: </b>"</span><span style='color:black'>范正忠</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>" <<a href="mailto:jjfan@iis.sinica.edu.tw" target="_blank">jjfan@iis.sinica.edu.tw</a>>, "Simonc" <<a href="mailto:simonc@iis.sinica.edu.tw" target="_blank">simonc@iis.sinica.edu.tw</a>><br><b>Cc: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Saturday, April 4, 2020 10:48:57 AM<br><b>Subject: </b>RE: [Most-ai-contest] The performance of the last version FGC QA system (4/4)<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>Thanks. Glad to know that we have got a new record high performance! Let’s keep pushing the performance.</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'> </span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>KY</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'> </span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:black'>From:</span></b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:black'> <a href="mailto:most-ai-contest-bounces@iis.sinica.edu.tw" target="_blank">most-ai-contest-bounces@iis.sinica.edu.tw</a> [<a href="mailto:most-ai-contest-bounces@iis.sinica.edu.tw" target="_blank">mailto:most-ai-contest-bounces@iis.sinica.edu.tw</a>] <b>On Behalf Of </b></span><span style='font-size:11.0pt;color:black'>范正忠</span><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:black'><br><b>Sent:</b> Saturday, April 4, 2020 10:24 AM<br><b>To:</b> Simonc <<a href="mailto:simonc@iis.sinica.edu.tw" target="_blank">simonc@iis.sinica.edu.tw</a>><br><b>Cc:</b> Most-ai Contest <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Subject:</b> Re: [Most-ai-contest] The performance of the last version FGC QA system (4/4)</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Dear all,<o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Enclosed please find the current performance of the FGC QA system.<o:p></o:p></span></p></div></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div></div><div><table class=MsoNormalTable border=1 cellspacing=0 cellpadding=0 width=1292 style='width:694.0pt;border-collapse:collapse'><tr style='height:11.25pt'><td width=80 nowrap valign=bottom style='width:42.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:11.25pt'></td><td width=265 nowrap valign=bottom style='width:142.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:11.25pt'></td><td width=109 nowrap valign=bottom style='width:58.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:11.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Single-Span</span><span lang=EN-US><o:p></o:p></span></p></td><td width=102 nowrap valign=bottom style='width:54.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:11.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Kuo</span><span lang=EN-US><o:p></o:p></span></p></td><td width=105 nowrap valign=bottom style='width:56.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:11.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Simonc</span><span lang=EN-US><o:p></o:p></span></p></td><td width=121 nowrap valign=bottom style='width:65.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:11.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Multi-Span</span><span lang=EN-US><o:p></o:p></span></p></td><td width=130 nowrap valign=bottom style='width:69.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:11.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Date-Duration</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:11.25pt'></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:11.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Train</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:11.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Dev</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:11.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Test</span><span lang=EN-US><o:p></o:p></span></p></td></tr><tr style='height:35.25pt'><td width=80 nowrap valign=bottom style='width:42.75pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:35.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>4</span><span style='font-size:11.0pt;color:black'>月<span lang=EN-US>2</span>日</span><span lang=EN-US><o:p></o:p></span></p></td><td width=265 nowrap valign=bottom style='width:142.5pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:35.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>ENSEMBLEModule: 12 models (new)</span><span lang=EN-US><o:p></o:p></span></p></td><td width=109 nowrap valign=bottom style='width:58.5pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:35.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.890<br>dev: 0.801<br>test: 0.750</span><span lang=EN-US><o:p></o:p></span></p></td><td width=102 nowrap valign=bottom style='width:54.75pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:35.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.899<br>dev: 0.699<br>test: 0.741</span><span lang=EN-US><o:p></o:p></span></p></td><td width=105 nowrap valign=bottom style='width:56.25pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:35.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;color:black'> </span><span lang=EN-US><o:p></o:p></span></p></td><td width=121 nowrap valign=bottom style='width:65.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:35.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.493<br>dev: 0.476<br>test: 0.350</span><span lang=EN-US><o:p></o:p></span></p></td><td width=130 nowrap valign=bottom style='width:69.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:35.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.589<br>dev: 0.720<br>test: 0.581</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:35.25pt'></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:35.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.786</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:35.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.709</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;background:#F8CBAD;padding:.75pt .75pt 0cm .75pt;height:35.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.658</span><span lang=EN-US><o:p></o:p></span></p></td></tr><tr style='height:47.25pt'><td width=80 nowrap valign=bottom style='width:42.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>4</span><span style='font-size:11.0pt;color:black'>月<span lang=EN-US>3</span>日</span><span lang=EN-US><o:p></o:p></span></p></td><td width=265 nowrap valign=bottom style='width:142.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span><span lang=EN-US><o:p></o:p></span></p></td><td width=109 nowrap valign=bottom style='width:58.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.890<br>dev: 0.801<br>test: 0.750</span><span lang=EN-US><o:p></o:p></span></p></td><td width=102 nowrap valign=bottom style='width:54.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.899<br>dev: 0.699<br>test: 0.741</span><span lang=EN-US><o:p></o:p></span></p></td><td width=105 nowrap valign=bottom style='width:56.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=121 nowrap valign=bottom style='width:65.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.548<br>dev: 0.667<br>test: 0.450</span><span lang=EN-US><o:p></o:p></span></p></td><td width=130 nowrap valign=bottom style='width:69.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.589<br>dev: 0.720<br>test: 0.581</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.791</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.725</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.668</span><span lang=EN-US><o:p></o:p></span></p></td></tr><tr style='height:47.25pt'><td width=80 nowrap valign=bottom style='width:42.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>4</span><span style='font-size:11.0pt;color:black'>月<span lang=EN-US>4</span>日</span><span lang=EN-US><o:p></o:p></span></p></td><td width=265 nowrap valign=bottom style='width:142.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span><span lang=EN-US><o:p></o:p></span></p></td><td width=109 nowrap valign=bottom style='width:58.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.888<br>dev: 0.801<br>test: 0.759</span><span lang=EN-US><o:p></o:p></span></p></td><td width=102 nowrap valign=bottom style='width:54.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.949<br>dev: 0.837<br>test: 0.876</span><span lang=EN-US><o:p></o:p></span></p></td><td width=105 nowrap valign=bottom style='width:56.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=121 nowrap valign=bottom style='width:65.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.548<br>dev: 0.667<br>test: 0.450</span><span lang=EN-US><o:p></o:p></span></p></td><td width=130 nowrap valign=bottom style='width:69.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:red'>train: 0.753</span><span lang=EN-US style='font-size:11.0pt;color:black'><br></span><span lang=EN-US style='font-size:11.0pt;color:red'>dev: 0.720</span><span lang=EN-US style='font-size:11.0pt;color:black'><br></span><span lang=EN-US style='font-size:11.0pt;color:red'>test: 0.774</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.817</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.737</span><span lang=EN-US><o:p></o:p></span></p></td><td width=87 nowrap valign=bottom style='width:46.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.705</span><span lang=EN-US><o:p></o:p></span></p></td></tr></table><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Please check the detail in Performance.txt file and Date-Duration performance is similar to </span><span style='color:black;background:white'>郭家銍</span><span lang=EN-US style='font-family:"Helvetica",sans-serif;color:black;background:white'> report.</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Helvetica",sans-serif;color:black;background:white'>Best,</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Helvetica",sans-serif;color:black;background:white'>jjfan</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div class=MsoNormal align=center style='text-align:center'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><hr size=3 width="100%" align=center></span></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>From: </span></b><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>"</span><span style='color:black'>范正忠</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>" <<a href="mailto:jjfan@iis.sinica.edu.tw" target="_blank">jjfan@iis.sinica.edu.tw</a>><br><b>To: </b>"Simonc" <<a href="mailto:simonc@iis.sinica.edu.tw" target="_blank">simonc@iis.sinica.edu.tw</a>><br><b>Cc: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Friday, April 3, 2020 4:45:39 PM<br><b>Subject: </b>[Most-ai-contest] The performance of the last version FGC QA system<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Dear all,<o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Enclosed please find the current performance of the FGC QA system.<o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><table class=MsoNormalTable border=1 cellspacing=0 cellpadding=0 width=1290 style='width:693.0pt;border-collapse:collapse'><tr style='height:15.75pt'><td width=96 nowrap valign=bottom style='width:51.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'></td><td width=261 nowrap valign=bottom style='width:140.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'></td><td width=120 nowrap valign=bottom style='width:64.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Single-Span</span><span lang=EN-US><o:p></o:p></span></p></td><td width=113 nowrap valign=bottom style='width:60.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Kuo</span><span lang=EN-US><o:p></o:p></span></p></td><td width=133 nowrap valign=bottom style='width:71.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Multi-Span</span><span lang=EN-US><o:p></o:p></span></p></td><td width=141 nowrap valign=bottom style='width:75.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Date-Duration</span><span lang=EN-US><o:p></o:p></span></p></td><td width=138 nowrap valign=bottom style='width:74.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'></td><td width=95 nowrap valign=bottom style='width:51.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Train</span><span lang=EN-US><o:p></o:p></span></p></td><td width=96 nowrap valign=bottom style='width:51.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Dev</span><span lang=EN-US><o:p></o:p></span></p></td><td width=96 nowrap valign=bottom style='width:51.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:15.75pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>Test</span><span lang=EN-US><o:p></o:p></span></p></td></tr><tr style='height:47.25pt'><td width=96 nowrap valign=bottom style='width:51.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:9.0pt;color:black'>4</span><span style='font-size:9.0pt;color:black'>月<span lang=EN-US>2</span>日</span><span lang=EN-US><o:p></o:p></span></p></td><td width=261 nowrap valign=bottom style='width:140.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>ENSEMBLEModule: 12 models (new)</span><span lang=EN-US><o:p></o:p></span></p></td><td width=120 nowrap valign=bottom style='width:64.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.890<br>dev: 0.801<br>test: 0.750</span><span lang=EN-US><o:p></o:p></span></p></td><td width=113 nowrap valign=bottom style='width:60.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.899<br>dev: 0.699<br>test: 0.741</span><span lang=EN-US><o:p></o:p></span></p></td><td width=133 nowrap valign=bottom style='width:71.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.493<br>dev: 0.476<br>test: 0.350</span><span lang=EN-US><o:p></o:p></span></p></td><td width=141 nowrap valign=bottom style='width:75.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.589<br>dev: 0.720<br>test: 0.581</span><span lang=EN-US><o:p></o:p></span></p></td><td width=138 nowrap valign=bottom style='width:74.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'></td><td width=95 nowrap valign=bottom style='width:51.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.786</span><span lang=EN-US><o:p></o:p></span></p></td><td width=96 nowrap valign=bottom style='width:51.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.709</span><span lang=EN-US><o:p></o:p></span></p></td><td width=96 nowrap valign=bottom style='width:51.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:47.25pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.658</span><span lang=EN-US><o:p></o:p></span></p></td></tr><tr style='height:63.0pt'><td width=96 nowrap valign=bottom style='width:51.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>4</span><span style='font-size:11.0pt;color:black'>月<span lang=EN-US>3</span>日</span><span lang=EN-US><o:p></o:p></span></p></td><td width=261 nowrap valign=bottom style='width:140.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>ENSEMBLEModule: 12 models (new)<br>MSPE_v18_branchy27<br>date_duration_module_4</span><span lang=EN-US><o:p></o:p></span></p></td><td width=120 nowrap valign=bottom style='width:64.5pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.890<br>dev: 0.801<br>test: 0.750</span><span lang=EN-US><o:p></o:p></span></p></td><td width=113 nowrap valign=bottom style='width:60.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.899<br>dev: 0.699<br>test: 0.741</span><span lang=EN-US><o:p></o:p></span></p></td><td width=133 nowrap valign=bottom style='width:71.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.548<br>dev: 0.667<br>test: 0.450</span><span lang=EN-US><o:p></o:p></span></p></td><td width=141 nowrap valign=bottom style='width:75.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>train: 0.589<br>dev: 0.720<br>test: 0.581</span><span lang=EN-US><o:p></o:p></span></p></td><td width=138 nowrap valign=bottom style='width:74.25pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'></td><td width=95 nowrap valign=bottom style='width:51.0pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.791</span><span lang=EN-US><o:p></o:p></span></p></td><td width=96 nowrap valign=bottom style='width:51.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.725</span><span lang=EN-US><o:p></o:p></span></p></td><td width=96 nowrap valign=bottom style='width:51.75pt;border:none;padding:.75pt .75pt 0cm .75pt;height:63.0pt'><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:11.0pt;color:black'>0.668</span><span lang=EN-US><o:p></o:p></span></p></td></tr></table><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Please </span><span style='font-size:10.5pt;color:black;background:white'>郭家銍</span><span lang=EN-US style='font-size:10.5pt;font-family:"Helvetica",sans-serif;color:black;background:white'> help to check Date-Duration ver.4. </span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:10.5pt;font-family:"Helvetica",sans-serif;color:black;background:white'>Best,</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-size:10.5pt;font-family:"Helvetica",sans-serif;color:black;background:white'>jjfan</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div class=MsoNormal align=center style='text-align:center'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><hr size=3 width="100%" align=center></span></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>From: </span></b><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>"</span><span style='color:black'>范正忠</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>" <<a href="mailto:jjfan@iis.sinica.edu.tw" target="_blank">jjfan@iis.sinica.edu.tw</a>><br><b>To: </b>"Simonc" <<a href="mailto:simonc@iis.sinica.edu.tw" target="_blank">simonc@iis.sinica.edu.tw</a>><br><b>Cc: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Thursday, April 2, 2020 3:56:36 PM<br><b>Subject: </b>Re: [Most-ai-contest] Updated Performance Data with Gold Answer Inclusion Rate<o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Dear all,<o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Enclosed please find the performance of the last code:<o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>ENSEMBLEModule: 12 models (new), single_span_multi_hop_v2_1<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Multi-Spans: MSPE_v18_branchy20<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>date_duration_module_3<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>arithmetic_module_3<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>kinship_module6<o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Overall:<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>train -> total: 882, correct: 668, accuracy: 0.757<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>dev -> total: 247, correct: 161, accuracy: 0.652<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>test -> total: 193, correct: 126, accuracy: 0.653<o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Single-Span:<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>train -> portion:0.619, count:546, errors: 86, accuracy: 0.842<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> ensemble only -> portion:0.619, count:546, errors: 37, accuracy: </span><strong><span lang=EN-US style='font-family:"Arial",sans-serif;color:red'>0.932</span></strong><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> multi-hop only -> portion:0.619, count:546, errors: 76, accuracy: 0.861<o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>dev -> portion:0.632, count:156, errors: 45, accuracy: 0.712<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <span style='background:white'>ensemble only -> portion:0.632, count:156, errors: 37, accuracy: </span></span><strong><span lang=EN-US style='font-family:"Arial",sans-serif;color:red;background:white'>0.763</span></strong><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'> multi-hop only -> portion:0.632, count:156, errors: 43, accuracy: 0.724</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>test -> portion:0.580, count:112, errors: 29, accuracy: 0.741<o:p></o:p></span></p></div></div></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <span style='background:white'>ensemble only -> portion:0.580, count:112, errors: 23, accuracy: </span></span><strong><span lang=EN-US style='font-family:"Arial",sans-serif;color:red;background:white'>0.795</span></strong><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'> multi-hop only -> portion:0.580, count:112, errors: 26, accuracy: 0.768</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt;background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>Multi-Spans:</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>train -> portion:0.083, count:73, errors: 37, accuracy: 0.493</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>dev -> portion:0.085, count:21, errors: 11, accuracy: 0.476</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>test -> portion:0.104, count:20, errors: 13, accuracy: 0.350</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>jjfan<o:p></o:p></span></p></div><div class=MsoNormal align=center style='text-align:center'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><hr size=3 width="100%" align=center></span></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>From: </span></b><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>"Simonc" <<a href="mailto:simonc@iis.sinica.edu.tw" target="_blank">simonc@iis.sinica.edu.tw</a>><br><b>To: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Tuesday, March 31, 2020 6:00:52 PM<br><b>Subject: </b>[Most-ai-contest] Updated Performance Data with Gold Answer Inclusion Rate<o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Dear all,<o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>The attached file contains the performance data from our results in 3/27.<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>This time, the gold answer inclusion rate is also included. (That is, counting the cases where the correct answer is included in the answer candidates.)<o:p></o:p></span></p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Regards,<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='color:black'>張光瑜</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><br>_______________________________________________<br>Most-ai-contest mailing list<br><a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a><br><a href="https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest" target="_blank">https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</a><o:p></o:p></span></p></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><br>_______________________________________________<br>Most-ai-contest mailing list<br><a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a><br><a href="https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest" target="_blank">https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</a><o:p></o:p></span></p></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><br>_______________________________________________<br>Most-ai-contest mailing list<br><a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank">Most-ai-contest@iis.sinica.edu.tw</a><br><a href="https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest" target="_blank">https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</a><o:p></o:p></span></p></div></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> <o:p></o:p></span></p></div></div></div></div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div></div></div></body></html>