<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:新細明體;
panose-1:2 2 5 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"\@新細明體";
panose-1:2 1 6 1 0 1 1 1 1 1;}
@font-face
{font-family:MicrosoftJhengHeiRegular;
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"新細明體",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:24.0pt;
margin-bottom:.0001pt;
mso-para-margin-top:0cm;
mso-para-margin-right:0cm;
mso-para-margin-bottom:0cm;
mso-para-margin-left:2.0gd;
mso-para-margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"新細明體",serif;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"新細明體",serif;}
span.EmailStyle18
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.fontstyle01
{mso-style-name:fontstyle01;
font-family:"MicrosoftJhengHeiRegular",serif;
color:black;
font-weight:normal;
font-style:normal;}
span.EmailStyle21
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:223175290;
mso-list-type:hybrid;
mso-list-template-ids:688193096 1532531904 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:18.0pt;
text-indent:-18.0pt;}
@list l0:level2
{mso-level-number-format:ideograph-traditional;
mso-level-text:%2、;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:48.0pt;
text-indent:-24.0pt;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:72.0pt;
text-indent:-24.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:96.0pt;
text-indent:-24.0pt;}
@list l0:level5
{mso-level-number-format:ideograph-traditional;
mso-level-text:%5、;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:120.0pt;
text-indent:-24.0pt;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:144.0pt;
text-indent:-24.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:168.0pt;
text-indent:-24.0pt;}
@list l0:level8
{mso-level-number-format:ideograph-traditional;
mso-level-text:%8、;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:192.0pt;
text-indent:-24.0pt;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:216.0pt;
text-indent:-24.0pt;}
@list l1
{mso-list-id:333069915;
mso-list-type:hybrid;
mso-list-template-ids:688193096 1532531904 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l1:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:18.0pt;
text-indent:-18.0pt;}
@list l1:level2
{mso-level-number-format:ideograph-traditional;
mso-level-text:%2、;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:48.0pt;
text-indent:-24.0pt;}
@list l1:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:72.0pt;
text-indent:-24.0pt;}
@list l1:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:96.0pt;
text-indent:-24.0pt;}
@list l1:level5
{mso-level-number-format:ideograph-traditional;
mso-level-text:%5、;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:120.0pt;
text-indent:-24.0pt;}
@list l1:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:144.0pt;
text-indent:-24.0pt;}
@list l1:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:168.0pt;
text-indent:-24.0pt;}
@list l1:level8
{mso-level-number-format:ideograph-traditional;
mso-level-text:%8、;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:192.0pt;
text-indent:-24.0pt;}
@list l1:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:216.0pt;
text-indent:-24.0pt;}
@list l2
{mso-list-id:1830175598;
mso-list-type:hybrid;
mso-list-template-ids:688193096 1532531904 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l2:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:18.0pt;
text-indent:-18.0pt;}
@list l2:level2
{mso-level-number-format:ideograph-traditional;
mso-level-text:%2、;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:48.0pt;
text-indent:-24.0pt;}
@list l2:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:72.0pt;
text-indent:-24.0pt;}
@list l2:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:96.0pt;
text-indent:-24.0pt;}
@list l2:level5
{mso-level-number-format:ideograph-traditional;
mso-level-text:%5、;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:120.0pt;
text-indent:-24.0pt;}
@list l2:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:144.0pt;
text-indent:-24.0pt;}
@list l2:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:168.0pt;
text-indent:-24.0pt;}
@list l2:level8
{mso-level-number-format:ideograph-traditional;
mso-level-text:%8、;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:192.0pt;
text-indent:-24.0pt;}
@list l2:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:216.0pt;
text-indent:-24.0pt;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=ZH-TW link="#0563C1" vlink="#954F72"><div class=WordSection1><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>I have checked the attached error cases. Possible reasons/solutions are listed as follows for your reference. I would like to discuss those issues with Prof. Menphis Chen first. <o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>Prof. Chen: Could you please indicate a discussion time slot that is convenient to you? I will call you via Skype to given detailed explanation. Thanks.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>KY<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>------------------------------------------------------<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>Training-Set Errors:<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l2 level1 lfo1'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>1.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：莎士比亚的喜剧作品有哪些</span><span lang=EN-US>?(</span></span><span class=fontstyle01><span style='font-family:"新細明體",serif'>在文本中</span><span lang=EN-US>)</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, “</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：莎士比亚的悲剧作品有哪些</span><span lang=EN-US>?(</span></span><span class=fontstyle01><span style='font-family:"新細明體",serif'>在文本中</span><span lang=EN-US>)</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, “</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：莎士比亚的悲喜剧作品有哪些</span><span lang=EN-US>?(</span></span><span class=fontstyle01><span style='font-family:"新細明體",serif'>在文本中</span><span lang=EN-US>)</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 7: “Angle bracket pair” formatting information and external knowledge about the names of those scripts should be helpful.<o:p></o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd'><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l2 level1 lfo1'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>2.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：试举出文本中五项作为生质燃料原料的粮食作物</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 9: “Sentence Scope” information should be helpful.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l2 level1 lfo1'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>3.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：生物医学所使用的奈米结晶金属是哪两种</span><span lang=EN-US>?(</span></span><span class=fontstyle01><span style='font-family:"新細明體",serif'>在本文中</span><span lang=EN-US>)</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 10: Answer tends to be a complete NP constitute.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l2 level1 lfo1'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>4.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：有哪些大众运输工具可以到达</span><span lang=EN-US> 2019 </span></span><span class=fontstyle01><span style='font-family:"新細明體",serif'>年台湾宝可梦活动会场呢</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 13: NE “</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>中和新芦线</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>” external knowledge should be helpful<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l2 level1 lfo1'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>5.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：根据文本的数据，男性癌症前三名是哪三种？</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 14: “Word-Matching Indicator” (such as </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>男性</span><span lang=EN-US> and </span></span><span class=fontstyle01><span style='font-family:"新細明體",serif'>癌症</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>) should be helpful<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l2 level1 lfo1'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>6.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：这起事故的肇事者所使用的交通工具为何</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, “</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：这起事故的肇事者其姓氏分别为何</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 15: “Sentence Scope” information should be helpful.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l2 level1 lfo1'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>7.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：三级座舱设计的波音</span><span lang=EN-US> 747 </span></span><span class=fontstyle01><span style='font-family:"新細明體",serif'>客机的舱等是哪三个</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 15: Benchmark error.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l2 level1 lfo1'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>8.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：澎湖旅行团总共安排了几个景点？</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, “</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：澎湖旅行团安排了哪五个景点？</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 17: Need “Item formatting information” (Items could be easily identified from visual information, but not NLP).<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l2 level1 lfo1'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>9.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：考古学家从遗址发掘中发现了人类会用什么工具来捕捞溪中的鱼蟹？</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 18: Benchmark error.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l2 level1 lfo1'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>10.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：山羊老师教大家哪两种类型的垃圾需要压扁或踩扁后回收丢到资源回收筒里？</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 19: “Sentence Scope” information should be helpful.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l2 level1 lfo1'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>11.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'> “</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：目前在台湾出现的肠病毒有哪几型</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 21: Adopted rules could be modified to cover this case.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>Test-Set Errors:<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>1.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>在「乌台诗案」中，有哪些人出面救了苏东坡？</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 22: Adopted rules could be modified to cover this case.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>2.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>高雄市被列为国定古迹的建筑物是哪些</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 23: Adopted rules could be modified to cover this case.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>3.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>屏东县双层巴士观光服务行经路线停靠哪些景点</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 23: Adopted rules could be modified to cover this case.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>4.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>全民健保实施之前的健康保险有哪些</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 24: Adopted rules could be modified to cover this case.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>5.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>癌症分期是根据哪些原则来判断</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 24: Need “Item formatting information” (Items could be easily identified from visual information, but not NLP).<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l0 level1 lfo2'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>6.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>小阿姨说，等春天来临时，哪些花儿会相继绽放，那十的植物元变成了万紫千红的锦绣世界？</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 25: Adopted rules could be modified to cover this case (e.g., matching more Q-strings).<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>Development-Set Errors:<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l1 level1 lfo3'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>1.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>「阿拉伯之春」运动发生在哪些区域？</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 28: Adopted rules could be modified to cover this case.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l1 level1 lfo3'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>2.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>鲸鲨曾经在哪些海域出现过</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 30: Adopted rules could be modified to cover this case.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l1 level1 lfo3'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>3.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>菲律宾的鲸鲨保育政策为何</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 30: Adopted rules could be modified to cover this case (e.g., matching more Q-strings).<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l1 level1 lfo3'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>4.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>开车出门前要记得做哪些车辆检查以减少交通事故发生</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 31: Adopted rules could be modified to cover this case.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l1 level1 lfo3'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>5.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>世界上最大的教堂有哪些建筑师与艺术家的设计</span><span lang=EN-US>?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 32: Adopted rules could be modified to cover this case.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l1 level1 lfo3'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>6.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>世界上最大的教堂内部有哪些艺术家的大作</span><span lang=EN-US>?(</span></span><span class=fontstyle01><span style='font-family:"新細明體",serif'>本文中</span><span lang=EN-US>)</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 32: Benchmark error.<o:p></o:p></span></p><p class=MsoListParagraph><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoListParagraph style='margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l1 level1 lfo3'><![if !supportLists]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><span style='mso-list:Ignore'>7.<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>“</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>内政部消防署提出防范纵火方法「三从四得」，请问是哪「三从」</span><span lang=EN-US> ?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, “</span><span class=fontstyle01><span style='font-family:"新細明體",serif'>問題：</span> </span><span class=fontstyle01><span style='font-family:"新細明體",serif'>内政部消防署提出防范纵火方法「三从四得」，请问是哪「四得」</span><span lang=EN-US> ?</span></span><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>”, page 32: Need “Item formatting information”.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>------------------------------------------------<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'>From:</span></b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'> most-ai-contest-bounces@iis.sinica.edu.tw [mailto:most-ai-contest-bounces@iis.sinica.edu.tw] <b>On Behalf Of </b></span><span style='font-size:11.0pt'>闍怵羅</span><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'><br><b>Sent:</b> Wednesday, April 1, 2020 6:31 PM<br><b>To:</b> Most-ai Contest <Most-ai-contest@iis.sinica.edu.tw><br><b>Subject:</b> [Most-ai-contest] Multi-spans extraction v18_b20<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><div><p class=MsoNormal>各位好，<span lang=EN-US><o:p></o:p></span></p><div><p class=MsoNormal>抱歉拖了這麼久才更新。<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal>附件包含兩個檔案：<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US>MSPE_v18_branchy20.py <</span>整合的時候，只要把之前的檔案覆蓋即可<span lang=EN-US>><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US>MSPE_error.pdf <</span>包含目前的整體情況，以及錯誤的每一題的文章、題目、預測、答案。<span lang=EN-US>><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US><</span>由於包含文章，所以頁數非常多，已經有做整理。<span lang=EN-US>><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US>=================<o:p></o:p></span></p></div><div><p class=MsoNormal>目前<span lang=EN-US>MSPE</span>的情況如下：<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal>一：已有採用<span lang=EN-US>gold support evidence </span>去取答案的版本，但是效果是幾乎沒有差別的。<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal>原因是：在原本的<span lang=EN-US>5</span>種模型去<span lang=EN-US>ensemble</span>的情況，就幾乎都包含原本的<span lang=EN-US> gold support evidence</span>的句子。<span lang=EN-US><br></span>也就是說，當我從每個<span lang=EN-US> gold support evidence </span>去取<span lang=EN-US>answer</span>的時候，對於原本的模型來說，是幾乎取出差不多的答案的。<span lang=EN-US><br></span>二：從問題直接提取相關的答案，還在撰寫，但是目前能救的題目，也幾乎被新版的<span lang=EN-US>MSPE</span>解決了，所以可能不會有更好的效果。<span lang=EN-US><br></span>三：目前剩下錯誤的題目，幾乎都是沒有夠多的答案。<span lang=EN-US><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p></div></div></div></body></html>