<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:新細明體;
panose-1:2 2 5 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"\@新細明體";
panose-1:2 1 6 1 0 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"新細明體",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"新細明體",serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=ZH-TW link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>Glad to see the significant improvement from your WikiQA module!<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'>KY<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'>From:</span></b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'> most-ai-contest-bounces@iis.sinica.edu.tw [mailto:most-ai-contest-bounces@iis.sinica.edu.tw] <b>On Behalf Of </b></span><span style='font-size:11.0pt'>許喬為</span><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'><br><b>Sent:</b> Saturday, April 4, 2020 5:46 PM<br><b>To:</b> jjfan <jjfan@iis.sinica.edu.tw><br><b>Cc:</b> Most-ai-contest <Most-ai-contest@iis.sinica.edu.tw><br><b>Subject:</b> [Most-ai-contest] Updated WikiQA (V2.0)<o:p></o:p></span></p></div></div><p class=MsoNormal><span lang=EN-US><o:p> </o:p></span></p><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Dear Dr. Fan,<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Please download the latest Wiki answer module V2.0 from the following link. In this release, I have modified these:<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><a href="https://www.dropbox.com/s/65ts8paj93no08o/WIKIQA_V2.0.tar.gz?dl=0">https://www.dropbox.com/s/65ts8paj93no08o/WIKIQA_V2.0.tar.gz?dl=0</a><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>- Add </span><span style='color:black'>高度</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>, </span><span style='color:black'>墓地</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> and custom </span><span style='color:black'>寿命</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>, </span><span style='color:black'>成立或建立年份</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> attributes in parsing questions<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>- Fix a bug of entity linking (regarding conversion between traditional chinese and simplified one)<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>This version answers 50% more questions than the previous version and at the same time increase the precision from 90.9 to 94.1%.<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Previous (V1.0.3): 20/22 = 90.9%<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Current (V2.0): 33/35 = 94.1%<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Note that in this version, I have specifically looked at the errors of the overall system and focused on using information from Wikidata to solve them, i.e., <o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Q) </span><span style='color:black'>苏轼几岁时过世</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>? (WikiQA) get_year(</span><span style='color:black'>苏轼的死亡日期</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> - </span><span style='color:black;background:white'>苏轼的出生日期</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>) = 62</span><span style='color:black;background:white'>岁</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>== gained corrects (15) ==<o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D097Q05 </span><span style='color:black'>诺贝尔于哪一年过世</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>?<o:p></o:p></span></p></div></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>> D097Q06 </span><span style='color:black'>诺贝尔享年几岁</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>? ['63</span><span style='color:black'>岁</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D077Q10 </span><span style='color:black'>马可</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>.</span><span style='color:black'>波罗是哪一国人？</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(</span><span style='color:black'>文本中</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>) </span><span style='color:black'>威尼斯共和国</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['</span></span><span style='color:black'>威尼斯共和国</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>> D064Q15 </span><span style='color:black'>郭雪湖享年几岁</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> 103</span><span style='color:black'>岁</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['103</span></span><span style='color:black'>岁</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>', '104</span><span style='color:black'>岁</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D064Q07 </span><span style='color:black'>郭雪湖的妻子是谁？林阿琴</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['</span></span><span style='color:black'>林阿琴</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D254Q01 </span><span style='color:black'>杨震出生于哪个朝代？东汉</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['</span></span><span style='color:black'>东汉</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D069Q02 </span><span style='color:black'>李安的职业是什么</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>?</span><span style='color:black'>导演</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['</span></span><span style='color:black'>导演</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D038Q06 </span><span style='color:black'>图灵是哪一国人</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>?</span><span style='color:black'>英国</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['</span></span><span style='color:black'>英国</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D038Q07 </span><span style='color:black'>图灵出生于哪一年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>?1912</span><span style='color:black'>年</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['1912</span></span><span style='color:black'>年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div></div><div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D038Q08 </span><span style='color:black'>图灵于哪一年过逝</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>?1954</span><span style='color:black'>年</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['1954</span></span><span style='color:black'>年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div></div></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>> D038Q09 </span><span style='color:black'>图灵几岁时过逝</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>?41</span><span style='color:black'>岁</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['42</span></span><span style='color:black'>岁</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>', '41</span><span style='color:black'>岁</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D246Q04 </span><span style='color:black'>哈里发塔高度有多少公尺</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>?828</span><span style='color:black'>公尺</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['828</span></span><span style='color:black'>公尺</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D245Q01 </span><span style='color:black'>圣伯多禄大殿于哪一年开始重建</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>?1506</span><span style='color:black'>年</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['1506</span></span><span style='color:black'>年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>> D071Q03 </span><span style='color:black'>张大千几岁时过逝呢</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>?83</span><span style='color:black'>岁</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['83</span></span><span style='color:black'>岁</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D283Q05 </span><span style='color:black'>刘侠的职业是什么？作家</span><span style='font-family:"Arial",sans-serif;color:black'> <span lang=EN-US>['</span></span><span style='color:black'>作家</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div></div></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(>: the QID where the whole system answered it wrong)<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>== sacrificed corrects (2) ==</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>1.</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div></div><div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D004Q05 Date-Duration Date-Duration: </span><span style='color:black'>苏东坡</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>死于</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>哪</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>一</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> ?(Gold) ['1101</span><span style='color:black'>年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Gold SE) [(12, '\n</span><span style='color:black'>建中靖国元年（</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>1101</span><span style='color:black'>年），</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>'), (17, '</span><span style='color:black'>七月二十八日于常州孙氏馆病卒，</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>')]<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Pred SE) [(17, '</span><span style='color:black'>七月二十八日于常州孙氏馆病卒，</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>')]<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>---<o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(ParseQ) </span><span style='color:black'>苏东坡</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> | </span><span style='color:black'>死亡年份</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(EL Queries) ['</span><span style='color:black'>苏东坡</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>', '</span><span style='color:black'>苏东坡</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(EL) [('</span><span style='color:black'>蘇軾</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>', 'Q36020')]<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Traverse) ['1101-08-24T00:00:00.000Z'] from ['Q36020']<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Post-Proc) ['1101</span><span style='color:black'>年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>', '-810</span><span style='color:black'>年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Match) True False <o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Passage Match) ['1101</span><span style='color:black'>年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Answers 1) (SE Match) [] <= error happened here<o:p></o:p></span></p></div></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>(WikiQA) None</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>[REASON] due to supporting evidence error (predicted answer not in extracted supporting evidences)<o:p></o:p></span></p></div></div></div></div></div></div></div></div></div></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>[Strategy] Tune the threshold of supporting evidence score<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div></div><div><div><div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>2.</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div></div><div><div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D001Q01 Date-Duration Date-Duration: </span><span style='color:black'>苏东坡</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>在</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>中国</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>历史</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>上</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>，</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>是</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>哪</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>一</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>个</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>朝代</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>的</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>人</span><span style='font-family:"Arial",sans-serif;color:black'> </span><span style='color:black'>？</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Gold) ['</span><span style='color:black'>北宋</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Gold SE) [(0, '</span><span style='color:black'>苏轼（</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>1037</span><span style='color:black'>年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>1</span><span style='color:black'>月</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>8</span><span style='color:black'>日－</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>1101</span><span style='color:black'>年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>8</span><span style='color:black'>月</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>24</span><span style='color:black'>日），</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>'), (2, '</span><span style='color:black'>北宋时著名的文学家、政治家、艺术家、医学家。</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>'), (4, '</span><span style='color:black'>号东坡居士、铁冠道人。</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>')]<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Pred SE) [(0, '</span><span style='color:black'>苏轼（</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>1037</span><span style='color:black'>年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>1</span><span style='color:black'>月</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>8</span><span style='color:black'>日－</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>1101</span><span style='color:black'>年</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>8</span><span style='color:black'>月</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>24</span><span style='color:black'>日），</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>')]<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>---<o:p></o:p></span></p></div><div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(ParseQ) </span><span style='color:black'>苏东坡在中国历史上，</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> | </span><span style='color:black'>朝代</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(EL Queries) ['</span><span style='color:black'>苏东坡在中国历史上，</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>', '</span><span style='color:black'>苏东坡</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(EL) [('</span><span style='color:black'>蘇軾</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>', 'Q36020')]<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Traverse) ['Q319460 </span><span style='color:black'>北宋</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>'] from ['Q36020']<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Post-Proc) ['</span><span style='color:black'>北宋</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Match) True <o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Passage Match) ['</span><span style='color:black'>北宋</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>', '</span><span style='color:black'>北宋</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(Answers 1) (SE Match) [] <span style='background:white'> <= error happened here</span><o:p></o:p></span></p><div><div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>(WikiQA) None</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div></div></div></div></div></div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>[REASON] due to supporting evidence error (predicted answer not in extracted supporting evidences)<o:p></o:p></span></p></div></div></div><div><p class=MsoNormal style='background:white'><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>[Strategy] Tune the threshold of supporting evidence score<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div></div></div></div></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>=== errors (2) ===</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>The only two errors are shown below:</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D247Q09 </span><span style='color:black'>哈里发塔总高度是几英尺？</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>( WikiQA) 828</span><span style='color:black'>公尺</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> (Gold) ['2,717</span><span style='color:black'>英尺</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>[Strategy] The author of output formatter said he will do unit conversion for me.</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p></div><div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>D001Q09 </span><span style='color:black'>辛弃疾是哪一个朝代的人？</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>(WikiQA) </span><span style='color:black'>宋</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'> (Gold) ['</span><span style='color:black'>南宋</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>']<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black;background:white'>[Strategy] consider the length of the answer as feature</span><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p></o:p></span></p><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div></div></div></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Best Regards,<o:p></o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span lang=EN-US style='font-family:"Arial",sans-serif;color:black'>Chiao-Wei<o:p></o:p></span></p></div></div></div></body></html>