<html><body><div style="font-family: arial, helvetica, sans-serif; font-size: 12pt; color: #000000"><div><style></style></div><div>The attached file are the performances.</div><div>The answer generating module's performances on the training set is strangely low in my opinion.</div><div>I'll check if there is any errors with my analysis.</div><div>Sorry for being late.</div><div><br data-mce-bogus="1"></div><div>張光瑜</div><div><br data-mce-bogus="1"></div><div><br></div><hr id="zwchr" data-marker="__DIVIDER__"><div data-marker="__HEADERS__"><b>寄件者: </b>"kysu" <kysu@iis.sinica.edu.tw><br><b>收件者: </b>"范正忠" <jjfan@iis.sinica.edu.tw>, "Most-ai Contest" <Most-ai-contest@iis.sinica.edu.tw><br><b>寄件備份: </b>2019 12 月 14 星期六 下午 5:01:34<br><b>主旨: </b>Re: [Most-ai-contest] The performance of the current integrated system on the dataset ver. 1.5<br></div><div><br></div><div data-marker="__QUOTED_TEXT__"><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d">I cannot check the content. What is current performance for train/dev data-set?</span></p><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d"> </span></p><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d">KY</span></p><p class="MsoNormal"><span lang="EN-US" style="font-family:'calibri' , sans-serif;color:#1f497d"> </span></p><div><div style="border:none;border-top:solid #e1e1e1 1pt;padding:3pt 0cm 0cm 0cm"><p class="MsoNormal"><b><span lang="EN-US" style="font-size:11pt;font-family:'calibri' , sans-serif">From:</span></b><span lang="EN-US" style="font-size:11pt;font-family:'calibri' , sans-serif"> most-ai-contest-bounces@iis.sinica.edu.tw [mailto:most-ai-contest-bounces@iis.sinica.edu.tw] <b>On Behalf Of </b></span><span style="font-size:11pt">范正忠</span><span lang="EN-US" style="font-size:11pt;font-family:'calibri' , sans-serif"><br><b>Sent:</b> Saturday, December 14, 2019 4:48 PM<br><b>To:</b> Most-ai Contest <Most-ai-contest@iis.sinica.edu.tw><br><b>Subject:</b> [Most-ai-contest] The performance of the current integrated system on the dataset ver. 1.5</span></p></div></div><p class="MsoNormal"><span lang="EN-US"> </span></p><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all,</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Enclosed please find the performance of our current integrated system on train / dev dataset.</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Please refer to the AMODE fields in each question for each module's performance.</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Hope this can help the error analysis of each module and please share your finding in the next week's meeting.</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">I am still waiting for 'multi-spans-extraction' & 'supporting evidence' modules to integrate. Please anyone has improved version just send to me. </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Best,</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">jjfan</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div align="center" style="text-align:center"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><hr size="3" width="100%" align="center" id="zwchr"></span></div><div><p class="MsoNormal"><b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">From: </span></b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"</span><span style="color:black">范正忠</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">" <<a href="mailto:jjfan@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">jjfan@iis.sinica.edu.tw</a>><br><b>To: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Monday, November 25, 2019 9:39:07 AM<br><b>Subject: </b>Re: [Most-ai-contest] It's time to start system integration</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div><div><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all,</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Please don't forget give me a readme.txt or I really don't know what is inside.</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Suggest readme.txt contains at least</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">1. Brief API description / document, function list at minimum</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">2. System requirements </span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Thanks.</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">jjfan</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div align="center" style="text-align:center"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><hr size="3" width="100%" align="center" id="zwchr"></span></div><div><p class="MsoNormal"><b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">From: </span></b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"</span><span style="color:black">范正忠</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">" <<a href="mailto:jjfan@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">jjfan@iis.sinica.edu.tw</a>><br><b>To: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Monday, November 25, 2019 9:18:05 AM<br><b>Subject: </b>[Most-ai-contest] It's time to start system integration</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all, </span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Good Morning!</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">It's time to start integration of the system. Please all module owners send me your Python Code. Thanks.</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Best,</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">jjfan</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div align="center" style="text-align:center"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><hr size="3" width="100%" align="center" id="zwchr"></span></div><div><p class="MsoNormal"><b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">From: </span></b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"</span><span style="color:black">范正忠</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">" <<a href="mailto:jjfan@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">jjfan@iis.sinica.edu.tw</a>><br><b>To: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Thursday, November 14, 2019 8:58:50 AM<br><b>Subject: </b>Re: [Most-ai-contest] </span><span style="color:black">科技大擂台討論會</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">(Today, 12:30-15:00)</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><div><div><p class="MsoNormal" style="margin-bottom:12pt"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all,<br><br>Note the following action items should be finished today.<br><br>3. FGC_Questions_S7.json son </span><span style="color:black">包含系統進行答題的過程中</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">, </span><span style="color:black">各個</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> module </span><span style="color:black">預計輸出</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">. <br> </span><span style="color:black">今日會議上討論要修改的部分</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">, </span><span style="color:black">請各位</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> module owner </span><span style="color:black">儘快提出各自修改的部分給我</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">, </span><span style="color:black">一起整理完後再寄送給大家</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> (10/14 </span><span style="color:black">以前完成</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">)<br>4. </span><span style="color:black">提供個自</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> module </span><span style="color:black">所需的</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> Python library </span><span style="color:black">及使用的</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> Python version. (10/14 </span><span style="color:black">以前完成</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">)<br> </span><span style="color:black">建議</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> pip list<br>7. </span><span style="color:black">為了確保大家沒有誤會各自負責的</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> module function, </span><span style="color:black">煩請簡單描述一下</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> (input, out, function) </span><span style="color:black">為何</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">. (10/14 </span><span style="color:black">以前完成</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">)</span></p></div><div><p class="MsoNormal"><strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:#ff6600">Item 4. Please also list additional installations if pip is not enough, such as database, files, ...</span></strong><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"></span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Best,</span></p></div><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">jjfan</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div align="center" style="text-align:center"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><hr size="3" width="100%" align="center" id="zwchr"></span></div><div><p class="MsoNormal"><b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">From: </span></b><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"</span><span style="color:black">范正忠</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">" <<a href="mailto:jjfan@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">jjfan@iis.sinica.edu.tw</a>><br><b>To: </b>"Po-Fen Lin" <<a href="mailto:pofen@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">pofen@iis.sinica.edu.tw</a>><br><b>Cc: </b>"Most-ai Contest" <<a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a>><br><b>Sent: </b>Tuesday, November 12, 2019 5:29:03 PM<br><b>Subject: </b>Re: [Most-ai-contest] </span><span style="color:black">科技大擂台討論會</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">(Today, 12:30-15:00)</span></p></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p><div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">Dear all,<br><br></span><span style="color:black">謝謝大家的參與討論</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">.<br><br></span><span style="color:black">附上今天討論的內容</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">.<br>1. schedule.ppt </span><span style="color:black">包含每個參與者的</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> job items </span><span style="color:black">及未來計畫進行</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> milestones<br>2. FGC_release_A_all.json </span><span style="color:black">包含</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> answer type, answer mode, ... </span><span style="color:black">的基礎的</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> annotation. </span><span style="color:black">提供大家參考</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><br> </span><span style="color:black">若發現</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> answer type </span><span style="color:black">或</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> answer mode </span><span style="color:black">有錯的地方</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">, </span><span style="color:black">請</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> email </span><span style="color:black">通知我</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">, </span><span style="color:black">有我這邊統一修正</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">, </span><span style="color:black">在再寄送給大家更新版</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> (</span><span style="color:black">隨時</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">)<br> </span><span style="color:black">請廖沛俊儘快完成</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> answer keyword spans </span><span style="color:black">的</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> annotation, </span><span style="color:black">並將完成後的</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> json </span><span style="color:black">檔案提供給我一起整理</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">. (10/15 </span><span style="color:black">以前完成</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">)<br>3. FGC_Questions_S7.json son </span><span style="color:black">包含系統進行答題的過程中</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">, </span><span style="color:black">各個</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> module </span><span style="color:black">預計輸出</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">. <br> </span><span style="color:black">今日會議上討論要修改的部分</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">, </span><span style="color:black">請各位</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> module owner </span><span style="color:black">儘快提出各自修改的部分給我</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">, </span><span style="color:black">一起整理完後再寄送給大家</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> (10/14 </span><span style="color:black">以前完成</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">)<br>4. </span><span style="color:black">提供個自</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> module </span><span style="color:black">所需的</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> Python library </span><span style="color:black">及使用的</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> Python version. (10/14 </span><span style="color:black">以前完成</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">)<br> </span><span style="color:black">建議</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> pip list <br>5. 1007</span><span style="color:black">說明會簡報</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">V9, </span><span style="color:black">國網機器遠端連線操作說明</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">: </span><span style="color:black">請郭家鉦幫忙看一下如何處理</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"</span><span style="color:black">自動化介接</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"</span><span style="color:black">及</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"</span><span style="color:black">程式上傳</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">/</span><span style="color:black">執行</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">"<br>6. </span><span style="color:black">附件二科技大擂台簡答題之答題規範</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">, </span><span style="color:black">科技大擂台簡答題之答題規範</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">v2: </span><span style="color:black">提供給謝尊安參考</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">.<br>7. </span><span style="color:black">為了確保大家沒有誤會各自負責的</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> module function, </span><span style="color:black">煩請簡單描述一下</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> (input, out, function) </span><span style="color:black">為何</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">. (10/14 </span><span style="color:black">以前完成</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">)<br><br></span><span style="color:black">有任何問題</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">, </span><span style="color:black">請隨時讓我知道</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">(email, line, skype, tel, ...). </span><span style="color:black">我會一起來協助如何處理</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">.<br></span><span style="color:black">謝謝的家的幫忙</span><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black">!<br><br>Best,<br>jjfan<br><br>_______________________________________________<br>Most-ai-contest mailing list<br><a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a><br><a href="https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest" target="_blank" rel="nofollow noopener noreferrer">https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</a></span></p></div></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><br>_______________________________________________<br>Most-ai-contest mailing list<br><a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a><br><a href="https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest" target="_blank" rel="nofollow noopener noreferrer">https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</a></span></p></div></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"><br>_______________________________________________<br>Most-ai-contest mailing list<br><a href="mailto:Most-ai-contest@iis.sinica.edu.tw" target="_blank" rel="nofollow noopener noreferrer">Most-ai-contest@iis.sinica.edu.tw</a><br><a href="https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest" target="_blank" rel="nofollow noopener noreferrer">https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest</a></span></p></div></div><p class="MsoNormal"><span lang="EN-US" style="font-family:'arial' , sans-serif;color:black"> </span></p></div></div></div><br>_______________________________________________<br>Most-ai-contest mailing list<br>Most-ai-contest@iis.sinica.edu.tw<br>https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest<br></div></div></body></html>