[Most-ai-contest] Multi-spans extraction V12

[張光瑜]

Dear all, 

The attached files are the errors and performance data. 

Regards, 
張光瑜 



寄件者: "范正忠" <jjfan at iis.sinica.edu.tw> 
收件者: "闍怵羅" <s2w81234 at gmail.com> 
副本: "Most-ai Contest" <Most-ai-contest at iis.sinica.edu.tw> 
寄件備份: 2020 3 月 16 星期一 上午 11:00:12 
主旨: Re: [Most-ai-contest] Multi-spans extraction V12 

Dear all, 

Enclosed please find the last version of our '簡答題' system performance on the last released data set 1.7.7 with modules 

bert_module_fgc5: best_RoBERTaL 
MSPE_v12_branchy7 

It is worse than the previous version of 

bert_module_fgc5: bestRoBERTaFGC_L_full_em 
MSPE_v12_branchy7: MSPE_v9_branchy8 

Overall testing set performance : 0.591 -> 0.549 ( - 4.2% ) 
single-span-extraction (testing set): 0.722 -> 0.670 ( -5.2% ) 
multi-spans-extraction (testing set): 0.200 -> 0.000 ( -20% ) 

Please do some error analysis. Thanks. 

Best, 
jjfan 



From: "闍怵羅" <s2w81234 at gmail.com> 
To: "Most-ai Contest" <Most-ai-contest at iis.sinica.edu.tw> 
Sent: Monday, March 16, 2020 1:21:24 AM 
Subject: [Most-ai-contest] Multi-spans extraction V12 

各位好， 
下面連結是將large base tag-model全部混在一起的版本。 
麻煩了 
[ https://drive.google.com/file/d/1LD6X0MHXqEwdjRrv2s988WpAg0zonJ2N/view?usp=sharing | https://drive.google.com/file/d/1LD6X0MHXqEwdjRrv2s988WpAg0zonJ2N/view?usp=sharing ] 

_______________________________________________ 
Most-ai-contest mailing list 
Most-ai-contest at iis.sinica.edu.tw 
https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest 

_______________________________________________ 
Most-ai-contest mailing list 
Most-ai-contest at iis.sinica.edu.tw 
https://www.iis.sinica.edu.tw/mailman/listinfo/most-ai-contest 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.iis.sinica.edu.tw/pipermail/most-ai-contest/attachments/20200316/4a75a020/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: error_report_20200316.zip
Type: application/zip
Size: 4578 bytes
Desc: not available
URL: <http://www.iis.sinica.edu.tw/pipermail/most-ai-contest/attachments/20200316/4a75a020/attachment.zip>