KcBERT-v2022, KcELECTRA-v2022

KcBERT-v2022, KcELECTRA-v2022

Tags
NLP
사이드프로젝트
PLM
Published
Published February 7, 2022
 
 

Result Table

Property
Size(용량)
NSMC(acc)
Naver NER(F1)
PAWS(acc)
KorNLI(acc)
KorSTS(spearman)
Question Pair(acc)
KorQuaD (Dev)(EM/F1)
KcELECTRA-base-v2022(dev)
488MB
87.35
76.5
82.12
83.67
95.12
69 / 90.4
KcELECTRA-base
475MB
86.9
74.8
81.65
82.65
95.78
70.60 / 90.11
KcELECTRA-small-v2022-1M
67MB
84.74
71.95
78.22
79.51
93.93
66.64 / 87.72
KcELECTRA-small-v2022-425k
67MB
84.25
71.75
76.91
76.9
93.27
63.88 / 85.32
KcELECTRA-base-v2022-namu-2M
87.1
81.2
81.32
83.96
95.12
70.12 / 90.69
KcELECTRA-base-v2022-namu-1M
86.87
79.75
80.92
81.95
95.12
70.00 / 90.59
KcBERT-Base-v2022-1M
84.88
78.74
79.08
63/ 85
KcELECTRA-base-v2022-namu-800k
78.8
80.71
82.15
94.98
KcBERT-Base
417MB
84.34
66.95
74.85
75.57
93.93
KcBERT-Large
1.2GB
85.53
70.15
76.99
77.49
94.06
KoBERT
351MB
86.11
80.65
79
79.64
93.93
XLM-Roberta-Base
1.03GB
86.26
82.95
79.92
79.09
93.53
HanBERT
614MB
87.31
82.4
80.89
83.33
94.19
KoELECTRA-Base
423MB
86.87
81.9
80.85
83.21
94.2
KoELECTRA-Base-v2
423MB
87.02
83.9
80.61
84.3
94.72
KoELECTRA-Base-v3
423MB
88.11
84.45
82.24
85.53
95.25
DistilKoBERT
108MB
84.13
62.55
70.55
73.21
92.48