Comment/Post Level


Codeswitched posts :
20 |
Monolingual posts :
82 |
Total posts :
102
Team Accuracy Recall Precision F1-Score
JustAnEagerStudent 0.794 0.900 0.486 0.632
A3-107 0.735 0.900 0.419 0.571
dcu-uvt 0.775 0.850 0.459 0.596
CMU 0.863 0.850 0.607 0.708
MSR-India 0.716 0.900 0.400 0.554
IUCL 0.794 0.800 0.485 0.604

Codeswitched posts :
22 |
Monolingual posts :
27 |
Total posts :
49
Team Accuracy Recall Precision F1-Score
TAU 0.864 0.708 0.803 0.753
IUCL 0.833 0.505 0.872 0.640
MSR-India 0.815 0.753 0.661 0.704
JustAnEagerStudent 0.700 0.882 0.493 0.633
DCU-UVT 0.800 0.839 0.616 0.710
A3-107 0.830 0.765 0.689 0.725
CMU 0.852 0.671 0.793 0.727

Codeswitched posts :
|
Monolingual posts :
|
Total posts :
Team Accuracy Recall Precision F1-Score
MSR-India 0.848 0.167 0.173 0.170
A3-107 0.457 0.833 0.128 0.222
CMU 0.798 0.412 0.207 0.276
IUCL 0.877 0.158 0.250 0.194

Token Level

Nepali English


lang1 :
173 |
lang2 :
699 |
ne :
127 |
other :
88 |
Total :
1087

Team Recall Precision F1-Score
JustAnEagerStudent 0.913 0.802 0.854
A3-107 0.919 0.764 0.835
dcu-uvt 0.925 0.833 0.877
CMU 0.844 0.825 0.834
MSR-India 0.919 0.685 0.785
IUCL 0.861 0.788 0.823

lang1 :
173 |
lang2 :
699 |
ne :
127 |
other :
88 |
Total :
1087
Team Recall Precision F1-Score
JustAnEagerStudent 0.936 0.911 0.923
A3-107 0.946 0.885 0.914
dcu-uvt 0.901 0.904 0.903
CMU 0.605 0.932 0.734
MSR-India 0.867 0.882 0.874
IUCL 0.976 0.809 0.885

lang1 :
173 |
lang2 :
699 |
ne :
127 |
other :
88 |
Total :
1087
Team Recall Precision F1-Score
JustAnEagerStudent 0.394 0.833 0.535
A3-107 0.346 0.917 0.503
dcu-uvt 0.496 0.818 0.618
CMU 0.307 0.951 0.464
MSR-India 0.276 0.565 0.370
IUCL 0.299 0.809 0.437

lang1 :
173 |
lang2 :
699 |
ne :
127 |
other :
88 |
Total :
1087
Team Recall Precision F1-Score
JustAnEagerStudent 0.886 0.696 0.780
A3-107 0.852 0.893 0.872
dcu-uvt 0.886 0.645 0.746
CMU 0.909 0.506 0.650
MSR-India 0.886 0.743 0.808
IUCL 0.068 0.750 0.125

lang1 :
173 |
lang2 :
699 |
ne :
127 |
other :
88 |
Total :
1087
Team Overall Accuracy
JustAnEagerStudent 0.865
A3-107 0.864
dcu-uvt 0.856
CMU 0.633
MSR-India 0.808
IUCL 0.805

Spanish English


ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Recall Precision F1-Score
TAU 0.022 0.200 0.039
IUCL 0.000 0.000 0.000
MSR-India 0.000 1.000 0.000
JustAnEagerStudent 0.000 0.000 0.000
DCU-UVT 0.022 0.077 0.034
A3-107 0.000 1.000 0.000
CMU 0.022 0.048 0.030

ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Recall Precision F1-Score
TAU 0.883 0.824 0.853
IUCL 0.874 0.819 0.845
MSR-India 0.881 0.812 0.845
JustAnEagerStudent 0.853 0.756 0.801
DCU-UVT 0.879 0.805 0.840
A3-107 0.863 0.806 0.834
CMU 0.862 0.811 0.836

ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Recall Precision F1-Score
TAU 0.864 0.887 0.876
IUCL 0.845 0.874 0.859
MSR-India 0.857 0.871 0.864
JustAnEagerStudent 0.746 0.839 0.789
DCU-UVT 0.841 0.867 0.854
A3-107 0.821 0.872 0.846
CMU 0.838 0.889 0.862

ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Recall Precision F1-Score
TAU 0.000 1.000 0.000
IUCL 0.000 1.000 0.000
MSR-India 0.000 1.000 0.000
JustAnEagerStudent 0.000 1.000 0.000
DCU-UVT 0.000 1.000 0.000
A3-107 0.000 1.000 0.000
CMU 0.000 0.000 0.000

ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Recall Precision F1-Score
TAU 0.293 0.537 0.379
IUCL 0.285 0.474 0.356
MSR-India 0.095 0.336 0.148
JustAnEagerStudent 0.145 0.550 0.230
DCU-UVT 0.224 0.552 0.319
A3-107 0.152 0.399 0.220
CMU 0.133 0.346 0.192

ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Recall Precision F1-Score
TAU 0.824 0.843 0.833
IUCL 0.812 0.825 0.819
MSR-India 0.825 0.849 0.837
JustAnEagerStudent 0.826 0.808 0.817
DCU-UVT 0.811 0.843 0.827
A3-107 0.815 0.783 0.799
CMU 0.824 0.788 0.806

ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Overall Accuracy
TAU 0.941
IUCL 0.918
MSR-India 0.918
JustAnEagerStudent 0.876
DCU-UVT 0.944
A3-107 0.936
CMU 0.903

Modern Arabic Dialets


ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Recall Precision F1-Score
MSR-India 0.000 0.000 0.000
A3-107 0.000 0.000 0.000
CMU 0.000 0.000 0.000
IUCL 0.000 0.000 0.000

ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Recall Precision F1-Score
MSR-India 0.897 0.410 0.563
A3-107 0.936 0.378 0.538
CMU 0.876 0.555 0.680
IUCL 0.917 0.333 0.488

ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Recall Precision F1-Score
MSR-India 0.586 0.863 0.698
A3-107 0.458 0.925 0.613
CMU 0.756 0.898 0.821
IUCL 0.484 0.819 0.609

ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Recall Precision F1-Score
MSR-India 0.000 1.000 0.000
A3-107 0.000 1.000 0.000
CMU 0.000 1.000 0.000
IUCL 0.000 1.000 0.000

ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Recall Precision F1-Score
MSR-India 0.209 0.809 0.332
A3-107 0.520 0.778 0.623
CMU 0.523 0.738 0.612
IUCL 0.033 0.176 0.055

ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Recall Precision F1-Score
MSR-India 0.939 0.995 0.966
A3-107 0.962 0.961 0.961
CMU 0.964 0.987 0.975
IUCL 0.013 0.051 0.020

ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Overall Accuracy
MSR-India 0.650
A3-107 0.616
CMU 0.775
IUCL 0.489