EMNLP 2014: Conference on Empirical Methods in Natural Language Processing — October 25–29, 2014 — Doha, Qatar.

emnlp2014

To register for CodeSwitch Shared Task, click below:

REGISTER

First Workshop on Computational Approaches to Code Switching

Comment/Post Level


Codeswitched posts :
20 |
Monolingual posts :
82 |
Total posts :
102
Team Accuracy Recall Precision F1-Score
MSR-India0.7160.9000.4000.554
A3-1070.7350.9000.4190.571
IUCL0.7940.8000.4850.604
dcu-uvt0.7750.8500.4590.596
CMU0.8630.8500.6070.708
JustAnEagerStudent0.7940.9000.4860.632

Codeswitched posts :
22 |
Monolingual posts :
27 |
Total posts :
49
Team Accuracy Recall Precision F1-Score
A3-1070.8300.7650.6890.725
DCU-UVT0.8000.8390.6160.710
JustAnEagerStudent0.7000.8820.4930.633
MSR-India0.8150.7530.6610.704
TAU0.8640.7080.8030.753
IUCL0.8330.5050.8720.640
CMU0.8520.6710.7930.727

Codeswitched posts :
|
Monolingual posts :
|
Total posts :
Team Accuracy Recall Precision F1-Score
CMU0.7980.4120.2070.276
IUCL0.8770.1580.2500.194
MSR-India0.8480.1670.1730.170
A3-1070.4570.8330.1280.222

Token Level

Nepali English


lang1 :
173 |
lang2 :
699 |
ne :
127 |
other :
88 |
Total :
1087
Team Recall Precision F1-Score
MSR-India0.9190.6850.785
A3-1070.9190.7640.835
IUCL0.8610.7880.823
dcu-uvt0.9250.8330.877
CMU0.8440.8250.834
JustAnEagerStudent0.9130.8020.854

lang1 :
173 |
lang2 :
699 |
ne :
127 |
other :
88 |
Total :
1087
Team Recall Precision F1-Score
MSR-India0.8670.8820.874
A3-1070.9460.8850.914
IUCL0.9760.8090.885
dcu-uvt0.9010.9040.903
CMU0.6050.9320.734
JustAnEagerStudent0.9360.9110.923

lang1 :
173 |
lang2 :
699 |
ne :
127 |
other :
88 |
Total :
1087
Team Recall Precision F1-Score
MSR-India0.2760.5650.370
A3-1070.3460.9170.503
IUCL0.2990.8090.437
dcu-uvt0.4960.8180.618
CMU0.3070.9510.464
JustAnEagerStudent0.3940.8330.535

lang1 :
173 |
lang2 :
699 |
ne :
127 |
other :
88 |
Total :
1087
Team Recall Precision F1-Score
MSR-India0.8860.7430.808
A3-1070.8520.8930.872
IUCL0.0680.7500.125
dcu-uvt0.8860.6450.746
CMU0.9090.5060.650
JustAnEagerStudent0.8860.6960.780

lang1 :
173 |
lang2 :
699 |
ne :
127 |
other :
88 |
Total :
1087
Team Overall Accuracy
MSR-India0.808
A3-1070.864
IUCL0.805
dcu-uvt0.856
CMU0.633
JustAnEagerStudent0.865

Spanish English


ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Recall Precision F1-Score
A3-1070.0001.0000.000
DCU-UVT0.0220.0770.034
JustAnEagerStudent0.0000.0000.000
MSR-India0.0001.0000.000
TAU0.0220.2000.039
IUCL0.0000.0000.000
CMU0.0220.0480.030

ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Recall Precision F1-Score
A3-1070.8630.8060.834
DCU-UVT0.8790.8050.840
JustAnEagerStudent0.8530.7560.801
MSR-India0.8810.8120.845
TAU0.8830.8240.853
IUCL0.8740.8190.845
CMU0.8620.8110.836

ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Recall Precision F1-Score
A3-1070.8210.8720.846
DCU-UVT0.8410.8670.854
JustAnEagerStudent0.7460.8390.789
MSR-India0.8570.8710.864
TAU0.8640.8870.876
IUCL0.8450.8740.859
CMU0.8380.8890.862

ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Recall Precision F1-Score
A3-1070.0001.0000.000
DCU-UVT0.0001.0000.000
JustAnEagerStudent0.0001.0000.000
MSR-India0.0001.0000.000
TAU0.0001.0000.000
IUCL0.0001.0000.000
CMU0.0000.0000.000

ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Recall Precision F1-Score
A3-1070.1520.3990.220
DCU-UVT0.2240.5520.319
JustAnEagerStudent0.1450.5500.230
MSR-India0.0950.3360.148
TAU0.2930.5370.379
IUCL0.2850.4740.356
CMU0.1330.3460.192

ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Recall Precision F1-Score
A3-1070.8150.7830.799
DCU-UVT0.8110.8430.827
JustAnEagerStudent0.8260.8080.817
MSR-India0.8250.8490.837
TAU0.8240.8430.833
IUCL0.8120.8250.819
CMU0.8240.7880.806

ambiguous :
1 |
lang1 :
636 |
lang2 :
306 |
mixed :
1 |
ne :
38 |
other :
120 |
Total :
1102
Team Overall Accuracy
A3-1070.936
DCU-UVT0.944
JustAnEagerStudent0.876
MSR-India0.918
TAU0.941
IUCL0.918
CMU0.903

Modern Arabic Dialets


ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Recall Precision F1-Score
CMU0.0000.0000.000
IUCL0.0000.0000.000
MSR-India0.0000.0000.000
A3-1070.0000.0000.000

ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Recall Precision F1-Score
CMU0.8760.5550.680
IUCL0.9170.3330.488
MSR-India0.8970.4100.563
A3-1070.9360.3780.538

ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Recall Precision F1-Score
CMU0.7560.8980.821
IUCL0.4840.8190.609
MSR-India0.5860.8630.698
A3-1070.4580.9250.613

ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Recall Precision F1-Score
CMU0.0001.0000.000
IUCL0.0001.0000.000
MSR-India0.0001.0000.000
A3-1070.0001.0000.000

ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Recall Precision F1-Score
CMU0.5230.7380.612
IUCL0.0330.1760.055
MSR-India0.2090.8090.332
A3-1070.5200.7780.623

ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Recall Precision F1-Score
CMU0.9640.9870.975
IUCL0.0130.0510.020
MSR-India0.9390.9950.966
A3-1070.9620.9610.961

ambiguous :
110 |
lang1 :
2687 |
lang2 :
6930 |
mixed :
3 |
ne :
1097 |
other :
1190 |
Total :
12017
Team Overall Accuracy
CMU0.775
IUCL0.489
MSR-India0.650
A3-1070.616