Skip to content

Latest commit

 

History

History
225 lines (225 loc) · 22.4 KB

many-to-many-full-results-per-language.md

File metadata and controls

225 lines (225 loc) · 22.4 KB
Raw
Language Pairs Baseline 6 Layer Baseline 6 Layer + RoBT Baseline 6 Layer + MergedAtt Baseline 6 Layer + MergedAtt + RoBT Baseline 6 Layer + MergedAtt + LaLN + LaLT Baseline 6 Layer + MergedAtt + LaLN + LaLT + RoBT Baseline 6 Layer + MergedAtt + LaLN + LaLT + RoBT + 6-to-6 Baseline 12 Layer + MergedAtt Baseline 12 Layer + MergedAtt +RoBT Baseline 12 Layer + MergedAtt + LaLN + LaLT Baseline 12 Layer + MergedAtt + LaLN + LaLT + RoBT Baseline 24 Layer + MergedAtt + LaLN + LaLT Baseline 24 Layer + MergedAtt + LaLN + LaLT + RoBT
Model Settings Layer Depth 6 6 6 6 6 6 6 12 12 12 12 24 24
Merged Attention Y Y Y Y Y Y Y Y Y Y Y
LaLN Y Y Y Y Y Y Y
LaLT Y Y Y Y Y Y Y
RoBT Y Y Y Y Y Y Y
OPUS En2XX en2af 31.4 29.3 30.2 28.9 35.8 34.6 35.5 33.9 32 38.2 36.9 39 38.1
en2am 10.7 10.3 9.7 9.3 12.5 12.4 11.8 11.8 11.4 14.5 14.2 17 16.5
en2ar 14.6 13.8 13.4 12.8 14.5 13.6 14.3 15.2 14.5 15.6 15.1 17.7 17.3
en2as 30.3 28.2 28.7 27.4 34.2 32.9 33.4 31.7 30.7 35.9 34.1 36.6 35.9
en2az 12.5 12 11.9 11.2 14.3 13.9 13.4 14.1 13.8 16.7 16.3 19.9 19.3
en2be 11.1 8.8 11.1 9.3 13.2 12.4 12 12.9 12 15.2 13.7 14.5 14.7
en2bg 23.2 23.1 22 21.6 24.6 24.1 23.4 24.6 24.7 25.9 26.1 27.7 27
en2bn 9.7 9 8.5 8.5 9.2 8.6 8.5 10.1 9.5 9.6 9.4 10 10.1
en2br 10.7 10.7 10.4 10 16.7 15.7 15.3 12.5 12.2 18.1 17.1 17.6 17.1
en2bs 18.8 18.7 18.7 18 18.9 18.7 18.5 20.4 20.1 20 19.8 21.6 20.9
en2ca 29.1 28.4 27.9 27 30.5 29.6 29.1 31.1 30.5 32.4 31.8 33.6 33
en2cs 21.3 21.2 20.2 20.1 22.1 21.1 21.1 21.9 22.1 22.8 22.7 24.5 24.4
en2cy 28.1 25.6 26.8 24.8 33.5 31.6 30.4 29.6 27.9 35.4 34.3 37 34.7
en2da 29.6 28.5 28.2 27.2 30.4 29.7 29.5 30.6 30 31.9 31 33.2 32.7
en2de 24.9 24.5 23.7 23.7 24.8 24.6 25.6 25.2 25.4 26.1 25.9 26.8 26.9
en2el 21.3 20.8 19.8 19.2 21.8 21.4 21.1 22.2 21.5 23.4 23 24.6 24.4
en2eo 25.6 24.6 24.3 23.4 28.9 28.5 28.2 27.7 26.9 30.9 30.8 31.2 30.8
en2es 30.7 30.4 29.8 29.2 31.3 30.7 30.6 32.3 32 33 32.5 34.7 34.1
en2et 20.3 23.5 19.8 21.2 21.3 20.8 20.3 21 21.4 21.9 24.3 22.2 22.5
en2eu 10.8 10.5 10 9.5 11.1 10.9 10.5 11.7 11.4 12.3 11.9 13.1 12.6
en2fa 6.7 6.7 6.7 6.5 6.7 6.9 6.6 7.4 7.4 7.8 7.5 8.5 8.3
en2fi 15.9 15.5 14.7 14.7 16.5 15.9 15.7 16.8 16.4 17.6 17.2 19.4 18.5
en2fr 26.5 25.9 25.1 24.9 26.3 25.9 26.5 27.6 27.1 28.2 27.4 29.8 29.5
en2fy 18.6 17.7 17.6 17.5 26.1 25.5 25.1 20.9 19.6 27.3 26.2 27.6 26.9
en2ga 34.2 32.4 31.6 30.1 36.5 35 35.1 36.2 34.4 39.8 38.3 43.1 41.2
en2gd 15.8 16 14.6 13.8 19.6 17.8 17.5 17.7 18.4 21.3 19.5 20.2 19.6
en2gl 21.6 21.2 20.6 19.4 22.5 22.1 21.9 23.1 22.5 24.9 24 25.6 24.8
en2gu 44.6 42.2 42.1 40 46.3 44.6 44.2 43.1 42.9 46.8 45.9 48.3 47.1
en2ha 24.2 23.5 22.8 21.7 28.3 27.8 27.4 27.5 27.4 31.1 31 34.5 33.6
en2he 24 23.1 23.2 22.1 25.1 24.5 24.8 24.6 24.3 26.6 26.1 27.9 27.3
en2hi 15.9 14.8 14.7 14.3 16 15.6 15.5 16.9 16.2 17.1 17.1 18.9 18.1
en2hr 20.9 20.3 20.4 19.5 20.8 20.3 20.5 21.8 21.6 21.9 22.4 23.6 23.2
en2hu 15.1 14.8 14.8 14.3 16.2 16 15.8 16.9 16.3 17.3 17.3 18.8 18.5
en2id 26.6 26.2 26.1 25.5 27.8 27.6 27.1 26.5 26.5 28.9 28.3 29.4 28.7
en2ig 26.4 25 23.6 23.1 36.7 35.3 34.7 28 26.7 39.1 37.7 38.5 36.7
en2is 17.3 16.1 16.1 15.3 17.9 17.3 17 17.3 17 18.5 18.6 19.9 19.8
en2it 24.7 24 23.8 23.5 25.4 24.8 24.7 25.8 25.6 26.6 25.7 28 27.4
en2ja 9 8.6 8 8.2 7.3 7.8 7.7 9.8 10.4 9.8 9.5 9.3 8.2
en2ka 14 13.4 13.2 12.7 14 13.6 13.5 15.1 14.8 15.1 15.2 16.2 16.3
en2kk 12.9 12 12.4 12 15.9 15.9 14.7 14.3 14 18.1 17.4 17.6 17.5
en2km 18.2 18.3 17.6 18.4 17.9 18.3 17.7 18.7 18.9 18 18.3 18.5 19.3
en2kn 10.4 9.7 10.4 9.5 11.3 10.9 10 11.1 10.3 11.6 10.6 12.7 11.2
en2ko 4.3 4.4 4.4 4.4 4.1 4.6 3.8 5 4.8 4.5 5.2 5.5 4.6
en2ku 5.3 4.9 4.9 4.8 6.4 6.3 6.2 5.9 5.6 7 7.2 7.5 7.5
en2ky 19.5 19.3 18.6 19 21.7 21.7 20.5 20 19.5 22.5 23.5 25.6 25.2
en2li 15.8 13 14.1 14.3 23.7 23.2 23.1 17.1 15.9 25 26.4 26.1 26.2
en2lt 28.7 27.2 27.1 25.8 29.2 28.1 27.6 30.6 29.7 30.9 29.5 33.2 32.2
en2lv 32.9 31.7 31.2 30 32.9 31.8 31.6 34.5 33.5 35.4 34.4 37.5 37.1
en2mg 18 17.4 16.9 16.5 17.9 17.3 17 19 18.5 19 18.6 20.4 20
en2mk 25.9 25.1 24.6 23.8 26.7 26 25.2 27.5 26.7 28.6 27.9 30.8 30
en2ml 4.3 4.3 4.1 3.9 4.5 4.6 4.2 4.3 4.4 5 4.7 5.5 5.5
en2mr 8.3 7.6 7.4 6.2 17.8 17.3 16.1 8.6 8 19.7 18.9 21.2 20.1
en2ms 20.6 19.9 19.7 19.1 21.8 21.4 21.1 20.8 21 22.4 22.6 22.9 22.5
en2mt 42.7 41.5 41.3 40.2 42.6 41.4 41.3 43.9 42.8 44.7 43.7 46.1 45.1
en2my 8.3 8.2 8.3 8.4 10.5 10.5 10.4 8.8 8.3 10.6 9.9 10.6 9.8
en2nb 26.4 25.3 24.8 24.1 29 28.5 27.8 28.1 27.4 30.7 29.9 33 31.8
en2ne 34.9 34.3 34.3 32.3 37.4 36 36.7 37.2 36.5 39.3 37.8 38.8 39.5
en2nl 22.6 21.7 21.7 20.6 22.9 22.7 23.2 23.5 23.1 24 23.8 25.3 25
en2nn 24.4 23.6 23 22.5 25.8 25.2 25.1 25.7 24.9 27.2 26.6 28.2 27.2
en2no 24.1 23.7 23.7 23.3 24.9 24.6 24.3 25.8 24.9 26.5 25.7 27.4 26.8
en2oc 9.6 9.4 9.9 9.2 12.7 12.6 13.5 16.8 15.3 14.4 13.1 14.3 13.5
en2or 12.4 11.8 12 11.4 13.3 13.2 12.8 13 12.8 13.3 13.5 14.3 13.8
en2pa 27 25.2 25.8 24.3 30.7 28.8 30.2 30.2 28.4 32.9 30.2 35 34
en2pl 16.1 15.5 15.1 14.8 16.3 16.1 16 17.4 17.2 18 17.5 19.4 19.5
en2ps 23.1 19.9 22 19.2 35.8 33.3 34.4 25.5 23.8 37.3 37.7 37.3 36.2
en2pt 25.9 25.8 25.4 24.8 27.1 26.4 26.3 27.9 27 28.9 28.6 30.4 29.5
en2ro 26.5 25.6 24.8 24.7 26.9 26.5 26.3 27.4 26.9 28.6 28.2 29.2 28.7
en2ru 22.3 21.7 20.6 19.8 21.6 21.1 22.2 23 22.4 24.1 23.3 25.9 25.5
en2rw 51.6 47.9 47.8 43.5 54.8 51.6 53.1 53.2 50.9 57.5 54 60 57.9
en2se 7.6 7.4 5.9 6.1 11 10.6 9.7 14.4 14.5 11.4 11 11 10.2
en2sh 37.6 35.8 34.8 33.3 37.5 36.5 36.1 39.4 38.4 40 39.5 44.1 42.6
en2si 9.4 9.2 9 8.8 9.9 9.6 9.4 9.7 9.6 9.9 10 10.7 10
en2sk 23.7 23.1 21.6 21.3 23.5 23 22.3 24.9 24.9 25.8 25.1 27.3 27.2
en2sl 19 17.9 17.6 17.1 19.7 18.8 19.3 20.5 20.3 21.6 21.3 23.2 22.8
en2sq 30.7 29.9 27.6 27 30.7 29.7 29.3 31.5 30.9 32.8 32.4 34.7 34.4
en2sr 17.5 17.1 16.9 16.3 17.4 17.3 17.1 18.2 18 19.1 19 20 19.8
en2sv 26.1 25.4 24.6 23.5 26.1 25.3 25.4 27.1 26.9 28.1 27.5 29.9 28.9
en2ta 10.4 10.2 9.7 9.6 11.8 11.1 10.7 12.2 11.8 12.5 12.1 13.3 13
en2te 15.3 13.7 14.5 13 19.2 17.6 17.6 15.4 14.4 20.6 18.4 22.2 21.2
en2tg 14.4 13.7 13.9 13.3 16.5 16.1 15.5 16.7 16.2 18.5 18.6 20.9 20.6
en2th 6.7 6.7 7.5 8.1 7 7.7 6.5 8.3 8.2 8.4 8.8 7.7 5.1
en2tk 27.7 27.3 27.3 26.1 37.8 40.3 36.4 28.9 27.3 40.4 43 42.5 42.1
en2tr 12.4 12.3 11.5 11.6 13.6 13.2 13.3 13.2 13.1 14.9 14.3 15.8 15.1
en2tt 5.6 5.4 5.4 5.2 6.5 6.2 6 6.1 6.2 7 7.1 8.1 8.3
en2ug 5.4 5 4.9 4.6 6.3 5.9 5.8 6.1 5.9 7.4 7.3 8.9 8.8
en2uk 13.3 12.6 12 11.4 12.2 11.9 12.2 13.2 12.8 13.8 12.8 14.4 13.9
en2ur 14.1 13.9 13.5 13.4 14.6 14.3 14.1 15.5 15.1 15.9 15.8 17.3 17.6
en2uz 6.4 6 5.9 5.5 7.8 7.5 7.1 7.4 7.4 8.8 9.1 10.3 9.9
en2vi 17.9 17.5 17.8 17.1 19.5 18.8 18.9 18.8 18.8 20.2 20.3 20.9 20.7
en2wa 18.9 17.9 18.4 17.5 24.4 23.4 23.2 20 19 26.5 26.2 24.3 23.2
en2xh 6.9 6.8 7.1 6.4 9.6 8.9 9 8.3 7.8 10 9.4 11.3 10.6
en2yi 13.9 12.1 10 10.8 17.1 15.7 17.7 15.3 14.1 22.1 20.4 21.8 20
en2zh 10.5 10 11 10.8 11.8 11.9 12.2 11.2 11.2 12.2 11.5 12.7 12.6
en2zu 21.7 20.7 20.5 19.8 29.3 28.6 28.2 21.8 20.7 30.2 29.7 28.7 28.1
OPUS XX2En af2en 44.1 44 43.3 43.2 44.3 43.8 42.5 46.9 46.8 46.7 47.2 49.3 48.6
am2en 17.4 16.4 16.2 15.9 16.6 16.4 15.9 18.8 19.1 19 19.5 21.1 22.5
ar2en 29.6 28.9 29 28.3 29.7 29 27.4 31.9 31.5 32.2 31.8 34.5 34.2
as2en 45.4 43.3 45.4 42.2 46 44.6 44.7 48.1 46.6 49.5 47.6 52.6 50.6
az2en 21.4 20.4 19.9 19.3 20.9 20.5 20.2 22.9 22.5 23.7 23.4 24.9 24.8
be2en 20.3 19.1 19.6 18.3 19.9 20.7 19 22.2 22.1 22.2 23.2 23.6 24.3
bg2en 28.3 28.4 27.5 27.7 28.4 28.1 27.5 29.9 29.7 29.7 30 31.5 31.3
bn2en 18.1 17.7 17.4 17.3 17.8 17.2 17.1 19.2 19.4 19.6 19.3 20.7 21.1
br2en 14.7 13.6 14.3 13.1 15.3 16.9 14.1 16.7 15.4 17.7 19.2 20 20.1
bs2en 27.4 27.2 26.5 26.5 27.2 27.2 26.7 28.9 29 29.1 29.2 30.5 30.4
ca2en 33.1 32.8 32.5 32.5 33.3 32.8 32.1 34.3 34.2 34.8 34.9 36.9 36.7
cs2en 29.6 29.9 28.9 29.3 29.5 29.9 29.3 30.8 31.1 31 31.4 32.9 33.3
cy2en 43 41.1 42.1 40.8 43.1 42.3 40.6 44.9 44.5 47.4 45.2 48.5 47.6
da2en 32.2 32.2 31.3 31.5 32.2 31.8 31.6 33.5 33.8 33.4 33.7 35.2 35.1
de2en 29.2 28.7 28.3 27.7 28.9 28.5 28 30.2 30.1 30 30.1 31.2 31.4
el2en 29.2 28.9 28.6 28 28.9 28.8 28.3 30.1 29.9 30.2 30.1 31.4 31.6
eo2en 31.4 30.7 30.7 29.7 31.5 31.5 30.6 33.3 33.5 33.9 34 36 36.2
es2en 34.2 34.2 33.9 33.5 34.9 34.5 34.3 36 36 36.4 36.7 38.1 38
et2en 26.9 29.5 26 27.6 28.9 26.6 27.9 28.3 28.7 28.5 30.6 30.3 30.6
eu2en 16.4 16 15.4 15.2 15.9 15.4 15.2 17.3 17.3 17.4 17.4 18.9 19.1
fa2en 19.3 18.9 18.9 18.4 19.2 19 18.5 21 20.8 21.3 21.1 22.3 22.4
fi2en 19.5 19.5 18.5 18.8 19.8 19.6 19.4 21.2 21.2 21.6 21.3 23 23.2
fr2en 28.1 28.7 28.1 27.6 28.8 28.4 27.7 29.5 29.7 29.8 30.2 31.3 31.4
fy2en 34.4 33.2 34 33 35.4 36.6 33.2 37.1 36 38.5 37.9 40.7 39.8
ga2en 48.9 47.4 47.4 45.5 48.8 47.2 47.3 51.5 50.7 52.2 50.8 55.3 54.3
gd2en 54.2 61.2 57.8 59.9 48.7 55.9 43.6 56.5 61 43.4 51 62.5 59.9
gl2en 26.3 26 26.1 25.6 26.3 26.3 25.8 28.3 27.9 28.5 28.3 29.8 29.7
gu2en 54.8 53.5 54.5 52.8 54.8 52.9 53.7 56.5 55.8 56.4 55.7 58.5 58.3
ha2en 19.6 19.6 19.2 18.7 20 19.8 19.5 21.4 21 21.6 22.4 22.6 22.5
he2en 29.3 29.3 28.8 28.1 29.1 29.3 28.8 31.5 31.5 31.8 31.8 34.3 34
hi2en 22.4 22.2 21.8 21.3 22.3 21.8 22.1 24.3 24.2 24.8 24.4 25.8 26.2
hr2en 27.7 27.9 26.9 26.9 27.7 27.7 27.1 29.1 29.2 29.5 29.5 31.1 31.3
hu2en 22.7 22.5 22.2 21.8 22.9 22.4 22.3 24.7 24.2 24.6 24.5 26.9 26.5
id2en 30.6 30.4 30.3 30.1 30.5 30.2 30.1 31.6 31.8 32.2 32.7 33.8 33.8
ig2en 41.4 36.4 40 37.5 40.4 44.1 38.6 46.2 44.8 46.1 47.5 47 51.1
is2en 19.5 19 18.9 18.9 19.6 19.3 19.2 20.5 20.6 21.3 21 23.3 23
it2en 30.2 30.3 29.4 29.5 30.5 30.2 30 31.9 31.8 32 32.1 33.2 33.8
ja2en 10.3 9.5 9.5 9.1 9.5 9.5 9.5 10.5 10.5 10.4 10.5 11.2 11.4
ka2en 18.9 19.4 18.4 18.3 18.6 18.8 18.4 20.7 20.7 21.4 20.7 22.9 23
kk2en 19.9 19.2 19.3 18.4 20.9 20.8 20.1 21.3 20.3 21.9 21.7 23.1 22.6
km2en 26.3 24.9 26.1 24.6 26.7 25.3 25.7 27 26.3 27.2 27.8 30.1 28.7
kn2en 29.7 25.8 29.4 25.2 29.2 25.8 28.1 31.8 26.9 33.4 28.2 35.7 31.6
ko2en 11.1 10.8 11.1 10.4 11.4 11.3 11.1 11.3 11.2 12.1 12.2 12.6 12.7
ku2en 18.4 17.5 17.5 16.7 17.7 18.4 17.4 20.9 20.4 20.3 21.9 22.7 23
ky2en 30 28.3 28.5 27.4 28.2 29 28 31.9 30.8 33.7 30.5 35 33.3
li2en 28.6 30.2 27.6 30 29.6 30.3 27.7 30.7 31.5 33.4 37.2 34.1 28.1
lt2en 36 35.4 34.5 34.2 35.5 35.2 35.2 38.1 37.7 38.5 38.2 40.8 40.4
lv2en 39.5 39 38.6 38.4 39.5 38.9 38.6 41.9 41.1 41.9 41.4 44.3 43.8
mg2en 23.2 22.8 22.7 22.1 23.4 22.8 22.9 24.8 24.6 25.4 24.9 27 26.5
mk2en 29.6 29.3 28.7 28.3 29.6 28.5 28.5 31.1 31.2 31.5 31.1 33.2 33
ml2en 16.2 16 15.8 15.8 16 16 15.8 17.2 17.3 17.5 17.4 18.4 18.4
mr2en 29.5 22.1 29.2 20.6 29.5 32.7 28.5 32.7 26.5 33.7 37.4 39.1 41
ms2en 26.3 26.2 26.2 26.2 26.8 26.7 26 27.5 27.6 27.9 28 29.2 29.6
mt2en 54.8 54.6 54.5 53.8 55.2 54.7 54.2 56.8 56.3 57 56.8 59.2 58.8
my2en 11.8 9.6 11.8 10.8 13.6 11.5 12.2 12.7 11.9 13.2 12.8 14 13.8
nb2en 36.1 36.1 35 34.6 36.5 36.1 35.5 37.3 37.4 37.9 38 39.6 39.9
ne2en 45.1 44.9 44 43.9 44.8 42.5 43.7 46 45.6 46.8 46.2 48.5 45
nl2en 27 27 26.4 26.2 27.5 27.3 26.2 28.8 28.8 29.1 28.5 30.5 30.7
nn2en 34.9 34.1 34.2 33.6 34.7 34.2 34 36.4 36.3 36.6 36.2 37.6 37.8
no2en 22.4 22.4 21.3 21.9 21.9 22.2 21.8 23.2 23.5 23.2 23.5 24.9 25
oc2en 16.9 17 16.8 15.6 16.8 16.9 16.3 17.2 18.3 17.3 18.8 18.3 19.3
or2en 23.1 19.6 22.3 19.3 22.9 22.1 22.1 25 22.9 25.7 24.4 28 27.2
pa2en 36.9 33.6 35.3 33.4 38.6 35.7 36.6 39.7 36.8 40.8 38.4 42.9 40.9
pl2en 22 22 21.7 21.7 22.2 22.2 21.8 23.6 23.6 24.5 24.4 25.6 25.6
ps2en 38.9 36 35.9 31.4 37.1 31.2 35 40.7 37.8 39.9 37.3 41.6 29.2
pt2en 32.5 32.8 31.9 31.7 32.6 32.3 32 33.6 33.7 33.9 33.9 35.6 35.3
ro2en 33.9 33.8 33.5 33.3 33.9 34 33.2 35.8 35.6 35.8 36 37.6 37.5
ru2en 28.6 28.1 27.8 27.3 28.4 28 27.3 30.2 29.7 30.2 29.9 32.1 31.6
rw2en 19.1 18.9 18.7 18.7 19.1 18.4 18.1 19.6 20.3 21.2 20.8 22.7 21.6
se2en 10.6 9.8 10 9.1 11.2 11.6 11 11.9 11 12.3 14.6 13.6 14.2
sh2en 46.3 45.8 44.5 43.8 46 44.7 44.7 48.2 47.9 48.7 47.9 51.4 50.8
si2en 19.6 19 19.1 18.4 19.3 19.1 18.9 20.7 20.2 20.6 20 22.6 21.8
sk2en 32.8 32.7 32.1 32.1 32.9 32.4 32.1 35.3 34.9 35.1 34.8 37.4 37.2
sl2en 23.6 23.5 22.7 22.7 23.5 23.4 22.9 25.1 24.9 25.1 25 26.9 27
sq2en 36.2 35.8 35.5 34.7 35.9 35.4 35.5 38.2 37.9 39 38.7 40.8 40.4
sr2en 27.1 26.8 26.5 26 27 26.7 26.5 28.4 28.3 28.8 28.6 30.2 30
sv2en 27.9 27.6 27.1 27.1 27.7 27.2 27 28.6 28.7 29.1 28.9 30.6 30.2
ta2en 23 22.2 22.5 21.5 22.6 22.5 21.5 24.5 23.7 24.5 24 25.8 25.5
te2en 29.5 27.2 29.4 26.4 29.1 28 28.2 31 28.8 31.9 30.9 34.1 34
tg2en 18.6 18.1 17.7 17.3 18.3 18.3 18.1 20.2 20.1 20.6 20.7 22.3 22
th2en 18.6 18.2 17.8 17.8 18.4 17.8 17.8 19.3 19.3 19.4 19.5 20.5 20.6
tk2en 41.2 36.6 37.7 37.7 39 38.6 38.8 41.3 41.7 44 42 46.5 51.1
tr2en 20.5 20.4 19.5 19.6 20.8 20.6 20.3 21.8 22 22.8 22.4 24.6 24.3
tt2en 13.1 12.4 12.3 12 13 12.5 13 14.6 14.2 14.5 14.6 17 16.9
ug2en 14.5 13.9 13.4 13 14 14.2 13.5 16 15.9 16.1 16.8 17.2 17.6
uk2en 23.6 23 23.1 22.2 23.4 23 22.5 24.8 24.8 25.2 24.8 26.5 26.3
ur2en 18.5 18.5 17.7 17.5 18.4 18.3 18.1 20.3 19.9 20 20.3 20.7 20.7
uz2en 15.4 15 14.4 14.3 15.2 15.2 15 16.6 16.6 16.6 16.8 18 18.2
vi2en 22.5 21.8 21.7 21.6 22.9 22.4 22.2 23 22.7 23.4 23.1 24.6 24.2
wa2en 28.8 29.7 27.9 28.2 29.5 28.2 28.1 30.5 29.8 31 30.1 34 29.6
xh2en 18.1 16.7 17.3 16 18 16.9 17.4 20.3 19 21 19.1 23.7 21.6
yi2en 22 27 23.5 26.4 21.6 22.1 23.2 22.4 21.9 24.6 33 22.7 20.7
zh2en 20 20.5 19.1 18.9 18.9 19.8 18.3 18.7 21.8 18.5 21.5 18.8 21.6
zu2en 43.8 41.8 42.1 40.7 42.6 43.2 42 45.6 45.3 47.6 47.2 49.3 50.3
Zero Shot Translation ar2de 1.6 7.3 1.2 6.9 1.3 8.7 8.7 1.3 9.6 2.1 10.1 1.4 11.9
ar2fr 4 13.6 3.1 13.4 3.5 15.9 16.8 2.8 17.3 3.7 18.8 2.5 21.7
ar2nl 3.7 9.2 2.5 8.8 2.2 10.4 9.7 4 10.6 2.7 11.4 1.7 13.1
ar2ru 4.5 11.7 3.3 11 3.9 12.2 13.8 3.9 14.3 5.2 15.4 4 17.8
ar2zh 3.3 11 2.6 10.5 2.7 11.6 13.3 2.6 11.3 7 11.7 5.3 12.3
de2ar 2.2 3.2 2.2 3.3 1.5 3.7 4.1 3 4.1 1.7 4.5 1.8 5.3
de2fr 3.2 14.7 3.1 13.6 3.9 15.7 16.7 3.7 17.3 3.8 18.4 3.9 20.4
de2nl 7.4 15.8 5.6 15.1 7 18 19.2 5.9 18.3 6.8 19.9 7.6 21.4
de2ru 2.4 9.6 2.2 8.8 3.3 10.4 11.2 3.4 11.2 3.6 12 4.6 13.9
de2zh 0.6 1.4 0.6 1.4 0.4 2 1.8 0.5 1.9 0.5 1.7 0.6 1.7
fr2ar 6 9.8 6.1 9.3 5.8 10.9 12.3 11.2 12.2 10.1 12.9 11 14.8
fr2de 3.4 12.7 3.2 11.9 4.8 14.6 15.8 3.4 15.1 7.7 16.5 7 18.1
fr2nl 8.1 16.1 6.6 15.5 7.1 18.2 19 7.5 18.6 9.8 20 11.9 21.8
fr2ru 6.4 14.2 4.9 13.5 6.8 14.9 16.5 7.7 16.3 11.9 17.6 14.4 19.6
fr2zh 3.6 10.3 2.7 9.6 2.9 12.8 13.8 3 11.4 4 12.5 3.9 13.2
nl2ar 2.7 3.5 2.8 3.5 1.9 4.2 4.1 3.7 4.2 2.6 4.5 2.9 4.9
nl2de 5.1 14.5 5.3 13.8 7.2 16.4 18 5.6 16.9 7 18.3 7.4 19.8
nl2fr 5.3 16.9 6 16.3 6.7 18.4 19.2 7 19.6 6.3 20.6 6.4 22.6
nl2ru 4.9 9.1 4.6 8.4 4.8 9.5 9.9 6.1 10.4 6.1 10.9 6 12
nl2zh 1 1.6 1.4 1.9 0.6 2.1 1.8 0.8 1.8 0.7 1.7 1 1.7
ru2ar 4.8 9.6 5.5 9.4 4.8 11 12.4 9.1 12.3 7 13.5 5.1 15.3
ru2de 3.5 9.8 3 9.1 4.8 10.9 11.4 3.4 11.6 5.4 12.5 4.5 14.2
ru2fr 5.1 18.2 3.9 17.4 7.5 19.1 21.2 4.9 20.9 7.2 22.1 4.9 24.7
ru2nl 5.7 9.6 5.7 9.8 5.5 10.9 11.1 6.1 11.3 6.3 11.9 4.9 13.4
ru2zh 3.7 9.6 2.8 9.9 4 10.9 11.6 2.6 10.3 4.9 10.3 3.2 10.8
zh2ar 4.2 7.9 3.8 7.5 3.4 8.6 10 7.8 9.7 6.7 10 7.7 11.7
zh2de 1.4 5 1.1 4.6 1.6 5.7 5.5 3.4 6.1 2.7 6.3 2 7.2
zh2fr 4.8 12.2 2.4 11.7 3.8 12.9 13.9 7.5 14.1 7.6 14.7 7.9 17
zh2nl 3.5 5.9 3.8 5.4 3.1 6.6 6 5.6 6.5 4.6 7 4.4 7.9
zh2ru 2.9 9.4 2.6 8.9 3.7 9.7 10.7 3.8 10.8 6.7 10.8 7.4 12.1