Papiamento (pap) subword embeddings

Vocab size vocab model 25 dim 50 dim 100 dim 200 dim 300 dim
1000 vocab model txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
3000 vocab model txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
5000 vocab model txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
10000 vocab model txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix
txt | bin
bokeh | umap | matrix

Training corpus sample, encoded with different BPE vocabulary sizes

Vocab sizepapwiki sample
original {| border=0 align=right cellpadding=0 cellspacing=0 width=000 style="margin: 0 0 0em 0em; background: #f0f0f0; border: 0px #aaaaaa solid; border-colla
promé ku e temporada di 0000, baseball america a skohé profar komo e di dos mihó prospekto di e ekipo di texas rangers i e di 00 enté. el a hunga e te
# christ church # saint andrew # saint george # saint james # saint john # saint joseph # saint lucy # saint michael # saint peter # saint philip # sa
1000 ▁{| ▁border =0 ▁align = right ▁cellpadding =0 ▁cellspacing =0 ▁width =000 ▁style =" margin : ▁0 ▁0 ▁0 em ▁0 em ; ▁background : ▁# f 0 f 0 f 0; ▁border : ▁0 px ▁# aaaaaa ▁solid ; ▁border - col la
▁promé ▁ku ▁e ▁tem por a da ▁di ▁0000, ▁bas e b al l ▁amer ica ▁a ▁s ko h é ▁prof ar ▁komo ▁e ▁di ▁dos ▁mi h ó ▁pr os pe kto ▁di ▁e ▁e ki po ▁di ▁te x as ▁r an ger s ▁i ▁e ▁di ▁00 ▁en t é . ▁el ▁a ▁hun ga ▁e ▁te
▁# ▁ch r ist ▁ch ur ch ▁# ▁sa in t ▁and re w ▁# ▁sa in t ▁ge or ge ▁# ▁sa in t ▁j am es ▁# ▁sa in t ▁jo h n ▁# ▁sa in t ▁j ose p h ▁# ▁sa in t ▁lu c y ▁# ▁sa in t ▁mi cha el ▁# ▁sa in t ▁p e ter ▁# ▁sa in t ▁p h il i p ▁# ▁sa
3000 ▁{| ▁border =0 ▁align = right ▁cellpadding =0 ▁cellspacing =0 ▁width =000 ▁style =" margin : ▁0 ▁0 ▁0 em ▁0 em ; ▁background : ▁# f 0 f 0 f 0; ▁border : ▁0 px ▁# aaaaaa ▁solid ; ▁border - col la
▁promé ▁ku ▁e ▁temporada ▁di ▁0000, ▁base ball ▁amer ica ▁a ▁sko hé ▁prof ar ▁komo ▁e ▁di ▁dos ▁mihó ▁pros pe kto ▁di ▁e ▁ekipo ▁di ▁tex as ▁ran ger s ▁i ▁e ▁di ▁00 ▁en t é . ▁el ▁a ▁hunga ▁e ▁te
▁# ▁ch r ist ▁ch ur ch ▁# ▁saint ▁and re w ▁# ▁saint ▁geor ge ▁# ▁saint ▁j am es ▁# ▁saint ▁john ▁# ▁saint ▁jose ph ▁# ▁saint ▁lu c y ▁# ▁saint ▁mi cha el ▁# ▁saint ▁pe ter ▁# ▁saint ▁p h ili p ▁# ▁sa
5000 ▁{| ▁border =0 ▁align = right ▁cellpadding =0 ▁cellspacing =0 ▁width =000 ▁style =" margin : ▁0 ▁0 ▁0 em ▁0 em ; ▁background : ▁# f 0 f 0 f 0; ▁border : ▁0 px ▁# aaaaaa ▁solid ; ▁border - col la
▁promé ▁ku ▁e ▁temporada ▁di ▁0000, ▁baseball ▁america ▁a ▁sko hé ▁profar ▁komo ▁e ▁di ▁dos ▁mihó ▁pros pekto ▁di ▁e ▁ekipo ▁di ▁texas ▁ran gers ▁i ▁e ▁di ▁00 ▁en t é . ▁el ▁a ▁hunga ▁e ▁te
▁# ▁ch r ist ▁ch ur ch ▁# ▁saint ▁and re w ▁# ▁saint ▁george ▁# ▁saint ▁james ▁# ▁saint ▁john ▁# ▁saint ▁joseph ▁# ▁saint ▁lu cy ▁# ▁saint ▁michael ▁# ▁saint ▁peter ▁# ▁saint ▁ph ili p ▁# ▁sa
10000 ▁{| ▁border =0 ▁align = right ▁cellpadding =0 ▁cellspacing =0 ▁width =000 ▁style =" margin : ▁0 ▁0 ▁0 em ▁0 em ; ▁background : ▁# f 0 f 0 f 0; ▁border : ▁0 px ▁# aaaaaa ▁solid ; ▁border - col la
▁promé ▁ku ▁e ▁temporada ▁di ▁0000, ▁baseball ▁america ▁a ▁skohé ▁profar ▁komo ▁e ▁di ▁dos ▁mihó ▁pros pekto ▁di ▁e ▁ekipo ▁di ▁texas ▁rangers ▁i ▁e ▁di ▁00 ▁ent é . ▁el ▁a ▁hunga ▁e ▁te
▁# ▁christ ▁church ▁# ▁saint ▁andre w ▁# ▁saint ▁george ▁# ▁saint ▁james ▁# ▁saint ▁john ▁# ▁saint ▁joseph ▁# ▁saint ▁lu cy ▁# ▁saint ▁michael ▁# ▁saint ▁peter ▁# ▁saint ▁phili p ▁# ▁sa