Rundi (rn) subword embeddings
| Vocab size | vocab | model | 25 dim | 50 dim | 100 dim | 200 dim | 300 dim |
|---|---|---|---|---|---|---|---|
| 1000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
| 3000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
| 5000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
Training corpus sample, encoded with different BPE vocabulary sizes
| Vocab size | rnwiki sample |
|---|---|
| original | iyo mibiri ifise iforoma riteye nk’ukwezi irashobora gufatana hanyuma igaca izibira uturingoti duto twa maraso, iyo umuntu yanduye indwara, aca ya ma ''polystachya maculata'' ''polystachya maculata'' ni gutera. * abavandimwe: ''polystachya'' <- ''orchidaceae''. * igihugu: uburundi. ---- * inkenuzo: sahwānyá ní ijāmbo rihwānyá amajāmbo asāngíye ubwôko cânké ingīngo zibiri mu ryŭngāne. ziri ubwôko butatu: |
| 1000 | ▁iyo ▁mi biri ▁i fise ▁i f o ro ma ▁ri te ye ▁nk ’ u k we zi ▁i ra shobora ▁gu fa t ana ▁hanyuma ▁i ga ca ▁i zi bira ▁u tu rin go ti ▁du to ▁t wa ▁ma raso , ▁iyo ▁umuntu ▁y an du ye ▁indwara , ▁a ca ▁ya ▁ma ▁'' po ly sta ch ya ▁ma cu la ta '' ▁'' po ly sta ch ya ▁ma cu la ta '' ▁ni ▁gutera . ▁* ▁aba v andi mwe : ▁'' po ly sta ch ya '' ▁ < - ▁'' orchi da cea e ''. ▁* ▁igihugu : ▁uburundi . ▁- - - - ▁* ▁inken u zo : ▁sa h w ā ny á ▁ní ▁ijāmbo ▁ri h w ā ny á ▁ama jāmbo ▁a s ā ng í ye ▁ub w ô ko ▁cânké ▁ing ī n go ▁zi biri ▁mu ▁ry ŭ ng ā ne . ▁zi ri ▁ub w ô ko ▁bu tatu : |
| 3000 | ▁iyo ▁mi biri ▁ifise ▁i fo ro ma ▁ri teye ▁nk ’ ukwezi ▁ira shobora ▁gu fa t ana ▁hanyuma ▁iga ca ▁izi bira ▁uturingoti ▁duto ▁twa ▁maraso , ▁iyo ▁umuntu ▁y andu ye ▁indwara , ▁aca ▁ya ▁ma ▁'' polysta chya ▁ma culata '' ▁'' polysta chya ▁ma culata '' ▁ni ▁gutera . ▁* ▁abavandimwe : ▁'' polysta chya '' ▁<- ▁'' orchidaceae ''. ▁* ▁igihugu : ▁uburundi . ▁---- ▁* ▁inkenuzo : ▁sah wānyá ▁ní ▁ijāmbo ▁ri h wānyá ▁ama jāmbo ▁a s āng í ye ▁ubwôko ▁cânké ▁ing ī ngo ▁zibiri ▁mu ▁ry ŭ ng ā ne . ▁ziri ▁ubwôko ▁bu tatu : |
| 5000 | ▁iyo ▁mi biri ▁ifise ▁i foroma ▁ri teye ▁nk ’ ukwezi ▁irashobora ▁gu fa t ana ▁hanyuma ▁iga ca ▁izi bira ▁uturingoti ▁duto ▁twa ▁maraso , ▁iyo ▁umuntu ▁y anduye ▁indwara , ▁aca ▁ya ▁ma ▁'' polystachya ▁maculata '' ▁'' polystachya ▁maculata '' ▁ni ▁gutera . ▁* ▁abavandimwe : ▁'' polystachya '' ▁<- ▁'' orchidaceae ''. ▁* ▁igihugu : ▁uburundi . ▁---- ▁* ▁inkenuzo : ▁sahwānyá ▁ní ▁ijāmbo ▁ri h wānyá ▁amajāmbo ▁a sāngíye ▁ubwôko ▁cânké ▁ingīngo ▁zibiri ▁mu ▁ry ŭ ng ā ne . ▁ziri ▁ubwôko ▁bu tatu : |