Pampanga (pam) subword embeddings
| Vocab size | vocab | model | 25 dim | 50 dim | 100 dim | 200 dim | 300 dim |
|---|---|---|---|---|---|---|---|
| 1000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
| 3000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
| 5000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
| 10000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
| 25000 | vocab | model |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
txt |
bin
bokeh | umap | matrix |
Training corpus sample, encoded with different BPE vocabulary sizes
| Vocab size | pamwiki sample |
|---|---|
| original | * dwkt - 00.0 energy fm * dwtl - 00.0 campus radio * dwec - 00.0 mor for life! * dwid - 00.0 love radio * dwtj - 00.0 spirit fm (from alaminos city) * * alupidian * atabayan * bagacay * baguingin * bagumbayan * bangkal * bantud * barangay 0 (pob.) * barangay 0 (pob.) * barangay 0 (pob.) * barangay 0 nanan na ku man panaruan indu ku, e na ku apatuknang kikiak, uling para kanaku, ing kikiakan ku kasing timbang ne ning yatu , uling karing pago ku, pu |
| 1000 | ▁* ▁d w k t ▁- ▁00 . 0 ▁ en er g y ▁f m ▁* ▁d w t l ▁- ▁00 . 0 ▁c amp us ▁r ad io ▁* ▁d w ec ▁- ▁00 . 0 ▁m or ▁f or ▁l if e ! ▁* ▁d w id ▁- ▁00 . 0 ▁l ov e ▁r ad io ▁* ▁d w t j ▁- ▁00 . 0 ▁sp ir it ▁f m ▁( f ro m ▁al am in os ▁c ity ) ▁* ▁* ▁al up id ian ▁* ▁at ab ayan ▁* ▁b ag ac ay ▁* ▁b ag u ing in ▁* ▁b ag um b ayan ▁* ▁b ang k al ▁* ▁b ant ud ▁* ▁bar ang ay ▁0 ▁( pob .) ▁* ▁bar ang ay ▁0 ▁( pob .) ▁* ▁bar ang ay ▁0 ▁( pob .) ▁* ▁bar ang ay ▁0 ▁n an an ▁na ▁k u ▁man ▁pan ar uan ▁ind u ▁k u , ▁e ▁na ▁k u ▁a p at uk n ang ▁k ik i ak , ▁ ul ing ▁par a ▁kan ak u , ▁ing ▁k ik i akan ▁k u ▁k as ing ▁t im b ang ▁ne ▁ning ▁y at u ▁ , ▁ ul ing ▁kar ing ▁p ag o ▁k u , ▁p u |
| 3000 | ▁* ▁d w kt ▁- ▁00. 0 ▁ener gy ▁f m ▁* ▁d w t l ▁- ▁00. 0 ▁campus ▁rad io ▁* ▁d w ec ▁- ▁00. 0 ▁mor ▁for ▁life ! ▁* ▁d w id ▁- ▁00. 0 ▁l ov e ▁rad io ▁* ▁d w t j ▁- ▁00. 0 ▁sp ir it ▁f m ▁( f rom ▁al am in os ▁city ) ▁* ▁* ▁al up id ian ▁* ▁at ab ayan ▁* ▁bag ac ay ▁* ▁b agu ing in ▁* ▁bag umb ayan ▁* ▁bang kal ▁* ▁bant ud ▁* ▁barangay ▁0 ▁( pob .) ▁* ▁barangay ▁0 ▁( pob .) ▁* ▁barangay ▁0 ▁( pob .) ▁* ▁barangay ▁0 ▁n anan ▁na ▁ku ▁man ▁pan ar uan ▁ind u ▁ku , ▁e ▁na ▁ku ▁apat uknang ▁k ik i ak , ▁uling ▁para ▁kan ak u , ▁ing ▁k ik i akan ▁ku ▁kas ing ▁t imb ang ▁ne ▁ning ▁yatu ▁, ▁uling ▁karing ▁pag o ▁ku , ▁pu |
| 5000 | ▁* ▁d w kt ▁- ▁00.0 ▁ener gy ▁f m ▁* ▁d w t l ▁- ▁00.0 ▁campus ▁radio ▁* ▁d w ec ▁- ▁00.0 ▁mor ▁for ▁life ! ▁* ▁d w id ▁- ▁00.0 ▁love ▁radio ▁* ▁d w t j ▁- ▁00.0 ▁sp ir it ▁f m ▁( f rom ▁al amin os ▁city ) ▁* ▁* ▁al up id ian ▁* ▁at ab ayan ▁* ▁bag acay ▁* ▁bagu ing in ▁* ▁bagumb ayan ▁* ▁bang kal ▁* ▁bant ud ▁* ▁barangay ▁0 ▁( pob .) ▁* ▁barangay ▁0 ▁( pob .) ▁* ▁barangay ▁0 ▁( pob .) ▁* ▁barangay ▁0 ▁n anan ▁na ▁ku ▁man ▁pan ar uan ▁ind u ▁ku , ▁e ▁na ▁ku ▁apat uknang ▁k ik i ak , ▁uling ▁para ▁kan aku , ▁ing ▁k ik i akan ▁ku ▁kas ing ▁t imb ang ▁ne ▁ning ▁yatu ▁, ▁uling ▁karing ▁pag o ▁ku , ▁pu |
| 10000 | ▁* ▁d w kt ▁- ▁00.0 ▁energy ▁f m ▁* ▁d w t l ▁- ▁00.0 ▁campus ▁radio ▁* ▁d w ec ▁- ▁00.0 ▁mor ▁for ▁life ! ▁* ▁d w id ▁- ▁00.0 ▁love ▁radio ▁* ▁d w t j ▁- ▁00.0 ▁spir it ▁f m ▁( from ▁al amin os ▁city ) ▁* ▁* ▁al up idian ▁* ▁at ab ayan ▁* ▁bagacay ▁* ▁bagu ingin ▁* ▁bagumbayan ▁* ▁bang kal ▁* ▁bant ud ▁* ▁barangay ▁0 ▁( pob .) ▁* ▁barangay ▁0 ▁( pob .) ▁* ▁barangay ▁0 ▁( pob .) ▁* ▁barangay ▁0 ▁n anan ▁na ▁ku ▁man ▁panar uan ▁ind u ▁ku , ▁e ▁na ▁ku ▁apat uknang ▁k iki ak , ▁uling ▁para ▁kan aku , ▁ing ▁k iki akan ▁ku ▁kas ing ▁timb ang ▁ne ▁ning ▁yatu ▁, ▁uling ▁karing ▁pag o ▁ku , ▁pu |
| 25000 | ▁* ▁dw kt ▁- ▁00.0 ▁energy ▁fm ▁* ▁dw t l ▁- ▁00.0 ▁campus ▁radio ▁* ▁dw ec ▁- ▁00.0 ▁mor ▁for ▁life ! ▁* ▁d wid ▁- ▁00.0 ▁love ▁radio ▁* ▁dw t j ▁- ▁00.0 ▁spirit ▁fm ▁( from ▁alaminos ▁city ) ▁* ▁* ▁al up idian ▁* ▁at abayan ▁* ▁bagacay ▁* ▁bagu ingin ▁* ▁bagumbayan ▁* ▁bangkal ▁* ▁bant ud ▁* ▁barangay ▁0 ▁( pob .) ▁* ▁barangay ▁0 ▁( pob .) ▁* ▁barangay ▁0 ▁( pob .) ▁* ▁barangay ▁0 ▁nanan ▁na ▁ku ▁man ▁panar uan ▁indu ▁ku , ▁e ▁na ▁ku ▁apat uknang ▁k iki ak , ▁uling ▁para ▁kanaku , ▁ing ▁k iki akan ▁ku ▁kasing ▁timbang ▁ne ▁ning ▁yatu ▁, ▁uling ▁karing ▁pago ▁ku , ▁pu |