Skip to content
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

122 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MorphLing

This repository serves as the source code of MorphLing, our undergraduate thesis as BS Computer Science students of Batangas State University.

My Specific Contribution

I built the web visualization tool for the tokenizer behaviors (e.g., subword splitting) of SentencePiece Byte-Pair Encoding (BPE) and MorphLing.

About

A morphology-aware hybrid tokenizer for the Tagalog Language.

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages