I think this would work better as a discussion post than an issue, but I got an LLM to make/train a 1e6 parameter transformer for out of vocabulary words. Try it on GitHub Pages. Funny enough, it doesn't get its example word correct unless you hyphenate it to anti-gravity.
I think this would work better as a discussion post than an issue, but I got an LLM to make/train a 1e6 parameter transformer for out of vocabulary words. Try it on GitHub Pages. Funny enough, it doesn't get its example word correct unless you hyphenate it to
anti-gravity.