ross/test-model-thing
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

test model thing, finally

Browse source
This commit is contained in:
jrz97619761 2026-08-12 16:11:30 +08:00
commit 2f70e5f3bf
5 changed files with 326 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

11
README.md Normal file
View file

@ -0,0 +1,11 @@
Hey! Thanks for being here.
Here's the video, if you came here from somewhere else -> [Video](https://example.com)
The semi-trained 4.5m model (it's not done, but also it's in millions of parameters, not billions) is available for you to use. So are the train and benchmark scripts (using MLX, but you can port to other platforms if you want).
However a larger 130m model is not provided, it is too large for GitHub to store. You can train it yourself and perhaps share it on a cloud storage provider instead.
Note that datasets are not included, and if you use a non-puretext dataset like wikipedia dump then feel free to write your own dataset extraction code or use an existing library.
The repo is MIT license, so feel free to fork the repo, I would be very happy to see that. Go ahead and explore!