somoene make me a code to pretrain a model from scratch on a gpu t4 google colab

<!-- SC_OFF --><div class="md"><p>I use a gpu t4 google colab for pretraining from scratch, but that can handle up to ~300-400m params. If somoene has multi gpus pls train , after

<!-- SC_OFF --><div class="md"><p>Well, alright, i want ~100M parameters . on a NVIDIA L4 (24GB VRAM)</p> <p>. any good dataset (and quanity of tokens ) to pretrain ?</p>

<!-- SC_OFF --><div class="md"><p>Trying to auto categorize a former employees photos from personal and work related. It’s a lot of photos and I don’t want the guy to loose

<!-- SC_OFF --><div class="md"><p>so recently i got to know that we can use vscode terimal + claude code + ollama models<br /> and i tried doing that it was great but im running