According to StanfordAILab, self play pretraining from random init shows predictable scaling on text, image, audio, and melodies.
Some results have been hidden because they may be inaccessible to you
Show inaccessible resultsSome results have been hidden because they may be inaccessible to you
Show inaccessible results