Questions about the loss curve in the image.
#1
by FlameF0X - opened
The loss curve looks like a wild ride. How does the model perform? Or did you got at least any other telemetry from the model?
Yeah... I realized that I had 4 data loaders, and they loaded the same data, so it was just loading the same data 4 times in a row. I plan to release another version soon. :)
I was also very confused about the loss 🤣
Lol.
It could be worse. Like for the model to collapse.
If you read yesterdays blog, Sonnet did. (25% -> 0% training)
And it did again today. Don't know whats wrong lol
Oh. Damn.
Well, i hope you would manage to fix the issue.
Good luck training your chess models 🔥
CompactAI changed discussion status to closed
Thanks!