Artificial Intelligence Asked by MonkeyDLuffy on August 24, 2021
I’m working on recognizing the numbers 3 and 7 using the MNIST data set. I’m using cnn_learner()
function from fastai library.
When I plotted the learning rate, the curve started going backward after a certain value on X-axis. Can someone please explain what does it signify?
I have not used fastai library but this also happens on tensorboard when you have more than one training being recorded on the same plot.
Looking at the picture, I think this is a very special type of graph because for a single LR value you have 2 loss values associated. Put in other words, you have the same LR value for different loss values. My guess it that some time-dependent issue is messing things here.
Another intuition that may help to solve the issue is representing data differently. If you rotate the graph 90º left-wise you could see how the LR is evolving with different loss values. LR should be decreasing along with loss value, but in this case it is not like that either. So review how you are setting the LR too!
My list of to-check would be:
Hope it helps
Correct answer by JVGD on August 24, 2021
Get help from others!
Recent Questions
Recent Answers
© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP