Fine-tune network, how to set up?

implementation help
1

Hi,
I have trained my network on a certain type of data and I have the checkpoint.
however I want to fine-tune it on another dataset now (out-of-domain).
I have load the checkpoint like below and set up the trainer:

model.load_from_checkpoint(checkpoint);

However, it seems that it doesn’t train as I can’t see the training loss, but only the validation loss.
Thanks in advance!

2

can you explain more on this? doesn’t it train when you call trainer.fit?

Also, we have moved the discussions to GitHub Discussions. You might want to check that out instead to get a quick response. The forums will be marked read-only after some time.

Thank you

3

Hi,
I found the solution,
instead of doing:
model = ModelClass()
model.load_from_checkpoint
it should be
model = ModelClass.load_from_checkpoint(file_path_to_checkpoint)

1 Like