Loading models with huggingface Automodel.from_pretrained

I remember there is something called AutoModel.from_config that doesn’t download the model but still initializes with random weights thus avoids any download. Then you can simply use lightning load_from_checkpoint to load the trained weights.

1 Like