you can set save_weights_only=True in ModelCheckpoint which will save the hparams and model.state_dict().
https://pytorch-lightning.readthedocs.io/en/latest/generated/pytorch_lightning.callbacks.ModelCheckpoint.html#pytorch_lightning.callbacks.ModelCheckpoint