On the GitHub issue, you mentioned that you want to use a labeled dataset on an epoch and other unlabeled dataset on another epoch. If this is what you meant, then I am not sure how are you going to introduce the loss with the unlabeled dataset in the first epoch and the same with the other dataset in the second epoch.