Good day to all,
I am training a transformer on MLM and need to change masking on the dataset every 2 epochs.
What would be the proper way to do this?
Thanks!
Good day to all,
I am training a transformer on MLM and need to change masking on the dataset every 2 epochs.
What would be the proper way to do this?
Thanks!