Metrics or Callbacks?

callbacks
6

Thanks all for your help! Can these discussions be summed up as follows?

  1. Just return light-weighted objects, and not return heavy objects or your memory will use up quickly.
  2. Use TorchMetrics to compute metrics because it can sync data automatically.
  3. If metrics are self-implemented and computed by callbacks, it can be called by different process in distributed training which may lead to diffusion.
    ​