It tooks a long time before starting per epoch

I have same codes on linux server and local windows computer. On my windows, it tooks a very long time (about 30 seconds) to prepare to start on epoch. However, the same code runs well on the linux server.
Here is :
windows: 3090ti, pytorch2.0.0+cu118, lightning2.0.2.
linux server: 3090, pytorch2.0.0+cu118, lightning2.0.1