`.detach()` cannot stop backprop in `training_step`

[wusuowei60]

Oh that’s also pretty neat. I had thought the subclass’s toggle_optimizer would be more complex than just pass.

and yeah, I’m using manual optimization and it works well.

Thank you again for timely and helpful reply.