Minimal fabric project with config file, resume and experiment tracker?


I am new to fabric and would like to start a new project with some example code. I noticed the official example, but would like to have one with more features (config file, resume, experiment tracker, etc…).

Could you point out one? Thanks

Hey there

One example I can give is from our Lit-GPT repository, it uses Fabric everywhere. Here is an example script that uses a lot of different features, including experiment tracking (TB or WandB):

It also also has all the logic to properly resume training from any checkpoint. I am confident that you can take a lot of this and just apply it to your setting very easily.

Let me know how it goes.

Happy holidays

Thank you for pointing this project. It is very helpful!

1 Like