Introducing Lit-GPT: Hackable implementation of open-source large language models released under Apache 2.0 →

Category: Articles

Optimizing LLMs from a Dataset Perspective
When to Use PyTorch Lightning or Lightning Fabric
The NeurIPS 2023 LLM Efficiency Challenge Starter Guide
TorchMetrics — a short history to 100+ metrics
Efficient Initialization of Large Models
Finetuning Falcon LLMs More Efficiently With LoRA and Adapters
Falcon – A guide to finetune and inference
Accelerating Large Language Models with Mixed-Precision Techniques
Parameter-Efficient LLM Finetuning With Low-Rank Adaptation (LoRA)
llama-adapter pseudo-code
Understanding Parameter-Efficient Finetuning of Large Language Models: From Prefix Tuning to LLaMA-Adapters