Introducing Lit-GPT: Hackable implementation of open-source large language models released under Apache 2.0 →

Category: Articles

Optimizing LLMs from a Dataset Perspective

When to Use PyTorch Lightning or Lightning Fabric

The NeurIPS 2023 LLM Efficiency Challenge Starter Guide

TorchMetrics — a short history to 100+ metrics

Efficient Initialization of Large Models

Finetuning Falcon LLMs More Efficiently With LoRA and Adapters

Falcon – A guide to finetune and inference

Accelerating Large Language Models with Mixed-Precision Techniques

Parameter-Efficient LLM Finetuning With Low-Rank Adaptation (LoRA)

llama-adapter pseudo-code

Understanding Parameter-Efficient Finetuning of Large Language Models: From Prefix Tuning to LLaMA-Adapters

1
2
»