Model preparation
Techniques applied to a model before it is served: fine-tuning, quantization and distillation.
Techniques applied to a model before it is served: fine-tuning, quantization and distillation.
The pages in this section are listed below in the recommended reading order.
- LLM fine-tuning Understand when fine-tuning is the right tool, and what it means for serving.
- LLM quantization Reduce numeric precision to cut memory and increase throughput, and understand the accuracy cost.
- LLM distillation Train a smaller model to reproduce a larger one's behaviour on a target task.