AI & Technical

Fine-Tuning

Training an existing AI model on domain-specific data to improve its performance.

Fine-tuning is the process of continuing to train a pre-trained LLM on a curated dataset specific to your domain, product, or tone. It can make the model more accurate for specialised topics and more consistent in its persona. However, fine-tuning is expensive, requires labelled data, and needs to be repeated when the base model is updated. For most website chat agent use cases, well-crafted system prompts and RAG achieve better results than fine-tuning at a fraction of the cost.

Related Terms