training
Pre-training, post-training, RLHF and related methods
Topics
- Large language modelsA large language model (LLM) is a neural network trained to predict the next token in a sequence of text. Trained on a huge corpus and then tuned to follow instructions, that one skill turns into…
- Training and fine-tuningLLMs are built in stages. Pre-training gives broad knowledge and language skill; post-training turns the result into a helpful, safe assistant. Fine-tuning adapts a trained model further for a…
Sources
- LoRA: Low-Rank Adaptation of Large Language Modelspaper · Hu et al. (Microsoft) · 17 June 2021
- Training language models to follow instructions with human feedbackpaper · Ouyang et al. (OpenAI) · 4 March 2022