Domain Adaptation

Contrast SFT and continued pretraining when adapting a base model to medical text

Adding 500 domain tokens to the tokenizer: how do you initialise their embeddings?

Pick a LoRA rank for a domain task and justify why r=512 isn't a free upgrade