Building base models from scratch. Data curation, compute budgets, scaling laws (Kaplan, Chinchilla), distributed training, synthetic data, contamination.