Skip to content

Commit 01aba5a

Browse files
authored
Update README.md
1 parent 0274ac5 commit 01aba5a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Effect of Optimizer Selection and Hyperparameter Tuning on Training Efficiency and LLM Performance
22

3-
**Paper:** [Optimizer Inclusions](paper/optimizer_inclusions.pdf)
3+
**Paper:** [Effect of Optimizer Selection and Hyperparameter Tuning on Training Efficiency and LLM Performance](paper/optimizer_inclusions.pdf)
44

55
- The choice of optimization algorithm for training Large Language Models (LLMs) significantly impacts both training speed and final predictive performance. We demonstrate the critical importance of hyperparameter tuning protocols in optimizer comparisons for LLMs. Our work reveals that inclusion relationships between optimizers play a crucial role in practice and consistently predict optimizer performance.
66

0 commit comments

Comments
 (0)