Model and Dataset Size Selection

[vishalbakshi]

Do #13 first.

• Test the best possible models (that we can fit on our hardware) on the best possible datasets. e.g. original paper used Llama2, we want to use Llama3-based models.
• Do a quick ablation between LoRA Learns Less and Forgets Less dataset for math and FineMath (sp?).