Help With Choosing Hardware [P]
I am going to fine-tune a satire model, with the base model being Qwen3.5-14B-Base.
Key points
- The dataset has ~18000 examples, most of which are pretty long and do not align with the model's internal knowledge (they have incorrect answers to facts), so I needed to do a full fine tune rather than use LoRA.
- Today, I rented a cloud computer on vast.ai.
- It had 4x12GB GPUs and 48GB of system RAM, but I feel stupid because it kept running out of memory when I tried training, and I kept trying to change settings rather than just renting a different computer, so I basically wasted $3.
- So, I would like to know if any of you have some recommendations for proper hardware to use.
Sources (1)
- [1]Help With Choosing Hardware [P]r/MachineLearning (top, daily) · Oct 10, 08:00 AM
I am going to fine-tune a satire model, with the base model being `Qwen3.5-14B-Base`.
The dataset has ~18000 examples, most of which are pretty long and do not align with the model's internal knowledge (they have incorrect answers to facts), so I needed to do a full fine tune rather than use LoRA.
Extractive summary: sentences quoted from the sources.