M5 Ultra Mac 256GB Studio - 64 core vs. 80 core version, is the inference speed difference worth the extra 10 weeks wait time?
I’m seeing 6-7 week delivery wait time for M5 Ultra Mac Studio 64 core version versus 15-17 weeks for 80 core version.
Proof1 community thread
Key points
- They both Ultra and have the same memory bandwidth.
- Is the speed difference that noticeable for prompt processing and token generation?
- Is it worth the $1200 price difference and extra 10 weeks wait time?
- I don’t think I’ve seen inference stats for the 60 core version from anyone.
Sources (1)
- [1]M5 Ultra Mac 256GB Studio - 64 core vs. 80 core version, is the inference speed difference worth the extra 10 weeks wait time?r/LocalLLaMA (top, daily) · Oct 11, 02:46 AM
I’m seeing 6-7 week delivery wait time for M5 Ultra Mac Studio 64 core version versus 15-17 weeks for 80 core version.
They both Ultra and have the same memory bandwidth.
Extractive summary: sentences quoted from the sources.