Apple
Apple
Out of context: Reply #3551
- Started
- Last post
- 3,604 Responses
- zaq2
- https://www.apple.co…ideaist
- InNOvationutopian
- The configuration I need to run LLMs locally is > $6Kzaq
- @Innovation never sleeps, like @Utopian, eh?
; )ideaist - how the hell are you meant to do anything with 8GB memory. love my M1 Max but very easy to max out 64GB with LLMs or anything Adobekingsteven
- Doesn’t it handle memory in a totally different way where it doesn’t need as mi h?monospaced
- much? I’m still on their last intel model until next year.monospaced
- not in any practical sense. if you need 64GB of fast memory nothing else will do. there are some things it is genuinely terrible at...kingsteven
- i do push it hard though. i'm often editing 100GB mp4s without proxy or running some demanding process like AI or gif of the day on Chrome browserkingsteven
- my M1 is a supercomputer compared to any intel mbp though (i moved from an i9 hackintosh that would rival any intel mac pro to this as my main machine)kingsteven
- i broke a lot of my own rules by going for a first-gen mac too, would love to try one of these M3 to see if it would be a worthwhile upgrade.kingsteven
- but yeah i very much doubt any model <48GB would cut it for AE / LLMs / fine-tuning/ unproxied large video fileskingsteven