> (ones you run on beefy 128GB+ RAM machines) PC or Mac? A PC, ya, no way, not w... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		seanmcdirmid 25 days ago \| parent \| context \| favorite \| on: Claude Code: connect to a local model when your qu... > (ones you run on beefy 128GB+ RAM machines) PC or Mac? A PC, ya, no way, not without beefy GPUs with lots of VRAM. A mac? Depends on the CPU, an M3 Ultra with 128GB of unified RAM is going to get closer, at least. You can have decent experiences with a Max CPU + 64GB of unified RAM (well, that's my setup at least).

QuantumNomad_ 25 days ago [–]

Which models do you use, and how do you run them?

seanmcdirmid 24 days ago | [–]

I have a M3 max 64GB.

For VS Code code completion in Continue using a Qwen3-coder 7b model. For CLI work Qwen coder 32b for sidebar. 8 bit quant for both.

I need to take a look at Qwen3-coder-next, it is supposed to have made things much faster with a larger model.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact