Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
steve_adams_86
on Sept 9, 2024
|
parent
|
context
|
favorite
| on:
Serving AI from the Basement – 192GB of VRAM Setup
I'm on an M2 max so I shouldn't be too far behind. I'm not actually sure how the model I'm using was quantized to be honest. I'll give it a try.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
