Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You need terabytes of memory to run a frontier class model


I wonder, if you can run at 8k or 15k t/s, you could in theory run 10 or 20 agents (or more) at the same time and generate hundreds of versions, then just analyze them. Think thinking mode x1000 at least... Would be interesting to see how good it would be


If you look closely, 80% of those terabytes of memory is stationary model weights.




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: