Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

If I just want to play with this as a toy without any performance considerations, is it possible to run this on a CPU only? Or do I need to faf about with getting CUDA and that nonsense running?


You probably want to check this port : https://github.com/ggerganov/whisper.cpp


That indeed seems perfect.


Yes, it runs well enough on CPU. https://modal-labs-whisper-pod-transcriber-fastapi-app.modal... runs on CPU, and chunks up podcast audio to parallelize over dozens of CPUs.


It’ll run on CPU in decent time, it’ll also depend on the kind of cpu you have and the model you pick. In my m1, the base model can do 5-10s in about as long.

I uploaded it to a hugging face space if you just want to fiddle with it without installing

https://huggingface.co/spaces/jerpint/babelfish


Yes, it runs fine on your computer.




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: