This is just a custom workflow engine, but for sth like that you could have used any of the existing ones and given it to agents. Stuff like, Temporal, Erandril have a durable workflow solution build on pg only as well, or windmill/airflow depending on how you look at it. But without the nice ui given by these tools.
AFAIK any app can opt out of VPN by binding to the wifi/cellphone interface directly, bypassing the OS's routing tables. You need to enable "block connections without VPN" to prevent any leaks.
On my m5 max 27b model does 75tps on 256k ctx and starts at 80 on the 8k ctx when you add https://huggingface.co/collections/z-lab/dflash-2 to it. So yeah base might be 30tps (I used iq4) but mtp or dflash help a lot and should be used when checking what is useful and what is not for running models as it is not fare to judge without them.
This looms nice and I starred but you just want actors and there are other options for that you might want to compare, I like rika actors, or temporal (not actors exactly but durable state and workflows). This is a space where a few very similar technologies after looked from different lenses sell themselves widely differently. So if you know what you want and the names of the things you are searching for you can get a thing that looks 90% like te rest, sorry a bit rambly. But yeah it would be nice to add some comparisons against these technologies as well.
reply