thanks for the feedback. genuinely curious what you think we could be doing better, especially around our dev practices. Would love to hear specifics.

Didn't yall have a release of a package that stole user keys or such?

Maybe this has improved since I last used it, but I was dismayed at not being able to do something like:

    litellm.register("foo", CustomAIProvider)
    litellm.do_whatever("foo/my-cool-model", "what is 2+2")

also if you had resource issues with your production deployment, keen to hear more details

I don't have specifics since it's been months, but LiteLLM on a hetzner server, deployed through Coolify was using 1-4 GB (cannot exactly, and dont know why either).

Bifrost feels very light, though.

Will try LiteLLM if it's in Rust.

Would also appreciate a slicker aesthetic. I got used to Bifrost shadcn with 0 border radius.

- We recently migrated to shadcn, which also comes with dark mode support. - You can subscribe to the issue or email me at yujong at berri.ai

I’m happy to provide any support if you’re willing to try out the initial version.

hey - litellm will migrate its core to Rust soon. please follow this issue if you're interested! https://github.com/BerriAI/litellm/issues/31263

cool! we have something similar implemented: https://github.com/fastrepl/anarlog/tree/main/crates/owhispe...

looks cool, checking it out!

amazing work! impressed with https://deepgrove.ai/chat

there is some overlap on how I built relay plugin: https://yujonglee.com/blog/hacking-tauri-for-designer/

Source code: https://github.com/fastrepl/anarlog/tree/d38413681a3c02f5ba3...

fyi this use vendored openrouter models info:

https://github.com/yujonglee/openrouter-toolkit/blob/main/cr...

Super impressed and inspired!

kind of self-plug, but you might find https://github.com/fastrepl/hyprnote/blob/main/README.md interesting.

EDIT: typo

It can run Whisper and Moonshine models locally, while also allowing the use of other API providers. Read the docs - or at least this post.

I would want such information accessible without having to go hunt for it. You could improve your presentation by interposing fewer clicks between a reader and the thing they want to know.

The information is readily available in the open-your-eyes section.

> I would want such information accessible without having to go hunt for it.

Where exactly, if not in the FM?