You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hey @elegast-me! I'm here to help you with any bugs, questions, or contributions you might have. Let's get this issue sorted out together!
Blinko has error handling and logging implemented in the AiStore class, which might help diagnose why the model is not unloading. Specifically, the completionsStream and writeStream methods log errors that occur during their execution. If an error occurs in completionsStream and it is not an "interrupted" error, it logs the error message using RootStore.Get(ToastPlugin).error(error.message). Similarly, in the writeStream method, errors are logged to the console with console.log('writeStream error', error). Checking these logs might provide insights into the issue [1].
Describe the bug
even though OLLAMA_KEEP_ALIVE is set to 0. Blinko seems to keep the model in memory whenever any ai request is made.
To Reproduce
Steps to reproduce the behavior:
any ai request keeps model in memory even when ollama_keep_alive is set to 0 in system env.
Desktop (please complete the following information):
The text was updated successfully, but these errors were encountered: