Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TensorRT doesn't find Loras from subdirectories #332

Open
Sana-A-E opened this issue Jun 14, 2024 · 2 comments
Open

TensorRT doesn't find Loras from subdirectories #332

Sana-A-E opened this issue Jun 14, 2024 · 2 comments

Comments

@Sana-A-E
Copy link

As mentioned in the title, when trying to convert Loras into TensorRT format via TensorRT tab, in the dropdown where one is supposed to select the Lora, only Loras from the models/Lora directory are available for selection, and none from the subdirectories under that directory.
Without directories for organization, Lora management becomes very inconvenient.

@Abishai2007
Copy link

Same issue here. Any fixes or workarounds?

@T9es
Copy link

T9es commented Jul 21, 2024

This issue was there from the start. You have several options, easiest: Create a backup of the lora/model files if you have the space, extract everything into the model/lora without any subdirectories.

The second is to modify the code. I haven't tried. Hopefully they update this soon enough with fixes. There's other issues like dots or spacebars being present in loRA names. This also breaks any export process.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants