Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Support Roberta model #124

Closed
esnvidia opened this issue Oct 25, 2023 · 3 comments
Closed

[FEA] Support Roberta model #124

esnvidia opened this issue Oct 25, 2023 · 3 comments
Assignees
Labels
feature request New feature or request new model triaged Issue has been triaged by maintainers

Comments

@esnvidia
Copy link

As title suggests, support the HF Roberta model with the pretrained weights here: https://huggingface.co/roberta-large

@jdemouth-nvidia
Copy link
Collaborator

Hi @esnvidia ,

Thanks for the suggestion. We will add it to the list of feature requests. Not sure if/when we will have time to implement it but we will keep it in mind.

Thanks,
Julien

@jdemouth-nvidia jdemouth-nvidia added the feature request New feature or request label Oct 25, 2023
@juney-nvidia juney-nvidia added the triaged Issue has been triaged by maintainers label Oct 25, 2023
@AdamzNV
Copy link
Collaborator

AdamzNV commented Oct 31, 2024

As more and more new models enter the market, we have prepared comprehensive instructions for TRT-LLM developers on adapting to new models of interest. We encourage our community developers to expand the range of supported models, fostering an open ecosystem with rapid iterations.

Please try following these instructions and let us know if you encounter any issues during the adaptation process. We greatly appreciate your dedication.

@nv-guomingz
Copy link
Collaborator

This model had been supported in Tensorrt-llm https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/bert/build.py#L101

please feel free to reopen this ticket if needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request new model triaged Issue has been triaged by maintainers
Projects
None yet
Development

No branches or pull requests

7 participants