Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate TensorRT-LLM #358

Merged
merged 16 commits into from
Nov 15, 2023
Merged

Integrate TensorRT-LLM #358

merged 16 commits into from
Nov 15, 2023

Conversation

yunfeng-scale
Copy link
Contributor

@yunfeng-scale yunfeng-scale commented Nov 1, 2023

Integrating TensorRT-LLM with LLM engine. there are lots of caveats in this integration:

fixes #363

@yunfeng-scale yunfeng-scale requested a review from a team November 1, 2023 20:59
Copy link
Member

@yixu34 yixu34 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some minor comments.

Can we create a github issue for visibility and link it to this PR?

@yunfeng-scale yunfeng-scale enabled auto-merge (squash) November 13, 2023 22:56
@yunfeng-scale yunfeng-scale merged commit 4e2ea6c into main Nov 15, 2023
@yunfeng-scale yunfeng-scale deleted the yunfeng-trt-llm branch November 15, 2023 05:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Integrate TensorRT-LLM
2 participants