Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PyTorch] add cuDNN acceleration #1592

Merged
merged 1 commit into from
Apr 21, 2022

Conversation

lanking520
Copy link
Contributor

Description

Inspired from PyTorch performance tuning thread: https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html#enable-cudnn-auto-tuner

Adding for Resnet and YOLO V5 related model speed up with this flag

@codecov-commenter
Copy link

Codecov Report

Merging #1592 (c667f67) into master (bb5073f) will decrease coverage by 1.23%.
The diff coverage is 60.41%.

@@             Coverage Diff              @@
##             master    #1592      +/-   ##
============================================
- Coverage     72.08%   70.85%   -1.24%     
- Complexity     5126     5400     +274     
============================================
  Files           473      504      +31     
  Lines         21970    23612    +1642     
  Branches       2351     2567     +216     
============================================
+ Hits          15838    16731     +893     
- Misses         4925     5602     +677     
- Partials       1207     1279      +72     
Impacted Files Coverage Δ
api/src/main/java/ai/djl/modality/cv/Image.java 69.23% <ø> (-4.11%) ⬇️
...i/djl/modality/cv/translator/BigGANTranslator.java 21.42% <ø> (-5.24%) ⬇️
...odality/cv/translator/BigGANTranslatorFactory.java 33.33% <0.00%> (+8.33%) ⬆️
...nslator/InstanceSegmentationTranslatorFactory.java 14.28% <0.00%> (-3.90%) ⬇️
.../modality/cv/translator/YoloTranslatorFactory.java 8.33% <0.00%> (-1.67%) ⬇️
...i/djl/modality/cv/translator/YoloV5Translator.java 5.69% <0.00%> (ø)
...odality/cv/translator/YoloV5TranslatorFactory.java 8.33% <0.00%> (-1.67%) ⬇️
...pi/src/main/java/ai/djl/ndarray/BytesSupplier.java 54.54% <0.00%> (-12.13%) ⬇️
...ain/java/ai/djl/ndarray/index/dim/NDIndexPick.java 100.00% <ø> (ø)
api/src/main/java/ai/djl/nn/Blocks.java 75.00% <0.00%> (-25.00%) ⬇️
... and 235 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bbdcbf7...c667f67. Read the comment docs.

@lanking520 lanking520 merged commit 109c9b4 into deepjavalibrary:master Apr 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants