-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Improvement] Speedup AVATest #784
Conversation
Codecov Report
@@ Coverage Diff @@
## master #784 +/- ##
==========================================
- Coverage 85.37% 85.16% -0.21%
==========================================
Files 130 130
Lines 9401 9413 +12
Branches 1580 1589 +9
==========================================
- Hits 8026 8017 -9
- Misses 970 997 +27
+ Partials 405 399 -6
Flags with carried forward coverage won't be shown. Click here to find out more.
Continue to review full report at Codecov.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
And test it on LFB, the computing time reduced to 120.4 seconds
Speed up reading csv and adding ground-truth info during ava testing.
We also remove the difficult & group flags, which are not used in ava evaluation.
The evaluation results are exactly the same.
Old (7m 52s):
==> 1.55786 seconds to Reading detection results
==> 34.0824 seconds to Reading detection results
==> 52.8981 seconds to Convert groundtruth
==> 366.015 seconds to convert detections
==> 17.5152 seconds to run_evaluator
New (5m 58s):
==> 1.38209 seconds to Reading detection results
==> 28.1567 seconds to Reading detection results
==> 0.860567 seconds to Convert groundtruth
==> 310.64 seconds to convert detections
==> 17.4251 seconds to run_evaluator
Another way to speed up testing is to increase the action_thr in test_cfg, for example, increasing it from 0.00 to 0.002 can shorten the test time by 2mins, with no performance drop (exactly the same performance):
action_thr 0.002 (4m 51s):
==> 1.41658 seconds to Reading detection results
==> 20.2866 seconds to Reading detection results
==> 0.792911 seconds to Convert groundtruth
==> 254.963 seconds to convert detections
==> 13.6164 seconds to run_evaluato