Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Definition of "Real Motion" #46

Open
bring-nirachornkul opened this issue Dec 31, 2024 · 0 comments
Open

Definition of "Real Motion" #46

bring-nirachornkul opened this issue Dec 31, 2024 · 0 comments

Comments

@bring-nirachornkul
Copy link

Dear team,

Thank you for your excellent work on "Generating Diverse and Natural 3D Human Motions from Text." I have a question regarding the term "real motion", as mentioned in Section 5.1.2 Quantitative Evaluation:

real motion

"The high R precision of real motions evidences the reliability of the proposed R-precision metric, which sets an upper performance limit for all methods."

You describe real motion as setting an upper performance limit for the R-precision metric but do not explicitly define it in the paper. Could you clarify:

  1. Does "real motion" refer to the ground-truth 3D motion data from the HumanML3D and KIT-ML datasets?
  2. How exactly is this real motion data used in the evaluation, particularly in the R-precision setup?
  3. If real motion represents the ground truth and is expected to serve as the benchmark for comparison, how does it achieve a score of 0.511 (Top-1) in the HumanML3D evaluation table? Shouldn't the ground truth ideally achieve a perfect R-precision score since it directly corresponds to the text descriptions?

Screenshot 2024-12-31 125719

Thank you for your time and for addressing these questions. I look forward to your clarification!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant