Skip to content

Empty weights for MCQ #12547

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
jasonqiu212 opened this issue Aug 5, 2023 · 13 comments · May be fixed by #13282
Open

Empty weights for MCQ #12547

jasonqiu212 opened this issue Aug 5, 2023 · 13 comments · May be fixed by #13282
Labels
help wanted Moderate difficulty, small localized change; suitable for novice contributors p.Medium Marginal impact; would like to do if time permits

Comments

@jasonqiu212
Copy link
Contributor

jasonqiu212 commented Aug 5, 2023 •
edited
Loading

V8.28.1

Description

With reference to #12544, it is possible to add empty weights (i.e. Leave the input box for weight empty) for rubric questions. The issue demonstrates that empty weights can be a valid feature. They can be used for:

  • Rubric options that do not have a suitable numerical weight
  • Rubric options that the user does not want to be calculated in the average weight statistics

Weights are also present in MCQ (single answer) and MCQ (multiple answers). However, both question types currently do not allow users to save with empty weights:

Screen Shot 2023-08-05 at 10 58 25 PM
Screen Shot 2023-08-05 at 10 59 00 PM
Screen Shot 2023-08-05 at 10 58 25 PM copy

Should empty weights be allowed for MCQ (single answer) and MCQ (multiple answers) too? Here's a possible use case:

  • Question: "Do you think this class is helpful?" with the options of:
    • Not enough information to evaluate
    • Disagree
    • Agree

It's difficult to assign a numerical weight to the 1st option.

Suggested Solution

  • You may wish to refer to [#12544] Rubric Question Statistics: Handle empty weights #12545
    • Use - to represent empty weights
    • Skip over empty weight values when calculating average weight
      • Edge case: All options have empty weights -> Average/total cannot be calculated -> Represented by -
    • Add explanation on usage of empty weights
@jasonqiu212 jasonqiu212 added the s.ToDiscuss The issue/PR is undergoing discussion/review by the core team label Aug 5, 2023
@damithc
Copy link
Contributor

damithc commented Aug 5, 2023

Should empty weights be allowed for MCQ (single answer) and MCQ (multiple answers) too? Here's a possible use case:

  • Question: "Do you think this class is helpful?" with the options of:

    • Not enough information to evaluate
    • Disagree
    • Agree

It's difficult to assign a numerical weight to the 1st option.

@jasonqiu212 Yes, I think this is a legit use case.

@github-actions github-actions bot mentioned this issue Aug 5, 2023
Open
@jasonqiu212 jasonqiu212 added p.Medium Marginal impact; would like to do if time permits help wanted Moderate difficulty, small localized change; suitable for novice contributors and removed s.ToDiscuss The issue/PR is undergoing discussion/review by the core team labels Aug 20, 2023
@pkwangjoo
Copy link

Hi! can I work on this issue?

@jasonqiu212
Copy link
Contributor Author

Hi @pkwangjoo, Sure thing! Feel free to submit a PR for this issue.

@RohithSurya
Copy link
Contributor

Hi Guys!! I would like to work on the issue if no one's working

@pkwangjoo
Copy link

Hi Guys!! I would like to work on the issue if no one's working

Hi @RohithSurya I am currently working on this issue:)

@RohithSurya
Copy link
Contributor

Ohh okay, thats fine.. I will find another issue to work on!

@dlimyy
Copy link
Contributor

dlimyy commented Oct 2, 2023

Hi, may I check if this issue is currently still being worked on by anyone as I would like to give this issue a try. Thanks!

@jasonqiu212
Copy link
Contributor Author

Hi @dlimyy, Feel free to submit a PR for this issue :)

@u7229988-Rabie
Copy link

Hi, can I work on this issue if no one is working on it? Can I be assigned to this issue? Thanks

@dlimyy
Copy link
Contributor

dlimyy commented Oct 18, 2023 •
edited
Loading

Hi @u7229988-Rabie , I am no longer working on it so you may work on it if no one else is working on it

@090997
Copy link

090997 commented Oct 21, 2023

Hi, I am interest on this issue. Can I work for this? @jasonqiu212

@itstrueitstrueitsrealitsreal
Copy link
Contributor

Interested in this issue, would like to work on it.

@SamGreenwood04
Copy link

Hi, I am interested in working on this issue! However, I am wondering if this has already been completed in #12544?

@peasantbird peasantbird linked a pull request Mar 24, 2025 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
help wanted Moderate difficulty, small localized change; suitable for novice contributors p.Medium Marginal impact; would like to do if time permits
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[#12547] Empty weights for MCQ peasantbird/teammates
9 participants
@damithc @jasonqiu212 @RohithSurya @pkwangjoo @dlimyy @itstrueitstrueitsrealitsreal @090997 @u7229988-Rabie @SamGreenwood04