FAQ on feedback_settings.yaml

What is feedback_settings.yaml ?

That is a optional yaml configuration used for generating feedback(s) and determine sucess/failure of the task.

What does it contain ?

Key	Default value	Description
quorum	1.0	float between 0.0 (0%) and 1.0 (100%) that the user should reach in order to success the task
has_feedback	false	true If we expected something on stdout (generated by the Runner). Else it is a pass/fail task
feedback_kind	None	any of these string values ("JavaGrading", "JaCoCo"). Useful only when you have has_feedback=True
coverage_stats	None	Sequences of string. Possible values are "INSTRUCTION", "BRANCH", "LINE", "METHOD", "CLASS" ) (check out more in https://www.eclemma.org/jacoco/trunk/doc/counters.html )
prohibited	{}	Map that has "problem id" as key and sequences of strings as values

Warning: IF feedback_kind == "JaCoCo" THEN YOU MUST HAVE A FLAVOUR FOLDER.

Example ?

has_feedback: true
quorum: 0.7
feedback_kind: JaCoCo
coverage_stats:
  - INSTRUCTION
  - BRANCH
prohibited:
  "some_problem_id":
     - System.arraycopy 
  "other_problem_id":
     - System.arraycopy