Skip to content
This repository has been archived by the owner on Nov 6, 2023. It is now read-only.

Fetch Test: Completely Disabled Rulesets #19339

Merged
merged 62 commits into from
Oct 16, 2020

Conversation

zoracon
Copy link
Contributor

@zoracon zoracon commented Jun 10, 2020

Date ran: 2020-04-17
Rulesets with all hosts that are nonfunctional in ways defined by check_rules.py were completely disabled.

Logic: (If all hosts nonfunctional, disable)

Fetch Test Rubric: #18866

Thinking
I wanted to clear out completely disabled rulesets first before moving on to round 2. That way we can make a more sane path of patching rules.

If for some reason that seems too intense, please consider the amount of hosts we load that are nonfunctional and weigh what outcomes are best for our users and load.

I am aware of issues #19034 and #19330 and want to amend these before moving to round two..

Attachments

Let me know if you have issues with this link - Just click "continue to view" if it prompts you to login

Comments for review

  • The adjusted rulesets are from the effects of having dangling references and then since they were touched, being run through proper coverage themselves. I wanted this PR to be just about those fully disabled but that's not possible with strict testing structure we have to prevent coverage problems in testing.

zoracon and others added 30 commits May 6, 2019 15:30
- Related files had references to the deleted batch
- Some of these files were also ran with the round 1 fetch test and reflect those changes
- Resulting test coverage from round 1 of fetch test
- Resulting from fetch test round 1
@zoracon zoracon changed the title Fetch Test Round 1: Completely Disabled Rulesets Fetch Test: Completely Disabled Rulesets Oct 16, 2020
@zoracon zoracon marked this pull request as ready for review October 16, 2020 22:28
@zoracon
Copy link
Contributor Author

zoracon commented Oct 16, 2020

Merging in this batch to wrap up this portion the work and running a ruleset release (Monday) to end this segment and have the rulesets reflect the changes.

With this portion of changes, it's become apparent the fetch errors will be persistent with each push no matter how many times I run it consecutively, which means I will definitely not do these fetch tests the same way as prior years and the way it was run in April. I plan to make some amendments to check_rules.py before running it again for smaller batches of rulesets. But completely disabled rulesets here should be cleaned up at the very least.

@zoracon zoracon merged commit 6994892 into EFForg:master Oct 16, 2020
@zoracon zoracon deleted the fetch-test-batch-deletion branch October 16, 2020 23:29
@J0WI
Copy link
Contributor

J0WI commented Oct 17, 2020

Thank you for working on this! 🎉

@zoracon
Copy link
Contributor Author

zoracon commented Oct 19, 2020

Thank you for working on this!

And thank you for the feedback!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants