dspace/config: add new bot user agents to ILRI override

Some of these are also submitted upstream to COUNTER-Robots. The rest are minor and not worth submitting. See: atmire/COUNTER-Robots#52
ilri · Mar 4, 2022 · 4aa1695 · 4aa1695
1 parent 9345e8d
commit 4aa1695
Showing 1 changed file with 10 additions and 0 deletions.
diff --git a/dspace/config/spiders/agents/ilri b/dspace/config/spiders/agents/ilri
@@ -24,3 +24,13 @@ qbhttp
 ^colly
 article-parser
 1science
+axios\/\d
+Faveeo\/\d
+Moreover\/\d
+Nutraspace\/Nutch
+Exploratodo\/\d
+GroupHigh\/\d
+Crowsnest\/\d
+metha\/\d
+ZoteroTranslationServer
+FullStoryBot