Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add new bots #34

Closed
wants to merge 9 commits into from
Closed

Add new bots #34

Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
3cf5a8c
COUNTER_Robots_list.json: Add Typhoeus
alanorth Feb 25, 2020
e31936d
COUNTER_Robots_list.json: Add Citoid
alanorth Feb 25, 2020
4cde667
COUNTER_Robots_list.json: Add ecointernet
alanorth Feb 25, 2020
b9ad9ad
COUNTER_Robots_list.json: Add 7siters
alanorth Feb 25, 2020
3f0f811
COUNTER_Robots_list.json: Add sqlmap
alanorth Feb 25, 2020
743d354
COUNTER_Robots_list.json: Add Pattern
alanorth Feb 25, 2020
f4af260
COUNTER_Robots_list.json: Add GigablastOpenSource
alanorth Apr 30, 2020
165bc3c
COUNTER_Robots_list.json: Add OgScrper
alanorth Apr 30, 2020
4127ed8
COUNTER_Robots_list.json: Add Turnitin
alanorth Jul 1, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
47 changes: 47 additions & 0 deletions COUNTER_Robots_list.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -210,6 +210,11 @@
"pattern": "China\\sLocal\\sBrowse\\s2\\.6",
"last_changed": "2017-08-08"
},
{
"pattern": "Citoid",
"last_changed": "2020-02-25",
"url": "https://www.mediawiki.org/wiki/Citoid"
},
{
"pattern": "cloakDetect",
"last_changed": "2017-08-08"
Expand Down Expand Up @@ -333,6 +338,11 @@
"pattern": "EBSCO\\sEJS\\sContent\\sServer",
"last_changed": "2017-08-08"
},
{
"pattern": "ecointernet",
"last_changed": "2020-02-25",
"url": "https://ecointernet.org/"
},
{
"pattern": "ELinks\\/",
"last_changed": "2017-08-08"
Expand Down Expand Up @@ -435,6 +445,11 @@
"pattern": "geturl",
"last_changed": "2017-08-08"
},
{
"pattern": "GigablastOpenSource",
"last_changed": "2020-04-30",
"description": "https://github.com/gigablast/open-source-search-engine"
},
{
"pattern": "G-i-g-a-b-o-t",
"last_changed": "2018-02-15",
Expand Down Expand Up @@ -802,6 +817,11 @@
"pattern": "Offline(\\s|\\+)Navigator",
"last_changed": "2017-08-08"
},
{
"pattern": "OgScrper",
"last_changed": "2020-04-30",
"description": "Unknown scraper"
},
{
"pattern": "^okhttp$",
"last_changed": "2018-02-15",
Expand All @@ -828,6 +848,11 @@
"pattern": "parsijoo",
"last_changed": "2017-08-08"
},
{
"pattern": "^Pattern\\/\\d",
"last_changed": "2020-02-25",
"url": "https://www.clips.uantwerpen.be/pattern"
},
{
"pattern": "Pcore-HTTP",
"last_changed": "2019-11-19"
Expand Down Expand Up @@ -969,6 +994,11 @@
"pattern": "speedy",
"last_changed": "2017-08-08"
},
{
"pattern": "sqlmap",
"last_changed": "2020-02-25",
"url": "https://github.com/sqlmapproject/sqlmap"
},
{
"pattern": "Strider",
"last_changed": "2017-08-08"
Expand Down Expand Up @@ -1018,10 +1048,21 @@
"pattern": "Trove",
"last_changed": "2017-08-08"
},
{
"pattern": "Turnitin",
"last_changed": "2020-07-01",
"description": "This robot collects content from the Internet for the sole purpose of helping educational institutions prevent plagiarism.",
"url": "https://turnitin.com/robot/crawlerinfo.html"
},
{
"pattern": "twiceler",
"last_changed": "2017-08-08"
},
{
"pattern": "Typhoeus",
"last_changed": "2020-02-25",
"url": "https://github.com/typhoeus/typhoeus"
},
{
"pattern": "ucsd",
"last_changed": "2017-08-08"
Expand Down Expand Up @@ -1194,5 +1235,11 @@
{
"pattern": "zyborg",
"last_changed": "2017-08-08"
},
{
"pattern": "7siters",
"last_changed": "2020-02-25",
"url": "https://7ooo.ru/siters"
}

]