projects
/
infodrom.org
/
www.zeitungsliste.de
/ history
commit
grep
author
committer
pickaxe
?
search:
re
summary
|
shortlog
|
log
|
commit
|
commitdiff
|
tree
first ⋅ prev ⋅ next
Update list of crawlers
[infodrom.org/www.zeitungsliste.de]
/
lib
/
core.inc
2018-06-28
Joey Schulze
Update list of crawlers
blob
|
commitdiff
|
raw
2018-06-28
Joey Schulze
No need to declare superglobals global
blob
|
commitdiff
|
raw
|
diff to current
2016-03-14
Joey Schulze
Convert spider detection to datastructure and loop
blob
|
commitdiff
|
raw
|
diff to current
2014-02-02
Joey Schulze
Add more bots
blob
|
commitdiff
|
raw
|
diff to current
2013-11-29
Joey Schulze
Add more bots
blob
|
commitdiff
|
raw
|
diff to current
2013-05-06
Joey Schulze
New spider
blob
|
commitdiff
|
raw
|
diff to current
2012-05-09
Joey Schulze
Two more spider
blob
|
commitdiff
|
raw
|
diff to current
2012-04-29
Joey Schulze
Allow more versions
blob
|
commitdiff
|
raw
|
diff to current
2012-04-26
Joey Schulze
New crawler
blob
|
commitdiff
|
raw
|
diff to current
2011-11-21
Joey Schulze
New crawler
blob
|
commitdiff
|
raw
|
diff to current
2011-04-09
Joey Schulze
Neuer Spider
blob
|
commitdiff
|
raw
|
diff to current
2011-04-01
Joey Schulze
New spider
blob
|
commitdiff
|
raw
|
diff to current
2011-03-12
Joey Schulze
New crawler
blob
|
commitdiff
|
raw
|
diff to current
2010-12-08
Joey Schulze
New bots
blob
|
commitdiff
|
raw
|
diff to current
2010-08-30
Joey Schulze
new spider
blob
|
commitdiff
|
raw
|
diff to current
2010-08-29
Joey Schulze
Detect more robots
blob
|
commitdiff
|
raw
|
diff to current
2010-07-10
Joey Schulze
New crawler
blob
|
commitdiff
|
raw
|
diff to current
2010-05-02
Joey Schulze
New version of Eurobot
blob
|
commitdiff
|
raw
|
diff to current
2010-05-02
Joey Schulze
New version for www.seoprofiler.com
blob
|
commitdiff
|
raw
|
diff to current
2010-03-09
Joey Schulze
New bots Xmarks and spbot
blob
|
commitdiff
|
raw
|
diff to current
2009-08-07
Joey Schulze
Two more bots to handle
blob
|
commitdiff
|
raw
|
diff to current
2009-07-24
Joey Schulze
Two more spider
blob
|
commitdiff
|
raw
|
diff to current
2009-06-09
Joey Schulze
Second rule for YaCy
blob
|
commitdiff
|
raw
|
diff to current
2009-06-02
Joey Schulze
More spider
blob
|
commitdiff
|
raw
|
diff to current
2009-04-20
Joey Schulze
New spiders
blob
|
commitdiff
|
raw
|
diff to current
2009-04-03
Joey Schulze
New spiders
blob
|
commitdiff
|
raw
|
diff to current
2009-03-12
Joey Schulze
Another spiders we don't recognise yet
blob
|
commitdiff
|
raw
|
diff to current
2009-01-12
Joey Schulze
New Crawler: SapphireWebCrawler/Nutch-1.0-dev (Sapphire...
blob
|
commitdiff
|
raw
|
diff to current
2008-12-26
Joey Schulze
New spider Ask Jeeves
blob
|
commitdiff
|
raw
|
diff to current
2008-12-07
Joey Schulze
New spider psbot/0.1
blob
|
commitdiff
|
raw
|
diff to current
2008-10-27
Joey Schulze
New bot: Gaisbot
blob
|
commitdiff
|
raw
|
diff to current
2008-10-09
Joey Schulze
New spider: Charlotte/1.1
blob
|
commitdiff
|
raw
|
diff to current
2008-10-06
Joey Schulze
New spider: Yahoo-MMCrawler
blob
|
commitdiff
|
raw
|
diff to current
2008-09-27
Joey Schulze
Another spider: MJ12bot/v1.2.3; majestic12.co.uk/bot...
blob
|
commitdiff
|
raw
|
diff to current
2008-09-23
Joey Schulze
New spider: Baiduspider
blob
|
commitdiff
|
raw
|
diff to current
2008-09-23
Joey Schulze
New spider: DotBot
blob
|
commitdiff
|
raw
|
diff to current
2008-09-23
Joey Schulze
New spider
blob
|
commitdiff
|
raw
|
diff to current
2008-09-13
Joey Schulze
Another new bot
blob
|
commitdiff
|
raw
|
diff to current
2008-09-05
Joey Schulze
Another spider
blob
|
commitdiff
|
raw
|
diff to current
2008-08-08
Joey Schulze
Simple is_admin()
blob
|
commitdiff
|
raw
|
diff to current
2008-07-22
Joey Schulze
A new bot:
blob
|
commitdiff
|
raw
|
diff to current
2008-07-02
Joey Schulze
pg_NumRows -> pg_num_rows
blob
|
commitdiff
|
raw
|
diff to current
2008-06-30
Joey Schulze
Another spider
blob
|
commitdiff
|
raw
|
diff to current
2008-06-29
Joey Schulze
Another crawler
blob
|
commitdiff
|
raw
|
diff to current
2008-06-28
Joey Schulze
Added the new ScoutJet crawler
blob
|
commitdiff
|
raw
|
diff to current
2008-06-25
Joey Schulze
Untypo
blob
|
commitdiff
|
raw
|
diff to current
2008-06-23
Joey Schulze
Import of the current version of zeitungsliste.de
blob
|
commitdiff
|
raw
|
diff to current