Re: List of abusive spider/acceleration software?
JONATHAN ROY <ROY_at_IDLE.COM> WROTE:
>Does anyone maintain a definitive list of user agents to
>ignore traffic from when logging ad impressions and clicks?
>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
We built several "spider traps" into our site. A logging
program maintains a list of spider names. Our ad logging
software then checks user agents against this list (among
other things to exclude robots).
Here is what we got so far. Its not the "definite list" but
after having logged robots on a busy site for about 1 year
now we don't discover a new species very often.
AltaVista Intranet V2.0 net.ve webmaster_at_net.ve
Arachnoidea (arachnoidea_at_euroseek.com)
ArchitextSpider
BackRub/2.1 backrub_at_google.stanford.edu /google.stanford.edu/
Cartographer 1.3
CherryPickerSE/2.0
contype
Crawler V 0.2.2 admin_at_crawler.de
Crescent Internet ToolPak HTTP OLE Control v.1.0
EchO!/2.0
eLeetFTP
EmailCollector/1.0
EmailSiphon
ExtractorPro
GAIS Robot/1.0B2
Go-Ahead-Got-It/1.1
Googlebot/1.0 googlebot@googlebot.com http://googlebot.com/
Gulliver/1.2
ia_archiver/1.6
InfoNaviRobot
InSite/1.0 libwww-perl/0.40
IWENG/1.2.003
Java1.1.3
libwww-perl/5.10
LinkWalker
Lycos_Spider_(T-Rex)/3.0
Lynx/2.6 libwww-FM/2.14
Mercator-1.0
Microsoft URL Control - 5.00.3714
NetAttache/2.5
NetBrief-Light 1.0
Openfind Robot/1.1A1
Scanner 2.101
Scooter/2.0 G.R.A.B. X2.0
Spider3_WiseWire
Tassilo Rinder's Internet Angel (INETA 2.3/32bit, Shareware)
TE
Teleport Pro/1.28
TURBOEXPLORER
Ultraseek
VCI WebViewer VCI WebViewer Win32
w3mir/1.0.4pre2-24-8-1998
Web Downloader/3.0
Web Sucker 1.0 Beta
Weber
WebMirror
WebVCR/2.0
WebZIP/2.46 (http://www.spidersoft.com)
Wget/1.4.5
WiseWire
WiseWire-Spider-1.0
Btw, sponsors appreciate it if they get separate stats for impressions and
clicks served to spiders.
regards,
--Walter
---------------------------------------------------------------------
Dr. Walter Soldierer The Digital Postcard
All-Yours Internet Solutions http://www.all-yours.net/postcard
http://www.all-yours.net/ mail@all-yours.net
========================================================================
------------------------------------------------------------------------
This week's Online Advertising Discussion List sponsor:
Internet.com, Conducent and ValueClick
PURE INTERNET...Three in four internet.com users are online purchasers.
Deliver your ad to a PURE Internet audience. Contact sl_at_internet.com.
http://www.internet.com/mediakit/pure.html
----
Don't Buy Hope! 30 percent of our user base clicks on ads in software!
Place Dynamic Ads in Downloadable Software. Invest in Results!
http://www.conducent.com/advertisers.shtm or eisenstadta@conducent.com
----
ValueClick has cost-effective ad space available for *Smarter Buyers*
-> Our Cost-per-Click model means risk-free Reach to over 10k websites!
ValueClick Ad Network | 805.965.0543 | http://www.valueclick.com
------------------------------------------------------------------------
========================================================================
Online Advertising Discussion List To Unsubscribe send UNSUBSCRIBE
http://www.o-a.com/ to online-ads-request@o-a.com
Received on Fri Feb 19 1999 - 08:07:25 CST
