Re: Automatic redirects on doorway pages?

From: Miki Dzugan <mdzugan_at_markneting.com>
Date: Mon 11 Sep 2000 13:13:21 -0500

PHILIP MAK <mfraser_at_seas.gwu.edu> WROTE:
> I am thinking that this would be a reliable method of
> determining that. HOWEVER, it would be very trivial for
> the AltaVista spider to send a fake referring URL to
> trick my script, so I'm wondering if anyone has
> specific information about this.

Haven't tried this myself, but all of the robots
request robot.txt when they hit the site. Wouldn't the
robot.txt show up in the history file for the robot
visitor?

Miki Dzugan
MARKnETING
http://www.markneting.com





Received on Mon Sep 11 2000 - 13:13:21 CDT