Blog
Guestbook
Search for:
December 20, 2001
One post
20-Dec-2001
In case you came here looking for a reference to netflix based on this…
In case you came here looking for a reference to netflix based on this, well, I like looking at peoples’ robots.txt files. Truth be told, I learn a great deal by looking at how sites do their thing. I remember visiting amazon a long time ago and seeing how they generate extra url stuff and...