ARTLUNG
this is the website of joe crawford. code. occasional comics. toy robots. san diego.
  • In case you came here looking for a reference to netflix based on this…
    In case you came here looking for a reference to netflix based on this, well, I like looking at peoples’ robots.txt files. Truth be told, I learn a great deal by looking at how sites do their thing. I remember visiting amazon a long time ago and seeing how they generate extra url stuff and…