New top story on Hacker News: Robots.txt for the NYT has a specific exclusion for an 1996 news article

Robots.txt for the NYT has a specific exclusion for an 1996 news article
8 by mikeortman | 0 comments on Hacker News.