Changeset [924cedd17ca37683ee15f6acfdcb41c47e0968bc] by Brian Michalski
Revision 924cedd17ca37683ee15f6acfdcb41c47e0968bc,
committed by Brian Michalski
· January 1st, 2012 @ 09:44 PM
Update robots.txt to turn off all spiders.
This is really just to prevent the nightly server from getting
slammed with servers hitting bad links or really ineffecient pages.
We'll adjust this behavior as we get closer to releasing / Concerto
is used in the wild.
https://github.com/concerto/concerto/commit/924cedd17ca37683ee15f6a...
1 changed file
-
M
public/robots.txt