Show robots.txt on www. & non-www domains only.

[ericrasch]

This would protect future namespaces like new. and dev. (you never know what someone will want to call their environments).

REF: 9de510a#commitcomment-4401567

[jimmynotjim]

+1 for this. With the current catch-all implementation, OEDb is going to send robots to the wrong url because it's a non-www site.

[ericrasch]

We're specifically having an issue on that and now on OCnet because 'new.' wasn't added to the list.

[ericclemmons]

Ok, so this will be patched, but luckily there's nothing preventing hand-patching the .htaccess that's live now.

[ericclemmons]

Closed because the code now lives in evolution/genesis-wordpress#48