Comments on: Twitter Domain Duplicate Content Issues http://hwork.org/2009/03/06/twitter-domain-duplicate-content-issues/ Henry Work Blog. Developer for TouringPlans.com. Formerly of TechCrunch (co-built CrunchBase). Once team captain of the Northern Bites. Thu, 15 Jul 2010 20:40:42 -0700 http://wordpress.org/?v=2.8.6 hourly 1 By: Henry Work http://hwork.org/2009/03/06/twitter-domain-duplicate-content-issues/comment-page-1/#comment-170 Henry Work Wed, 25 Mar 2009 16:02:09 +0000 http://hwork.org/?p=3#comment-170 Hey Andy, Thanks for the headsup on robots.txt. It's what Matt Cutts recommends (http://www.youtube.com/watch?v=nM2VDkXPt0I) and it seems to work fine with the webmaster console. Why do you recommend using noindex? Good idea on the spam link. Those urls are reviewed before they go live so they shouldn't be spam once they get there anyways. -Henry Hey Andy,

Thanks for the headsup on robots.txt. It’s what Matt Cutts recommends (http://www.youtube.com/watch?v=nM2VDkXPt0I) and it seems to work fine with the webmaster console. Why do you recommend using noindex?

Good idea on the spam link. Those urls are reviewed before they go live so they shouldn’t be spam once they get there anyways.

-Henry

]]> By: Andy Beard http://hwork.org/2009/03/06/twitter-domain-duplicate-content-issues/comment-page-1/#comment-169 Andy Beard Wed, 25 Mar 2009 13:18:47 +0000 http://hwork.org/?p=3#comment-169 Robots.txt is a really bad tool for SEO - they would be much better off using meta noindex follow. Also please add a simple way for me to just report a spam link in Crunchbase, especially on incoming links in the sidebar. Robots.txt is a really bad tool for SEO – they would be much better off using meta noindex follow.

Also please add a simple way for me to just report a spam link in Crunchbase, especially on incoming links in the sidebar.

]]>