@jason_hamiltonm tweets related to: Google, Robots, File, Indexing

Ajax-loader
Believe it or not, I am not a huge fan of placing robots.txt files on sites unless you want to specifically block content and sections from Google or other search engines. It just always felt redundant to tell a search engine they can crawl your site when they will do so unless you tell them not to.
J Hamilton-Mascioli Twitter

Google Recommends Not Using Robots.txt File If You Want Full Indexing http://t.co/RID1CpNYC4 via @rustybrick

J Hamilton-Mascioli Twitter

See what's Trending Now for @jason_hamiltonm

See All Trending »
x
J Hamilton-Mascioli

Follow @jason_hamiltonm on Twitter