Thread: Need Robots.txt to prevent duplicate content crawls
View Single Post
  #2 (permalink)  
Old 20-05-07
California Jerry's Avatar
California Jerry California Jerry is offline
Junior Blogger
  
Join Date: May 2007
Location: Mountain View, CA
Posts: 22
Default
Why not just use this:

User-agent: *
Disallow: /category-page/
Disallow: /archive-page/

__________________
John Reese Traffic Secrets Bonus
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote