zencart robots.txt的阻止收录写法

首先开启ZENCART  URL 静态化,然后将下列代码复制到robots.txt中,放于根目录

这样就可以达到阻止一些不必要收录分权网页的效果

specials.html、products_all.html、products_new.html、featured_products.html根据自己喜好决定是否阻止收录。

User-agent: * 
Disallow: /cache/ 
Disallow: /contrib/ 
Disallow: /min/ 
Disallow: /docs/ 
Disallow: /extras/ 
Disallow: /htmlarea/ 
Disallow: /stats/ 
Disallow: /sitemap/ 
Disallow: /graphics/ 
Disallow: /login.html 
Disallow: /privacy.html 
Disallow: /conditions.html 
Disallow: /contact_us.html 
Disallow: /shippinginfo.html 
Disallow: /gv_faq.html 
Disallow: /discount_coupon.html 
Disallow: /unsubscribe.html 
Disallow: /shopping_cart.html 
Disallow: /ask_a_question.html 
Disallow: /popup_image_additional.html 
Disallow: /product_reviews_write.html 
Disallow: /tell_a_friend.html 
Disallow: /pages-popup_image.html? 
Disallow: /popup_image_additional.html? 
Disallow: /?main_page=* 
Disallow: /index.php?main_page=*

发表评论

电子邮件地址不会被公开。 必填项已用*标注