Tổng hợp Mẫu file robots.txt

Tổng hợp Mẫu file robots.txt

MẪU SỐ 1 THƯỜNG ĐƯỢC HAY SỬ DỤNG

=================

User-agent: *
Allow:/wp-content/*.png
Allow:/wp-content/*.jpg
Allow:/wp-content/*.jpeg
Allow:/wp-content/*.gif
Disallow:
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /*add-to-cart=*
Disallow: /*add_to_wishlist=*
Disallow: /cart/
Disallow: /checkout/
Disallow:/wp-content/
Disallow:/my-account/
Disallow:/wp-login.php*
Sitemap: https://iwebsite.vn/sitemap.xml
Sitemap: https://www.iwebsite.vn/post-sitemap.xml
Sitemap: https://www.iwebsite.vn/page-sitemap.xml

=================

MẪU SỐ 2 CŨNG ĐƯỢC CÁC WEBMASTER SỬ DỤNG

================

User-agent: *
Disallow: /wp-admin/
Disallow: /readme.html
Disallow: /license.txt
Disallow: /?s=*
Allow: /wp-admin/admin-ajax.php
Allow: /wp-admin/images/*
Sitemap: https://batdongsannhadat.com.vn/sitemap_index.xml

================