Анализ сайта

Оптимизация вашего сайта и исправление ошибок.

Robots.txt для WordPress — авторская версия

Как включить и использовать кэш браузера в настройках htaccess
12.05.2017
Редирект пользователей и роботов с нежелательных сайтов
14.05.2017
User-agent: *
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /wp-includes/
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: */trackback
Disallow: */*/trackback
Disallow: /?*
Disallow: /tag
Disallow: /tag/*
Disallow: /author
Disallow: /*?option=
Disallow: /wp-json
Disallow: */?s=
Disallow: *sort=
Disallow: *view=
Disallow: *utm=
Disallow: /category
Disallow: /*page
Disallow: */feed
Disallow: /*?*
Disallow: /xmlrpc.php

User-agent: GoogleBot
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /wp-includes/
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: */trackback
Disallow: */*/trackback
Disallow: /?*
Disallow: /tag
Disallow: /tag/*
Disallow: /author
Disallow: /*?option=
Disallow: /wp-json
Disallow: /category
Disallow: /*page
Disallow: */feed
Disallow: /*?*
Disallow: /xmlrpc.php

User-agent: Yandex
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /wp-includes/
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: */trackback
Disallow: */*/trackback
Disallow: /?*
Disallow: /tag
Disallow: /tag/*
Disallow: */feed
Disallow: /*?*
Disallow: /author
Disallow: /*?option=
Disallow: /wp-json
Disallow: /category
Disallow: /*page
Disallow: /xmlrpc.php
Clean-Param: utm_source&utm_medium&utm_campaign
 
User-agent: Googlebot-Image
Allow: /wp-content/uploads/
 
User-agent: YandexImages
Allow: /wp-content/uploads/

Host: адрес_сайта_без_http
Sitemap: http://адрес_сайта/sitemap.xml