User-agent: Slurp Disallow:/ User-agent: twiceler Disallow:/ User-agent: MSNBot Disallow:/ User-agent: Yandex Allow: /$ Allow: /products-1* Allow: /products-2* Allow: /products-3* Allow: /products-4* Allow: /products-5* Allow: /products-6* Allow: /products-7* Allow: /products-8* Allow: /products-9* Allow: /wnews* Disallow:/ Crawl-delay: 5 Host: gm.rbs.ru User-agent: * Disallow:/biznes* Disallow:/bank* Disallow:/login.html* Disallow:/help* Disallow:/ya* Disallow:/kpk-content* Disallow:/abjavy* Disallow:/acc.html* Disallow:/register.html* Disallow:/cart-view.html* Disallow:/buy-out-item-innk* Disallow:/iriki-* Disallow:/wnews-email* Disallow:/buy-now* Disallow:/img/commercials* Disallow:/view-watchit* Disallow:/view-rate* Disallow:/view-tellafriend* Disallow:/view-notifyonstock* Crawl-delay: 5 Host: gm.rbs.ru