User-agent: Googlebot
User-agent: Adsbot-Google
User-agent: Applebot
User-agent: baiduspider
User-agent: Bingbot
User-agent: ia_archiver
User-agent: msnbot
User-agent: Naverbot
User-agent: seznambot
User-agent: teoma
User-agent: Twitterbot
User-agent: Yandex
User-agent: Yeti
User-agent: Slurp
User-agent: MSNBot
User-agent: Googlebot-Image
User-agent: yahoo-mmcrawler
User-agent: psbot
User-agent: *