# Robots.txt file from http://rt.ju690.com # All robots will spider the domain User-agent:* Disallow: / Disallow:/m Disallow:/m/ Disallow:/static/ Disallow:/rt/ Disallow:/rt/latest Disallow:/rt/timeline User-agent: Spinn3r Disallow: / User-agent: MLBot Disallow: / User-agent: Slurp Disallow:/ #User-agent: YodaoBot #Disallow:/ #User-agent: Sosospider #Disallow:/ User-agent: twiceler. Disallow:/ User-agent: Sogou Disallow:/ User-agent: sogou spider Disallow:/ User-agent: psbot Disallow:/ User-agent: Yeti Disallow:/ User-agent: msnbot-media Disallow:/ User-agent: MJ12bot Disallow: / Sitemap:http://rt.ju690.com/sitemap.xml # End robots.txt file