User-agent: IRLbot Disallow: / User-agent: SBIder Disallow: / User-agent: msnbot Disallow: / User-agent: HTTrack Disallow: / User-agent: Jyxobot/1 Disallow: / User-agent: Googlebot Disallow: /cgi-bin/ User-agent: VoilaBot Disallow: / User-agent: VoilaBot BETA 1.2 Disallow: / User-agent: Speedy Spider Disallow: / User-agent: ia_archive Disallow: / User-agent: psbot Disallow: / User-agent: tpiol Disallow: / User-agent: FAST MetaWeb Crawler Disallow: / User-agent: FAST MetaWeb Crawler (helpdesk at fastsearch dot com) Disallow: / User-agent: MJ12bot/v1.0.8 Disallow: / User-agent: Gigabot/3.0 Disallow: / User-agent: ichiro/2.0 Disallow: / User-agent: WebAlta Crawler/2.0 Disallow: / User-agent: MLBot Disallow: / User-agent: ScoutJet Disallow: / User-agent: TurnitinBot/2.1 Disallow: / User-agent: Yanga WorldSearch Bot v1.1/beta Disallow: / User-agent: dotbot Disallow: / User-agent: twiceler Disallow: / User-agent: Yandex/1.01.001 Disallow: / User-agent: Snapbot/1.0 Disallow: / User-agent: * Disallow: /audio/ Disallow:/ajaxbible/ Disallow: /biblesupersearch/ Disallow: /cgi-bin/ Disallow: /crossword/ Disallow: /includes/ Disallow: /JQuery/ Disallow: /maps/ Disallow: /os2/ Disallow: /pilgrim/ Disallow: /postcard/ Disallow: /psjs_datalogs/ Disallow: /readbible/ Disallow: /rtf/ Disallow: /spwar/ Disallow: /summaries/ Disallow:/test/ Disallow: /toronto/ Disallow: /zip/ Disallow: /iulian/