User-agent: * Disallow: /YourGovernment/Revenue/News/Article/* Disallow: /DesktopModules/DigArticles Disallow: /*?* Disallow: /community/events/ctl/Details Disallow: /wwtest.stlouisco.com Disallow: /staging.stlouisco.com Disallow: /Testarea/ Disallow: /Community/Events/ Disallow: /Community/NewsPressReleases/ Disallow: /admin/ Disallow: /App_Browsers/ Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /App_GlobalResources/ Disallow: /bin/ Disallow: /Components/ Disallow: /Config/ Disallow: /contest/ Disallow: /controls/ Disallow: /DesktopModules/ Disallow: /Documentation/ Disallow: /HttpModules/ Disallow: /images/ Disallow: /Install/ Disallow: /js/ Disallow: /Portals/ Disallow: /Providers/ # Preserve "Resources" for site friendly urls # Disallow: /Resources/ContentRotator/ Disallow: /Resources/ControlPanel/ Disallow: /Resources/Dashboard/ Disallow: /Resources/FeedBrowser/ Disallow: /Resources/OpenForceAd/ Disallow: /Resources/Search/ Disallow: /Resources/Shared/ Disallow: /Resources/SkinWidgets/ Disallow: /Resources/TabStrip/ Disallow: /Resources/Widgets/ Disallow: /Activity-Feed/userId/ Crawl-delay: 5 User-agent: msnbot Disallow: /admin/ Disallow: /App_Browsers/ Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /App_GlobalResources/ Disallow: /bin/ Disallow: /Components/ Disallow: /Config/ Disallow: /contest/ Disallow: /controls/ Disallow: /DesktopModules/ Disallow: /Documentation/ Disallow: /HttpModules/ Disallow: /Install/ Disallow: /js/ Disallow: /Portals/ Disallow: /Providers/ # Preserve "Resources" for site friendly urls Disallow: /Resources/ContentRotator/ Disallow: /Resources/ControlPanel/ Disallow: /Resources/Dashboard/ Disallow: /Resources/FeedBrowser/ Disallow: /Resources/OpenForceAd/ Disallow: /Resources/Search/ Disallow: /Resources/Shared/ Disallow: /Resources/SkinWidgets/ Disallow: /Resources/TabStrip/ Disallow: /Resources/Widgets/ Disallow: /User-Profile/ # Do not index user profiles Disallow: /Contest/ # Do not index the old contest site Disallow: /guidedtour/ # Do not index the old guidedtour Crawl-delay: 5 User-agent: Slurp Disallow: /*/ctl/ # Slurp permits * Disallow: /admin/ Disallow: /App_Browsers/ Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /App_GlobalResources/ Disallow: /bin/ Disallow: /Components/ Disallow: /Config/ Disallow: /contest/ Disallow: /controls/ Disallow: /DesktopModules/ Disallow: /Documentation/ Disallow: /HttpModules/ Disallow: /Install/ Disallow: /js/ Disallow: /Portals/ Disallow: /Providers/ # Preserve "Resources" for site friendly urls Disallow: /Resources/ContentRotator/ Disallow: /Resources/ControlPanel/ Disallow: /Resources/Dashboard/ Disallow: /Resources/FeedBrowser/ Disallow: /Resources/OpenForceAd/ Disallow: /Resources/Search/ Disallow: /Resources/Shared/ Disallow: /Resources/SkinWidgets/ Disallow: /Resources/TabStrip/ Disallow: /Resources/Widgets/ Disallow: /User-Profile/ # Do not index user profiles Disallow: /Contest/ # Do not index the old contest site Disallow: /guidedtour/ # Do not index the old guidedtour Crawl-delay: 5 User-agent: Googlebot Disallow: /*/ctl/ # Googlebot permits * Disallow: /admin/ Disallow: /App_Browsers/ Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /App_GlobalResources/ Disallow: /bin/ Disallow: /Components/ Disallow: /Config/ Disallow: /contest/ Disallow: /controls/ # Disallow: /DesktopModules/ Disallow: /Documentation/ Disallow: /HttpModules/ Disallow: /Install/ # Disallow: /js/ # Disallow: /Portals/ Disallow: /Providers/ # Preserve "Resources" for site friendly urls # Disallow: /Resources/ContentRotator/ # Disallow: /Resources/ControlPanel/ # Disallow: /Resources/Dashboard/ Disallow: /Resources/FeedBrowser/ Disallow: /Resources/OpenForceAd/ Disallow: /Resources/Search/ # Disallow: /Resources/Shared/ Disallow: /Resources/SkinWidgets/ Disallow: /Resources/TabStrip/ Disallow: /Resources/Widgets/ Disallow: /User-Profile/ # Do not index user profiles Disallow: /Contest/ # Do not index the old contest site Disallow: /guidedtour/ # Do not index the old guidedtour User-agent: Yahoo Pipes 1.0 Disallow: /admin/ Disallow: /App_Browsers/ Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /App_GlobalResources/ Disallow: /bin/ Disallow: /Components/ Disallow: /Config/ Disallow: /contest/ Disallow: /controls/ Disallow: /DesktopModules/ Disallow: /Documentation/ Disallow: /HttpModules/ Disallow: /Install/ Disallow: /js/ Disallow: /Portals/ Disallow: /Providers/ # Preserve "Resources" for site friendly urls Disallow: /Resources/ContentRotator/ Disallow: /Resources/ControlPanel/ Disallow: /Resources/Dashboard/ Disallow: /Resources/FeedBrowser/ Disallow: /Resources/OpenForceAd/ Disallow: /Resources/Search/ Disallow: /Resources/Shared/ Disallow: /Resources/SkinWidgets/ Disallow: /Resources/TabStrip/ Disallow: /Resources/Widgets/ Disallow: /User-Profile/ # Do not index user profiles User-agent: sogou spider Disallow: /