# Configure Behavior User-agent: * Crawl-delay: 5 # DOTNETNUKE SECTION STARTS 9/2/2010 9:23:22 PM # Begin DNN Exclusion Folders Disallow: /admin/ Disallow: /app_browsers/ Disallow: /app_code/ Disallow: /app_data/ Disallow: /app_globalresources/ Disallow: /bin/ Disallow: /components/ Disallow: /config/ Disallow: /controls/ Disallow: /desktopmodules/ Disallow: /documentation/ Disallow: /emailtemplate/ Disallow: /generator/ Disallow: /install/ Disallow: /portal/ Disallow: /portals/ Disallow: /providers/ Disallow: /resources/ Disallow: /userprofile/ # Begin DNN Exclusion Pages Disallow: /searchresults.aspx Disallow: /userprofile.aspx Disallow: /admin.aspx Sitemap: http://www.onit.com/sitemap.aspx # DOTNETNUKE SECTION ENDS