This is the current robots.txt file I am using on a site of mine. I have excluded large parts of the IP.Board forum in order to try and cut down on duplicate content. I've also excluded some WordPress search pages (as well as admin pages).However, I want the Google Images to be able to crawl anywhere, and I also want the AdSense bot to be able to crawl anywhere.Have I done it right?  I'm now a little confused after reading that the addition of User-agent: Googlebot may override certain other values. Does the position of things in the file matter?##################################################### ALLOW MEDIA BOT TO CRAWL ANYWHERE#####User-agent: Mediapartners-GoogleAllow: /##################################################### ALLOW IMAGE BOT TO CRAWL ANYWHERE#####User-agent: Googlebot-ImageAllow: /##################################################### ALLOW MAIN GOOGLEBOT SPECIFIC ACCESS#####User-agent: GooglebotDisallow: /forums/calendar/Disallow: /forums/gallery/Disallow: /forums/members/Disallow: /forums/user/Disallow: /forums/index.phpDisallow: /forums/*&search_tags=Disallow: /search/Disallow: /*?s=Disallow: /wp-admin/Disallow: /wp-content/
Correct usage of robots.txt file (Googlebot-Image and Mediapartners-Google)
robots.txt;user agent