# If the Joomla site is installed within a folder such as at # e.g. www.example.com/joomla/ the robots.txt file MUST be # moved to the site root at e.g. www.example.com/robots.txt # AND the joomla folder name MUST be prefixed to the disallowed # path, e.g. the Disallow rule for the /administrator/ folder # MUST be changed to read Disallow: /joomla/administrator/ # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/orig.html # # For syntax checking, see: # http://www.sxw.org.uk/computing/robots/check.html sitemap:http://magicalmouseholidays.com.au/index.php?option=com_xmap&view=xml&tmpl=component&id=9 User-agent: * Allow: /*.js* Allow: /*.css* Allow: /*.png* Allow: /*.jpg* Allow: /*.gif* Disallow: /administrator/ Disallow: /cache/ Disallow: /cli/ Disallow: /includes/ Disallow: /installation/ Disallow: /language/ Disallow: /libraries/ Disallow: /logs/ Disallow: /Disney-Cruise-Line/disney-cruise-line-ports-of-call.html Disallow: /tmp/ Disallow: /index.php/sitemap.html Disallow: /index.php/Create-an-account.html Disallow: /News-Reviews/Tags/Tag/ Disallow: /News-Reviews/Categories/ Disallow: /News-Reviews/Blogger/ Disallow: /Reviews-News/Categories/ Disallow: /Reviews-News/Categories/Listings/ Disallow: /Reviews-News/Tags/Tag/ Disallow: /Reviews-News/Tags/Listings/ Disallow: /Reviews-News/Blogger/ Disallow: /index.php?option=com_search&view=search&tmpl=component Disallow: /foundry/ Disallow: /FP-RokTabs-1/ Disallow: /FP-RokTabs-2/ Disallow: /component/com_roksprocket/ User-agent: MJ12bot Disallow: / User-agent: ia_archiver Disallow: /