28 Oct Robots.txt
Posted at 09:03h in Website Management 0 Comments
This is a small text file placed in the site’s root directory that is meant to have the effect of disallowing automated indexing of files on the website by search engine crawlers.
For the FHA site, the following additional directories have been disallowed in robots.txt: /newprint, /fhaphp, /code, and /dev. These directories MAY contain personally identifiable information (e.g., email addresses, phone numbers) which, if discovered by a search engine, would subvert the security protections afforded by Joomla’s access level protection for menu items and files.