Magento_Robots module

This topic is generated automatically from the corresponding README in the Magento codebase. If you want to contribute, refer to Magento Code Contributions.

The Robots module provides the following functionalities:

  • contains a router to match application action class for requests to the robots.txt file;
  • allows obtaining the content of the robots.txt file depending on the settings of the current website.