Update the Magento Functional Testing Framework and pull new tests

This topic was updated due to the 2.0.2 MFTF release.

Overview

Magento tests and the Framework are stored in different repositories.

Magento tests are stored in the same repository as the Magento code base. When you pull changes in the Magento code, you’re potentially pulling corresponding tests .

The Framework is installed separately as a dependency using Composer. When pulling the latest Magento code, you need to update the corresponding Composer dependencies in the magento2/dev/tests/acceptance directory. This ensures that the MFTF is up to date.

Update the MFTF

$ cd dev/tests/acceptance
  • Update your own tests, including data, metadata etc, if they contain tags that are unsupported anymore in newer version. Check details about backward incompatible changes in Changelog, and learn documentation of new MFTF release.

  • Run composer update to get the latest framework version:

$ composer update
  • Generate newly pulled tests:
$ vendor/bin/robo generate:tests