Introduction to the Functional Testing Framework
The Magento Testing Framework (MTF) is superseded by the Magento Functional Testing Framework (MFTF). While the MTF is still functional, all MTF tests are being ported over to the MFTF. We recommend using the MFTF for testing.
This guide provides instructions on installing and configuring the Functional Testing Framework (FTF). Using the FTF, you can create and run functional tests to make it easier to perform basic acceptance testing, smoke testing, regression testing, and so on.
FTF is an open source cross-platform solution (that is, does not depend on a specific operating system).
FTF enables you to quickly develop functional tests for the Magento application. These tests can be performed at any time.
You can run a single test independently, many tests together (that is, a test suite), or you can run all available tests.
FTF does not contain tests. All functional tests are located in
<magento2 root dir>/dev/tests/functional/.
What tools should I use to run tests with FTF?
What do I have as output after running tests with FTF?
Basic PHPUnit results
Screenshots of failures
Logs of failures
This guide is intended to be used by any Magento developer. In addition, it can be used by software engineers such as QA specialists, PHP developers, and system integrators.
Facilitate functional testing and minimize efforts to perform regression testing.
FTF is purposed to test user interactions with web application under test.
FTF works with functional tests located in
Out-of-the-box tests cover basic functionality. Extended functionality can be tested using customized tests, created with FTF.
Relative to your software development lifecycle, the FTF can help you:
During the development phase, test any changes of functionality (new modules, update modules, fix bugs).
During the maintenance phase, for periodic automated regression testing.
FTF use cases examples
As Magento developer I want to cover implemented functionality with new tests (for example, added attribute on Customer Form, extended Search functionality, added tags for Products etc).
As a software engineer I want to perform regression testing before release to be confident that Magento works as expected with new functionality.
FTF works with tests from
For other tests please see the following topics:
FTF on GitHub
Follow the FTF project and contribute on GitHub https://github.com/magento/mtf.