A frequent cause of regressions with the installer is people not setting defaults on their admin settings making them appear on the installer page.

We should have an automated test to detect these problems. It could detect how many settings are on the page, or see if there are too many steps.

A brief chat with David suggests it would be non-trivial to do this with the current behat integration because all the setup code is quite tightly integrated. But none the less, this would help us detect problems in an area which doesn't get heavily tested during development.