The use case for this is in other people’s CI. The non-e2e tests
are sometimes timing based and thus inherently flakey. The
e2etests are not that, since they’re based on interactions with a
real server.

Fixes #327.