I have a project with multiple modules defined.
When I right click on a test folder in a module, and say "Run All Tests", it behaves properly. But then I go to another module and do the same, and it still runs the tests from the last module. I have to open the folder and choose a lower level directory to run tests on in order to get it to run tests from that module.
This may be similar to issue IDEA-16616.