http://www.intellij.net/tracker/idea/viewSCR?publicId=13622
This notification would document
1) Name of configuration
2) What was run (package, class, method)
3) number of failures/errors/success
Right now there isn't a way to hookup in the environment and derive metrics from it. Knowing when you run, what you run and how often is key to improving your Test-Driven-Design and Refactoring skills: small controlled steps.