I don't remember this being possible from the metric configuration itself. The notification rules have it, but obviously they just govern notification.

You might have to put this timing logic in the response action script.

Ken