Button issue

I have made invisible buttons for animations on roll over/ roll out etc. I have been testing them for any bugs and found an issue. If you click and hold and drag off of the button area it does not read it as a roll out and therefore doesn’t play the roll out animation. Is there anyway to fix it so that even if someone were to click and hold and drag off of the area it would still detect it as a roll out. Thanks.