Extracting rectangle objects from image.

I have a image of a vehicle that is processed using MSER. I am stuck on how to properly extract just the rectangular license plate in the image. I made several attempts but I still picked up the surrounding edges around the license plate together with it. Any ideas on how to get just the license plate? Thanks in advance!