ActionScript 3.0 :: EventListener - Select / Deselect Sprite On Stage

I have the following code:
Code:
btn.addEventListener(MouseEvent.CLICK, select);
function select(evt:MouseEvent):void {
addEventListener(MouseEvent.CLICK, unselect);
} function unselect(evt:MouseEvent):void {
removeEventListener(MouseEvent.CLICK, unselect);
}
The idea is to be able to select the "btn" sprite and while it is selected you can click anywhere on stage to deselect it. I thought this would work but somehow after a single mouse click it also executes the unselect function. Since I add this function after the mouseclick I do not understand why it is doing this. Is this not the way to do such a thing?