Difficult to remove

I got this to go with my Milwaukee 2663 impact driver. The 2663 has the friction ring tip. Once you get this attachment on over the ring it has a lot of movement. I was just testing it out and wanted to take it off. This proved to be very difficult. The piece tends to come off half way when then pops the opposite side back down. I was amazed I couldnt get it off. The only way to remove it was to put the adapter in a bench vise and yank the tool out. The issue is that the interior of this adapter should have been better designed so that it properly compresses the friction ring at all points when removing it. If there is not full contact all around the ring won't compress and that's when you get this problem of the thing coming off half way and snapping back down. Sockets pop on and off the friction ring with no problem. Now I will feel like I can only use this sparingly since I know how hard it is to equip.