It's possible, but you would have to charter your own speedboat, which would be stupidly expensive: quotes on the net vary from 8000 baht for a privately negotiated transfer to 15000 baht (!) to getting the Holiday Inn to pick you up in their own boat. Staying another night and taking the ferry across the next day will thus almost certainly be cheaper.
In addition, the feasibility and cost of this will depend on weather conditions, and the crossing will be actively dangerous if your departure is delayed for any reason and you end up doing it at night: those speedboats are fast and you're screwed if you hit anything in the dark.
Also, Destination Air used to offer a seaplane shuttle for 5000 baht/seat, but this stopped running a few years ago.