Heh, quite a problem. Hmm, don't fill it full yet. Try to shake it like there is no tomorrow and the water hammer effect might pop it out.
Then one one solution could be to use suitable stick/rod, dip it on wonderglue and then attach it to the marble. Just don't glue the marble into the vase...