changed mind about coop

So I signed a contract 10 days ago and gave my deposit. I've changed my mind. The seller waited well over a week to sign contract and haggled over some fixtures that we went back and fourth over and over again. Also, the mortgage rates have gone up as I wasn't able to lock anything until they finally sold. They still haven't put my deposit into escrow and the money is still in my bank account. However my attorney advised me that were finally in contract as of yesterday. Can I let them know I want out due to the mortgage rates? Or can I just remove the money from my bank account and then let them know?