Try an ice pick or a similar sharp tool with a point that is circular and a little larger than a pin. Paperclips aren't going to be sharp enough. If you still have trouble take it to a shoe repair.
Piece of advice, unless you have bird ankles your dance shoes are probably too big if your straps are too big. I was horrified to find out that for dance shoes to fit the right way they had to be much smaller than your street shoes. Latin shoes, your big toe should be on the floor, at least part way and your smooth should fit like a glove, I mean really like a glove so that you can kick with all your strength and the shoe wouldn't even think of coming off. If your feet can move or wiggle or shift inside even a little bit they are too big. I didn't believe this at first and I was wrong.
The right shoes in dance make all the difference. Pay for good shoes and make sure they fit and they will pay their own dividends. I suggest trying Ray Rose and DanceNaturals. To put it in perspective, my dance shoes are 3 full sizes smaller than my normal shoes. Good luck.