I feel like the weekend is going to drag! I really wish we'd paid for priority now - we were told not to because my husband was denied a visitors visa once (he applied for six months after having visited loads before already). But in hindsight I still wish we had gone for it!
Yeah, they tell you not to use priority if you've had a refusal, but I think that's just to cover themselves because they can't guarantee a fast decision in that case (i.e. if they have to look into the refusal it can delay the decision).
However, all priority processing does is cut the queue when your package arrives... and that happens before they even see that you've had a previous refusal. So, even if it does take a bit longer to process once they pick it up, paying for priority will still reduce the processing time by up to a few weeks because your application won't be sitting in line for as long.