I have, on many occasions, come to the brawling hall and found that I have to wait over an hour just to get a match because someone keeps refusing to accept. Here is update that will hopefully be implemented soon since this is a major issue for anyone playing rank pvp.
When a player refuses 3 matches withing a 5-minute time span, they will not be able to join queue for a quarter hour. Other ideas have been suggested; some of these ideas included rank penalties, scrip penalties, and even temporary bans. Whatever KI does, they should somehow put a stop to people constantly declining matches and preventing others from enjoying rank.