It's not a correct timer, it's just estimated/guessed times. People who already play have to leave the server in order to get new peoples on it. However if the players decide to stay the queue will take longer. The only thing you can do is to wait for it to drop down. From personal experience I can tell that watching youtube vids or watching tv while you have an eye on the screen, is the best way to go.