Since you're on a relatively new server, you are expected to wait much longer as people most likely have stopped playing when the server started. Wait until your server becomes cross server.

There's also the bug where you are "kicked out" from the queue and you wait forever. Just refresh and try again if you cannot leave from arena.