If you mean the default agent queue , for example, below when creating a build definition 
A queue attached to a pool containing the agents that you want to run. You can first check the status of your agent pool. Make sure everything is in order.

And even after creating the definition, you can still change the queue to General , try changing the queue here to determine if there is still an empty queue.

source share