Resolved! Chat Conversation in Limbo, if a queue has 2 agents, first one Rejects and the 2nd one times out.
So have I have small chat queue with only 2 agents at any given time. Testing the Agent Chat setup, I had the first Agent reject and then had the 2nd agent timeout and automatically get set to 'Away'. The customers chat window was stuck on 'Routing y...