Queue Callback

I’m utilizing the queue callback module and getting some complaints from the customer. Callers are indicating they are being pushed further back in line as they wait. So a customer is told they are 5th in line and then all of a sudden they are 7th. I assumed that when a previous call utilizes the queue callback it would hold their spot in line, is that the case?