I want to implement a solution where a specified list of callers when call comes from these known callers it will be routed to a specific queue and the rest goes to general queue.
I would suggest an asterisk-centric solution would look much like the blacklist code you can study in /etc/asterisk/extensions.conf but in reverse. Just direct your inbound calls to a context that simply looks up the caller ID(number) in an asteriskdb (sqlite3) table you populate and so redirect to the final destination.