Billy only remembers info about an issue for the moment when a bounty comment is added to it.
But if after that the task changes (renamed, tags changed, etc.), then such changes are not pulled to the board.
Maybe Billy should periodically update info about issues?