I think it depends on the table (and possibly the game). I’m playing in a game where the bad guys usually have their own timetables for doing things. If we as players get sidetracked, there’s the expectation that the bbeg continues with their plan unopposed. It’s also within reason that if the players are known to the bbeg, they will do things to keep us occupied / distract us.

With that said, if this is not what the table expects, then everyone needs to sit down and talk it over.