That means I need to shuffle them off to one side while the hero and heroine deal with an issue along the way.
It's a good thing there's magic involved, but still. . . .
In some respects the fairy tale world is like a Dark Ages setting: kings and queens and princes and princesses go running all about without attendants.
On the other hand, it's also a place that, while there are bandits (in case you need a mundane substitution of letters, or sometimes in place of ogres), a lone traveler can easily walk from one kingdom to another untroubled.
The problem with novels is that a more detailed setting can't be half of one, and half of the other.