Vanishing Store

There's this idea I've seen in a number of places where you have a strange store that appears. There's generally no indication of it moving in, or of anything moving out, you're just walking along a street one day and notice a store you've never seen before. When you go in, there are all sorts of marvels to be found (though it is generally a bad idea to actually buy anything, as the shopkeeper is likely to be some sort of fey or fiend, or perhaps a djinn). Leave and wait a day, or any such, and it's gone, with no sign it was ever there.

While I can just have something like that in a game without bothering about lore, I'm wondering if there's something similar in lore. It seems like something that would exist.

Akiliths are mold like demons that are able to latch onto doorways or windows to create portals to the Abbyss. Maybe one managed to attune to a demiplane and create a portal in order to lure unsuspecting travellers into its reach.