The loading time for returning to respite when inside the other world takes long time and you would probably be doing something else while waiting for it to be done, but it will takes you instantly to the loading screen when it's done which is annoying since there is no warning or whatsoever.
Hey there! This idea was merged as it seems to be similar to an earlier one. Let us know if you think your post does not match - Steph