Sci-Fi book with a ramshackle shed being drawn towards the end of the universe or into the future; turns out to be a human perception of something

There is a scene in the book that is very different from everything else in the book.

There is a ramshackle shed, which is being drawn (or maybe pushed?) like a carriage towards the end of the universe or into the future or something. Possibly by horses, but maybe some other animal and possibly a robotic version of the animal. But that’s not really what anything is, it’s just a human perception of something that is not completely conceivable to a human brain.

I think there is an old lady or man there and the protagonist of the book comes to this weird place and talks to them and does something important and then leaves? Drinking tea may have been involved.

But I only have a vague memory of it. My father described this scene to me and asked me what the book was and said I gave it to him! I vaguely remember this scene, but not the book it fits into and it’s driving me nuts. He seemed to think it was from a series, and from a Sci-Fi book, although it is possible it it neither of those things…

Feels a bit like something that could happen in Nick Harkaway’s The Gone-Away World or something Murakami, but I am certain my father hasn’t read any Murakami and there was lots of craziness in The Gone-Away World, but not this particular craziness. The scene felt sort of felt Discworldy God like, sorta how you might chat with a God, but the rest of the book did not. It was also a very quiet and unrushed feeling scene, but with the idea that something very dangerous and fast was happening outside of this weird place and that something inside it could help.