Manga where a boy and his house are transported to a magical world and he is extremely powerful there

I believe you are looking for Ore no Ie ga Maryoku Spot datta Ken – Sundeiru dake de Sekai Saikyou, or My House is a Magic Power Spot - Just by Living there I Become the Strongest in the World.

The main character and his house are summoned to another world while he was asleep. He wakes up to the women who summoned the house outside. Then he shouts at them to shut up, which causes all of them to fly backwards into trees, after which they all run away. The women then encounter a dragon, and run back towards the house. The main character then yells at them to let him sleep, which defeats the dragon.

Just a warning, the first two chapters at least appear to keep having the women piss themselves in fear, and the second shout shreds all their clothing so it is probably NSFW.