High mortgage rates and building costs have reversed the pandemic trend of bigger houses.