Do physical or social factors predominate in place attachment?

Are there studies that analyse if stress in displacement primarily results from being removed from a physical or from a social environment?

For example, does it lead to more stress to remain in a place if the community leaves, or to leave a physical place jointly with a community?