Why didn't Sophie let Julian go to her house after two small guesses?

Sophie has a strong self-esteem since she was a child. Her family is poor. She is a Polish immigrant. At that time, France discriminated against Poles, and people there looked down on them. Her family was laughed at, so she didn't want Julian to see it.

Sophie said in the film: "I told you never to come to my house." Are you happy now? Have you brought relief? "

It can be seen that Sophie doesn't want Julian to see her down and out.