My DD hated my sister's house and my grandma's house.
I think smells could have something to do with it. Also energy. My sister has 4 kids with tons of energy who were so excited to see the baby. We would get a few feet into the house and she'd be inconsolable screaming bloody murder.
At my grandma's we had to keep taking her outdoors to calm her down.
There's no telling. But I would just honor baby's wishes for now. Chances are good she'll grow out of it soon enough.
SAHM to Magnolia May (09/10), Luke Russett (04/13) and expecting 11/16. Wife and best friend to my airman.