My DD hated my sister's house and my grandma's house.
I think smells could have something to do with it. Also energy. My sister has 4 kids with tons of energy who were so excited to see the baby. We would get a few feet into the house and she'd be inconsolable screaming bloody murder.
At my grandma's we had to keep taking her outdoors to calm her down.
There's no telling. But I would just honor baby's wishes for now. Chances are good she'll grow out of it soon enough.
SAHM to Magnolia May (09/10) and Luke Russett (04/13) and wife and best friend to my airman.