I’ve never heard someone ask, “where is your office located?” Maybe because I worked retail and then worked from home. I have been asked if I work from home once they find out I work for a vendor or ask if I have to go into an office at all. Some people asked my territory if they really understood the type of work I did when I worked for a vendor. When I did work in offices people would ask if I worked close to home or in RTP (an area in NC that a lot of people worked) that sort of thing.
I think people who work in offices are more likely to think other people work in offices. I also think if you seem intelligent, responsible, and very capable, people assume office worker or some sort of professional. I woman I know who is an accountant once said to me, “I had to get a college degree, I wasn’t going to wind up working at the mall, it would have killed my father.” I’m sure she felt awful when I said, “most of my career was at the mall.” Many of my close friends who stuck with their mall careers are almost all making more than her most likely. My point is, she never would have guessed I didn’t work in an office from what I surmised, because I think she had a positive impression of me, and looked down on people who did my type of work. The two did not fit together in her head.