From the article it’s impossible to tell why you were there. Maybe he was honestly expecting a cleaning lady. You’re small and young looking we get it. And you are new to the situation. Probably the worst approach you would take is to enforce your so called privilege. Being hard to work with isn’t a privilege. After all you probably need to work with guy and you don’t want to make an enemy.