I just did this with the robe and passcode and it worked. I don’t recall it doing a skill check, I just used the LIE option when talking to the third yellow eye imp. I do know that if you killed any golems or imps it triggers an alarm and you lose the option to disguise yourself.
I entered the manor from the shop next door using window and grapple across avoiding the front door.