I know that these big fluffy robes and a perk at high-end hotels, but since I won't wear anything without washing it first I wouldn't assume that a robe in a room was clean.

While I can understand your complaint, I don't think it warrants "a complementary night or two".