We're landlords and a couple of bathrooms had similar problems. We appear to have solved them by installing humidistat 'silent run' fans, which are almost silent and can be boosted when user in the room having a shower.
I'm no ventilation engineer, so can't tell you details of why it seems OK now.