While I can find excessive perfume smells annoying (eg. the lady next to me at a recent concert I attended), I have to feel a little scepticism when OP’s concern over perfume in washing extends to “the building across the road from us”, unless the road is very narrow and the buildings are tall and wide.
I am reminded of an instance when one person’s concern over the noise of an air-conditioner inhibited that person’s neighbour from using it, even when his elderly wife was terminally ill in mid-summer. The person claimed special sensitivity. The sound level, objectively measured with a sound level meter only a few meters from the compressor, was barely above ambient on a day with a light breeze and well below noise limits set by reasonable standards.
That said, we could all do with fewer unnecessary chemicals added to detergents and the like.