All the time. There are things many people do which cause me (and others) physical pain because of a medical condition. They don't mean to cause me harm, but because they have a mental model of everyone sharing similar abilities as themselves, it simply doesn't occur to them that the one small thing they're doing has negative consequences for others. It's a monkeysphere thing, it's nobody's fault.
I get past it by remembering that I am also incapable of remembering everyone's needs at all times. I'm sure there are many things I have done which seemed completely mundane at the time, but affected someone else negatively. No matter how hard I tried.
The people who still do things like casually block the entire sidewalk with a heavy rental e-bike still pisses me off. But, not for as long as it used to. And if it's something I can fix for someone else who can't, I'll try to do that too.
I also try hard to ensure I actively remember other people's needs where I can. If I can create less suffering, I think that's a good thing to try for.