The user count is just showing the number of subs from the instance you're on, not the total number who are seeing your posts. It's a meaningless number that just causes confusion, imo.
Although I am ill and night have misread your post so if this is irrelevant info please forgive.