The main thing people get from milk is, depending on the country, vitamin D, which isn't naturally occurring there and is best obtained by just getting some sun, and the fat, which most people cut out of it. Milk's calcium absorption is, at best, around 30% and not a great source of calcium. You get better calcium intake from leafy greens and nuts (~50% absorption). Also, there has not been a definitive link between additional bone density from calcium and brittle bones. Japan and India are still mostly lactose intolerant and have fewer hip fractures than America, which has one of the highest milk intakes in the world. It's more likely manual labor and sunlight is better for bone health.
The idea that milk is healthy is part of misunderstandings that have been taken as fact for decades, but it's not really. It's not junk food... until you start adding even more sugar to an already surprisingly sugary drink.
Quickly found source concerning meta analysis and milk's health benefits
Several years ago, when I was still going into the office, I made a similar decision. I tossed all my old socks and bought like, 12 pairs of argyle socks in a variety of brighter colors and deliberately wore different colors every day. They're the same brand so they all wear the same, just sometimes bright green and orange(or whatever) on each foot. I got a few questions at first, though never negative. People thought they were being helpful letting me know my socks didn't match, but when I told them it was intentional they thought it was a great idea. Now it's expected for me to have mismatched socks and no one notices. Of course, being WFH now, I almost never wear socks anymore. But on the occasion someone notices these days, they don't really care.