Same for me, my pupils dilate more so the bright parts irritate them more. Light mode in a properly lit room is much more comfortable, although something like Solarised or Gruvbox is a little better than black on white.