But Google is already analyzing all emails received. So the only difference is that they actually know which links have been clicked.

The privacy issue is Gmail, not that particular feature.