Initial thought is that something is not right with your Wi-Fi. When my HomePod minis take over I notice that updates may be a bit slower, but I don’t get that.