You can absolutely make a lipo battery "explode" by overheating it by drawing too much power. But it's the kind of explosion where it spews hot gas and maybe catches on fire. You'll definitely get hurt, but that's about it.

You can do MUCH worse by overcharging it. (note the size of that battery). There will eventually be a fireball if you overcharge it and keep overcharging it when it's already swollen to a balloon. But you generally don't charge stuff while it's in your pocket.

These were actual killing-people-explosions. Lipo batteries don't do that.