I once worked in a SCIF and (with one exception in the morning where a security officer could just check your ID card to speed it along) even if there was a large group of people entering every single one needed to close the security door behind them and let the next person use their key. If someone, especially someone you don't recognize, asked you to hold the door you were supposed to say "no" and inform a security officer.