The other side of the coin is . . . some companies and individuals actually put stuff inside the HP cavity to make it expand quicker.
I have never worried about getting media inside a HP cavity. Even back in the day when I was shooting some of the big hole HP's like the .284",115gr Speers outta my 7mm Rem Mag.
YMMV --- SAWMAN