theres no need to remove the insert for labels.
It's all a matter of preference. Removing the inlays allows for the use of laminated labels and limits the amount of chip covered (using the original inlay footprint vs expanding it to the complete recessed area allows about 10% more of the chip material to be exposed). Both of these are important to me.
Thanks,
Grant