I am no expert, but before i got mine pierced and I am a guy just in case I did alot of research alot. I also have several female friends that have had them and removed them either before or during pregnancy and after as well for various reasons. Those that have had children never mentioned any issues, other then one friend who took hers out during pregnancy due to the throbbing and to her uncomfortable nature, (she had had them for years before pregnant) never mentioned there ever being an issue while breast feeding.
In Short I would say no, shouldn’t make a difference and in fact when I was researching in the Victorian ages doctors some encouraged women to have them pierced so that the nipple and surrounding area would be more accessible to the child after birth.
Like Gailcalled said there are alot of tiny holes.
Also if for some reason there was a non routine healing or something that just went abnormal after your piercing was taken out that you feel might be a concern consult with your maternity doctor at your next visit.
Hope this helped.