Depends on the kind of invasive plant itself. I like most plants and trees, but not if they’re ugly or really destructive, or have no real purpose to humans, like thistle, goatweed, or chickweed. I like mint, so even if my neighbour planted mint beside my house, and it spread over, I wouldn’t mind. Or even purple loosestrife——a very invasive flowering plant that’s banned in some places——I think it’s a rather nice-looking plant.
My neighbour actually has a kind of “ivy” that he grows all around his patio lattice frame. It is very invasive, and every year it encroaches onto my side, even tangling its stringy vines around my deck. So one year, I painted the leaves of this ivy (that was on my side of the fence) with a weed killer, and the entire plant dried up and died. Lol.