Depending on the state or country you live in their are laws regarding problem birds and wildlife dependent on species.
In California it is illegal to harm, disturb, or otherwise tamper with nesting birds. After the breeding season is over it is then okay to remove old nests or take preventive measures to discourage future nesting in a particular area.
All species of songbirds are protected, with only Starlings, House sparrows, Crows and Pigeons exempt. However, no decent person would harm these species either until the above mentioned appropriate time.
While it may be annoying it is temporary, and I would encourage you to broaden your sights and have tolerance. Humans aren’t the only creatures that have a right to pursue their life, liberty and happiness.