Seems sort of like eavesdropping to me—not really a horrible thing to do, but quite possibly bad manners.
or