You’ll see charges you didn’t make on your credit card statements. Call your credit card company. Tell them that your credit card number was stolen, and that you’d like to dispute the charges you didn’t make and you’d like for them to send you a replacement card.

Credit card customer service people deal with this every day. They’ll know what to do.