This is confusing but may help.

When you rent a car, the agency will help you with the best way to handle toll. Many times you can get an EZ Pass device in the car.

Three years ago I rented a car in lower Manhattan, drove it to Boston and dropped it at Logan airport. I drove the parkway through Westchester into Connecticut, and made it to Boston using only the EZ pass in the rental car. No hassles, minimal cost.

^^ That makes the most sense. Call the car rental place and ask if they can put an EZ-Pass in your car. You might also want to check if there is a GPS built in or put your destinations on your phone in advance.

Depending on the route you take through or around NYC, there might be premiums for paying with cash. It’s much better to rent an EZ-Pass, if possible.

The tolls end once you get past New York and into Connecticut.

Check with the rental company how much they charge per day to use the EZ pass. I’ve heard stories that vary from $1 a day to $10. I guess it’s not only the days that you actually drive through a toll, but over the entire time you rented the car. I’d just ask how it works with the particular car company so you don’t get a surprise at the end.