Are there any other states besides Florida and Georgia that are both physically adjacent (i.e. they have a common border) and alphabetically adjacent?

Illinois and Indiana – I think so.

Ohio and Pennsylvania—nope, Oklahoma and Oregon are between them.

Connecticut and Delaware—nope, they don’t touch.

Any others?