Last. Even if not really a letter, it used to be added on after Z. It used to be called “and per se and,” meaning ”‘and’, as such or by itself ‘and” (elided into “ampersand”) and was made of the letters “et”, which is Latin for “and.” You can still sort of see how & might look like a lowercase e + t.
More here.