[Mod Note:] Moderators are not able to access email addresses. Only Augustlan, RichardHenry, Andrew, Ben and Tim would be able to access it if a need arose.
Also, if you are concerned about privacy, in your account settings it is a good idea to turn OFF the settings that allow others to read all your questions and comments in one place.
Regarding users accounts being hijacked. The only cases I am aware of from Fluther happened because:
1. The user had not logged off a public computer and the account was used by another.
2. The user had shared the password with a bf who in turn locked her out of her account when the relationship soured.
3. The user had put highly personal details and links in their questions and were found on internet search.
Never has the sharing of user email ever been an issue and I am very certain that those with access would never abuse the privilege.