Goodness, this would be nice! I have felt very uncomfortable afterward, when the person mentioned in a question considered checking out Fluther. Inside, I was thinking, “No no no! They’ll see that question!” I don’t know if anything will be done about this, but I just wanted to let you know I could relate, jmah!
You can hope it is not one of your last 25 questions. At the moment it seems only the last 25 questions are listed in one’s profile. I think there was a talk about pagination of one’s external profile but it seems it has not been done yet. But, of course, one can always use the search box and find all of your questions, if he so chooses to.