If you are still interested in the person (and what reason do you have to still be interested?), then I think there is a possibility that this person is uncomfortable in social situations, for whatever reason (could have ADD, or Aspergers). Then it would be worth having a second and third date to see if they relax, or become more open. If they do have ADD, a date where there are few distractions would be better than a noisy restaurant.
Once I interviewed a potential employee. She was totally off. No eye contact. Very nervous. Not really answering questions. I checked her references very carefully, and talked to them for a long time. I did this, because her resume looked great, and I couldn’t understand how she could be so great on paper, and so lousy in the interview.
Based on my research, I hired her. Well, she’s the hardest working employee I’ve ever had. But, she does have ADD, and, it turns out, she hadn’t gotten any sleep the night before the interview. So, I think it is worth investigating people you are interested in when things just don’t make sense. There might be a good reason for their behavior, or you might find that the good stuff isn’t what you thought it was.