Manhattan Transfer (1975) said, “You know I’m not keen about a bean, unless it is a chili chi;i bean’ (talk it boy!).
The Inkspots, who did the original version in the 1940s, said, ”...unless it is a coffee, coffee bean.” Which makes sense since it is Java Jive the song is about.