What does the phrase “fallen off the lips” mean?

I was listening to a interview in which the following dialogue occurred:

Interviewer: “I went to a church service for years and the words ‘poor’ and ‘poverty’ never crossed the lips of anyone or any sermon”

Interviewee: “Well they might have fallen off the lips”

What is meant by the phrase fallen off the lips?