Why did this stranger say this to me?

I think it was because you were looking for cheese. If you had been looking for milk the conversation would have been normal