This is what I love most about the hobby, getting to share experiences with people who never knew anything this amazing actually existed!!
I feel we as drone pilots sometimes let the negativity surrounding drones in the media push us into this dark corner, when in all honesty most people are just incredibly fascinated (and a little terrified, but in an awestruck way). We get so comfortable with these things that we forget we're hurling a SCREAMING HORNET across the sky at 80mph and then toss it around in the air like a rag doll, and it takes bystanders a little time to realize we know what we're doing (and we don't mean anyone any harm).
People love to see when someone is passionate about something, so treat any interaction with the general non-drone public as a teaching opportunity. They might be so intrigued that you spend more time just talking about the thing than actually flying it :P Enjoy!!