I quickly learned that all you have to do is give one person on each street a free tour ride and they'll convince everybody else it's safe and fun.
Another thing that works is to invite all of the neighbors to come look at your toys. While you explain how everything works, you mention that you take off and land into the wind, so sometimes they'll have the chance to wave hi as you go over, but it's safer all around to do it that way.
The airfield where I live has an open-gate policy, and is empty land on 2 sides, so we have a lot of dog-walkers, ATV riders, etc, going past us on any day nice enough to fly. If they see us standing around, they will often come to chat. They will also bring their kids to look at the planes, and we usually manage to stuff the kids into a plane for some pics, while telling the parents that we have room for more planes, that planes are cheaper than the ATV they rode up in, etc.