Billy,
My experience with the 172 is exactly like yours. I'm 5'5" and 150 lbs. In a 172, if I leave the seat low then I can't see over the panel; if I crank up the seat then the yoke is in my lap, very awkward to fly. When I come in for landing, the 172 just floats and floats.
I like the responsiveness of the 150/152. To me, the 152 is like a sporty car with good handling and the 172 is like the family sedan.