I'm not down on myself at all.
I don't think it's just because of my stuttering, but some other things may have gotten in the way of it too.
I'm a nerd. I spend most of my free time in front of the computer, otherwise I'm usually out smoking weed with friends. I think that made me more social and more confident, but I used to be a nervous wreck.
It never got in the way of getting with girls. Most think it's cute. :D