Yeah...it was really fucked-up for that to come out into the open, if it affected you that way. I could totally see how that would make you feel self-conscious.
The thing is, all men (and women) have things that they fantasize about. But fantasies and fetishes are just that...they don't need to take over a real relationship, so try not to let that happen.
Look at all of the men in the world who are married to great big COWS. Do ya think that they don't whack it to mags of perfect-looking, hot models and shit?? Of COURSE they do! But it's separate from the fact that their wives are the ones who they love and who are there with them in the real world, not some fantasy woman.
I know that my kid's dad was way into big tits too. In fact ALL of his exes were very well-endowed, except for me. I think he learned that those "things" did not a relationship make. It was only one element. When we got together, he definitely went against type, since I do not have big ones. We lasted for over four years and are still really good friends.
The thing you need to remember is that he loves YOU, the person he sees right in front of him. He knew there were no big boobs in the deal, but there was so much more to you that was better. As I got older and more secure with myself, I forgot about the stuff that I wasn't.