Op my only suggestion is to stop contact and seek another GP.
I started seeing a new dr at the beginning of this pregnancy just months after I moved to this new town. At first he seemed lovely and complimented me for many things, but as time went on and each appointment came about he got more and more personal with me. Started making strange comments about his lack of relationship with his wife, ignoring anything I said regarding my husband, etc etc even to the point that he unasked moved my top to check on a very small mole that I have on one breast (at the top so could just be seen, but he proceeded to see if there were more) he was a very attractive young confident man and at first the flirting was a compliment and then I just found it odd. I told my husband about everything that happened each appointment but after the boob bit I had had enough. My intentions weren't the same (hence the constant mention of my husband) as a result I had to choose to find a new dr to go through for my baby which ment have had to over an hour away and pay for private care to get.
Moral to my story is that while it might be nice now I do suggest getting away from the situation develope the skills or get the right help needed to get well for yourself (not needing to be dependent) and I fear he may be using your struggle as a way for him self to get control of a situation etc.
I have since thought about my situation and wondered how many other women has he been like that too.
I think you realise yourself that its not a healthy professional not otherwise relationship and its possible more if a band aid for your current struggle then anything more.