I've taken IQ tests quite a few times as I was considered 'gifted' in school and was put into advanced programs (ff from birth btw), and my test results could vary by up to 7 points depending on the day! If I'd gotten enough sleep the night before, if I was stressed about something else, if I was hungry when I sat the test etc. could all make the results vary. So 3 points??? Meh!
If I was struggling with bf-ing, bub & I weren't happy and thriving, and I wanted to switch to ff I certainly wouldn't worry about my bub losing 3 IQ points as a 30yo!