I have a pretty similar situation to you. We were ttc for about a year with no luck at all. All my tests came back perfect, but my husbands first sperm count was at 9 million. The next one he had was at 14 million (with everything else pretty decent- morphology, motility etc). We kept trying for a while longer, but were told we would need ivf. This was really devastating for both of us. And you need time to really let yourself just feel what you need to feel.
After about 21 months of ttc we started ivf. We didnt need to do icsi as he had plenty of sperm for ivf- I think I remember the ivf scientist saying they put about 100,000 (healthy) sperm around each egg.
Anyways, I am now pregnant. After our first go with IVF, I am pregnant. Its very early days but I am really hopeful! So there is hope for you. You are young and healthy and that is a really great thing. I remember our fertility specialist saying that with ivf/icsi the man's problem is pretty much taken out of the equation and if the female has no probs then your odds of it working are pretty good.
If youre thinking about ivf, my advice would be to book in all your appointments nice and quick because the initial process can take a little while to get through.. once you have all the info you need and all the tests done then you can make a decision about whether its what you both want to do.
Don't give up!! It is a really hard time, but don't give up!