Don't worry about what other people think - if you and your DP want to have kids now then go for it! It really doesn't matter how long you've been together.
As far as 'being ready' goes - not everyone has a magic moment where they're suddenly 'ready'. If I hadn't accidentally fallen pg with DS1 6 months after I got married, I don't know when we would have ever started trying. There was always something else to achieve, somewhere else to travel, weddings to attend, etc etc. But I don't for a second regret getting pregnant when I did, even if the timing wasn't the greatest - having a child trumps everything!
As others have said it could take several months, years even, to get pregnant. You've already suggested your fertility might be compromised - and even if it weren't there are no guarantees. You only get about 12 opportunities a year to fall pregnant, and a healthy couple only has a 1 in 4 (I think??) chance each time anyway!
I say go for it, and if you happen to fall pregnant you can adjust plans as needed. Unless you're extremely unlucky (and have a rough pregnancy for example), there is every possibility that you would be fine to go ahead with your travel plans regardless.