Is 2 weeks too short of notice for a wedding ceremony? Should we just elope?

My fiance and I want a small simple beach wedding. We would love it if our parents could be there. We haven't officially invited anyone. He says he knows his parents can come, but mine say they don't think they can because they say it's too short of notice and they don't have money to travel. We think it'd be weird if it was just his side of the family. What should we do? just elope? try to work something out?