We're eloping. Should we have a small or big party?

How about you two find a way to compromise and meet in the middle? Your wanting only immediate family is just as selfish as him wanting to invite the whole world. So you have to work out a situation that will work for the both of you. Or have two parties.