If you want to be married, you need to have a wedding. The wedding ceremony is where two people become a married couple.
A wedding ceremony can be very low-key. My brother and sister-in-law got married at their local courthouse. He wore a suit, she wore a pretty dress, neither of them bought new clothes. Their witnesses were two friends from work. They went out to lunch afterward and then went back to work for the afternoon. No fancy party, no fancy food, no fancy outfits, just getting marrried and moving on with life - but they did have the wedding ceremony.