Do you know how your embryos are frozen, and how many you'll be required to thaw? At my clinic, my embryos were frozen in sleeves of 3 so I had to thaw 3 at a time. I'm asking because my RE also said that re-freezing an embryo is not ideal, so would you be OK with putting only the best looking embryo back in and then discarding the other 2 embryos?
I personally put 2 embryos back both times, and am totally fine with twins (and at this point I'd be thrilled with them!) It is a lot of stress on your body and your finances, but the way I see it is that in the long run it could actually save us money. If we got pg with a singleton and then went back for #2, we'd have to pay for more IF treatments, all while paying for child #1 costs such as food, clothing, daycare, etc.
Either way, it's a very personal decision, so I wish you luck in whatever you and YH decide.