My DH is also on clomid. His before number ranged from under 1 mil-6 mil but his morph and motility were good. After taking clomid his motility was a little lower too, but his count was 140 mil. We did 2 IUIs and were successful on the second one, he's on it again right now to TTC#2. I also was on clomid, even though I don't have any issues. The RE wanted me to have 2 eggs to give the sperm more targets.
If your wife is really against drugs, then I guess there is nothing you can do. The IUI helps the sperm get closer to the target so that will help even though the motility is a little low. You can always try the IUI for a couple months and see how it goes.
For me we are covered through insurance at 50% so I really wanted to make every cycle have the absolute best chance of working. I would and still will do whatever I need to get pg, whether that be clomid, injections, or IVF.