i recommend not worrying either. as long as the baby is growing and is healthy and you are not risking your own health, then everything is fine.
i'm actually losing weight. i was down 2 lbs from my previous appointment when i went in on Monday (total of 8 lbs from the beginning of the pg). granted, i am a plus sized gal, so they encourage me to only gain 10-15 lbs for the entire pregnancy, more toward the end. but, the 2 lbs lost did get their attention and they asked if i was trying to lose weight. i am not, but tend to lose my appetite half way through most meals, so i am not eating as much as i usually do. i know the baby gets what it needs first, so i am just making sure that i am eating healthy, so that what it gets is good nutrition. i'm not a veggie person, never have been, but i eat them. in fact, i eat them first, so i can get on with the rest of my meal, enjoying it. so, the baby is definitely getting its veggies. :)
i hope you find peace with your situation. trust your doctors to keep you informed as to when you truly need to be concerned.