So I'm attempting to smooth/clean up a design I'm making for a greeting card on Inkscape. I started in GIMP, then realized a vector image would be best, and the trace bitmap function does a lot of what I am looking for.
Rather than explain what I think is happening, I'll just show you the before and after.
This is a screenshot of the .png, zoomed in, and I essentially want the picture to remain as it is, just cleaned up by converting it to a vector

What happens when I perform the trace bitmap, is that it smooths out awesome, but all the colors in the card tend to overlap each other, and show up in places they're not wanted (see how the text now has a small layer of green, and beige?)

And this is just a full sized shot of the card

So Basically, I need to smooth and clean things up, and avoid getting every color traced around the whole image, but stay in their perspective places.
How can I achieve this? I'm new to Inkscape, and have had no luck finding an example of this, partly because I don't even really know the terminology to explain what is happening (apologies!).