For example, look at this image. This consists of a black background with a white square and a duplicate black square on top of it.

Notice that a faint white line is visible! This is technically a rendering error - the black square is a duplicate so it completely obscures the white square. No white should be visible at all! In fact, this error is infinitesimal - no matter what resolution you export at and no matter how much you zoom in in Inkscape, that white line will have the same thickness.

But there is any easy workaround for this because the errors are infinitesimal. Simply export it at several times your desired image size and then use a program like Paint.NET/Photoshop/Gimp/Irfanview to resize the image back down to the size you want.

Voila!
Note:If you look closely, you'll notice that the white lines are still faintly visible in this final image. I don't think it's possible to truly remove them, but the larger you export before resizing, the fainter they will appear afterwards. This was about 10x, but in my experience 4-5x is usually enough to make it look presentable.