That seems a long way around things.
Couldn't you just write everything you need on one piece of paper. Take a nice picture of that then take the pieces and paste them electronically onto a new layer of your map?
If you make the text very contrasty, you should be able to erase the background of the text and just have the text.. if it has a bit of an edge, try adding a small glow around your text, that will mask the slight white edge.
If Inkscape can live trace your text, then you can have nice clean text on your map.