I think the coords in FZ only has a 4 or 6 thou resolution, hence why it jumps when you enter numbers.
Everybody usually leaves the Arduino on the board even though it’s not part of a shied.
EDIT - Actually if you know how to edit parts at the svg level you can remove the silkscreen of the UNO.