How to make component holes closer together

It depends on how many. If it's just a couple of holes you can grab a via out of the Core Bin and place where it needs to go, and then just link it. If it's a lot you have to alter the part drawings.