Vacuum advance should have no negative effect on performance, only there to aid in economy and efficiency at part throttle cruise.
Sounds like yours is connected to manifold vacuum which will alter idle rpm and just cause stable setting issue around idle and just off idle. This is why it is connected to ported spark advance on a Chrysler product.