Did you plug up the rear vacuum port, if it's not being used? I forgot to do that once, not paying attention to what I was doing, and you can definitely hear it, and it will run terrible.
On a more general note, don't expect the carb to be tuned optimally for your engine out of the box. My 77 NYB w/ stock 440 has an AVS2 that was installed by the previous owner. The secondary flap was so loose it would open just blipping the throttle (which it definitely should not do). The effect on the road was when you'd tromp on the pedal it would bog terribly. I also had to install much leaner rods in the primary and smaller jets in the secondary.
This was not seat-of-the-pants tuning. I used a tailpipe wideband O2 sensor, so I was able to dial it in pretty good.