I found the issue. To answer your question, it would idle fine with my foot on the brake and other foot lightly on the accelerator.
I looked under the hood and way down by the ac drier, the link hose to the vacuum accumulator tank was rotted and broken. Changed it and now it runs fine. I will be going through all these hoses this weekend. The plastic one for the climate control appears to have been changed and is in good shape.