[Portaudio] playback delay

[Crafoo]

Hello,

I am playing short sound samples with Portaudio when the user mouses over an icon or presses a mouse button.  So far I have been using just 1 PA stream and mixing the sounds in the callback.  I am using Pa_OpenDefaultStream() with 32bit float samples, 128 frames/buffer, and 44.1kHz samples.  I let PA choose the default host API and device: on my test system that it turns out to be "MME" and "SigmaTel Audio".

Right now I have about a .2sec or so delay between a mouse press and the sound playback.  What do I need to do to remove as much of the delay as possible?