Yeah, I also don't feel comfortable tweaking timing parameters (default for poll.delay seems to be non zero:
http://wiki.eclipse.org/SWTBot/FAQ#Can_I_change_the_poll_delay_for_evaluating_conditions_in_SWTBot_tests.3F).
I sent a mail to the SWTBot list to see if they can help here.

I am on 3.5.1 and will try on 3.6 M4 soon.