On your Settings page, you will see a setting option “Timeout of experiment (days)”. This option gives you the ability to set a maximum number of days you'd like to A/B test a single experiment before you move on to the next experiment.
For example: You are testing a Red button color vs. Blue button color. The tests results are showing both buttons are neck to neck and the experiment is unable to determine a statistical significance after "x" number of days. At that point, AutoOptimize will make the decision to go with the experiment that produced the best result and move on to the next experiment.