Cannot get a bootstrap dropdown to display properly on startup

Cannot get a bootstrap dropdown to display properly on startup

I can demonstrate my issue in my jsfiddle: http://jsfiddle.net/4T2TT/
<div class="btn-group open">
<button class="btn btn-danger dropdown-toggle"
id="reject-button" data-toggle="dropdown">Reject<span
class="caret"></span></button>
<ul class="dropdown-menu">
<li><a id="image-illegible"
href="/Home/Reject/44001FFF-E07A-4881-A16E-9C4FF7DFACB8/Message">Image
is illegible</a></li>
<li><a id="invalid-bill" href="#">Image is not a valid
bill</a></li>
<li><a id="images-incomplete" href="#">Bill images are
incomplete</a></li>
<li><a id="missing-information" href="#">Cannot find
find required information</a></li>
</ul>
</div>
On start up the dropdown is displaying but I do not understand how to make
it start hidden rather than shown.
Is there a setting to make it start up hidden or is there something else I
am missing?