I actually found the answer shortly after asking:
The linked stack overflow answer states:
First, make sure that the command history window is docked (If you have a floating window every time you press up then it is not docked. There is a drop-down menu - little circle with a triangle inside. Open the menu and select "Dock").
Once\if the window is docked, open the menu again and make sure that "Match Beginning" is selected and not "Match Anywhere".
I should have googled "Previous History Command" prior to asking this question