Keep the mouse pointer in the main window (where you normally drag files), then use the horizontal scroll to change the panel.