Nah you dont, in object mode pressing F9 ,F10 etc lets you select them directly, no need to go to comp. (checked it out after this thread!)

But with a quick right click your sorted, I pretty much use the hotbox all the time now with no menus up at all, a lot faster, took a while to get used to though!