If you select the orthographic camera in the outliner, you can rotate it just like a normal object. It's best if you rotate in another view however, else it will rotate erratically.