Try viewing one channel (e.g. rotate Y) at a time and scrub through, trying to understand how the graph editor relates to the viewport. The value for rotate will be in degrees, so 0-360 etc.
You can probably delete all the keys in the scale channels, unless you're scaling your camera. Also try keying just the translates (shift W) for the camera, then view the graph editor and scrub through, or just key the rotates (shift E). It takes a while to get a feel for what's going on, especially when you play with different tangent types, but it is essential to know if you're doing animation.