Hello Peri bare with me, this is going to get lengthy and technical.
Anything outside the 90 degree cone of vision is going to be distorted. That's unavoidable due to physics/laws and perception of perspective. Human eye have roughly 50-60 degree cone of vision. But dispair not. We can straighten those verticals out.


Here's a trick from Maya 6 killer tips:
Perceptual Perspective Correction
A long-standing technique preferred by architectural illustrators and large-format photographers is to eliminate the third vanishing point while maintaining the position of the horizon line and key features.
This amounts to effectively straightening out the converging vertical lines a camera would see as it tilts skyward. While looking upward at a very tall structure such as a skyscraper, this phenomenon is unavoidable, but with lower structures, or even in a room, your brain compensates for the optical taper, keeping vertical lines parallel and delivering a perceptually correct view.

You can test this out simply by tilting your head up towards the ceiling as you watch a corner of a room. Now do the same thing with a camera and observe the effect.
Although the tapering is optically correct, being able to eliminate it in a 2D image such as a photograph or CG render creates a much more pleasing and refined look.

Maya luckily has included the virtual analog of a perspective shift lens in a commonly overlooked attribute in the Camera Attribute Editor called Film Offset. Of little use in animated cameras (except for excellent abstraction potential), it shifts the virtual film plane in screen space x or y a given amount.

To start, position a camera near the bottom of a tall building-shaped cube. Use the local camera command Panel View, Camera Tools, Yaw-Pitch Tool to then tilt upward, setting the horizon line at a given position. Next, under the Camera Attribute Editor, Film Back, Film Offset, type in an arbitrary number such as .3 in the second field (y). The horizon will shift down below frame, but raise it back up to the same level with the Yaw-Pitch Tool.

Now you will have the same view, but with parallel vertical edges. If it is not yet parallel, try increasing or decreasing the Film Offset value and Yaw-Pitch accordinly. Your still renders can now look much more refined with this great technique.

For something really wild, increase your field of view to a very large value and add Film Offset to both x and y. Now tumble the camera through your own version of Hitchcock's Vertigo!