I'm not sure if you can delete the directory. Maya allows you to have multiple versions installed on the same machine (3.0, 4.0, 4.5, etc.), and it stores shelves and preferences specific to each version in their own directories.

You might consider looking up information in the help files on environmental variables to see if you can change default locations of these directories.