Note to self:
When you turn off auto_load plugins, make sure to unload them, too. Don't be afraid to turn even the core ones off, Maya could act silly to start with but doesn't it do that anyways..