right click on the material's attribute that has the file mapped and choose Break Connections from the menu that opens.