Yeah you're going to eat up system resources and hike up render times if you have textures that are larger than needed. This bit that Alex Alvarez talks about gets linked a lot, check it out.