if its not a lambert1 problem, select your objects which you dnt want to be affected (colourwise), go to the hypergraph, dependancy graph and cut the connection