To remove all instances of a color from the grid, right click on a cell containing that color and select "Delete This Color From Grid"