Colour by Annotation ignores overwrites group colour schemes

Colour by annotation is always applied to all groups as well as the background alignment, regardless of whether 'Apply Colour to All Groups' is selected. Should it be?