Using subject selection to add or subtract from a linear gradient

I love the subject and background selection. Sometimes I do prefeer to draw a linear gradient on what I want altered. Say that gradient covers part of the subject in photo it would be great if I could use subject selection from another layer til add or subtract from the current gradient layer. Even though it meant I'd have to rasterize the gradient layer.