Are there quick masks on the gradient maps?
If there is a little white box next to the black and white cookie looking thing then yes there is. And in the case that there is get out a paintbrush and paint black on the white box you'll see what happpens.
if there isn't however i'd say do a gradient map, apply the image and then delete the gradient map and erase the parts of the applied image.