It's always been a pain in the butt for me. Usually I just set aside a few moments to go through and delete my unwanted brushes, because I usually only keep a set for one specific usage. Arduous? Hell yes.