Channel masking with layers is possible

Didn’t realize this myself until it was too late, but it can be done! You just need to use channel factors in the dot menu.