Here's an example of using a pattern fill on a mask to affect the style of the coastal lines... this example shows one of the actions I posted earlier, before and after I apply the mask to the layer.

Click image for larger version. 

Name:	Masking to affect the style of coastal lines on maps - Before.jpg 
Views:	187 
Size:	723.4 KB 
ID:	53354 Click image for larger version. 

Name:	Masking to affect the style of coastal lines on maps - After.jpg 
Views:	143 
Size:	661.3 KB 
ID:	53355