Well, mountains happen where tectonic plates are pressing into each other, and rivers form where water begins to gather (at the bottom of mountains, for example) and goes downhill toward an outlet, usually the ocean.

I also like the style of your mountains. I think it's just that they don't fit in with the style of the rest of the map.