Well no, they don't. The northern tip of the Ural mountain range actually swings eastward and then westward, where it runs ALONG the coast and forces it to jut out towards the Novaya Zemlya island chain (which in fact is a continuation of the same mountain range).

Mountain ranges never meet the coast at right angles. Keep in mind that a coastline is nothing more than a line linking all points of the same elevation (to be more precise, a coastline is a line linking all points undergoing the same amount of gravity, but that's almost the same thing). Like other elevation contour lines, it is shaped by the terrain and not the other way around. A mountain range meeting the coast at right angles would imply a ridge line that nicely rises up from the surrounding terrain at one side, then rises and falls with the different stretches of the mountain range, and then, very suddenly, ends in an almost vertical drop of 1000s of meters. Not even a massive meteorite impact would result in such a scene (simply because a meteorite impact large enough to disrupt a mountain range would probably cause even greater damage to the surrounding terrain, submerging that even further than the mountains, once again resulting in a coast that juts out where the mountains are).

Being a geographer working in the space sector, I don't know of any mountain range that stops so abruptly, neither on Earth nor on Mars, the moon, ...