Look at New York, Miami, Venice for similar significant cities on islands (albeit not capitals). It doesn't seem too implausible. It may be even more likely if the capital is fairly new, and the location is basically for showing off.