So in a nut shell. The consequences of different eye structures could be:

A human visiting an alien house or ship could be driven "crazy" by the monochromatic nature of the house or ship, when in fact the alien sees a great amount of color. OR vise versa.