The plates move as one piece, and they move away from the side where they have divergent boundaries.
Basically, one plate, one direction. It doesn't look like that in this last image - the East Plate, or example, appears to be moving north and south and eastwards...