It sounds like it could be because the image you are using is not scalled appropriately to the scale you are trying to use, and as it gets repeated it slowly goes off from the grid. One of the reasons I always try and use non-gridded patterns if that makes sense