Yeah, I tend to go with the flow. I've actually had it where a side jaunt determined by player decisions lead to a very enjoyable time for all even if I never did get to the big encounter/dungeon I had planned. If everyone loved it, you then have a feel for what they enjoy and can tailor the module you created for next time so it's more appealing.