A couple things you may want to ask yourself:

How is the river passage defended? The town is walled, but the river entry / exit are fairly wide open.
The bridge looks like an ideal spot for tolls, especially if all the docks are on the east bank and trade enters / exits the west.
Maybe another dock north of the bridge? Can vessels pass under it?
I would think the trader's market would be more central to the keep and the wealthier clientele, instead of next to the poorest section of town.

I really like the look you have here! Looking forward to seeing more.